Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Contrasts in within-subjects designs can't be computed using a contrast-specific error term (as recommended in the literature) #2653

Closed
3 tasks done
mservantufc opened this issue Apr 1, 2024 · 1 comment

Comments

@mservantufc
Copy link

JASP Version

0.18.3

Commit ID

No response

JASP Module

ANOVA

What analysis are you seeing the problem on?

Repeated measures ANOVA

What OS are you seeing the problem on?

Windows 10

Bug Description

When computing a custom contrast in a one-way repeated measures ANOVA, unticking the box "Assume equal variances" returns the error message "Unequal variances only available for main effects of within-subjects factors". It seems important to fix this bug as (1) contrast-specific error terms are generally recommended for RM ANOVAs (e.g., Boik, 1981; Maxwell & Delanay, 2018) and (2) this feature is available for post-hoc tests (one can untick the option "Pool error term for RM factors", and JASP does not return an error message), which is confusing. In addition, is there any reason why the labels "Assume equal variances" vs. "Pool error term for RM factors" differ between the contrast and post-hoc menus? Unticking them should do the same thing (i.e, do not pool the error term). Am I missing something?
Screen capture of the bug:
bug

Expected Behaviour

Unticking the box "Assume equal variances" should compute a contrast-specific error term.

Steps to Reproduce

  1. Compute a repeated-measures ANOVA using the datafile provided above.
  2. Compute a custom contrast
    3.Untick the option "Assume equal variances"
    See attached JASP file
    Bug_report.zip

Log (if any)

No response

Final Checklist

  • I have included a screenshot showcasing the issue, if possible.
  • I have included a JASP file (zipped) or data file that causes the crash/bug, if applicable.
  • I have accurately described the bug, and steps to reproduce it.
@JohnnyDoorn
Copy link

Hi @mservantufc ,

Last month I updated JASP's default behavior in RM ANOVA, to align with your point/references. We were still in the mode of replicating SPSS' default behavior, but I think it's time to leave them behind and do what seems most proper, so in the next release (in May) the RM ANOVA will by default use the multivariate model (i.e., allow specific error-terms). This change also extends the applicability of the issue, so also for interactions, and will now be called the same option under the "model" "contrast" and "posthoc tests" tabs: "Pool error term for follow-up tests", which will be unchecked by default.

Cheers
Johnny

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants