Richter, M (2015) A critical comment on residual tests in the analysis of planned contrasts. Psychological Methods. ISSN 1939-1463
This is the latest version of this item.
Richter_2015_PsychologicalMethods_GOA.pdf - Accepted Version
It is current practice that researchers testing specific, theory-driven predictions do not only use a planned contrast to model and test their hypotheses but also test the residual variance (the C+R approach). This analysis strategy relies on work by Abelson and Prentice (1997) who suggested that the result of a planned contrast needs to be interpreted in the light of the variance that is left after the variance explained by the contrast has been subtracted from the variance explained by the factors of the statistical model. Unfortunately, the C+R approach leads to six fundamental problems. In particular, the C+R approach (1) relies on the interpretation of a non-significant result as evidence for no effect, (2) neglects the impact of sample size, (3) creates problems for a priori power analyses, (4) may lead to significant effects that lack a meaningful interpretation, (5) may give rise to misinterpretations, and (6) is inconsistent with the interpretation of other statistical analyses. Given these flaws, researchers should refrain from testing the residual variance when conducting planned contrasts. Single contrasts, Bayes factors, and likelihood ratios provide reasonable alternatives that are less problematic.
|Additional Information:||This article may not exactly replicate the final version published in the APA journal. It is not the copy of record.|
|Subjects:||B Philosophy. Psychology. Religion > BF Psychology|
|Divisions:||Natural Sciences and Psychology|
|Publisher:||American Psychological Association|
|Date Deposited:||02 Nov 2015 08:45|
|Last Modified:||02 Nov 2015 08:45|
|DOI or Identification number:||10.1037/met0000044|
Available Versions of this Item
A critical comment on residual tests in the analysis of planned contrasts. (deposited 09 Jul 2015 10:31)
- A critical comment on residual tests in the analysis of planned contrasts. (deposited 02 Nov 2015 08:45) [Currently Displayed]
Actions (login required)