Richter, M (2015) Residual tests in the analysis of planned contrasts: Problems and solutions. Psychological Methods, 21 (1). pp. 112-120. ISSN 1939-1463
This is the latest version of this item.
|
Text
Richter_2015_PsychologicalMethods_GOA.pdf - Accepted Version Download (305kB) | Preview |
Abstract
It is current practice that researchers testing specific, theory-driven predictions do not only use a planned contrast to model and test their hypotheses but also test the residual variance (the C+R approach). This analysis strategy relies on work by Abelson and Prentice (1997) who suggested that the result of a planned contrast needs to be interpreted in the light of the variance that is left after the variance explained by the contrast has been subtracted from the variance explained by the factors of the statistical model. Unfortunately, the C+R approach leads to six fundamental problems. In particular, the C+R approach (1) relies on the interpretation of a non-significant result as evidence for no effect, (2) neglects the impact of sample size, (3) creates problems for a priori power analyses, (4) may lead to significant effects that lack a meaningful interpretation, (5) may give rise to misinterpretations, and (6) is inconsistent with the interpretation of other statistical analyses. Given these flaws, researchers should refrain from testing the residual variance when conducting planned contrasts. Single contrasts, Bayes factors, and likelihood ratios provide reasonable alternatives that are less problematic.
Item Type: | Article |
---|---|
Additional Information: | This article may not exactly replicate the final version published in the APA journal. It is not the copy of record. |
Subjects: | B Philosophy. Psychology. Religion > BF Psychology |
Divisions: | Natural Sciences & Psychology (closed 31 Aug 19) |
Publisher: | American Psychological Association |
Date Deposited: | 02 Nov 2015 08:45 |
Last Modified: | 04 Sep 2021 14:05 |
DOI or ID number: | 10.1037/met0000044 |
URI: | https://researchonline.ljmu.ac.uk/id/eprint/1822 |
Available Versions of this Item
-
A critical comment on residual tests in the analysis of planned contrasts. (deposited 09 Jul 2015 10:31)
- Residual tests in the analysis of planned contrasts: Problems and solutions. (deposited 02 Nov 2015 08:45) [Currently Displayed]
View Item |