More voodoo correlations: When average-based measures inflate correlations

Journal of General Psychology

Volumn 139, Issue 4, 2012, Pages 260-272

  Brand, Andrew ^a   Bradley, Michael T ^b  

^a KING'S COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF NEW BRUNSWICK   (Canada)

Author keywords

averaging; correlation; effect size; inflation; reliability

Indexed keywords

HUMAN; MONTE CARLO METHOD; PROCEDURES; PSYCHOLOGY; STANDARDS; STATISTICAL ANALYSIS; STATISTICS;

DATA INTERPRETATION, STATISTICAL; HUMANS; MONTE CARLO METHOD; PSYCHOLOGY, EXPERIMENTAL; STATISTICS AS TOPIC;

EID: 84866645650     PISSN: 00221309     EISSN: 19400888     Source Type: Journal    
DOI: 10.1080/00221309.2012.703711     Document Type: Article

References (28)

1. Baguley, T. (2009). Standardized or simple effect size: What should be reported? British Journal of Psychology, 100, 603-617.
2. Baguley, T. (2010). When correlations go bad. The Psychologist, 23, 122-123.
3. Brand, A., Bradley,M. T., Best, L.A., & amp; Stoica, G. (2008). Accuracy of effect size estimates from published psychological research. Perceptual and Motor Skills, 106, 645-649.
4. Brand, A., Bradley, M. T., Best, L. A., & Stoica, G. (2011). Multiple trials may yield exaggerated effect size estimates. The Journal of General Psychology, 138, 1-11.
5. Carre, J., McCormick, C., & Mondloch, C. J. (2009). Facial structure is a reliable cue of aggressive behaviour. Psychological Science, 20, 1994-1998.
6. Coetzee, V., Chen, J., Perrett, D. I., & Stephen, I. D. (2010). Deciphering faces: Quantifiable visual cues to weight. Perception, 39, 51-61.
7. Cohen, J. (1988). Statistical power analysis for the behavioural sciences (2nd Edition). Hillsdale, New Jersey: Lawrence Erlbaum Associates.
8. Cortina. J. M. (1993).What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78, 98-104.
9. D'Andrade, R. G. and Dart, J. (1990). The interpretation of r versus r2 or why percent of variance is a poor measure of size of effect. Journal of Quantitative Anthropology, 2, 47-59.
10. Feinberg,D. R., DeBruine, L. M., Jones, B. C., & Perrett, D. I. (2008). The role of femininity and averageness of voice pitch in aesthetic judgments of women's voices. Perception, 37, 615-623.
11. Fiedler, K. (2011). Voodoo correlations are everywhere-not only in neuroscience. Perspectives on Psychological Science, 6, 163-171.
12. Hodgetts, C. J., Hahn, U., & Chater, N. (2009) Transformation and alignment in similarity. Cognition, 113, 62-79.
13. Lane, D. M., & Dunlap, W. P. (1978). Estimating effect size: Bias resulting from the significance criterion in editorial decisions. British Journal of Mathematical and Statistical Psychology, 31, 107-112.
14. Monin, B. (2003). The warm glow heuristic: When liking leads to familiarity. Journal of Personality and Social Psychology, 85, 1035-1048.
15. Monin, B., & Oppenheimer, D. (2005). Correlated averages vs. average correlations: Demonstrating the warm glow heuristic beyond aggregation. Social Cognition, 23, 257-278.
16. Nickerson, C. A. E. (1995). Does willingness to pay reflect the purchase of moral satisfaction? A reconsideration of Kahneman and Knetsch. Journal of Environmental Economics and Management, 28, 126-133.
17. Ozer,D. J. (1985).Correlation and theCoefficient of Determination. Psychological Bulletin, 97, 307-315.
18. Preacher, K. J., Rucker, D. D., MacCallum, R. C. & Nicewander, W. A. (2005). Use of the extreme groups approach: A critical reexamination and new recommendations. Psychological Methods, 10, 178-192.
19. R Development Core Team (2011). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Available at http://www.r-project.org.
20. Rule, N. O., & Ambady, N. (2008). The face of success: Inferences from chief executive officers' appearance predict company profits. Psychological Science, 19, 109-111.
21. Savani, K., Stephens, N. M., & Markus, H. R. (2011). The unanticipated interpersonal and societal consequences of choice victim blaming and reduced support for the public good. Psychological Science, 22, 795-802.
22. Schmidt, F. L., Le, H., & Ilis, R. (2003). Beyond alpha: An experimental examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychological Methods, 8, 206-224.
23. Schmidt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8, 350-353.
24. Shevlin, M., Miles, J. N. V., Davies, M. N. O., & Walker, S. 2000). Coefficient alpha: A useful indicator of reliability? Personality and Individual Differences, 28, 229-237.
25. Spearman, C. (1904). The proof and measurement of association between two things. American Journal of Psychology, 15, 72-101.
26. Spearman, C. (1910).Correlation calculated from faulty data. British Journal of Psychology, 3, 271-295.
27. Vul, E., Harris C., Winkielman, P., & Pashler, H. (2009). Puzzlingly high correlations in fMRI Studies of emotion, personality, and social cognition. Perspectives on Psychological Science, 4, 274-290.
28. Wilkinson, L., & APA Task Force on Statistical Inference (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.