Median splits, Type II errors, and false-positive consumer psychology: Don't fight the power

Journal of Consumer Psychology

Volumn 25, Issue 4, 2015, Pages 679-689

  McClelland, Gary H ^a   Lynch, John G ^b   Irwin, Julie R ^c   Spiller, Stephen A ^d   Fitzsimons, Gavan J ^e  

^a UNIVERSITY OF COLORADO   (United States)

^b UNIVERSITY OF COLORADO   (United States)

^c UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

^e DUKE UNIVERSITY   (United States)

Author keywords

False positive psychology; Median splits; Statistical power

Indexed keywords

EID: 84942198012     PISSN: 10577408     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jcps.2015.05.006     Document Type: Article

References (46)

1. Abelson R.P. Statistics as principled argument 1995, Psychology Press, New York.
2. Aiken L.S., West S.G. Multiple regression: Testing and interpreting interactions 1991, Sage Publications, Newbury Park, CA.
3. Akerlof G.A. The market for "lemons": Quality uncertainty and the market mechanism. The Quarterly Journal of Economics 1970, 84(3):488-500.
4. Bem D.J. Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology 2011, 100:407-425. 10.1037/a0021524.
5. Brauer M., McClelland G.H. L'utilisation des contrastes dans l'analyse des données: Comment tester les hypothèses spécifiques dans la recherche en psychologie?. L'Année Psychologique 2005, 105(2):273-305.
6. Brinberg D., Lynch J.G., Sawyer A.G. Hypothesized and confounded explanations in theory tests: A Bayesian analysis. Journal of Consumer Research 1992, 19(2):139-154.
7. Busemeyer J.R., Jones L.E. Analysis of multiplicative combination rules when the causal variables are measured with error. Psychological Bulletin 1983, 93(3):549-562.
8. Butts M.M., Ng T.W. Chopped liver? OK. Chopped data? Not OK. Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences 2009, 361-386. Taylor & Francis, New York. C.E. Lance, R.J. Vandenberg (Eds.).
9. Cohen J. The cost of dichotomization. Applied Psychological Measurement 1983, 7(3):249-253.
10. Cohen J., Cohen P., West S.G., Aiken L.S. Applied multiple regression/correlation analysis for the behavioral sciences 2003, Lawrence Erlbaum Associates, Mahwah, New Jersey. 3rd ed.
11. Czellar S. Self-presentational effects in the Implicit Association Test. Journal of Consumer Psychology 2006, 16(1):92-100.
12. DeCoster J., Iselin A.R., Gallucci M. A conceptual and empirical examination of justifications for dichotomization. Psychological Methods 2009, 14(4):349-366.
13. Disatnik D., Steinhart Y. Need for cognitive closure, risk aversion, uncertainty changes, and their effect on investment decisions. Journal of Marketing Research 2015, 52(June):349-359.
14. Farewell V.T., Tom B.D.M., Royston P. The impact of dichotomization on the efficiency of testing for an interaction effect in exponential family models. Journal of the American Statistical Association 2004, 99(467):822-831.
15. Fitzsimons G.J. Editorial: Death to dichotomizing. Journal of Consumer Research 2008, 35(1):5-8.
16. Fleischmann M., Pons S. Electrochemically induced nuclear fusion of deuterium. Journal of Electroanalytical Chemistry and Interfacial Electrochemistry 1989, 261(2):301-308.
17. Frederick S. Cognitive reflection and decision making. The Journal of Economic Perspectives 2005, 19(4):25-42.
18. Galileo, G. (1962). Dialogue Concerning the Two Chief World Systems. Translated by S. Drake, Foreword by Albert Einstein. Berkeley: University of California Press.
19. Gans J.S., Shepherd G.B. How are the mighty fallen: Rejected classic articles by leading economists. The Journal of Economic Perspectives 1994, 8(1):165-179.
20. Gelman A., Loken E. The statistical crisis in science. American Scientist 2014, 102(6):460.
21. Hoffman D.L., Novak T.P., Schlosser A.E. Locus of control, web use, and consumer internet regulation. Journal of Public Policy and Marketing 2003, 22(1):41-57.
22. Humphreys L.G. Doing research the hard way: Substituting analysis of variance for a problem in correlational analysis. Journal of Educational Psychology 1978, 70(6):873-876.
23. Humphreys L.G., Fleishman A. Pseudo-orthogonal and other analysis of variance designs involving individual-difference variables. Journal of Educational Psychology 1974, 66(4):464-472.
24. Iacobucci D., Posovac S.S., Kardes F.R., Schneider M.J., Popovich D.L. Toward a more nuanced understanding of the statistical properties of a median split. Journal of Consumer Psychology 2015, 25(4):652-665. (in this issue).
25. Iacobucci D., Saldanha N., Deng X. A meditation on mediation: Evidence that structural equations models perform better than regressions. Journal of Consumer Psychology 2007, 17(2):139-153.
26. Ioannidis J.P. Why most published research findings are false. PLoS Medicine 2005, 2(8):696-701.
27. Irwin J.R., McClelland G.H. Misleading heuristics and moderated multiple regression models. Journal of Marketing Research 2001, 38(1):100-109.
28. Irwin J.R., McClelland G.H. Negative consequences of dichotomizing continuous predictor variables. Journal of Marketing Research 2003, 40(August):366-371.
29. Johnson P.O., Neyman J. Tests of certain linear hypotheses and their application to some educational problems. Statistical Research Memoirs 1936, 1:57-93.
30. Judd C.M., Westfall J., Kenny D.A. Treating stimuli as a random factor in social psychology: A new and comprehensive solution to a pervasive but largely ignored problem. Journal of Personality and Social Psychology 2012, 103(1):54-69.
31. Judge T.A., Bono J.E. Relationship of core self-evaluations traits-self-esteem, generalized self-efficacy, locus of control, and emotional stability-with job satisfaction and job performance: A meta-analysis. Journal of Applied Psychology 2001, 86(1):80.
32. Kardes F.R., Fennis B.M., Hirt E.R., Tormala Z.L., Bullington B. The role of the need for cognitive closure in the effectiveness of the disrupt-then-reframe influence technique. Journal of Consumer Research 2007, 34(3):377-385.
33. Kastrati A., Neumann F.-J., Schulz S., Massberg S., Byrne R.A., Ferenc M., et al. Abciximab and heparin versus bivalirudin for non-ST elevation myocardial infarction. The New England Journal of Medicine 2011, 365(21):1980-1989.
34. Keppel G., Wickens T.D. Design and analysis: A researcher's handbook 2004, University of California Press, Berkeley. 4th ed.
35. Lemanske R.F., Mauger D.T., Sorkness C.A., Jackson D.J., Boehmer S.J., Martinez F.D., et al. Step-up therapy for children with uncontrolled asthma receiving inhaled corticosteroids. The New England Journal of Medicine 2010, 362(11):975-985.
36. MacCallum R.C., Zhang S., Preacher K.J., Rucker D.D. On the practice of dichotomization of quantitative variables. Psychological Methods 2002, 7(1):19-40.
37. Mani A., Mullainathan S., Shafir E., Zhao J. Poverty impedes cognitive function. Science 2013, 341(6149):976-980.
38. Mani A., Mullainathan S., Shafir E., Zhao J. Response to comment on "Poverty impedes cognitive function". Science 2013, 342(6163):1169-e.
39. Maxwell S.E., Delaney H.D. Bivariate median splits and spurious statistical significance. Psychological Bulletin 1993, 113(1):181-190.
40. McClelland G.H., Judd C.M. Statistical difficulties of detecting interactions and moderator effects. Psychological Bulletin 1993, 114:376-390.
41. Shah J.Y., Kruglanski A.W., Thompson E.P. Membership has its (epistemic) rewards: Need for closure effects on in-group bias. Journal of Personality and Social Psychology 1998, 75(2):383.
42. Simmons J.P., Nelson L.D., Simonsohn U. False-positive psychology undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science 2011, 22(11):1359-1366.
43. Smith N.C. Presidential session summary: Ethics in consumer research. Advances in consumer research 1998, Volume 25:68. Association for Consumer Research, Provo, UT. J.W. Alba, J.W. Hutchinson (Eds.).
44. Spiller S.A., Fitzsimons G.J., Lynch J.G., McClelland G.H. Spotlights, floodlights, and the magic number zero: Simple effects tests in moderated regression. Journal of Marketing Research 2013, 50(2):277-288.
45. Webster D.M., Kruglanski A.W. Individual differences in need for cognitive closure. Journal of Personality and Social Psychology 1994, 67(6):1049.
46. Wicherts J.M., Scholten A.Z. Comment on "poverty impedes cognitive function". Science 2013, 342(6163):1169-1169.