Null hypothesis significance testing: On the survival of a flawed method

American Psychologist

Volumn 56, Issue 1, 2001, Pages 16-26

  Krueger, Joachim ^a  

^a BROWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; HUMAN; METHODOLOGY; REPRODUCIBILITY; RESEARCH;

HUMANS; REPRODUCIBILITY OF RESULTS; RESEARCH; RESEARCH DESIGN;

EID: 0035220378     PISSN: 0003066X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0003-066X.56.1.16     Document Type: Article

References (49)

1. Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423-437.
2. Carver, R. P. (1978). The case against statistical hypothesis testing. Harvard Educational Review, 48, 378-399.
3. Chow, S. L. (1998). Statistical significance: Rationale, validity and utility. Behavioral and Brain Sciences, 21, 169-240.
4. Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304-1312.
5. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003.
6. Dawes, R. M. (1988). Rational choice in an uncertain world. San Diego, CA: Harcourt Brace Jovanovich.
7. Dawes, R. M. (1991). Probabilistic versus causal thinking. In D. Cicchetti & W. M. Grove (Eds.), Thinking clearly about psychology: Vol. 1. Matters of public interest: Essays in honor of Paul Everett Meehl (pp. 235-264). Minneapolis: University of Minnesota Press.
8. Dawes, R. M. (1997). Qualitative consistency masquerading as quantitative fit. In M. L. Dalla Chiara, D. Kees, D. Mundici, & J. van Bentheim (Eds.), Structures and norms in science (pp. 387-394). Dordrecht, the Netherlands: Kluwer Academic.
9. Diaconis, P., & Mosteller, F. (1989). Methods of studying coincidences. Journal of the American Statistical Association: Applications & Case Studies, 84, 853-861.
10. Dixon, P. (1998). Why scientists value p values. Psychonomic Bulletin & Review, 5, 390-396.
11. Ethier, S. N. (1982). Testing for favorable numbers on a roulette wheel. Journal of the American Statistical Association: Theory and Methods, 77, 660-665.
12. Falk, R., & Greenbaum, C. W. (1995). Significance tests die hard. Theory & Psychology, 5, 75-98.
13. Feinstein, A. R. (1998). P-values and confidence intervals: Two sides of the same unsatisfactory coin. Journal of Clinical Epidemiology, 51, 355-360.
14. Fisher, R. A. (1960). The design of experiments (8th ed.). Edinburgh, Scotland: Oliver & Boyd. (Original work published 1935)
15. Frick, R. W. (1996). The appropriate use of null hypothesis testing. Psychological Methods, 1, 379-390.
16. Gaertner, S., & Bickman, L. (1971). Effects of race on the elicitation of helping behavior: The wrong number technique. Journal of Personality and Social Psychology, 20, 218-222.
17. Gigerenzer, G. (1993). The superego, the ego, and the id in statistical reasoning. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues (pp. 311-339). Hillsdale, NJ: Erlbaum.
18. Goodman, S. N. (1999a). Toward evidence-based medical statistics. 1: The P value fallacy. Annals of Internal Medicine, 130, 995-1004.
19. Goodman, S. N. (1999b). Toward evidence-based medical statistics. 2: The Bayes factor. Annals of Internal Medicine, 130, 1005-1013.
20. Gott, J. R. (1993). Implications of the Copernican principle for our future prospects. Nature, 363, 315-319.
21. Greenwald, A. G., Gonzalez, R., Harris, R. J., & Guthrie, D. (1996). Effect sizes and p values: What should be reported and what should be replicated? Psychophysiology, 33, 175-183.
22. Hagen, R. L. (1997). In praise of the null hypothesis statistical test. American Psychologist, 52, 15-24.
23. Harlow, L. L., Mulaik, S. A., & Steiger, J. H. (1997). What if there were no significance tests? Mahwah, NJ: Erlbaum.
24. Hays, W. L. (1973). Statistics for the social sciences (2nd ed.). New York: Holt, Rinehart & Winston.
25. Hays, W. L., & Winkler, R. L. (1971). Statistics: Probability, inference, and decision. New York: Holt, Rinehart & Winston.
26. Hedges, L. V. (1981). Distribution theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107-128.
27. Hume, D. (1978). A treatise of human nature. Glasgow, Scotland: William Collins. (Original work published 1739)
28. Hunter, J. E. (1997). Needed: A ban on the significance test. Psychological Science, 8, 3-7.
29. Kaplan, A., & Krueger, J. (1999). Compliance after threat: Self-affirmation or self-presentation? Current Research in Social Psychology, 4, 178-197. Retrieved December 14, 2000, from the World Wide Web: http://www.uiowa.edU/~grpproc/crisp/crisp.4.7.htm
30. Krueger, J. (1998). The bet on bias: A foregone conclusion? Psycoloquy, 9(46). Retrieved December 14, 2000, from the World Wide Web: http://www.cogsci.soton.ac.uk/cgi/psyc/newpsy?9.46
31. Lewandowsky, S., & Maybery, M. (1998). The critics rebutted: A Pyrrhic victory. Behavioral and Brain Sciences, 21, 210-211.
32. Lindley, D. V. (1993). The analysis of experimental data: The appreciation of tea and wine. Teaching Statistics, 15, 22-25.
33. Lykken, D. T. (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 151-159.
34. Lykken, D. T. (1991). What's wrong with psychology anyway? In D. Cicchetti & W. M. Grove (Eds.), Thinking clearly about psychology: Vol. 1. Matters of public interest: Essays in honor of Paul Everett Meehl (pp. 3-39). Minneapolis: University of Minnesota Press.
35. Meehl, P. E. (1990). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, 66(Suppl. 1), 195-244.
36. Melton, A. W. (1962). Editorial. Journal of Experimental Psychology, 64, 553-557.
37. Moore, D. S., & McCabe, G. P. (1993). Introduction to the practice of statistics. New York: Freeman.
38. Morrison, D. E., & Henkel, R. E. (1970). The significance test controversy. Chicago: Aldine.
39. Oakes, W. F. (1975). On the alleged falsity of the null hypothesis. Psychological Record, 25, 265-272.
40. Oakes, W. F. (1986). Statistical inference: A commentary for the social and behavioral sciences. Chichester, England: Wiley.
41. Paulos, J. A. (1998). Once upon a number. New York: Basic Books.
42. Prentice, D. A., & Miller, D. T. (1992). When small effects are impressive. Psychological Bulletin, 112, 160-164.
43. Reichenbach, H. (1951). The rise of scientific philosophy. Berkeley: University of California Press.
44. Russell, B. (1955). Nightmares of eminent persons. New York: Simon & Schuster.
45. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-316.
46. Thompson, B. (1997). In praise of brilliance: Where that praise really belongs. American Psychologist, 52, 799-800.
47. Tversky, A., & Kahneman, D. (1971). Belief in the law of small numbers. Psychological Bulletin, 76, 105-110.
48. Tversky, A., & Kahneman, D. (1974, September 27). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124-1131.
49. Wilkinson, L., & the Task Force on Statistical Inference. (1999). Statistical methods in psychology journals. American Psychologist, 54, 594-604.