Lessons learned from statistical reform efforts in other disciplines

Psychology in the Schools

Volumn 44, Issue 5, 2007, Pages 441-449

  Fidler, Fiona ^a   Cumming, Geoff ^a  

^a LA TROBE UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34250863894     PISSN: 00333085     EISSN: 15206807     Source Type: Journal    
DOI: 10.1002/pits.20236     Document Type: Article

References (51)

1. Altman, D.G., Machin, D., Bryant, T.N., & Gardner, M.J. (Eds.). (2000). Statistics with confidence (2nd ed.). London: BMJ Books.
2. Altman, M. (2004). Introduction. Journal of Socio-Economies, 33, 523-525.
3. American Psychological Association. (1994). Publication Manual of the American Psychological Association (4th ed.). Washington, DC: Author
4. American Psychological Association (2001). Publication Manual of the American Psychological Association (5th ed.), Washington, DC: Author.
5. Anderson, D., Burnham, K., & Thompson, W. (2000). Null hypothesis testing: Problems, prevelence, and an alternative. Journal of Wildlife Management, 64, 912-923.
6. Belia, S., Fidler, F., Williams, J., & Cumming, G. (2005). Researchers misunderstand confidence intervals and standard error bars. Psychological Methods, 10, 389-396.
7. Cohen, J. (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-153.
8. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003.
9. Cumming, G. (2005). Understanding the average probability of replication: Comment on Killeen (2005). Psychological Science, 16, 1002-1004.
10. Cumming, G., & Finch, S. (2005). Inference by eye: Confidence intervals, and how to read pictures of data. American Psychologist, 60, 170-180.
11. Cumming, G., Williams, J., & Fidler, F. (2004). Replication, and researchers' understanding of confidence intervals and standard error bars. Understanding Statistics, 3, 299-311.
12. Cutler, S.J., Greenhouse, S.W., Cornfield, J., & Schneiderman, M.A. (1966). The role of hypothesis testing in clinical trials. Journal of Chronic Diseases, 19, 857-882.
13. Fidler, F. (2002). The fifth edition of the APA. Publication Manual: Why its statistics recommendations are so controversial. Educational and Psychological Measurement, 62, 749-770.
14. Fidler, F., Burgman, M., Cumming, G., Buttrose, R., & Thomason, N. (2006). Impact of criticisms of null hypothesis significance testing on statistical reporting practices in conservation biology. Conservation Biology, 20, 1539-1544.
15. Fidler, F., Cumming, G., Burgman, M., & Thomason, N. (2004). Statistical reform in medicine, psychology and ecology. Journal of Socio-Economies, 33, 615-630.
16. Fidler, F., Cumming, G., Thomason, N., Pannuzzo, D., Smith, J., Fyffe, P., et al. (2005). Evaluating the effectiveness of editorial policy to improve statistical practice: The case of the Journal of Consulting and Clinical Psychology. Journal of Consulting and Clinical Psychology, 73, 136-143.
17. Fidler, F., Thomason, N., Cumming, G., Finch, S., & Leeman, J. (2004). Editors can lead researchers to confidence intervals but they can't make them think: Statistical reform lessons from medicine. Psychological Science, 15, 119-126.
18. Finch, S., Cumming, G., Williams, J., Palmer, L., Griffith, E., Alders, G., et al. (2004). Reform of statistical inference in psychology: The case of Memory & Cognition. Behavior Research Methods, Instruments, & Computers, 36, 312-324.
19. Finch, S., Thomason, N., & Cumming, G. (2002). Past and future American Psychological Association guidelines for statistical practice. Theory & Psychology, 12, 825-853.
20. Gigerenzer, G. (1987). Probabilistic thinking and the fight against subjectivity. In L. Kruger, J. Lorraine, & G. Gigerenzer (Eds.). The probabilistic revolution, Vol. 2: Ideas in the sciences (pp. 11-33). Cambridge, MA: The MIT Press.
21. Gigerenzer, G. (1998). Surrogates for theories. Theory & Psychology, 8, 195-204.
22. Glaser, D.N. (1996). The need for a moratorium on significance testing. Journal of Cardiovascular Nursing, 11, viii-ix.
23. Grissom, R.J., & Kim, J.J. (2005). Effect sizes for research. A broad practical approach. Mahwah, NJ: Erlbaum.
24. Haller, H., & Krauss, S. (2002). Misinterpretations of significance: A problem students share with their teachers? Methods of Psychological Research, 7, 1-20.
25. Harris, E.K. ( 1993). On p values and confidence intervals (why can't we p with more confidence?). Clinical Chemistry, 39, 927-928.
26. Hill, C.R., & Thompson, B. (2004), Computing and interpreting effect sizes. In J.C. Smart (Ed.), Higher education: Handbook of theory and research (vol. 19, pp. 175-196). New York: Kluwer.
27. Hoenig, J.M., & Heisey, D.M. (2001). The abuse of power: The pervasive fallacy of power calculations for data analysis. The American Statistician, 55, 19-24.
28. Hubbard, R., & Ryan, P.A. (2000). The historical growth of statistical significance testing in psychology - and its future prospects. Educational and Psychological Measurement, 60, 661-681.
29. International Committee of Medical Journal Editors. (1988). Uniform requirements for manuscripts submitted to biomedical journals. Annals of Internal Medicine, 108, 258-265.
30. Kendall, P.C. (1997). Editorial. Journal of Consulting and Clinical Psychology, 65, 3-5.
31. Killeen, P.R. (2005), An alternative to null hypothesis significance tests. Psychological Science, 16, 345-353.
32. Kline, R.B. (2004) Beyond significance testing: Reforming data analysis methods in behavioral research. Washington, DC: APA Books.
33. Loftus, G. (1993). Editorial comment. Memory & Cognition, 21, 1-3.
34. Meehl, P.E. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis: University of Minnesota Press.
35. Morrison, D.E., & Henkel, R.E. (Eds.). (1970). The significance test controversy. Chicago: Aldine.
36. Oakes, M.W. (1986). Statistical inference: A commentary for the social and behavioural sciences. Chichester, UK: Wiley.
37. Rennie, D. (1978). Vive la difference (p < 0.05). New England Journal of Medicine, 299, 828-829.
38. Rothman, K.J. (1978). A show of confidence. New England Journal of Medicine, 299, 1362-1363.
39. Rothman, K.J. (1998). Writing for Epidemiology. Epidemiology, 9, 333-337.
40. Royall, R. (1986). The effect of sample size on the meaning of significance tests. American Statistician, 40, 313-315.
41. Sanabria, E, & Killeen, P.R. (2007). Better statistics for better decisions: Rejecting null hypotheses statistical tests in favor of replication statistics. Psychology in the Schools, 44, 471-481.
42. Sawyer, A.C., & Peter, J.P. (1983). The significance of statistical significance tests in marketing research. Journal of Marketing Research, 20, 122-133.
43. Schmidt, F., & Hunter, J. (1996). Eight common but false objections to the discontinuation of significance testing in psychology: Implications for training of researchers. Psychological Methods, 1, 115-129.
44. Sedlmeier, P. (1999). Improving statistical reasoning: Theoretical models and practical implications. Mahwah, NJ: Erlbaum.
45. Smithson, M. (2000). Statistics with confidence. London: Sage.
46. Thompson, B. (1996). AERA editorial policies regarding statistical significance testing: Three suggested reforms. Educational Researcher, 25, 26-30.
47. Thompson, B. (2006). Foundations of behavioral statistics: An insight-based approach. New York: Guilford.
48. Thompson, B. (2007). Effect size, confidence intervals, and confidence intervals for effect sizes. Psychology in the Schools, 44, 423-432.
49. Weisburd, D., & Lurn, C.M., & Yang S.M. (2003). When can we conclude that treatments or programs "don't work"? The Annals of the American Academy of Political and Social Science, 587, 31-48.
50. Wilkinson, L., & Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
51. Ziliak, S., & McCloskey, D. (2004). Size matters: The standard error of regressions in the American Economic Review. Journal of Socioeconomics, 33, 665-675.