Sweating the small stuff in educational psychology: How effect size and power reporting failed to change from 1969 to 1999, and what that means for the future of changing practices

Educational Psychology

Volumn 28, Issue 2, 2008, Pages 151-160

  Osborne, Jason W ^a  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

Changing practice; Effect sizes; Power; Statistics

Indexed keywords

EID: 38849105611     PISSN: 01443410     EISSN: 14695820     Source Type: Journal    
DOI: 10.1080/01443410701491718     Document Type: Article

References (23)

1. Boring, E.G. (1919). Mathematical vs. scientific importance. Psychological Bulletin, 16, 335-338.
2. Cohen, J. (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-153.
3. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
4. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
5. Crandall, C.S., Olson, L.M., & Sklar, D.P. (2001). Mortality reduction with air bag and seat belt use in head-on passenger car collisions. American Journal of Epidemiology, 153, 219-224.
6. Deemer, W.L. (1947). The power of me t test and the estimation of required sample size. Journal of Educational Psychology, 38, 329-342.
7. Fidler, F. (2005). From statistical significance to effect estimation: Statistical reform in psychology, medicine, and ecology. Doctoral dissertation, University of Melbourne. Retrieved from http://www.botany.unimelb. edu.au/envisci/fiona/fidlerphd_aug06.pdf, 2 April 2007.
8. Fidler, F., & Cumming, G. (2008). The new stats: Attitudes for the twenty-first century. In J.W. Osborne (Ed.), Best practices in quantitative methods. Thousand Oaks, CA: Sage Publishing.
9. Iramaneerat, C., Smith, E.V., Jr., & Smith, R.M. (in press). An introduction to Rasch measurement. In J.W. Osborne, (Ed.) Best practices in quantitative methods. Thousand Oaks, CA: Sage Publishing.
10. Killeen, P.R. (2008). Replication statistics as a replacement for significance testing, best practices in scientific decision-making. In J. Osborne (Ed.), Best practices in quantitative methods. Thousand Oaks, CA: Sage Publishing.
11. Osborne, J.W., & Overbay, A. (2004). The power of outliers (and why researchers should ALWAYS check for them). Practical Assessment, Research, and Evaluation, 9(6). Retrieved from http://pareonline.net/getvn.asp?v= 9&n=6, 2 April 2007.
12. Osborne, J.W., & Waters, E. (2002). Four assumptions of multiple regression that researchers should always test. Practical Assessment, Research, and Evaluation, 8(2). Retrieved from http://pareonline.net/getvn. asp?v=8&n=2, 2 April 2007.
13. Rossi, J.S. (1990). Statistical power of psychological research: What have we gained in 20 years? Journal of Counseling and Clinical Psychology, 58, 646-656.
14. Rozeboom, W.W. (1997). Good science is abductive, not hypothetico-deductive. In L.L. Harlow, S.A. Mulaik, & J.H. Steiger (Eds.), What if there were no significance tests? (pp. 335-392). Mahwah, NJ: Erlbaum.
15. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-316.
16. Thompson, B. (1993). The use of statistical significance tests in research: Bootstrap and other alternatives. Journal of Experimental Education, 61, 361-377.
17. Thompson, B. (2002a). What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher, 31(3), 24-31.
18. Thompson, B. (2002b). "Statistical," "practical," and "clinical": How many kinds of significance do counselors need to consider? Journal of Counseling and Development, 80, 64-71.
19. Thompson, B. (in press). Computing and interpreting effect sizes, confidence intervals, and confidence intervals for effect sizes. In J.W. Osborne (Ed.), Best practices in quantitative methods. Thousand Oaks, CA: Sage Publishing.
20. Tukey, J.W. (1991). The philosophy of multiple comparisons. Statistical Science, 6, 100-116.
21. Wilcox, R.R. (2005a). Introduction to robust estimation and hypothesis testing (2nd ed.). San Diego, CA: Academic Press.
22. Wilkinson, L., & the APA Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
23. Williams, A.F., & Lund, A.K. (1986). Seat belt use laws and occupant crash protection in the United States. American Journal of Public Health, 76, 1438-1442.