Effect size reporting practices in published articles

Educational and Psychological Measurement

Volumn 69, Issue 2, 2009, Pages 245-265

  Alhija, Fadia Nasser Abu ^a   Levy, Adi ^a  

^a TEL AVIV UNIVERSITY   (Israel)

Author keywords

Effect size; Practical significance; Statistical significance

Indexed keywords

EID: 62849099708     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164408315266     Document Type: Article

References (43)

1. AERA Task Force on Reporting of Research Methods in AERA Publications. (2006). Standards of reporting on empirical social science research in AERA publications. Retrieved March 17, 2007 from http://www.sagepub.com/upm-data/ 13127-Standards-from-AERA.pdf
2. American Psychological Association. (2001). Publication manual (5 th ed.). Washington, DC: Author.
3. Anderson, D.R., Burnham, K.P., & Thompson, W.L. (2000). Null hypothesis testing: problems, prevalence, and an alternative. Journal of Wildlife Management, 64, 912-923.
4. APA Task Force for Statistical Inference (1996, December). Task Force on Statistical Inference initial report. Retrieved March 17, 2007, from http://www.apa.org/science/bsaweb-tfsi.html
5. Capraro, M.R., & Capraro, M.M. (2002). Treatment of effect sizes and statistical significance tests in textbooks. Educational and Psychological Measurement, 64, 771-782.
6. Cohen, J. (1977). Statistical power analysis for the behavioral sciences (Rev. ed.). New York: Academic Press.
7. Cohen, J. (1988). Statistical power analysis for the behavior sciences (2 nd ed.). Hillsdale, NJ: Erlbaum.
8. Cohen, J. (1994). The earth is round (p < :05). American Psychologist, 64, 997-1003.
9. Fan, X. (2001). Statistical significance and effect size in education research: Two sides of a coin. Journal of Educational Research, 64, 275-283.
10. Filder, F. (2002). The fifth edition of the APA publication manual: Why its statistics recommendations are so controversial. Educational and Psychological Measurement, 64, 749-770.
11. Finch, S., Thomason, N., & Cumming, G. (2002). Past and future American Psychological Association Guidelines for statistical practice. Theory & Psychology, 64, 825-853.
12. Fox, C.L., & Boulton, M.J. (2003). Evaluating the effectiveness of a social skills training (SST) programme for victims of bullying. Educational Research, 64, 231-247.
13. Glass, G.V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5 (10). 3-8.
14. Grisim, J.R., & Kim, J.J. (2005). Effect sizes for research: A broad practical approach. Mahwah, NJ: Lawrence Erlbaum.
15. Hays, W.L. (1963). Statistics for psychologists. New York: Holt, Rinehart & Winston.
16. Hays, W.L. (1973). Statistics for the social sciences. New York: Holt, Rinehart & Winston.
17. Hedges, L.V. (1981). Distribution theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107-128.
18. Hedges, L.V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
19. Hopkins, W.G. (2002). The new view of statistics. Retrieved October 28, 2002, from http://www.sportscsi.org/resource/ststs/effectmag.html
20. Kalyuga, S., & Sweller, J. (2004). Measuring knowledge to optimize cognitive load factors during instruction. Journal of Educational Psychology, 96 558-568.
21. Kirk, R.E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746-759.
22. Kirk, R.E. (2001). Promoting good statistical practices: Some suggestions. Educational and Psychological Measurement, 61, 213-218.
23. Nickerson, R.S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 64, 241-301.
24. Oakes, M. (1986). Statistical inference: A commentary for the social and behavioral sciences. New York: Wiley.
25. Reid, R., Gonzalez, J.E., Nordness, P.D., Trout, A., & Epstein, M. (2004). A meta-analysis of the academic status of students with emotional/behavioral disturbance. Journal of Special Education, 64, 130-143.
26. Rosnow, R.L., & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276-1284.
27. Rossi, J.S. (1997). A case study in the failure of psychology as a cumulative science: The spontaneous recovery of verbal learning. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 175-197). Hillsdale, NJ: Erlbaum.
28. Rozeboom, W.W. (1960). The fallacy of the null hypothesis significance test. Psychological Bulletin, 57, 416-428.
29. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies ? Psychological Bulletin, 64, 309-316.
30. Stevens, J.P. (1999). Intermediate statistics: A modern approach (3 rd ed.). Hillsdale, NJ: Erlbaum.
31. Thompson, B. (1996). AERA editorial policies regarding statistical significance testing: Three suggested reforms. Educational Researcher, 25 (2). 26-30.
32. Thompson, B. (1998). Statistical significance and effect size reporting: Portrait of possible future. Research in the Schools, 5 (2). 33-38.
33. Thompson, B. (1999). Journals editorial policies regarding statistical significance tests: heat is to fire as p is to importance. Educational Psychological Review, 64, 157-169.
34. Thompson, B. (2002 a). What future quantitative social science research could look like: Confidence intervals for effect sizes ? Educational Researcher, 31 (3). 33-38.
35. Thompson, B. (2002 b). ''Statistical,'' ''practical,'' and ''clinical'': How many kinds of significance do counselors need to consider ? Journal of Counseling & Development, 64, 64-71.
36. Thompson, B. (2006). Foundation of behavioral statistics: An insight-based approach. New York: Guilford Press.
37. Thompson, B., & Snyder, P.A. (1997). Statistical significance testing practices in the Journal of Experimental Education. Journal of Experimental Education, 66, 75-83.
38. Thompson, B., & Snyder, P.A. (1998). Statistical significance and reliability analyses in recent JCD research articles. Journal of Counseling & Development, 76, 436-441.
39. Tukey, J.W. (1991). The philosophy of multiple comparisons. Statistical Science, 64, 100-116.
40. Vacha-Haase, T., Nilsson, J.E., Reetz, D.R., Lance, T.S., & Thompson, B. (2000). Reporting practices and APA editorial policies regarding statistical significance and effect size. Theory & Psychology, 64, 413-425.
41. Vacha-Haase, T., & Thompson, B. (2004). How to estimate and interpret various effect sizes. Journal of Counseling Psychology, 64, 473-481.
42. Vukovic, R.K., Wilson, A.M., & Nash, K.K. (2004). Naming speed deficits in adults with reading disabilities: A test of the double-deficit hypothesis. Journal of Learning Disabilities, 64, 440-450.
43. Wilkinson, L., & APA Task Force on Statistical Inference. (1999). Statistical methods in psychology: Guidelines and explanations. American Psychologist, 64, 549-604.