Some effects of including effect size and “what if” information

Journal of Experimental Education

Volumn 70, Issue 4, 2002, Pages 365-382

  Robinson, Daniel H ^a   Williams, Natasha J ^a   Bera, Stephan J ^a   Fouladi, Rachel T ^b  

^a UNIVERSITY OF TEXAS   (United States)

^b UNIVERSITY OF TEXAS MD ANDERSON CANCER CENTER   (United States)

Author keywords

Editorial policy; Effect sizes; Statistical significance

Indexed keywords

EID: 23044534703     PISSN: 00220973     EISSN: 19400683     Source Type: Journal    
DOI: 10.1080/00220970209599513     Document Type: Article

References (28)

1. American Psychological Association. (1994). Publication manual of the American Psychological Association (4th ed.). Washington, DC: Author.
2. American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
3. Appel, L. J., Moore, T. J., Obarzanek, E., Vollmer, W. M., Svetkey, L. P., Sacks, F. M., et al. (1997). A clinical trial of the effects of dietary patterns on blood pressure. New England Journal of Medicine, 336, 1117-1124.
4. Cohen, J. (1977). Statistical power analyses for the behavioral sciences. New York: Academic Press.
5. Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304-1312.
6. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003.
7. Glass, G. V., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. Beverly Hills, CA: Sage.
8. Kirk, R. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement 56, 746-759.
9. Knapp, T. R., & Sawilowsky, S. S. (2001). Constructive criticisms of methodological and editorial practices. The Journal of Experimental Education, 70(1), 65-79.
10. Levin, J. R., & Robinson, D. H. (1999). Further reflections on hypothesis testing and editorial policy for scholarly research journals. Educational Psychology Review, 11, 143-155.
11. McLean, J. E., & Kaufman, A. S. (2000). Editorial: Statistical significance testing and Research in the Schools. Research in the Schools, 7(2).
12. Murphy, K. R. (1997). Editorial. Journal of Applied Psychology, 82, 3-5.
13. Olejnik, S., & Algina, J. (2000). Measures of effect size for comparative studies: Applications, inter-pretations, and limitations. Contemporary Educational Psychology, 25, 241-286.
14. Robinson, D. H., Funk, D. C., Halbur, D., & O'Ryan, L. (in press). The .05 level of significance: Traditional, arbitrary, sacred, magical, mindless, or simply psychological? Research in the Schools.
15. Robinson, D. H., Levin, J. R., Halbur, D., & O'Ryan, L. (2001). Does use of statistical language constitute a "significant" roadblock to readers interpretations of research results? Journal of Educational Psychology, 93, 646-654.
16. Robinson, D. H., & Wainer, H. (2002). On the past and future of null hypothesis significance testing. Journal of Wildlife Management, 66, 263-271.
17. Royer, J. M. (2000). Editorial: A policy on reporting of effect sizes. Contemporary Educational Psy-chology, 25, 239.
18. Scarr, S. (1997). Rules of evidence: A larger context for the statistical debate. American Psychologist, 8, 16-17.
19. Thompson, B. (1989). Asking "what if' questions about significance tests. Measurement and Evaluation in Counseling and Development, 22(2), 66-68.
20. Thompson, B. (1996). AERA editorial policies regarding statistical significance testing: Three suggested reforms. Educational Researcher, 25(2), 26-30.
21. Thompson, B. (1999). Journal editorial policies regarding statistical significance tests: Heat is to fire as p is to importance. Educational Psychology Review, 11, 157-169.
22. Thompson, B. (2001). Significance, effect sizes, stepwise methods, and other issues: Strong arguments move the field. The Journal of Experimental Education, 70(1), 80-93.
23. Thompson, B., & Kieffer, K. M. (2000). Interpreting statistical significance test results: A proposed new "what if' method. Research in the Schools, 7(2), 3-10.
24. Tukey, J. W. (1960). Conclusions vs. decisions. Technometrics, 2, 423-433.
25. Tukey, J. W. (1991). The philosophy of multiple comparisons. Statistical Science, 6, 100-116.
26. Vacha-Haase, T., Nilsson, J. E., Reetz, D. R., Lance, T. S., & Thompson, B. (2000). Reporting practices and APA editorial policies regarding statistical significance and effect size. Theory & Psychology, 10, 413-425.
27. van der Molen, J. H. W., & van der Voort, T. H. A. (1997). Children's recall of television and print news: A media comparison study. Journal of Educational Psychology, 89, 82-91.
28. Wilkinson, L., & The APA Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.