Does statistical language constitute a "significant" roadblock to readers' interpretations of research results?

Journal of Educational Psychology

Volumn 93, Issue 3, 2001, Pages 646-654

  Robinson, Daniel H ^a   O'Ryan, Leslie ^c   Levin, Joel R ^b   Halbur Ramseyer, Duane ^c  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

^c University of Texas ^*

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85047683022     PISSN: 00220663     EISSN: None     Source Type: Journal    
DOI: 10.1037/0022-0663.93.3.646     Document Type: Article

References (34)

1. American Psychological Association. (1994). Publication manual of the American Psychological Association (4th ed.). Washington, DC: Author.
2. Appel, L. J., Moore, T. J., Obarzanek, E., Vollmer, W. M., Svetkey, L. P., Sacks, F. M., Bray, G. A., Vogt, T. M., Cutler, J. A., Windhauser, M. M., Lin, P. H., & Karanja, N. (1997). A clinical trial of the effects of dietary patterns on blood pressure. New England Journal of Medicine, 336, 1117-1124.
3. Atkinson, D. R., Furlong, M. J., & Wampold, B. E. (1982). Statistical significance, reviewer evaluations, and the scientific process: Is there a statistically significant relationship? Journal of Counseling Psychology, 29, 189-194.
4. Baer, J., & Baer, S. (1988, March/April). Statistical significance. Gifted Child Today, 22-23.
5. Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423-437.
6. Carver, R. (1978). The case against statistical significance testing. Harvard Educational Review, 48, 378-399.
7. Carver, R. (1993). The case against statistical significance testing, revisited. Journal of Experimental Education, 61, 287-292.
8. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (Rev. ed.). Hillsdale, NJ: Erlbaum.
9. Cohen, J. (1990). Things I have learned so far. American Psychologist, 43, 1304-1312.
10. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003.
11. Cronbach, L. J. (1975). Beyond the two disciplines of scientific psychology. American Psychologist, 30, 116-127.
12. Heldref Foundation. (1998). Guidelines for contributors. Journal of Experimental Education, 67, 2.
13. Keaster, R. D. (1988, November). Statistical significance testing: From routine to ritual (Document No. TH012775). Paper presented at the Mid-South Educational Research Association, Louisville KY. (ERIC Document Reproduction Service No. ED303 514)
14. Kupfersmid, J. (1988). Improving what is published: A model in search of an editor. American Psychologist, 43, 635-642.
15. Levin, J. R. (1993). Statistical significance testing from three perspectives. Journal of Experimental Education, 61, 378-382.
16. Levin, J. R. (1998). What if there were no more bickering about statistical significance tests? Research in the Schools, 5(2), 43-53.
17. Levin, J. R., & Robinson, D. H. (1999). Further reflections on hypothesis testing and editorial policy for scholarly research journals. Educational Psychology Review, 11, 143-155.
18. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834.
19. Morrison, D. E., & Henkel, R. E. (Eds.). (1970). The significance test controversy: A reader. Chicago: Aldine.
20. Robinson, D. H., & Levin, J. R. (1997). Reflections on statistical and substantive significance, with a slice of replication. Educational Researcher, 26(5), 21-26.
21. Rosenthal, R. (1991). Meta-analysis procedures for social research (2nd ed.). Newbury Park, CA: Sage.
22. Rosenthal, R., & Gaito, J. (1963). The interpretation of level of significance by psychological researchers. Journal of Psychology, 55, 33-38.
23. Rosnow, R. L., & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276-1284.
24. Schafer, W. D. (1993). Interpreting statistical significance and nonsignificance. Journal of Experimental Education, 61, 383-387.
25. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, 115-129.
26. Seaman, M. A., & Serlin, R. C. (1998). Equivalence confidence intervals for two-group comparisons of means. Psychological Methods, 3, 403-411.
27. Shaver, J. (1985, October). Chance and nonsense: A conversation about interpreting tests of statistical significance, Part 2. The Phi Delta Kappan, 138-141.
28. Shaver, J. P. (1993). What statistical significance testing is, and what it is not. Journal of Experimental Education, 61, 293-316.
29. Sohn, D. (2000). Significance testing and the science. American Psychologist, 55, 964-965.
30. Thompson, B. (1994). The concept of statistical significance testing (Report No. EDO-TM-94-1). Washington, DC: Office of Educational Research and Improvement. (ERIC Document Reproduction Service No. 366 654)
31. Thompson, B. (1996). AERA editorial policies regarding statistical significance testing: Three suggested reforms. Educational Researcher, 25(2), 26-30.
32. Thompson, B. (1997). Editorial policies regarding statistical significance tests: Further comments. Educational Researcher, 26(5), 29-32.
33. Thompson, B. (1999). Journal editorial policies regarding statistical significance tests: Heat is to fire as p is to importance. Educational Psychology Review, 11, 157-169.
34. Walma van der Molen, J. H., & van der Voort, T. H. A. (1997). Children's recall of television and print news: A media comparison study. Journal of Educational Psychology, 89, 82-91.