Research news and comment: Aera editorial policies regarding statistical significance testing: Three suggested reforms

Educational Researcher

Volumn 25, Issue 2, 1996, Pages 26-30

  Thompson, Bruce ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79957902492     PISSN: 0013189X     EISSN: 1935102X     Source Type: Journal    
DOI: 10.3102/0013189X025002026     Document Type: Article

References (51)

1. American Psychological Association (1994). Publication manual of the American Psychological Association, 4th ed. Washington, DC: Author.
2. Association for Assessment in Counseling. (1994). Guidelines for authors. Measurement and Evaluation in Counseling and Development, 27(1), 341.
3. Atkinson, DR, MJ Furlong, and BE Wampold (1982). Statistical significance, reviewer evaluations, and the scientific process: Is there a (statistically) significant relationship? Journal of Counseling Psychology, 29, 189-194.
4. Bakan, D (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423-437.
5. Berger, JO, and DA Berry (1988). Statistical analysis and the illusion of objectivity. American Scientist, 76, 159-165.
6. Carver, R (1978). The case against statistical significance testing. Harvard Educational Review, 48, 378-399.
7. Carver, R (1993). The case against statistical significance testing, revisited. Journal of Experimental Education, 61(4), 287-292.
8. Clark, HH (1976). Reply to Wike and Church. Journal of Verbal Learning and Verbal Behavior, 15, 257-261.
9. Cohen, J (1990). Things I have learned (so far). American Psychologist, 45(12), 1304-1312.
10. Cohen, J (1994). The earth is round (p <05). American Psychologist, 49, 997-1003.
11. Cohen, LH (1979). Clinical psychologists' judgments of the scientific merit and clinical relevance of psychotherapy outcome research. Journal of Consulting and Clinical Psychology, 47, 421-423.
12. Cronbach, LJ (1975). Beyond the two disciplines of psychology. American Psychologist, 30, 116-127.
13. Daniel, WW (1977). Statistical significance versus practical significance. Science Education, 61, 423-427.
14. Dar, R (1987). Another look at Meehl, Lakatos, and the scientific practices of psychologists. American Psychologist, 42, 145-151.
15. Greenwald, AG (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1-20.
16. Hays, WL (1981). Statistics, 3rd ed. New York: Holt, Rinehart and Winston.
17. Huberty, CJ (1987). On statistical testing. Educational Researcher, 16(8), 4-9.
18. Huberty, CJ (1993). Historical origins of statistical testing practices: The treatment of Fisher versus Neyman-Pearson views in textbooks. Journal of Experimental Education, 61, 317-333.
19. Huberty, CJ, and JD Morris (1988). A single contrast test procedure. Educational and Psychological Measurement, 48, 567-578.
20. Hudson, WD (1969). The is/ought question. London: Macmillan.
21. Hume, D (1957). An inquiry concerning human understanding. New York: The Liberal Arts Press.
22. Knapp, TR (1978). Canonical correlation analysis: A general parametric significance testing system. Psychological Bulletin, 85, 410-416.
23. Kupfersmid, J (1988). Improving what is published: A model in search of an editor. American Psychologist, 43, 635-642.
24. Lindquist, EF (1953). Design and analysis of experiments in psychology and education. Boston: Houghton Mifflin.
25. Loftus, GR, and EF Loftus (1982). Essence of statistics. Monterey, CA: Brooks/Cole.
26. Meehl, PE (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834.
27. Melton, A (1962). Editorial. Journal of Experimental Psychology, 64, 553-557.
28. Morrison, DE and RE Henkel (Eds.) (1970). The significance test controversy. Chicago: Aldine.
29. Nunnally, J (1960). The place of statistics in psychology. Educational and Psychological Measurement, 20, 641-650.
30. Oakes, M (1986). Statistical inference: A commentary for the social and behavioral sciences. New York: Wiley.
31. Olejnik, SF (1984). Planning educational research: Determining the necessary sample size. Journal of Experimental Education, 53, 40-48.
32. Rosenthal, R (1979). The "file drawer problem" and tolerance for null results. Psychological Bulletin, 86, 638-641.
33. Rosenthal, R (1991). Effect sizes: Pearson's correlation, its display via the BESD, and alternative indices. American Psychologist, 46, 1086-1087.
34. Rosnow, RL, and R Rosenthal (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276-1284.
35. Rozeboom, WW (1960). The fallacy of the null hypothesis significance test. Psychological Bulletin, 57, 416-428.
36. Savage, RJ (1957). Nonparametric significance. Journal of the American Statistical Association, 52, 331-344.
37. Shaver, J (1985). Chance and nonsense. Phi Delta Kappan, 67(1), 57-60.
38. Shaver, J (1993). What statistical significance testing is, and what it is not. Journal of Experimental Education, 61(4), 293-316.
39. Snyder, P, and S Lawson (1993). Evaluating results using corrected and uncorrected effect size estimates. Journal of Experimental Education, 61(4), 334-349.
40. Strike, KA (1979). An epistemology of practical research. Educational Researcher, 8(1), 10-16.
41. Thompson, B (1987). [Review of Foundations of behavioral research (3rd ed.)]. Educational and Psychological Measurement, 47, 1175-1181.
42. Thompson, B (1988). [Review of Analyzing multivariate data]. Educational and Psychological Measurement, 48, 1129-1135.
43. Thompson, B (1989). Statistical significance, result importance, and result generalizability: Three noteworthy but somewhat different issues. Measurement and Evaluation in Counseling and Development, 22, 2-6.
44. Thompson, B (1991). A primer on the logic and use of canonical correlation analysis. Measurement and Evaluation in Counseling and Development, 24(2), 80-95.
45. Thompson, B (1992). Two and one-half decades of leadership in measurement and evaluation. Journal of Counseling and Development, 70, 434-438.
46. Thompson, B (1993). The use of statistical significance tests in research: Bootstrap and other alternatives. Journal of Experimental Education, 61(4), 361-377.
47. Thompson, B (1994a). The concept of statistical significance testing (An ERIC/AE Clearinghouse Digest #EDO-TM-94-l). Measurement Update, 4(1), 5-6. (ERIC Document Reproduction Service No. ED 366 654).
48. Thompson, B (1994b). The pivotal role of replication in psychological research: Empirically evaluating the replicability of sample results. Journal of Personality, 62(2), 157-176.
49. Tukey, JW (1991). The philosophy of multiple comparisons. Statistical Science, 6, 100-116.
50. Woolley, T W (1983). A comprehensive power-analytic investigation of research in medical education. Journal of Medical Education, 85, 710-715.
51. Yates, F (1951). The influence of Statistical methods for research workers on the development of the science of statistics. Journal of the American Statistical Association, 46, 19-34.