The insignificance of “significance” tests: Three recommendations for health education researchers

American Journal of Health Education

Volumn 36, Issue 2, 2005, Pages 109-112

  Buhi, Eric R ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33645404773     PISSN: 19325037     EISSN: 21683751     Source Type: Journal    
DOI: 10.1080/19325037.2005.10608167     Document Type: Article

References (30)

1. Merrill RM, Stoddard J, Shields EC. The use of statistics in the American Journal of Health Education from 1994 through 2003: A content analysis. Amer J Health Educ. 2004; 35: 290-297.
2. Basch CE, Gold RS. The dubious effects of type V errors in hypothesis testing on health education practice and theory. Health Educ Res. 1986; 1: 299-305.
3. Buhi ER. Reliability reporting practices in rape myth research. J Sch Health. In press.
4. Wang MQ. Research notes: Analysis of data from complex survey designs. Am J Health Behav. 2001; 25: 72-74.
5. Peng CJ, Manz BD, Keck J. Modeling categorical variables by logistic regression. Am J Health Behav. 2001; 25: 278-284.
6. Drane JW, Valois RF. Risk behavior data analysis: Ordinal or dichotomous the choice is yours. Am J Health Behav. 2002; 26: 465-472.
7. Anderson DR, Burnham KP, Thompson WL. Null hypothesis testing: Problems, prevalence, and an alternative. J Wildl Manage. 2000; 64: 912-923.
8. Fidler F, Cumming G, Burgman M, Thomason N. Statistical reform in medicine, psychology, and ecology. Journal of Socio-Economics. 2004; 33: 615-630.
9. Nickerson RS. Null hypothesis significance testing: A review of an old and continuing controversy. Psychol Methods. 2000; 5: 241-301.
10. Harlow LL, Mulaik SA, Steiger JH, eds. What If There Were No Significance Tests? Mahwah, NJ: Lawrence Erlbaum; 1997.
11. Kline RB. Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research. Washington, DC: American Psychological Association; 2004.
12. Morrison DE, Henkel RE, eds. The Significance Test Controversy: A Reader. Chicago: Aldine Publishing; 1970.
13. Vacha-Haase T. Statistical significance should not be considered one of life’s guarantees: Effect sizes are needed. Educ Psychol Meas. 2001; 61: 219-224.
14. Carver RP. The case against statistical significance testing. Harv Educ Rev. 1978; 48: 378-399.
15. Carver RP. The case against statistical significance testing, revisited. Journal of Experimental Education. 1993; 61: 287-292.
16. Cohen J. The Earth is round (p <.05). Am Psychol. 1994; 49: 997-1003.
17. Thompson B. Five methodology errors in educational research: The pantheon of statistical significance and other faux pas. Invited address at the annual meeting of the American Educational Research Association. April 15, 1998; San Diego, Ca. ERIC# ED 419 023.
18. Thompson B. If statistical significance tests are broken/misused, what practices should supplement or replace them? Theory Psychol. 1999; 9: 165-181.
19. Thompson B. The “significance” crisis in psychology and education. Journal of Socio-Economics. 2004; 33: 607-613.
20. Kirk RE. Practical significance: A concept whose time has come. Educ Psychol Meas.1996; 56: 746-759.
21. Cortina JM, Dunlap WP. On the logic and purpose of significance testing. Psychol Methods. 1997; 2: 161-172.
22. Hagen RL. In praise of the null hypothesis statistical test. Am Psychol. 1998; 52: 15-24.
23. Thompson B. In praise of brilliance: Where that praise really belongs. Am Psychol. 1998; 53: 799-800.
24. Tukey JW. The philosophy of multiple comparisons. Stat Sci. 1991; 25: 26-30.
25. Rosnow RL, Rosenthal R. Statistical procedures and the justification of knowledge in psychological science. Am Psychol. 1989; 44: 1276-1284.
26. Shaver JP. Chance and nonsense. Phi Delta Kappan. 1985; 67: 57-60.
27. Snyder P, Lawson S. Evaluating results using corrected and uncorrected effect size estimates. Journal of Experimental Education. 1993; 61: 334-349.
28. Thompson B. What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher. 2002; 31: 24-31.
29. Thompson B. Research synthesis: Effect sizes. In Green J, Camilli G, Elmore PB, eds. Complementary Methods for Research in Education. Washington, DC: American Educational Research Association. In press.
30. Thompson B. The use of statistical significance tests in research: Bootstrap and other alternatives. Journal of Experimental Education. 1993; 61: 361-377.