The controversy of significance testing: Misconceptions and alternatives

American Journal of Critical Care

Volumn 8, Issue 5, 1999, Pages 291-296

  Glaser, Dale N ^a  

^a Pacific Science and Engineering Group   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EPIDEMIOLOGY; EQUIPMENT; HUMAN; METHODOLOGY; NURSING RESEARCH; REPRODUCIBILITY; REVIEW; STANDARD; STATISTICAL ANALYSIS;

BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; EFFECT MODIFIERS (EPIDEMIOLOGY); HUMANS; NURSING RESEARCH; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN;

EID: 0033192728     PISSN: 10623264     EISSN: None     Source Type: Journal    
DOI: 10.4037/ajcc1999.8.5.291     Document Type: Article

References (43)

1. Harlow LL. Significance testing introduction and overview. In: Harlow LL, Mulaik SA, Steiger JH, eds. What If There Were No Significance Tests? Mahwah, NJ: Lawrence Erlbaum; 1997:1-17.
2. Gigerenzer G. The superego, the ego, and the id in statistical reasoning. In: Keren G, Lewis C, eds. A Handbook for Data Analysis in the Behavioral Sciences. Hillsdale, NJ: Lawrence Erlbaum; 1993:311-339.
3. Huberty CJ. Historical origins of statistical testing practices: the treatment of Fisher versus Neyman-Pearson views in textbooks. J Exp Educ. 1993;61:317-333.
4. Cohen J. The earth is round (p <.05). Am Psychol. 1994;49:997-1003.
5. Kuhn TS. The Structure of Scientific Revolutions. 2nd ed. Chicago, Ill: University of Chicago Press; 1970.
6. Bakan D. The test of significance in psychological research. Psychol Bull. 1966;66:423-437.
7. Rozeboom WW. The fallacy of the null-hypothesis significance test. Psychol Bull. 1960;57:416-428.
8. Rozeboom WW. Good science is not abductive, but hypothetico-deductive. In: Harlow LL, Mulaik SA, Steiger JH, eds. What If There Were No Significance Tests? Mahwah, NJ: Lawrence Erlbaum; 1997:335-391.
9. Schmidt FL, Hunter JE. Eight common but false objections to the discontinuation of significance testing in the analysis of research data. In: Harlow LL, Mulaik SA, Steiger JH, eds. What If There Were No Significance Tests? Mahwah, NJ: Lawrence Erlbaum; 1997:37-64.
10. Schmidt FL. Statistical significance testing and cumulative knowledge in psychology: implications for training of researchers. Psychol Methods. 1996;1:115-129.
11. Cohen JC. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Lawrence Erlbaum; 1988.
12. Schmidt F. Board of scientific affairs action on significance testing. Ind Organ Psychol. 1996;33:110-111.
13. Task Force on Statistical Inference. Initial report - draft. Available at: http://www.apa.org/science/tfsi.html. Accessed January 10, 1997.
14. Harlow LL, Mulaik SA, Steiger JH, eds. What If There Were No Significance Tests? Mahwah, NJ: Lawrence Erlbaum; 1997.
15. Reichardt CS, Gollob HF. When confidence intervals should be used instead of statistical tests, and vice versa. In: Harlow LL, Mulaik SA, Steiger JH, eds. What If There Were No Significance Tests? Mahwah, NJ: Lawrence Erlbaum; 1997:259-284.
16. Pedhazur EJ, Schmelkin LP. Measurement, Design, and Analysis: An Integrated Approach. Hillsdale, NJ: Lawrence Erlbaum; 1991.
17. Thompson B. AERA editorial policies regarding statistical significance testing: three suggested reforms. Educ Res. 1996;25:26-30.
18. Moore DS. The Basic Practice of Statistics. New York, NY: WH Freeman & Co; 1995.
19. Bullock HE, Harlow LL, Mulaik SA. Causation issues in structural equation modeling research. Struct Equation Modeling. 1994;1:253-267.
20. Mulaik SA, Raju NS, Harshman RA. There is a time and place for significance testing. In: Harlow LL, Mulaik SA, Steiger JH, eds. What If There Were No Significance Tests? Mahwah, NJ: Lawrence Erlbaum; 1997:65-115.
21. Thompson B. The concept of statistical significance testing. Meas Update. 1994;4:5-6.
22. Stevens J. Applied Multivariate Statistics for the Social Sciences. 3rd ed. Mahwah, NJ: Lawrence Erlbaum; 1996.
23. Thompson B. Five methodology errors in educational research: the pantheon of statistical significance and other faux pas. Paper presented at: Annual Meeting of the American Educational Research Association; April 15, 1998; San Diego, Calif.
24. Keppel G. Design and Analysis: A Researcher's Handbook. 2nd ed. Englewood Cliffs, NJ: Prentice-Hall; 1982.
25. Sawyer AG, Ball AD. Statistical power and effect size in marketing research. J Mark Res. 1981;18:275-290.
26. Chow SL. Significance test or effect size? Psychol Bull. 1988;103:105-110.
27. Prentice DA, Miller DT. When small effects are impressive. Psychol Bull. 1992;112:160-164.
28. Kirk RE. Practical significance: a concept whose time has come. Educ Psychol Meas. 1996;56:746-759.
29. Erick RW. The appropriate use of null hypothesis testing. Psychol Methods. 1996;1:379-390.
30. Rosenthal R. The "file-drawer problem" and tolerance for null results. Psychol Bull. 1979;86:638-641.
31. Cronbach LJ, Snow RE. Aptitudes and Instructional Methods: A Handbook for Research on Interactions. New York, NY: Irvington; 1977.
32. Aron A, Aron EN. Statistics for Psychology. Upper Saddle River, NJ: Prentice-Hall; 1994.
33. Cohen J. Things I have learned (so far). Am Psychol. 1990;45:1304-1312.
34. Meehl PE. Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. J Consult Clin Psychol. 1978;46:806-834.
35. American Psychological Association. Publication Manual of the American Psychological Association. 4th ed. Washington, DC: American Psychological Association; 1994.
36. Thompson B. If statistical significance tests are broken/misused, what practices should supplement or replace them? Paper presented at: Annual Meeting of the American Psychological Association; August 17, 1997; San Diego, Calif.
37. Thompson B. AERA debate on use of statistical significance tests: comments for the royal rumble. Paper presented at: Annual Meeting of the American Educational Research Association; April 15, 1998; San Diego, Calif.
38. Murphy K. Editorial. J Appl Psychol. 1997;82:3-5.
39. Schmidt FL. What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. Am Psychol. 1992;47:1173-1181.
40. Glass GV, McGaw B, Smith ML. Meta-Analysis in Social Research. Beverly Hills, Calif: Sage; 1981.
41. Petitti DB. Meta-Analysis, Decision Analysis, and Cost-Effectiveness Analysis. New York, NY: Oxford University Press; 1994.
42. Shrout PE. Should significance tests be banned? Introduction to a special section exploring the pros and cons. Psychol Sci. 1997;8:1-2.
43. Chow SL. Statistical Significance: Rationale, Validity, and Utility. Thousand Oaks, Calif: Sage Publications Inc; 1996.