Researchers misunderstand confidence intervals and standard error bars

Psychological Methods

Volumn 10, Issue 4, 2005, Pages 389-396

  Bella, Sarah ^a   Fidler, Fiona ^a   Williams, Jennifer ^a   Cumming, Geoff ^a  

^a LA TROBE UNIVERSITY   (Australia)

Author keywords

Confidence intervals; Error bars; Standard error; Statistical cognition; Statistical reform

Indexed keywords

ARTICLE; CONFIDENCE INTERVAL; HUMAN; RESEARCH; STATISTICAL ANALYSIS; STATISTICS;

CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; HUMANS; RESEARCH;

EID: 30544447613     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.10.4.389     Document Type: Article

References (25)

1. Altman, D. G., Machin, D., Bryant, T. N., & Gardner, M. J. (2000). Statistics with confidence: Confidence intervals and statistical guidelines (2nd ed.). London: British Medical Journal Books.
2. American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
3. Cohen, J. (1990). Things I have learned so far. American Psychologist, 45, 1304-1312.
4. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003.
5. Cumming, G., & Finch, S. (2001). A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement, 61, 530-572.
6. Cumming, G., & Finch, S. (2005). Inference by eye: Confidence intervals and how to read pictures of data. American Psychologist, 60, 170-180.
7. Cumming, G., Williams, J, & Fidler, F. (2004). Replication, and researchers' understanding of confidence intervals and standard error bars. Understanding Statistics, 3, 299-311.
8. Fidler, F., Thomason, N., Cumming, G., Finch, S., & Leeman, J. (2004). Editors can lead researchers to confidence intervals, but can't make them think: Statistical reform lessons from medicine. Psychological Science, 15, 119-126.
9. Finch, S., Cumming, G., & Thomason, N. (2001). Reporting of statistical inference in the Journal of Applied Psychology: Little evidence of reform. Educational and Psychological Measurement, 61, 181-210.
10. Finch, S., Thomason, N., & Cumming, G. (2002). Past and future American Psychological Association guidelines for statistical practice. Theory and Psychology, 12, 825-853.
11. Grissom, R. J., & Kim, J. J. (2005). Effect sizes for research: A broad practical approach. Mahwah, NJ: Erlbaum.
12. Harlow, L. L., Mulaik, S. A., & Steiger, J. H. (Eds.). (1997). What if there were no significance tests? Mahwah, NJ: Erlbaum.
13. Kline, R. B. (2004). Beyond significance testing. Reforming data analysis methods in behavioral research. Washington, DC: American Psychological Association.
14. Masson, M. E. J., & Loftus, G. R. (2003). Using confidence intervals for graphically based data interpretation. Canadian Journal of Experimental Psychology, 57, 203-220.
15. Nickerson, R. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5, 241-301.
16. Oakes, M. (1986). Statistical inference: A commentary for the social and behavioural sciences. Chichester, England: Wiley.
17. Payton, M. E., Greenstone, M. H., & Schenker, N. (2003). Over-lapping confidence intervals or standard error intervals: What do they mean in terms of statistical significance? Journal of Insect Science, 3, Article 34. Retrieved May 16, 2005, from www.insectscience.org/3.34
18. Schenker, N., & Gentleman, J. F. (2001). On judging the significance of differences by examining the overlap between confidence intervals. The American Statistician, 55, 182-186.
19. Schmidt, F. L. (1992). What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. American Psychologist, 47, 1173-1181.
20. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, 115-129.
21. Smithson, M. (2002). Confidence intervals. Thousand Oaks, CA: Sage.
22. Thompson, B. (1996). AERA editorial policies regarding statistical significance testing: Three suggested reforms. Educational Researcher, 25, 26-30.
23. Thompson, B. (1999). Why "encouraging" effect size reporting is not working: The etiology of researcher resistance to changing practices. Journal of Psychology, 133, 133-140.
24. Wilkinson, L., & the Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
25. Wolfe, R., & Hanley, J. (2002). If we're so different why do we keep overlapping? When 1 plus 1 doesn't make 2. Canadian Medical Association Journal, 166, 65-66.