Inference by eye confidence intervals and how to read pictures of data

American Psychologist

Volumn 60, Issue 2, 2005, Pages 170-180

  Cumming, Geoff ^a   Finch, Sue ^a,b  

^a LA TROBE UNIVERSITY   (Australia)

^b UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

CONFIDENCE INTERVAL; HUMAN; REVIEW;

CONFIDENCE INTERVALS; HUMANS;

EID: 14844300794     PISSN: 0003066X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0003-066X.60.2.170     Document Type: Review

References (50)

1. Altman, D. G., Machin, D., Bryant, T. N., & Gardner, M. J. (2000). Statistics with confidence: Confidence intervals and statistical guidelines (2nd ed.). London: British Medical Journal Books.
2. American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
3. Belia, S., Fidler, F., Williams, J., & Cumming, G. (2004). Researchers misunderstand confidence intervals and standard error bars. Manuscript submitted for publication.
4. Bird, K. D. (2002). Confidence intervals for effect sizes in analysis of variance. Educational and Psychological Measurement, 62, 197-226.
5. Cleveland, W. S. (1994). The elements of graphing data. Summit, NJ: Hobart Press.
6. Cohen, J. (1994). The earth is round (p < 05). American Psychologist, 49, 997-1003.
7. Cohen, J. (1995). The earth is round (p <.05): Rejoinder. American Psychologist, 50, 1103.
8. Cumming, G. (2004). Inference by eye: Confidence intervals, p values, and overlap. Manuscript in progress.
9. Cumming, G., & Finch, S. (2001). A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement, 61, 530-572.
10. Cumming, G., Williams, J., & Fidler, F. (2004). Replication, and researchers' understanding of confidence intervals and standard error bars. Understanding Statistics, 3, 299-311.
11. Edgington, E. S. (1995). Randomization tests (3rd ed.). New York: Dekker.
12. Estes, W. K. (1997). On the communication of information by displays of standard errors and confidence intervals. Psychonomic Bulletin & Review, 4, 330-341.
13. Fidler, F. (2002). The fifth edition of the APA Publication Manual: Why its statistics recommendations are so controversial. Educational and Psychological Measurement, 62, 749-770.
14. Fidler, F., & Thompson, B. (2001). Computing correct confidence intervals for ANOVA fixed- and random-effects effect sizes. Educational and Psychological Measurement, 61, 575-604.
15. Finch, S., Cumming, G., Williams, J., Palmer, L., Griffith, E., Alders, C., et al. (2004). Reform of statistical inference in psychology: The case of Memory & Cognition. Behavior Research Methods, Instruments, & Computers, 36, 312-324.
16. Finch, S., Thomason, N., & Cumming, G. (2002). Past and future American Psychological Association guidelines for statistical practice. Theory and Psychology, 12, 825-853.
17. Gardner, M. J., & Altman, D. G. (1986). Confidence intervals rather than p values: Estimation rather than hypothesis testing. British Medical Journal, 292, 746-750.
18. Hays, W. L. (1973). Statistics for the social sciences (2nd ed.). New York: Holt, Rinehart & Winston.
19. Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage.
20. International Committee of Medical Journal Editors. (1997). Uniform requirements for manuscripts submitted to biomedical journals. Annals of Internal Medicine, 126, 36-47.
21. Kendall, P. C. (1999). Clinical significance. Journal of Consulting and Clinical Psychology, 67, 283-284.
22. Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746-759.
23. Kline, R. B. (2004). Beyond significance testing: Reforming data analysis methods in behavioral research. Washington, DC: American Psychological Association.
24. Krantz, D. H. (1999). The null hypothesis testing controversy in psychology. Journal of the American Statistical Association, 44, 1372-1381.
25. Light, R., Singer, J., & Willett, J. (1994). The visual presentation and interpretation of meta-analysis. In H. Cooper & L. Hedges (Eds.), The handbook of research synthesis (pp. 439-453). New York: Sage.
26. Loftus, G. R. (2002). Analysis, interpretation, and visual presentation of experimental data. In J. Wixted & H. Pashler (Eds.), Stevens' handbook of experimental psychology: Vol. 4. Methodology in experimental psychology (3rd ed., pp. 339-390). New York: Wiley.
27. Loftus, G. R., & Masson, M. (1994). Using confidence intervals in within-subject designs. Psychonomic Bulletin & Review, 1, 476-490.
28. Masson, M., & Loftus, G. R. (2003). Using confidence intervals for graphically based interpretation. Canadian Journal of Experimental Psychology, 57, 203-220.
29. McGill, R., Tukey, J. W., & Larsen, W. A. (1978). Variations of box plots. The American Statistician, 32, 12-16.
30. Nickerson, R. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5, 241-301.
31. Nicol, A. A. M., & Pexman, P. M. (2003). Displaying your findings: A practical guide for creating figures, posters, and presentations. Washington, DC: American Psychological Association.
32. Oakes, M. (1986). Statistical inference: A commentary for the social and behavioural sciences. Chichester, England: Wiley.
33. Rossi, J. S. (1997). A case study in the failure of psychology as a cumulative science: The spontaneous recovery of verbal learning. In L. L. Harlow, S. A. Muliak, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 175-197). Mahwah, NJ: Erlbaum.
34. Satterthwaite, F. E. (1946). An approximate distribution of estimates of variance components. Biometrics Bulletin, 2, 110-114.
35. Saville, D. J. (2003). Basic statistics and the inconsistency of multiple comparison procedures. Canadian Journal of Experimental Psychology, 57, 167-175.
36. Schenker, N., & Gentleman, J. F. (2001). On judging the significance of differences by examining the overlap between confidence intervals. The American Statistician, 55, 182-186.
37. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, 115-129.
38. Smithson, M. (2000). Statistics with confidence. London: Sage.
39. Smithson, M. (2001). Correct confidence intervals for various regression effect sizes and parameters: The importance of noncentral distributions in computing intervals. Educational and Psychological Measurement, 61, 605-632.
40. Smithson, M. (2002). Confidence intervals. Thousand Oaks, CA: Sage.
41. Steiger, J. H. (2004). Beyond the F test: Effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis. Psychological Methods, 9, 164-182.
42. Steiger, J. H., & Fouladi, T. (1997). Noncentrality interval estimation and the evaluation of statistical models. In L. Harlow, S. Muliak, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 221-257). Mahwah, NJ: Erlbaum.
43. Thompson, B. (2002). What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher, 31, 25-32.
44. Tryon, W. W. (2001). Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: An integrated alternative method of conducting null hypothesis statistical tests. Psychological Methods, 6, 371-386.
45. Vaux, D. L. (2004, April 22). Error message. Nature, 428, 799.
46. Welch, B. L. (1938). The significance of the difference between two means when the population variances are unequal. Biometrika, 29, 350-362.
47. Wilcox, R. R. (1998). How many discoveries have been lost by ignoring modern statistical methods? American Psychologist, 53, 300-314.
48. Wilcox, R. R. (2003). Applying contemporary statistical techniques. New York: Academic Press.
49. Wilkinson, L., & Task Force on Statistical Inference, American Psychological Association. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
50. Wolfe, R., & Hanley, J. (2002). If we're so different why do we keep overlapping? When 1 plus 1 doesn't make 2. Canadian Medical Association Journal, 166, 65-66.