Confidence intervals and replication: Where will the next mean fall?

Psychological Methods

Volumn 11, Issue 3, 2006, Pages 217-227

  Cumming, Geoff ^a   Maillardet, Robert ^b  

^a LA TROBE UNIVERSITY   (Australia)

^b UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Average probability of replication; Confidence interval misconceptions; Future replication means; Interpretation of confidence intervals; Replicability of results; Statistical means

Indexed keywords

ARTICLE; CONFIDENCE INTERVAL; HUMAN; METHODOLOGY; PSYCHOLOGICAL MODEL; PSYCHOLOGY; STATISTICS;

CONFIDENCE INTERVALS; HUMANS; MODELS, PSYCHOLOGICAL; PSYCHOLOGY;

EID: 33748773893     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.11.3.217     Document Type: Article

References (26)

1. American Psychological Association. (2001). Publication Manual of the American Psychological Association (5th ed.). Washington. DC: Author.
2. Belia, S., Fidler, F., Williams, J., & Gumming, G. (2005). Researchers misunderstand confidence intervals and other error bars. Psychological Methods, 10, 389-396.
3. Carver, R. P. (1978). The case against statistical significance testing. Harvard Educational Review, 48, 378-399.
4. Cleveland, W. S. (1994). The elements of graphing data. Summit, N.T: Hobart Press.
5. Gumming, G. (2005). Understanding the average probability of replication: Comment on Killeen (2005). Psychological Science, 16, 1002-1004.
6. Cumming, G., & Finch, S. (2001). A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement, 61, 530-572.
7. Cumming, G., & Finch, S. (2005). Inference by eye: Confidence intervals and how to read pictures of data. American Psychologist, 60, 170-180.
8. Cumming, G., Williams. J., & Fidler, F. (2004). Replication and researchers' understanding of confidence intervals and standard error bars. Understanding Statistics, 3, 299-311.
9. Doros, G., & Geier, A. B. (2005). Probability of replication revisited: Comment on "An alternative to null-hypothesis significance tests." Psychological Science, 16, 1005-1006.
10. Estes, W. K. (1997). On the communication of information by displays of standard errors and confidence intervals. Psychonomic Bulletin & Review, 4, 330-341.
11. Fisher, R. A. (1966). The design of experiments (8th ed.). Edinburgh, Uni Led Kingdom: Oliver & Boyd.
12. Froman, T., & Shneyderman, A. (2004). Replicability reconsidered: An excessive range of possibilities. Understanding Statistics, 3, 365-373.
13. Killeen, P. R. (2005a). An alternative to null hypothesis significance tests. Psychological Science, 16, 345-353.
14. Killeen, P. R. (2005b). Replicability, confidence, and priors. Psychological Science, 16, 1009-1012.
15. Killeen, P. R. (in press). Beyond statistical inference: A decision theory for science. Psychonomic Bulletin & Review.
16. Kline, R. B. (2004). Beyond significance testing. Reforming data analysis methods in behavioral research. Washington, DC: American Psychological Association.
17. Macdonald, R. R. (2005). Why replication probabilities depend on prior probability distributions: A rejoinder to Killeen (2005). Psychological Science, 16, 1007-1008.
18. Newcombe, R. G. (1998). Two-sided confidence intervals for the single proportion: Comparison of seven methods. Statistics in Medicine, 17, 857-872.
19. Newcombe, R. G., & Altman, D. G. (2000). Proportions and their differences. In D. G. Altman, I). Machin, T. N. Bryant, & M. J. Gardner (Eds.), Statistics with confidence: Confidence intervals and statistical guidelines (2nd ed., pp. 45-56). London: British Medical. Journal Books.
20. Sohn, D. (1998). Statistical significance and replicability. Why the former does not presage the latter. Theory & Psychology, 8, 291-311.
21. Tukey, J. W. (1969). Analyzing data: Sanctification or detective work? American Psychologist, 24, 83-91.
22. Tukey, J. W., & McLaughlin, D. H. (1963). Less vulnerable confidence and significance procedures for location based on a single sample: Trimming/Winsorization 1. Sankhya A, 25, 331-352.
23. Wichman, B. A., & Hill, J. D. (1982). Algorithm AS183: An efficient, and portable pseudo-random number generator. Applied Statistics, 31, 188-190.
24. Wichman, B. A., & Hill, J. D. (1987, March). Building a random-number generator. BYTE, pp. 127-128.
25. Wilcox, R. R. (2003). Applying contemporary statistical techniques. San Diego. CA: Academic Press.
26. Wilson, E. B. (1927). Probable inference, the law of succession, and statistical inference. Journal of the American Statistical Association, 22, 209-212.