Confidence Intervals Make a Difference: Effects of Showing Confidence Intervals on Inferential Reasoning

Educational and Psychological Measurement

Volumn 72, Issue 6, 2012, Pages 1039-1052

  Hoekstra, Rink ^a   Johnson, Addie ^a   Kiers, Henk A L ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

confidence intervals; significance testing; statistical inference

Indexed keywords

EID: 84867683819     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164412450297     Document Type: Article

References (39)

1. Abelson R. P.What if there were no significance tests?. Harlow L. L.Mulaik S. A.Steiger J. H., ed. Mahwah, NJ: Erlbaum; 1997:117-141.
2. Publication manual of the American Psychological Association. 2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.Washington, DC: Author; 2001:.
3. Publication manual of the American Psychological Association. 2009). Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.Washington, DC: Author; 2009:.
4. Belia S.,Fidler F.,Williams J.,Cumming G.Researchers misunderstand confidence intervals and standard error bars.Psychological Methods. 2005;10:389-396.
5. Berkson J.Some difficulties of interpretation encountered in the application of the chi-square test.Journal of the American Statistical Association. 1938;33:526-536.
6. Boring E. G.Mathematical versus scientific significance.Psychological Bulletin. 1919;16:335-338.
7. Chow S. L.Statistical significance: Rationale, validity and utility. Thousand Oaks, CA: Sage; 1996:.
8. Chow S. L.A précis of "Statistical significance: Rationale, validity and utility.".Behavioral and Brain Sciences. 1998;21:169-194.
9. Cohen J.Statistical power analysis for the behavioral sciences. New York, NY: Academic Press; 1977:.
10. Cohen J.The earth is round (p < .05).American Psychologist. 1994;49:997-1003.
11. Cortina J. M.,Dunlap W. P.On the logic and purpose of significance testing.Psychological Methods. 1997;2:161-172.
12. CoulsonM.HealeyM.FidlerF.CummingG. (2010). Confidence intervals permit, but do not guarantee, better inference than statistical significance testing. Frontiers in Psychology, 1, 26. Retrieved from http://www.frontiersin.org/quantitative_psychology_and_measurement/10.3389/fpsyg.2010.00026/abstract.
13. Cumming G.Replication and p intervals: p values predict the future only vaguely, but confidence intervals do much better.Perspectives on Psychological Science. 2008;3:286-200.
14. Cumming G.,Fidler F.Confidence intervals: Better answers to better questions.Journal of Psychology. 2009;217:15-26.
15. Cumming G.,Fidler F.,Leonard M.,Kalinowski P.,Christiansen A.,Kleinig A.,. . Wilson S.Statistical reform in psychology: Is anything changing?.Psychological Science. 2007;18:230-232.
16. Cumming G.,Finch S.Inference by eye: Confidence intervals and how to read pictures of data.American Psychologist. 2005;60:170-180.
17. Cumming G.,Williams J.,Fidler F.Replication and researchers' understanding of confidence intervals and standard error bars.Understanding Statistics. 2004;3:299-311.
18. Dixon P.Why scientists value p values.Psychonomic Bulletin & Review. 1998;5:390-396.
19. Fidler F.,Loftus G. R.Why figures with error bars should replace p values: Some conceptual arguments and empirical demonstrations.Journal of Psychology. 2009;217:27-37.
20. Fidler F.,Thomason N.,Cumming G.,Finch S.,Leeman J.Editors can lead researchers to confidence intervals, but can't make them think: Statistical reform lessons from medicine.Psychological Science. 2004;12:119-126.
21. Gigerenzer G.Surrogates for theories.Theory & Psychology. 1998;8:195-204.
22. Harris R. J.Significance tests have their place.Psychological Science. 1997;8:8-11.
23. Hoekstra R.,Finch S.,Kiers H. A. L.,Johnson A.Probability as certainty: Dichotomous thinking and the misuse of.p Psychonomic Bulletin & Review. 2006;13:1033-1037.
24. Kline R. B.Beyond significance testing: Reforming data analysis methods in behavioural research. Washington, DC: American Psychological Association; 2004:.
25. Krantz D. H.The null hypothesis testing controversy in psychology.Journal of the American Statistical Association. 1999;44:1372-1381.
26. Kruschke J. K.What to believe: Bayesian methods for data analysis.Trends in Cognitive Sciences. 2010;14:293-300.
27. Lai J.,Fidler F.,Cumming G.Subjective p intervals: Researchers underestimate the variability of p values over replication.Methodology. :.
28. Meehl P. E.Theoretical risks and tabular asterisk: Sir Karl, Sir Ronald, and the slow progress of soft psychology.Journal of Consulting and Clinical Psychology. 1978;46:806-834.
29. Miller J.What is the probability of replicating a statistically significant effect?.Psychonomic Bulletin & Review. 2009;16:617-640.
30. Mulaik S.,Raju N.,Harshman R.What if there were no significance tests?. Harlow L. L.Mulaik S. A.Steiger J. H., ed. Mahwah, NJ: Erlbaum; 1997:65-115.
31. Nelson N.,Rosenthal R.,Rosnow R. L.Interpretation of significance levels and effect sizes by psychological researchers.American Psychologist. 1986;41:1299-1301.
32. Oakes M.Statistical inference: A commentary for the social and behavioural sciences. Chicester, England: John Wiley; 1986:.
33. Poitevineau J.,Lecoutre B.Interpretation of significance levels by psychological researchers: The .05 cliff effect may be overstated.Psychonomic Bulletin & Review. 2001;8:847-850.
34. Rosenthal R.,Gaito J.The interpretation of levels of significance by psychological researchers.Journal of Psychology. 1963;55:33-38.
35. Rouder J. N.,Morey R. D.Relational and arelational confidence intervals: A comment on Fidler, Thomason, Cumming, Finch, and Leeman (2004).Psychological Science. 2005;16:77-79.
36. Schmidt F. L.Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers.Psychological Methods. 1996;1:115-129.
37. Schmidt F. L.,Hunter J. E.What if there were no significance tests?. Harlow L. L.Mulaik S. A.Steiger J. H., ed. Mahwah, NJ: Erlbaum; 1997:37-64.
38. Tryon W. W.Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: An integrated alternative method of conducting null hypothesis statistical tests.Psychological Methods. 2001;6:371-386.
39. Wilkinson L.Statistical methods in psychology journals: Guidelines and explanations.American Psychologist. 1999;54:594-604.