Why figures with error bars should replace p values some conceptual arguments and empirical demonstrations

Journal of Psychology

Volumn 217, Issue 1, 2009, Pages 27-37

  Fidler, Fiona ^a   Loftus, Geoffrey R ^b  

^a LA TROBE UNIVERSITY   (Australia)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Confidence intervals; Error bars; Figures; P values; Statistical reform; Statistical thinking

Indexed keywords

EID: 67649515771     PISSN: 00443409     EISSN: None     Source Type: Journal    
DOI: 10.1027/0044-3409.217.1.27     Document Type: Article

References (32)

1. Abelson, R. P. (1997). On the surprising longevity of flogged horses: Why there is a case for the significance test. Psychological Science, 8, 12-15.
2. Altman, D. G., and Bland, M. (1995). Absence of evidence is not evidence of absence. British Medical Journal, 311, 485.
3. Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423-437.
4. Carver, R. P. (1978). The case against statistical significance testing. Harvard Educational Review, 48, 378-399.
5. Cohen, J. (1962). The statistical power of abnormal - social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-153.
6. Cumming, G., Fidler, F., Leonard, M., Kalinowski, P., Christiansen, A., Kleinig, A. et al. (2007). Statistical reform in psychology: Is anything changing? Psychological Science, 18, 230-232.
7. Cumming G., and Finch S. (2001). A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement, 61, 532-574.
8. Cumming G., and Finch S. (2005). Inference by eye: Confidence intervals, and how to read pictures of data. American Psychologist, 60, 170-180.
9. Falk, R., and Greenbaum, C. W. (1995). Significance tests die hard: The amazing persistence of a probabilistic misconception. Theory and Psychology, 5, 75-98.
10. Finch, S., Cumming, G., and Thomason, N. (2001). Reporting of statistical inference in the Journal of Applied Psychology: Little evidence of reform. Educational and Psychological Measurement, 61, 181-210.
11. Fidler, F., Burgman, M., Cumming, G. Buttrose, R. and Thomason, N. (2006). Impact of criticism of null hypothesis significance testing on statistical reporting practices in conservation biology. Conservation Biology, 20, 1539-1544.
12. Fidler, F., Cumming, G., Thomason, N., Pannuzzo, D., Smith, J., Fyffe, P. et al. (2005). Toward improved statistical reporting in the Journal of Consulting and Clinical Psychology. Journal of Consulting and Clinical Psychology, 73, 136-143.
13. Greenwald, A. G., Gonzalez, R., Harris, R. J., and Guthrie, D. (1996). Effect Sizes and p-values: What should be reported and what should be replicated? Psychophysiology, 33, 175-183.
14. Haller, H., and Krauss, S. (2002). Misinterpretations of significance: A problem students share with their teachers? Methods of Psychological Research, 7, 1-20.
15. Hoenig J. M., and Heisey D. M. (2001). The abuse of power: The pervasive fallacy of power calculations for data analysis. The American Statistician, 55, 19-24.
16. Kline, R. B. (2004). Beyond significance testing: Reforming dataanalysis methods in behavioral research. Washington DC: American Psychological Association.
17. Lecoutre M.-P., Poitevineau J., and Lecoutre B. (2003). Even statisticians are not immune to misinterpretations of null hypothesis significance tests. International Journal of Psychology, 38, 37-45.
18. Loftus, G. R. (1991). On the tyranny of hypothesis testing in the social sciences. Contemporary Psychology. 36, 102-105.
19. Loftus, G. R. (1996). Psychology will be a much better science when we change the way we analyze data. Current Directions in Psychological Science, 161-171.
20. Loftus, G. R., and Masson, M. E. J. (1994) Using confidence intervals in within-subjects designs. Psychonomic Bulletin and Review, 1, 476-490.
21. Lykken, D. T. (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 131-139.
22. Meehl, P. E. (1967). Theory testing in psychology and physics: A methodological paradox. Philosophy of Science, 34, 103-115.
23. Meehl, P. E. (1990). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, Monograph Supplement 1-V66.
24. Newcombe, R. G., and Altman, D. G. (2000) Proportions and their differences. In D. G. Altman, D. Machin, T. N. Bryant, and M. J. Gardner (Eds.) Statistics with confidence (pp. 39-50). London: BMJ Books.
25. Oakes, M. W. (1986). Statistical inference: A commentary for the social and behavioural sciences. Chichester: Wiley.
26. Rosenthal, R., and Gaito, J. (1963). The interpretation of levels of significance by psychological researchers. Journal of Psychology, 55, 33-38.
27. Rosenthal, R., and Rubin, D. B. (1985). Statistical analysis: Summarizing evidence versus establishing facts. Psychological Bulletin, 97, 527-529.
28. Rossi, J. (1990). Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting and Clinical Psychology, 58, 646-656.
29. Rozeboom, W. W. (1960). The fallacy of the null-hypothesis significance test. Psychological Bulletin, 57, 416-428.
30. Schmidt, F. L. (1994). Data analysis methods and cumulative knowledge in Psychology: Implications for the training of researchers. APA (Division 5) Presidential Address.
31. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, 115-129.
32. Sedlmeier, P., and Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-315.