A Test by Any Other Name: P Values, Bayes Factors, and Statistical Inference

Multivariate Behavioral Research

Volumn 51, Issue 1, 2016, Pages 23-29

  Stern, Hal S ^a  

^a 5226 Donald Bren Hall   (United States)

Author keywords

Bayesian inference; confidence intervals; effect size; significance testing

Indexed keywords

ATTENTION; CONFIDENCE INTERVAL; HUMAN; NULL HYPOTHESIS; SCIENTIST; STATISTICAL SIGNIFICANCE; BAYES THEOREM; BEHAVIORAL RESEARCH; PROCEDURES; STATISTICAL ANALYSIS; STATISTICAL MODEL;

BAYES THEOREM; BEHAVIORAL RESEARCH; DATA INTERPRETATION, STATISTICAL; MODELS, STATISTICAL;

EID: 84958818750     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1080/00273171.2015.1099032     Document Type: Article

References (24)

1. D.J.Bem, (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100, 407–425. doi:10.1037/a0021524
2. J.Berkson, (1942). Tests of significance considered as evidence. Journal of the American Statistical Association, 37, 325–335. doi:10.1080/01621459
3. D.A.Berry, (2004). Bayesian statistics and the efficiency and ethics of clinical trials. Statistical Science, 19, 175–187. doi:10.1214/088342304000000044
4. B.P.Carlin,, & T.A.Louis, (2008). Bayesian methods for data analysis(3rd ed.). Boca Raton, FL: Chapman and Hall/CRC.
5. R.Christensen,, W.Johnson,, A.Branscum,, & T.E.Hanson, (2010). Bayesian ideas and data analysis. Boca Raton, FL: Chapman and Hall/CRC.
6. J.Cohen, (1994). The earth is round (p <.05). American Psychologist, 49, 997–1003. doi:10.1037/0003-066X.49.12.997
7. G.Cumming, (2011). Understanding the new statistics: Effect sizes, confidence intervals and meta-analysis. New York, NY: Routledge.
8. D.C.Funder,, J.M.Levine,, D.M.Mackie,, C.C.Morf,, C.Sansone,, S.Vazier,, & S.G.West, (2014). Improving the dependability of resaerch in personality and social psychology: Recommendations for research and educational practice. Personality and Social Psychology Review, 18, 3–12. doi:10.1177/1088868313507536.
9. A.Gelman,, J.B.Carlin,, H.S.Stern,, D.B.Dunson,, A.Vehtari,, & D.B.Rubin, (2013). Bayesian data analysis(3rd ed.). Boca Raton, FL: Chapman and Hall/CRC.
10. A.Gelman,, & H.Stern, (2006). The difference between “significant” and “not significant” is not itself statistically significant. The American Statistician, 60, 328–331. doi:10.1198/000313006X152649
11. S.N.Goodman, (1999). Toward evidence-based medical statistics. 1: The P value fallacy. Annals of Internal Medicine, 130, 995–1004. doi:10.7326/0003-4819-130-12-199906150-00008
12. H.Hoijtink,, P.van Kooten,, & K.Hulsker, (2016a). Why Bayesian psychologists should change the way they use the Bayes factor. Multivariate Behavioral Research, 51, 1–9. doi:10.1080/00273171.2014.969364.
13. H.Hoijtink,, P.van Kooten,, & K.Hulsker, (2016b). Bayes factors have frequency properties, this should not be ignored: A rejoinder to Morey, Wagenmakers, and Rouder. Multivariate Behavioral Research, 51, 18–21. doi:10.1080/00273171.2015.1071705.
14. R.E.Kass,, & A.E.Raftery, (1995). Bayes factors. Journal of the American Statistical Association, 90, 773–795. doi:10.1080/01621459.1995.10476572
15. R.B.Kline, (2013). Beyond significance testing: Statistics reform in the behavioral sciences(2nd ed.). Washington, DC: American Psychological Association.
16. J.T.Leek,, & R.D.Peng, (2015). Statistics: P values are just the tip of the iceberg. Nature, 520, 612. doi:10.1038/520612a
17. R.J.Little, (2006). Calibrated Bayes: A Bayes/frequentist roadmap. The American Statistician, 60, 213–223. doi:10.1198/000313006X117837
18. R.D.Morey,, E.-J.Wagenmakers,, & J.N.Rouder, (2016). Calibrated Bayes factors should not be used: A reply to Hoijtink, van Kooten, and Hulsker. Multivariate Behavioral Research, 51, 10–17. doi:10.1080/00273171.2015.1052710.
19. R.Rosenthal,, & D.B.Rubin, (1994). The counternull value of an effect size: A new statistic. Psychological Science, 5, 329–334. doi:10.1111/j.1467-9280.1994.tb00281.x
20. W.W.Rozeboom, (1960). The fallacy of the null hypothesis significance test. Psychological Bulletin, 57, 416–428. doi:10.1037/h0042040
21. D.B.Rubin, (1984). Bayesianly justfiable and relevant frequency calculations for the applied statistician. Annals of Statistics, 12, 1151–1172. doi:10.1214/aos/1176346785
22. J.P.Simmons,, L.D.Nelson,, & U.Simonsohn, (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366. doi:10.1177/0956797611417632
23. D.Tramifow,, & M.Marks, (2015). Editorial. Basic and Applied Social Psychology, 37, 1–2. doi:10.1080/01973533.2015.1012991
24. L.Wilkinson,, & the Task Force on Statistical Inference. (1999). Statistical methods in psychology: Guidelines and explanation. American Psychologist, 54, 594–604. doi:10.1037/0003-066X.54.8.594