On the Reproducibility of Psychological Science

Journal of the American Statistical Association

Volumn 112, Issue 517, 2017, Pages 1-10

  Johnson, Valen E ^a   Payne, Richard D ^a   Wang, Tianying ^a   Asher, Alex ^a   Mandal, Soutrik ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Bayes factor; Null hypothesis significance test; Posterior model probability; Publication bias; Reproducibility; Significance test

Indexed keywords

EID: 85013253115     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.2016.1240079     Document Type: Article

References (24)

1. Begley, C. G., and Ellis, L. M., (2012), “Drug Development:Raise Standards for Preclinical Cancer Research,” Nature, 483, 531–533.
2. Berger, J. O., and Delampady, M. (1987), “Testing Precise Hypotheses,” Statistical Science, 2, 317--335.
3. Caraux, G., and Gascuel, O., (1992), “Bounds on Distributions Functions of Order Statistics for Dependent Variates,” Statistics & Probability Letters, 14, 103–105.
4. Fanelli, D., (2010), ‘“Positive’ Results Increase Down the Hierarchy of the Sciences,” PLoS One, 5, e10068. doi:10.1371/journal.pone.
5. Fisher, R. A., (1915), “Frequency Distribution of the Values of the Correlation Coefficient in Samples from an Indefinitely Large Population,” Biometrika, 10, 507–521.
6. Francis, G., (2013), “Replication, Statistical Consistency, and Publication Bias,” (with discussion), Journal of Mathematical Psychology, 57, 153–169.
7. Franco, A., Malhotra, N., and Simonovits, G., (2014), “Publication Bias in the Social Sciences:Unlocking the File Drawer,” Science, 345, 1502–1505.
8. Ioannidis, J. P., (2005), “Why Most Published Research Findings are False,” PLoS Medicine, 2, e124.
9. 2 Test for Goodness-of-Fit,” Annals of Statistics, 32, 2361–2384.
10. Johnson, V. E. (2007), “Bayesian Model Assessment using Pivotal Quantities,” Bayesian Analysis, 2, 719–733.
11. Johnson, V. E. (2013a), “Revised Standards for Statistical Evidence,” Proceedings of the National Academy of Sciences, 110, 19313–19317.
12. Johnson, V. E. (2013b), “Uniformly Most Powerful Bayesian Tests,” Annals of Statistics, 41, 1716--1741.
13. Johnson, V. E., and Rossell, D., (2010), “On the Use of Non-Local Prior Densities in Bayesian Hypothesis Tests,” Journal of the Royal Statistical Society, Series B, 72, 143–170.
14. Little, R. J., and Rubin, D. B., (2014), Statistical Analysis With Missing Data, New York:Wiley.
15. McNutt, M., (2014), “Reproducibility,” Science, 343, 229–229.
16. OSC (2015), “Estimating the Reproducibility of Psychological Science,” Science, 349, aac4716.
17. Pashler, H., and Wagenmakers, E.-J., (2012), “Editors’ Introduction to the Special Section on Replicability in Psychological Science a Crisis of Confidence?” Perspectives on Psychological Science, 7, 528–530.
18. Peplow, M., (2014), “Social Sciences Suffer from Severe Publication Bias,” Nature:News, doi:10.1038/nature.2014.15787.
19. Prinz, F., Schlange, T., and Asadullah, K., (2011), “Believe it or not:How Much can we Rely on Published Data on Potential Drug Targets?” Nature Reviews Drug Discovery, 10, 712–712.
20. Simmons, J., Nelson, L., and Simonsohn, U., (2011), “False-Positive Psychology:Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant,” Psychological Science, 22, 1359–1366.
21. Simonsohn, U., Nelson, L., and Simmons, J., (2014), “P-curve:A Key to the File Drawer,” Journal of Experimental Psychology:General, 143, 534–547.
22. Tanner, M. A., and Wong, W. H., (1987), “The Calculation of Posterior Distributions by Data Augmentation,” Journal of the American Statistical Association, 82, 528–540.
23. Wasserstein, R., and Lazar, N., (2016), “The ASA's Statement on P-Values:Context, Process, and Purpose,” The American Statistician, 70, 129--133.
24. Yuan, Y., and Johnson, V. E., (2011), “Goodness-of-Fit Diagnostics for Bayesian Hierarchical Models,” Biometrics, 68, 156–164.