The distribution of P-values in medical research articles suggested selective reporting associated with statistical significance

Journal of Clinical Epidemiology

Volumn 87, Issue , 2017, Pages 70-77

  Perneger, Thomas V ^a   Combescure, Christophe ^a  

^a GENEVA UNIVERSITY HOSPITALS   (Switzerland)

Author keywords

P values; Practice of research; Publication bias; Statistical tests

Indexed keywords

ALTERNATIVE HYPOTHESIS; ARTICLE; CROSS-SECTIONAL STUDY; HUMAN; MEDICAL LITERATURE; MEDICAL RESEARCH; NULL HYPOTHESIS; OBSERVATIONAL STUDY; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL (TOPIC); STATISTICAL SIGNIFICANCE; SYSTEMATIC ERROR; PROCEDURES; PUBLICATION; PUBLISHING; STATISTICS; STATISTICS AND NUMERICAL DATA;

BIOMEDICAL RESEARCH; CROSS-SECTIONAL STUDIES; HUMANS; PERIODICALS AS TOPIC; PUBLICATION BIAS; STATISTICS AS TOPIC;

EID: 85019054912     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2017.04.003     Document Type: Article

References (25)

1. Chavalarias, D., Wallach, J.D., Li, A.H.T., Ioannidis, J.P.A., Evolution of reporting of P values in the biomedical literature, 1990-2015. JAMA 315 (2016), 1141–1148.
2. Sterling, T.D., Publication decisions and their possible effects on inferences drawn from tests of significance—or vice-versa. J Am Stat Assoc 54 (1959), 30–34.
3. Head, M.L., Holman, L., Kahn, A.T., Jennions, M.D., The extent and consequences of P-hacking in science. PLoS Biol, 13, 2015, e1002106.
4. Begg, C.B., Berlin, J.A., Publication bias: a problem in interpreting medical data. J Am Stat Assoc 61 (1988), 419–445.
5. Gøtzsche, P., Believability of relative risks and odds ratios in abstracts: cross sectional study. BMJ 333 (2006), 231–234.
6. Masicampo, E.J., Lalande, D.R., A peculiar prevalence of p values just below.05. Q J Exp Psychol 65 (2012), 2271–2279.
7. Ginsel, B., Aggrawal, A., Xuan, W., Harris, I., The distribution of probability values in medical abstracts: an observational study. BMC Res Notes, 8, 2015, 721.
8. Jager, L.R., Leek, J.T., An estimate of the science-wise false discovery rate and application to the top medical literature. Biostatistics 15 (2014), 1–12.
9. Benjamini, Y., Hechtlinger, Y., Discussion: an estimate of the science-wise false discovery rate and application to the top medical literature by Jager and Leek. Biostatistics 15 (2014), 13–16.
10. Gelman, A., O'Rourke, K., Discussion: difficulties in making inferences about scientific truth from distributions of published p-values. Biostatistics 15 (2014), 18–23.
11. Goodman, S.N., Discussion: an estimate of the science-wise false discovery rate and application to the top medical literature. Biostatistics 15 (2014), 23–27.
12. Ioannidis, J.P.A., Discussion: why “An estimate of the science-wise false discovery rate and application to the top medical literature” is false. Biostatistics 15 (2014), 28–36.
13. Goodman, S.N., Toward evidence-based medical statistics. 1: the p value fallacy. Ann Intern Med 130 (1999), 995–1004.
14. Wasserstein, R.L., Lazar, N.A., The ASA's statement on p-values: context, process, and purpose. Am Stat 70 (2016), 129–131.
15. Murdoch, D.J., Tsai, Y.L., Adcock, J., P-values are random variables. Am Stat 62 (2008), 242–245.
16. Pounds, S., Morris, S.W., Estimating the occurrence of false positives and false negatives in microarray studies by approximating and partitioning the empirical distribution of p-values. Bioinformatics 19 (2003), 1236–1242.
17. Bland, M., Do baseline P-values follow a uniform distribution in randomised trials?. PLoS One, 8, 2013, e76010.
18. Hung, H.M.J., O'Neill, R.T., Bauer, P., Köhne, K., The behavior of the p-value when the alternative hypothesis is true. Biometrics 53 (1997), 11–22.
19. Selke, T., Bayarri, M.J., Berger, J.O., Calibration of p values for testing precise null hypotheses. Am Stat 55 (2001), 62–71.
20. Jannot, A.S., Ehret, G., Perneger, T., P<5×10-8 has emerged as a standard of statistical significance for genome-wide association studies. J Clin Epidemiol 68 (2015), 460–465.
21. Easterbrook, P.J., Berlin, J.A., Gopalan, R., Matthews, D.R., Publication bias in clinical research. Lancet 337 (1991), 867–872.
22. Dickersin, K., Min, Y., Meinert, C.L., Factors affecting publication of research results—follow-up of applications submitted to two Institutional Review Boards. JAMA 267 (1992), 374–378.
23. Goodman, S.N., Toward evidence-based medical statistics. 2: the Bayes factor. Ann Intern Med 130 (1999), 1005–1013.
24. Hopper, R., The Bayesian interpretation of a P-value depends only weakly on statistical power in realistic situations. J Clin Epidemiol 62 (2009), 1242–1247.
25. Feinstein, A.R., P-values and confidence intervals: two sides of the same unsatisfactory coin. J Clin Epidemiol 51 (1998), 355–360.