An estimate of the science-wise false discovery rate and application to the top medical literature

Biostatistics

Volumn 15, Issue 1, 2014, Pages 1-12

  Jager, Leah R ^a   Leek, Jeffrey T ^b  

^a UNITED STATES NAVAL ACADEMY   (United States)

^b JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

Author keywords

False discovery rate; Genomics; Meta analysis; Multiple testing; Science wise false discovery rate; Two group model

Indexed keywords

ALGORITHM; ARTICLE; COMPUTER PROGRAM; COMPUTER SIMULATION; FALSE DISCOVERY RATE; GENOMICS; HUMAN; LABORATORY DIAGNOSIS; MEDICAL RESEARCH; META ANALYSIS; MULTIPLE TESTING; PUBLICATION; SCIENCE-WISE FALSE DISCOVERY RATE; STANDARD; STATISTICAL ANALYSIS; TWO-GROUP MODEL; UNITED KINGDOM; UNITED STATES;

FALSE DISCOVERY RATE; GENOMICS; META-ANALYSIS; MULTIPLE TESTING; SCIENCE-WISE FALSE DISCOVERY RATE; TWO-GROUP MODEL;

ALGORITHMS; BIOMEDICAL RESEARCH; COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; FALSE POSITIVE REACTIONS; GREAT BRITAIN; HUMANS; PUBLICATIONS; SOFTWARE; UNITED STATES;

EID: 84890457511     PISSN: 14654644     EISSN: 14684357     Source Type: Journal    
DOI: 10.1093/biostatistics/kxt007     Document Type: Article

References (31)

1. ALLISON, D. B., CUI, X., PAGE, G. P. AND SABRIPOUR, M. (2006). Microarray data analysis: from disarray to consolidation and consensus. Nature Reviews Genetics 7, 55-65. (Pubitemid 41828948)
2. ALLISON, D. B., GADBURY, G. L., HEO, M., FERNANDEZ, J. R., PROLLA, T. A. AND WEINDRUCH, R. (2002). A mixture model approach for the analysis of microarray gene expression data. Computational Statistics and Data Analysis 39, 1-20.
3. ALTMAN, D. G. (2002). Poor-quality medical research: what can journals do? Journal of the American Medical Association 287, 2765-2767. (Pubitemid 34591958)
4. ALTMAN, D. G. (2005). Why we need confidence intervals. World Journal of Surgery 29, 554-556. (Pubitemid 41187387)
5. ALTMAN, D. G. AND GARDNER, M. J. (1986). Confidence intervals rather than P-values: estimation rather than hypothesis testing. British Medical Journal 292, 746-750. (Pubitemid 16167414)
6. BHOPAL, R., RANKIN, J., MCCOLL, E., THOMAS, L., KANER, E., STACY, R., PEARSON, P., VERNON, B. AND RODGERS, H. (1997). The vexed question of authorship: views of researchers in a British medical faculty. British Medical Journal 314, 1009-1012. (Pubitemid 27149758)
7. CASELLA, G. AND BERGER, R. L. (2002). Statistical Inference, 2nd edition. Pacific Grove, CA: Duxbury.
8. DE LONG, J. B. AND LANG, K. (1989). Are all economic hypotheses false? Journal of Political Economy 100, 1257-1272.
9. DEMPSTER, A. P., LAIRD, N. M. AND RUBIN, D. B. (1977). Maximum likelihood from incomplete data via the EM Algorithm. Journal of the Royal Statistical Society, Series B 39, 1-38.
10. EASTERBROOK, P. J., BERLIN, J. A., GOPALAN, R. AND MATTHEWS, D. R. (1991). Publication bias in clinical research. Lancet 337, 867-872.
11. EFRON, B., TIBSHIRANI, R. (2002). Empirical bayes methods and false discovery rates for microarrays. Genetic Epidemiology 23, 70-86. (Pubitemid 34743158)
12. GENOVESE, C. R., LAZAR, N. A., NICHOLS, T. (2002). Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuro Image 15, 870-878. (Pubitemid 34852500)
13. GOODMAN, S. N. (1999). Toward evidence-based medical statistics. 1: the P value fallacy. Annals of Internal Medicine 130, 995-1004. (Pubitemid 29283991)
14. GOODMAN, S. AND GREENLAND, S. (2007). Why most published research findings are false: problems in the analysis. PLoS Medicine 4, e168.
15. IOANNIDIS, J. P. A. (2005). Why most published research findings are false. PLoS Medicine 2, e124.
16. KAPLAN, E. L. AND MEIER, P. (1958). Nonparametric estimation from incomplete observations. Journal of the American Statistical Association 53, 457-481.
17. KENDZIORSKI, C. M., NEWTON, M. A., LAN, H. AND GOULD, M. N. (2003). On parametric empirical Bayes methods for comparing multiple groups using replicated gene expression profiles. Statistics in Medicine 22, 3899-3914. (Pubitemid 38008708)
18. KLEINBAUM, D. G. AND KLEIN, M. (2005). Survival Analysis: A self learning text, 2nd edition. New York, NY: Springer.
19. LEEK, J. T. AND STOREY, J. D. (2008). A general framework for multiple testing dependence. Proceedings of the National Academy of Sciences of the United States of America 105, 18718-18723.
20. LEEK, J. T. AND STOREY, J. D. (2011). The joint null criterion for multiple hypothesis tests. Statistical Applications in Genetics and Molecular Biology 10, 28.
21. MACDONALD, P. D. M. AND PITCHER, T. J. (1979). Age-groups from size-frequency data: a versatile and efficient method of analysing distribution mixtures. Journal of Fisheries Research Board of Canada 36, 987-1001.
22. MCCULLOCH, C. E. AND SEARLE, S. R. (2001). Generalized, Linear, and Mixed Models, 1st edition. New York, NY: John Wiley and Sons.
23. NEWTON, M. A., KENDZIORSKI, C. M., RICHMOND, C. S., BLATTNER, F. R. AND TSUI, K. W. (2001). On differential variability of expression ratios: improving statistical inference about gene expression changes from microarray data. Journal of Computational Biology 8, 37-52. (Pubitemid 32679478)
24. PENG, R. D. (2012). Reproducible research in computational science. Proceedings of the National Academy of Sciences of the United States of America 334, 1226-1227.
25. POUNDS, S., MORRIS, S. W. (2003). Estimating the occurrence of false positives and false negatives in microarray studies by approximating and partitioning the empirical distribution of P-values. Bioinformatics 19, 1236-1242. (Pubitemid 36850216)
26. SIMMONS, J. P., NELSON, L. D. AND SIMONSOHN, U. (2011). False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science 22, 1359-1366.
27. STOREY, J. D. AND TIBSHIRANI, R. (2003). Statistical significance for genomewide studies. Proceedings of the National Academy of Sciences of the United States of America 100, 9440-9445. (Pubitemid 37033947)
28. TABARROK, A. (2005). Why most published research findings are false. Marginal Revolution. http://marginal revolution.com/marginalrevolution/2005/09/ why most publis.html.
29. VAN BELLE G., FISHER, L. D., HEAGERTY, P. J. AND LUMLEY, T. (2004). Biostatistics: A Methodology for the Health Sciences, 2nd edition. Hoboken, New Jersey: John Wiley and Sons.
30. VON ELM, E. AND EGGER, M. (2004). The scandal of poor epidemiological research. British Medical Journal 329, 868-869. (Pubitemid 39422927)
31. WENGRZIK, J. W. AND TIMM, J. (2011). Comparing several methods to fit finite mixture models to grouped data by the EM algorithm. Proceedings of the World Congress on Engineering 1, 1.