The false-positive to false-negative ratio in epidemiologic studies

Epidemiology

Volumn 22, Issue 4, 2011, Pages 450-456

  Ioannidis, John P A ^a   Tarone, Robert ^b   McLaughlin, Joseph K ^a  

^a STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b INTERNATIONAL EPIDEMIOLOGY INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACUTE CORONARY SYNDROME; ARTICLE; ASTHMA; CORONARY ARTERY DISEASE; FALSE NEGATIVE RESULT; FALSE POSITIVE RESULT; GENE LOCUS; GENETIC ANALYSIS; GENETIC ASSOCIATION; GENETIC EPIDEMIOLOGY; GENETICS; GENOME; HUMAN; MAJOR DEPRESSION; OBESITY; OSTEOPOROSIS; PRIORITY JOURNAL; SMOKING;

DATA INTERPRETATION, STATISTICAL; EPIDEMIOLOGIC RESEARCH DESIGN; FALSE NEGATIVE REACTIONS; FALSE POSITIVE REACTIONS; GENOME-WIDE ASSOCIATION STUDY; HUMANS; MOLECULAR EPIDEMIOLOGY;

EID: 80051552041     PISSN: 10443983     EISSN: 15315487     Source Type: Journal    
DOI: 10.1097/EDE.0b013e31821b506e     Document Type: Article

References (66)

1. Boffetta P, McLaughlin JK, La Vecchia C, Tarone RE, Lipworth L, Blot WJ. False-positive results in cancer epidemiology: a plea for epistemological modesty. J Natl Cancer Inst. 2008;100:988-995. (Pubitemid 352019795)
2. Ioannidis JP. Why most published research findings are false. PLoS Med. 2005;2:e124.
3. Blair A, Saracci R, Vineis P, et al. Epidemiology, public health, and the rhetoric of false positives. Environ Health Perspect. 2009;117:1809-1813.
4. Spiegelhalter DJ, Abrams KR, Myles JP. Bayesian Approaches to Clinical Trials and Health-Care Evaluation. Chichester: Wiley; 2004.
5. Wacholder S, Chanock S, Garcia-Closas M, El ghormli L, Rothman N. Assessing the probability that a positive report is false: an approach for molecular epidemiology. J Natl Cancer Inst. 2004;96:434-442. (Pubitemid 38443646)
6. Ioannidis JP, Trikalinos TA. Early extreme contradictory estimates may appear in published research: the Proteus phenomenon in molecular genetics research and randomized trials. J Clin Epidemiol. 2005;58:543-549. (Pubitemid 40692719)
7. Davey Smith G, Ebrahim S. Data dredging, bias, or confounding. BMJ. 2002;325:1437-1438. (Pubitemid 36026785)
8. Colhoun HM, McKeigue PM, Davey Smith G. Problems of reporting genetic associations with complex outcomes. Lancet. 2003;361:865-872. (Pubitemid 36331853)
9. Hirschhorn JN, Lohmueller K, Byrne E, Hirschhorn K. A comprehensive review of genetic association studies. Genet Med. 2002;4:45-61. (Pubitemid 44698579)
10. Lohmueller KE, Pearce CL, Pike M, Lander ES, Hirschhorn JN. Meta-analysis of genetic association studies supports a contribution of common variants to susceptibility to common disease. Nat Genet. 2003;33:177-182. (Pubitemid 36177070)
11. Kraft P, Zeggini E, Ioannidis JP. Replication in genome-wide association studies. Stat Sci. 2009;24:561-573.
12. Hirschhorn JN. Genomewide association studies-illuminating biologic pathways. N Engl J Med. 2009;360:1699-1701.
13. Chanock S. High marks for GWAS. Nat Genet. 2009;41:765-766.
14. Ioannidis JP, Thomas G, Daly MJ. Validating, augmenting and refining genome-wide association signals. Nat Rev Genet. 2009;10:318-329.
15. Bosker FJ, Hartman CA, Nolte IM, et al. Poor replication of candidate genes for major depressive disorder using genome-wide association data. Mol Psychiatry. In press.
16. Caporaso N, Gu F, Chatterjee N, et al. Genome-wide and candidate gene association study of cigarette smoking behaviors. PLoS One. 2009;4: e4653.
17. Morgan TM, Krumholz HM, Lifton RP, Spertus JA. Nonvalidation of reported genetic risk factors for acute coronary syndrome in a large-scale replication study. JAMA. 2007;297:1551-1561. (Pubitemid 46588368)
18. Richards JB, Kavvoura FK, Rivadeneira F, et al. Collaborative metaanalysis: associations of 150 candidate genes with osteoporosis and osteoporotic fracture. Ann Intern Med. 2009;151:528-537.
19. Samani NJ, Erdmann J, Hall AS, et al. Genomewide association analysis of coronary artery disease. N Engl J Med. 2007;357:443-453. (Pubitemid 47204873)
20. Scuteri A, Sanna S, Chen WM, et al. Genome-wide association scan shows genetic variants in the FTO gene are associated with obesityrelated traits. PLoS Genet. 2007;3:e115.
21. Sõber S, Org E, Kepp K, et al. Targeting 160 candidate genes for blood pressure regulation with a genome-wide genotyping array. PLoS One. 2009;4:e6034.
22. Wu H, Romieu I, Shi M, et al. Evaluation of candidate genes in a genome-wide association study of childhood asthma in Mexicans. J Allergy Clin Immunol. 2010;125:321.e13-327.e13.
23. Khoury MJ, Bertram L, Boffetta P, et al. Genome-wide association studies, field synopses, and the development of the knowledge base on genetic variation and human diseases. Am J Epidemiol. 2009;170:269-279.
24. Siontis KC, Patsopoulos NA, Ioannidis JP. Replication of past candidate loci for common diseases and phenotypes in 100 genome-wide association studies. Eur J Hum Genet. 2010;18:832-837.
25. Hindorff LA, Junkins HA, Manolio TA. A catalog of published genomewide association studies. Available at: www.genome.gov/gwastudies.Accessed August 1, 2010.
26. Hindorff LA, Sethupathy P, Junkins HA, et al. Potential etiologic and functional implications of genome-wide association loci for human diseases and traits. Proc Natl Acad Sci U S A. 2009;106:9362-9367.
27. Phillips CV. Publication bias in situ. BMC Med Res Methodol. 2004;4:20.
28. Kavvoura FK, Liberopoulos G, Ioannidis JP. Selection in reported epidemiologic risks: an empirical assessment. PLoS Med. 2007;4:e79.
29. Ioannidis JPA. Why most discovered true associations are inflated. Epidemiology. 2008;19:640-648.
30. Pe'er I, Yelensky R, Altshuler D, Daly MJ. Estimation of the multiple testing burden for genomewide association studies of nearly all common variants. Genet Epidemiol. 2008;32:381-385. (Pubitemid 351656309)
31. Hoggart CJ, Clark TG, De Iorio M, Whittaker JC, Balding DJ. Genome-wide significance for dense SNP and resequencing data. Genet Epidemiol. 2008;32:179-185. (Pubitemid 351288034)
32. Zeggini E, Ioannidis JP. Meta-analysis in genome-wide association studies. Pharmacogenomics. 2009;10:191-201.
33. Zeggini E, Weedon MN, Lindgren CM, et al. Replication of genomewide association signals in UK samples reveals risk loci for type 2 diabetes. Science. 2007;316:1336-1341. (Pubitemid 46871654)
34. Zeggini E, Scott LJ, Saxena R, et al. Meta-analysis of genome-wide association data and large-scale replication identifies additional susceptibility loci for type 2 diabetes. Nat Genet. 2008;40:638-645. (Pubitemid 351601209)
35. Voight BF, Scott LJ, Steinthorsdottir V, et al. Twelve type 2 diabetes susceptibility loci identified through large-scale association analysis. Nat Genet. 2010;42:579-589.
36. Panagiotou O, Evangelou O, Ioannidis JP. Genome-wide significant associations for variants with minor allele frequency <5%: an overview. Am J Epidemiol. 2010;172:869-889.
37. Yang J, Benyamin B, McEvoy BP, et al. Common SNPs explain a large proportion of the heritability for human height. Nat Genet. 2010;42:565-569.
38. Park JH, Wacholder S, Gail MH, et al. Estimation of effect size distribution from genome-wide association studies and implications for future discoveries. Nat Genet. 2010;42:570-575.
39. Gibson G. Hints of hidden heritability in GWAS. Nat Genet. 2010;42: 558-560.
40. Kabat GC. Hyping Health Risks: Environmental Hazards in Every Day Life and the Science of Epidemiology. New York: Columbia University Press; 2008.
41. Maziak W. The triumph of the null hypothesis: epidemiology in an age of change. Int J Epidemiol. 2009;38:393-402.
42. Young S. Acknowledge and fix the multiple testing problem. Int J Epidemiol. 2010;39:934; author reply 934-935. doi: 10.1093/ije/ dyp188.
43. Sterne JA, Davey Smith G. Sifting the evidence-what's wrong with significance tests? BMJ. 2001;322:226-231. (Pubitemid 32116172)
44. Goodman SN. Toward evidence-based medical statistics. 2: the Bayes factor. Ann Intern Med. 1999;130:1005-1013. (Pubitemid 29283992)
45. Dwan K, Altman DG, Arnaiz JA, et al. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One. 2008;3:e3081.
46. Hopewell S, Loudon K, Clarke MJ, Oxman AD, Dickersin K. Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database Syst Rev. 2009:MR000006.
47. Riboli E, Norat T. Epidemiologic evidence of the protective effect of fruit and vegetables on cancer risk. Am J Clin Nutr. 2003;78(suppl 3):559S-569S. (Pubitemid 40012550)
48. Ioannidis JP. Contradicted and initially stronger effects in highly cited clinical research. JAMA. 2005;294:218-228. (Pubitemid 41043792)
49. Prentice RL, Pettinger M, Anderson GL. Statistical issues arising in the Women's Health Initiative. Biometrics. 2005;61:899 -911; discussion 911-941.
50. Skrabanek P. Has risk-factor epidemiology outlived its usefulness? Am J Epidemiol. 1993;138:1016-1017. (Pubitemid 24002368)
51. Shapiro S. Looking to the 21st century: have we learned from our mistakes, or are we doomed to compound them? Pharmacoepidemiol Drug Saf. 2004;13:257-265. (Pubitemid 38514841)
52. Feinstein AR. Scientific standards in epidemiologic studies of the menace of daily life. Science. 1988;242:1257-1263. (Pubitemid 19008055)
53. Austin PC, Mamdani MM, Juurlink DN, Hux JE. Testing multiple statistical hypotheses resulted in spurious associations: a study of astrological signs and health. J Clin Epidemiol. 2006;59:964-969. (Pubitemid 44183881)
54. Stampfer M. Observational epidemiology is the preferred means of evaluating effects of behavioral and lifestyle modification. Control Clin Trials. 1997;18:494-499; discussion 514-516.
55. Hernán MA, Alonso A, Logan R, et al. Observational studies analyzed like randomized experiments: an application to postmenopausal hormone therapy and coronary heart disease. Epidemiology. 2008;19:766-779.
56. Vandenbroucke JP. Observational research, randomized trials, and two views of medical science. PLoS Med. 2008;5:e67.
57. Ioannidis JP, Loy EY, Poulton R, Chia KS. Researching genetic versus non-genetic determinants of disease: a comparison and proposed unification. Sci Transl Med. 2009;1:7ps8.
58. Patel CJ, Bhattacharya J, Butte AJ. An environment-wide association study (EWAS) on type 2 diabetes mellitus. PLoS One. 2010;5:e10746.
59. Kyzas PA, Denaxa-Kyza D, Ioannidis JP. Almost all articles on cancer prognostic markers report statistically significant results. Eur J Cancer. 2007;43:2559-2579. (Pubitemid 350086938)
60. Hozo I, Schnell MJ, Djulbegovic B. Decision-making when data and inferences are not conclusive: risk-benefit and acceptable regret approach. Semin Hematol. 2008;45:150-159. (Pubitemid 351876120)
61. Hozo I, Djulbegovic B. When is diagnostic testing inappropriate or irrational? Acceptable regret approach. Med Decis Making. 2008;28: 540-553. (Pubitemid 351990003)
62. Djulbegovic B, Hozo I. When should potentially false research findings be considered acceptable? PLoS Med. 2007;4:e26.
63. Merton RK. The normative structure of science. In: Storer NW, ed. The Sociology of Science. Theoretical and Empirical Investigations. Chicago and London: Chicago University Press; 1973.
64. Pielke RA Jr. The Honest Broker: Making Sense of Science in Policy and Politics. Cambridge; Cambridge University Press; 2007.
65. Tatsioni A, Bonitsis NG, Ioannidis JP. Persistence of contradicted claims in the literature. JAMA. 2007;298:2517-2526. (Pubitemid 350223538)
66. Bartlett C, Sterne J, Egger M. What is newsworthy? Longitudinal study of the reporting of medical research in two British newspapers. BMJ. 2002;325:81-84. (Pubitemid 34774882)