Evaluation of the potential excess of statistically significant findings in published genetic association studies: Application to Alzheimer's disease

American Journal of Epidemiology

Volumn 168, Issue 8, 2008, Pages 855-865

  Kavvoura, Fotini K ^a   McQueen, Matthew B ^b   Khoury, Muin J ^c   Tanzi, Rudolph E ^d   Bertram, Lars ^d   Ioannidis, John P A ^a,e,f  

^a UNIVERSITY OF IOANNINA   (Greece)

^b UNIVERSITY OF COLORADO   (United States)

^c NATIONAL CENTER ON BIRTH DEFECTS AND DEVELOPMENTAL DISABILITIES   (United States)

^d MASSACHUSETTS GENERAL HOSPITAL   (United States)

^e INSTITUTE OF COMPUTER SCIENCE   (Greece)

^f TUFTS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Alzheimer disease; Bias (epidemiology); Genetic markers; Genetics; Meta analysis; Publication bias

Indexed keywords

DATABASE; EPIDEMIOLOGY; GENETIC MARKER; META-ANALYSIS; NERVOUS SYSTEM DISORDER;

ALZHEIMER DISEASE; ARTICLE; CALCULATION; DATA BASE; EFFECT SIZE; EVALUATION; GENETIC ASSOCIATION; GENETIC MARKER; NUCLEOTIDE SEQUENCE; PUBLICATION; PUBLISHING; STATISTICAL ANALYSIS;

ALZHEIMER DISEASE; BIAS (EPIDEMIOLOGY); GENETIC PREDISPOSITION TO DISEASE; HUMANS;

EID: 53749093122     PISSN: 00029262     EISSN: 14766256     Source Type: Journal    
DOI: 10.1093/aje/kwn206     Document Type: Article

References (50)

1. Ioannidis JP, Gwinn M, Little J, et al. A road map for efficient and reliable human genome epidemiology. Nat Genet. 2006;38(1):3-5.
2. Hirschhorn JN, Lohmueller K, Byrne E, et al. A comprehensive review of genetic association studies. Genet Med. 2002;4(2):45-61.
3. Ioannidis JP. Non-replication and inconsistency in the genome-wide association setting. Hum Hered. 2007;64(4):203-213.
4. Patterson M, Cardon L. Replication publication. PLoS Biol. 2005;3(9):e327.
5. Chanock SJ, Manolio T, Boehnke M, et al. Replicating genotype-phenotype associations. Nature. 2007;447(7145):655-660.
6. Evans DM, Cardon LR. Genome-wide association: a promising start to a long race. Trends Genet. 2006;22(7):350-354.
7. Marchini J, Donnelly P, Cardon LR. Genome-wide strategies for detecting multiple loci that influence complex diseases. Nat Genet. 2005;37(4):413-417.
8. Thomas DC. Are we ready for genome-wide association studies? Cancer Epidemiol Biomarkers Prev. 2006;15(4):595-598.
9. Ioannidis JP. Why most published research findings are false. PLoS Med. 2005;2(8):e124.
10. Dickersin K. The existence of publication bias and risk factors for its occurrence. JAMA. 1990;263(10):1385-1389.
11. Dickersin K, Min YI. Publication bias: the problem that won't go away. Ann N Y Acad Sci. 1993;703:135-146.
12. Dickersin K, Min YI, Meinert CL. Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. JAMA. 1992;267(3):374-378.
13. Easterbrook PJ, Berlin JA, Gopalan R, et al. Publication bias in clinical research. Lancet. 1991;337(8746):867-872.
14. Ioannidis JP. Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA. 1998;279(4):281-286.
15. Kavvoura FK, Liberopoulos G, Ioannidis JP. Selection in reported epidemiological risks: an empirical assessment [electronic article]. PLoS Med. 2007;4(3):e79.
16. Chan AW, Krleza-Jeric K, Schmid I, et al. Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research. CMAJ. 2004;171(7):735-740.
17. Chan AW, Hrobjartsson A, Haahr MT, et al. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291(20):2457-2465.
18. Ranstam J, Buyse M, George SL, et al. Fraud in medical research: an international survey of biostatisticians. ISCB Subcommittee on Fraud. Control Clin Trials. 2000;21(5):415-427.
19. Gardner W, Lidz CW, Hartwig KC. Authors' reports about research integrity problems in clinical trials. Contemp Clin Trials. 2005;26(2):244-251.
20. Al-Marzouki S, Evans S, Marshall T, et al. Are these data real? Statistical methods for the detection of data fabrication in clinical trials. BMJ. 2005;331(7511):267-270.
21. Lau J, Ioannidis JP, Terrin N, et al. The case of the misleading funnel plot. BMJ. 2006;333(7568):597-600.
22. Egger M, Davey Smith G, et al. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629-634.
23. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50(4):1088-1101.
24. Rothstein HR, Sutton AJ, Borestein M. Publication Bias in Meta-Analysis - Prevention, Assessment and Adjustments. Chichester, United Kingdom: John Wiley and Sons Ltd; 2005.
25. Sterne JA, Gavaghan D, Egger M. Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol. 2000;53(11):1119-1129.
26. Macaskill P, Walter SD, Irwig L. A comparison of methods to detect publication bias in meta-analysis. Stat Med. 2001;20(4):641-654.
27. Ioannidis JP, Trikalinos TA. An exploratory test for an excess of significant findings. Clin Trials. 2007;4(3):245-253.
28. Ntzani EE, Rizos EC, Ioannidis JP. Genetic effects versus bias for candidate polymorphisms in myocardial infarction: case study and overview of large-scale evidence. Am J Epidemiol. 2007;165(9):973-984.
29. Pan Z, Trikalinos TA, Kavvoura FK, et al. Local literature bias in genetic epidemiology: an empirical evaluation of the Chinese literature. PLoS Med. 2005;2(12):e334.
30. Calnan M, Smith GD, Sterne JA. The publication process itself was the major cause of publication bias in genetic epidemiology. J Clin Epidemiol. 2006;59(12):1312-1318.
31. Munafo MR, Matheson IJ, Flint J. Association of the DRD2 gene Taq1A polymorphism and alcoholism: a meta-analysis of case-control studies and evidence of publication bias. Mol Psychiatry. 2007;12(5):454-461.
32. Serrano NC, Diaz LA, Paez MC, et al. Angiotensin-converting enzyme I/D polymorphism and preeclampsia risk: evidence of small-study bias. PLoS Med. 2006;3(12):e520.
33. Bertram L, McQueen MB, Mullin K, et al. Systematic meta-analyses of Alzheimer disease genetic association studies: the AlzGene database. Nat Genet. 2007;39(1):17-23.
34. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177-188.
35. Mantel N, Haenszel W. Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst. 1959;22(4):719-748.
36. Cochran WG. The combination of estimates from different experiments. Biometrics. 1954;10:101-129.
37. Higgins JP, Thompson SG, Deeks JJ, et al. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557-560.
38. Ioannidis JP, Trikalinos TA. Early extreme contradictory estimates may appear in published research: the Proteus phenomenon in molecular genetics research and randomized trials. J Clin Epidemiol. 2005;58(6):543-549.
39. Easton DF, Pooley KA, Dunning AM, et al. Genome-wide association study identifies novel breast cancer susceptibility loci. Nature. 2007;447(7148):1087-1093.
40. Zeggini E, Weedon MN, Lindgren CM, et al. Replication of genome-wide association signals in UK samples reveals risk loci for type 2 diabetes. Science. 2007;316(5829):1336-1341.
41. Ioannidis JP, Ntzani EE, Trikalinos TA, et al. Replication validity of genetic association studies. Nat Genet. 2001;29(3):306-309.
42. Zollner S, Pritchard JK. Overcoming the winner's curse: estimating penetrance parameters from case-control data. Am J Hum Genet. 2007;80(4):605-615.
43. Khoury MJ, Gwinn M, Burke W, et al. Will genomics widen or help heal the schism between medicine and public health? Am J Prev Med. 2007;33(4):310-317.
44. Lin PI, Vance JM, Pericak-Vance MA, et al. No gene is an island: the flip-flop phenomenon. Am J Hum Genet. 2007;80(3):531-538.
45. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21(11):1539-1558.
46. 2 index? Psychol Methods. 2006;11(2):193-206.
47. Ioannidis JP, Patsopoulos NA, Evangelou E. Heterogeneity in meta-analyses of genome-wide association investigations. PLoS ONE. 2007;2(9):e841.
48. Ioannidis JP, Boffetta P, Little J, et al. Assessment of cumulative evidence on genetic associations: interim guidelines. Int J Epidemiol. 2008;37(1):120-132.
49. Ioannidis JP, Bernstein J, Boffetta P, et al. A network of investigator networks in human genome epidemiology. Am J Epidemiol. 2005;162(4):302-304.
50. The GAIN Collaborative Research Group. New models of collaboration in genome-wide association studies: the Genetic Association Information Network. Nat Genet. 2007;39(9):1045-1051.