Evaluation of excess statistical significance in meta-analyses of 98 biomarker associations with cancer risk

Journal of the National Cancer Institute

Volumn 104, Issue 24, 2012, Pages 1867-1878

  Tsilidis, Konstantinos K ^a   Papatheodorou, Stefania I ^a   Evangelou, Evangelos ^a   Ioannidis, John P A ^a,b  

^a UNIVERSITY OF IOANNINA   (Greece)

^b STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

25 HYDROXYVITAMIN D; BIOLOGICAL MARKER; C PEPTIDE; C REACTIVE PROTEIN; CYANOCOBALAMIN; ESTRADIOL; ESTRONE; GLUCOSE; INSULIN; LYCOPENE; PYRIDOXINE; SEX HORMONE; SEX HORMONE BINDING GLOBULIN; SOMATOMEDIN B; SOMATOMEDIN BINDING PROTEIN 3; SOMATOMEDIN C;

CANCER RISK; DIETARY INTAKE; EFFECT SIZE; ENVIRONMENTAL FACTOR; HELICOBACTER INFECTION; HEPATITIS; HUMAN; INFECTION; INFLAMMATION; MEDLINE; PAPILLOMAVIRUS INFECTION; PRIORITY JOURNAL; REVIEW; STATISTICAL ANALYSIS; STATISTICAL SIGNIFICANCE; SYSTEMATIC REVIEW;

ALPHAPAPILLOMAVIRUS; BIAS (EPIDEMIOLOGY); CONFOUNDING FACTORS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; HELICOBACTER INFECTIONS; HELICOBACTER PYLORI; HEPATITIS, VIRAL, HUMAN; HUMANS; INFLAMMATION; META-ANALYSIS AS TOPIC; NEOPLASMS; PAPILLOMAVIRUS INFECTIONS; PREDICTIVE VALUE OF TESTS; RISK FACTORS; SOMATOMEDINS; TUMOR MARKERS, BIOLOGICAL;

EID: 84871848283     PISSN: 00278874     EISSN: 14602105     Source Type: Journal    
DOI: 10.1093/jnci/djs437     Document Type: Review

References (80)

1. Ioannidis JP, Panagiotou OA. Comparison of effect sizes associated with biomarkers reported in highly cited individual articles and in subsequent meta-analyses. JAMA. 2011;305(21):2200-2210.
2. Bossuyt PM. The thin line between hope and hype in biomarker research. JAMA. 2011;305(21):2229-2230.
3. Rifai N, Altman DG, Bossuyt PM. Reporting bias in diagnostic and prognostic studies: time for action. Clin Chem. 2008;54(7):1101-1103.
4. Moons KG, Altman DG, Vergouwe Y, Royston P. Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ. 2009;338:b606.
5. Kyzas PA, Denaxa-Kyza D, Ioannidis JP. Almost all articles on cancer prognostic markers report statistically significant results. Eur J Cancer. 2007;43(17):2559-2579.
6. Ioannidis JP. Why most published research findings are false. PLoS Med. 2005;2(8):e124.
7. Dwan K, Altman DG, Arnaiz JA, et al. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One. 2008;3(8):e3081.
8. Ioannidis JP. Why most discovered true associations are inflated. Epidemiology. 2008;19(5):640-648.
9. Chan AW, Altman DG. Identifying outcome reporting bias in randomised trials on PubMed: review of publications and survey of authors. BMJ. 2005;330(7494):753.
10. Chan AW, Hrobjartsson A, Haahr MT, Gotzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291 (20):2457-2465.
11. Chan AW, Krleza-Jeric K, Schmid I, Altman DG. Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research. CMAJ. 2004;171(7):735-740.
12. Sterne JA, Sutton AJ, Ioannidis JP, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343:d4002.
13. Ioannidis JP, Trikalinos TA. The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey. CMAJ. 2007;176(8):1091-1096.
14. Lau J, Ioannidis JP, Terrin N, Schmid CH, Olkin I. The case of the misleading funnel plot. BMJ. 2006;333(7568):597-600.
15. Ioannidis JP, Trikalinos TA. An exploratory test for an excess of significant findings. Clin Trials. 2007;4(3):245-253.
16. Ioannidis JP. Excess significance bias in the literature on brain volume abnormalities. Arch Gen Psychiatry. 2011;68(8):773-780.
17. Kavvoura FK, McQueen MB, Khoury MJ, Tanzi RE, Bertram L, Ioannidis JP. Evaluation of the potential excess of statistically significant findings in published genetic association studies: application to Alzheimer's disease. Am J Epidemiol. 2008;168(8):855-865.
18. Spitz MR, Bondy ML. The evolving discipline of molecular epidemiology of cancer. Carcinogenesis. 2010;31(1):127-134.
19. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177-188.
20. Veglia F, Loft S, Matullo G, et al. DNA adducts and cancer risk in prospective studies: a pooled analysis and a meta-analysis. Carcinogenesis. 2008;29(5):932-936.
21. Chinn S. A simple method for converting an odds ratio to effect size for use in meta-analysis. Stat Med. 2000;19(22):3127-3131.
22. Cochran WG. The combination of estimates from different experiments. Biometrics. 1954;10:101-129.
23. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21(11):1539-1558.
24. Ioannidis JP, Patsopoulos NA, Evangelou E. Uncertainty in heterogeneity estimates in meta-analyses. BMJ. 2007;335(7626):914-916.
25. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629-634.
26. Harbord RM, Egger M, Sterne JA. A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Stat Med. 2006;25(20):3443-3457.
27. Wang C, Yuan Y, Hunt RH. The association between Helicobacter pylori infection and early gastric cancer: a meta-analysis. Am J Gastroenterol. 2007;102(8):1789-1798.
28. Zhuo XL, Wang Y, Zhuo WL, Zhang XY. Possible association of Helicobacter pylori infection with laryngeal cancer risk: an evidence-based meta-analysis. Arch Med Res. 2008;39(6):625-628.
29. Zhuo WL, Zhu B, Xiang ZL, Zhuo XL, Cai L, Chen ZT. Assessment of the relationship between Helicobacter pylori and lung cancer: a meta-analysis. Arch Med Res. 2009;40(5):406-410.
30. Donato F, Boffetta P, Puoti M. A meta-analysis of epidemiological studies on the combined effect of hepatitis B and C virus infections in causing hepatocellular carcinoma. Int J Cancer. 1998;75(3):347-354.
31. Hobbs CG, Sterne JA, Bailey M, Heyderman RS, Birchall MA, Thomas SJ. Human papillomavirus and head and neck cancer: a systematic review and meta-analysis. Clin Otolaryngol. 2006;31(4):259-266.
32. Taylor ML, Mainous AG 3rd, Wells BJ. Prostate cancer and sexually transmitted diseases: a meta-analysis. Fam Med. 2005;37(7):506-512.
33. Lubin JH, Gail MH. On power and sample size for studying features of the relative odds of disease. Am J Epidemiol. 1990;131(3):552-566.
34. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557-560.
35. Rinaldi S, Cleveland R, Norat T, et al. Serum levels of IGF-I, IGFBP-3 and colorectal cancer risk: results from the EPIC cohort, plus a meta-analysis of prospective studies. Int J Cancer. 2010;126(7):1702-1715.
36. Morris JK, George LM, Wu T, Wald NJ. Insulin-like growth factors and cancer: no role in screening. Evidence from the BUPA study and meta-analysis of prospective epidemiological studies. Br J Cancer. 2006;95(1):112-117.
37. Key TJ, Appleby PN, Reeves GK, Roddam AW. Insulin-like growth factor 1 (IGF1), IGF binding protein 3 (IGFBP3), and breast cancer risk: pooled individual data analysis of 17 prospective studies. Lancet Oncol. 2010;11(6):530-542.
38. Chen B, Liu S, Xu W, Wang X, Zhao W, Wu J. IGF-I and IGFBP-3 and the risk of lung cancer: a meta-analysis based on nested case-control studies. J Exp Clin Cancer Res. 2009;28(1):89.
39. Rowlands MA, Gunnell D, Harris R, Vatten LJ, Holly JM, Martin RM. Circulating insulin-like growth factor peptides and prostate cancer risk: a systematic review and meta-analysis. Int J Cancer. 2009;124(10):2416-2429.
40. Pisani P. Hyper-insulinaemia and cancer, meta-analyses of epidemiological studies. Arch Physiol Biochem. 2008;114(1):63-70.
41. Roddam AW, Allen NE, Appleby P, Key TJ. Endogenous sex hormones and prostate cancer: a collaborative analysis of 18 prospective studies. J Natl Cancer Inst. 2008;100(3):170-183.
42. Key T, Appleby P, Barnes I, Reeves G. Endogenous sex hormones and breast cancer in postmenopausal women: reanalysis of nine prospective studies. J Natl Cancer Inst. 2002;94(8):606-616.
43. Barba M, Yang L, Schunemann HJ, et al. Urinary estrogen metabolites and prostate cancer: a case-control study and meta-analysis. J Exp Clin Cancer Res. 2009;28(1):135.
44. Yin L, Grandi N, Raum E, Haug U, Arndt V, Brenner H. Meta-analysis: longitudinal studies of serum vitamin D and colorectal cancer risk. Aliment Pharmacol Ther. 2009;30(2):113-125.
45. Yin L, Raum E, Haug U, Arndt V, Brenner H. Meta-analysis of longitudinal studies: serum vitamin D and prostate cancer risk. Cancer Epidemiol. 2009;33(6):435-445.
46. Chen P, Hu P, Xie D, Qin Y, Wang F, Wang H. Meta-analysis of vitamin D, calcium and the prevention of breast cancer. Breast Cancer Res Treat. 2010;121(2):469-477.
47. Gallicchio L, Boyd K, Matanoski G, et al. Carotenoids and the risk of developing lung cancer: a systematic review. Am J Clin Nutr. 2008;88(2): 372-383.
48. Zhuo H, Smith AH, Steinmaus C. Selenium and lung cancer: a quantitative analysis of heterogeneity in the current epidemiological literature. Cancer Epidemiol Biomarkers Prev. 2004;13(5):771-778.
49. Saadatian-Elahi M, Norat T, Goudable J, Riboli E. Biomarkers of dietary fatty acid intake and the risk of breast cancer: a meta-analysis. Int J Cancer. 2004;111(4):584-591.
50. Buck K, Zaineddin AK, Vrieling A, Linseisen J, Chang-Claude J. Metaanalyses of lignans and enterolignans in relation to breast cancer risk. Am J Clin Nutr. 2010;92(1):141-153.
51. Simon JA, Chen YH, Bent S. The relation of alpha-linolenic acid to the risk of prostate cancer: a systematic review and meta-analysis. Am J Clin Nutr. 2009;89(5):1558S-1564S.
52. Larsson SC, Giovannucci E, Wolk A. Folate and risk of breast cancer: a meta-analysis. J Natl Cancer Inst. 2007;99(1):64-76.
53. Collin SM, Metcalfe C, Refsum H, et al. Circulating folate, vitamin B12, homocysteine, vitamin B12 transport proteins, and risk of prostate cancer: a case-control study, systematic review, and meta-analysis. Cancer Epidemiol Biomarkers Prev. 2010;19(6):1632-1642.
54. Larsson SC, Orsini N, Wolk A. Vitamin B6 and risk of colorectal cancer: a meta-analysis of prospective studies. JAMA. 2010;303(11):1077-1083.
55. Tsilidis KK, Branchini C, Guallar E, Helzlsouer KJ, Erlinger TP, Platz EA. C-reactive protein and colorectal cancer risk: a systematic review of prospective studies. Int J Cancer. 2008;123(5):1133-1140.
56. Heikkila K, Harris R, Lowe G, et al. Associations of circulating C-reactive protein and interleukin-6 with cancer risk: findings from two prospective cohorts and a meta-analysis. Cancer Causes Control. 2009;20(1):15-26.
57. Huang JQ, Zheng GF, Sumanac K, Irvine EJ, Hunt RH. Meta-analysis of the relationship between cagA seropositivity and gastric cancer. Gastroenterology. 2003;125(6):1636-1644.
58. Zhao YS, Wang F, Chang D, Han B, You DY. Meta-analysis of different test indicators: Helicobacter pylori infection and the risk of colorectal cancer. Int J Colorectal Dis. 2008;23(9):875-882.
59. Islami F, Kamangar F. Helicobacter pylori and esophageal cancer risk: a metaanalysis. Cancer Prev Res (Phila). 2008;1(5):329-338.
60. Gutierrez J, Jimenez A, de Dios Luna J, Soto MJ, Sorlozano A. Meta-analysis of studies analyzing the relationship between bladder cancer and infection by human papillomavirus. J Urol. 2006;176(6, pt 1):2474-2481.
61. Mandelblatt JS, Kanetsky P, Eggert L, Gold K. Is HIV infection a cofactor for cervical squamous cell neoplasia? Cancer Epidemiol Biomarkers Prev. 1999;8(1):97-106.
62. Zhang ZF, Begg CB. Is Trichomonas vaginalis a cause of cervical neoplasia? Results from a combined analysis of 24 studies. Int J Epidemiol. 1994;23(4):682-690.
63. Khanjani N, Hoving JL, Forbes AB, Sim MR. Systematic review and metaanalysis of cyclodiene insecticides and breast cancer. J Environ Sci Health C Environ Carcinog Ecotoxicol Rev. 2007;25(1):23-52.
64. Lopez-Cervantes M, Torres-Sanchez L, Tobias A, Lopez-Carrillo L. Dichlorodiphenyldichloroethane burden and breast cancer risk: a meta-analysis of the epidemiologic evidence. Environ Health Perspect. 2004;112(2):207-214.
65. Ioannidis JP. Interpretation of tests of heterogeneity and bias in meta-analysis. J Eval Clin Pract. 2008;14(5):951-957.
66. Panagiotou OA, Ioannidis JP. Primary study authors and methodologists differ in their interpretations of heterogeneous meta-analysis results. J Clin Epidemiol. 2012; 65(7):740-747.
67. Roddam AW, Allen NE, Appleby P, et al. Insulin-like growth factors, their binding proteins, and prostate cancer risk: analysis of individual patient data from 12 prospective studies. Ann Intern Med. 2008;149(7):461-471.
68. Ioannidis JP, Tzoulaki I. Minimal and null predictive effects for the most popular blood biomarkers of cardiovascular disease. Circ Res. 2012;110(5):658-662.
69. Zhang SM, Buring JE, Lee IM, Cook NR, Ridker PM. C-reactive protein levels are not associated with increased risk for colorectal cancer in women. Ann Intern Med. 2005;142(6):425-432.
70. Bertagnolli MM, Eagle CJ, Zauber AG, et al. Celecoxib for the prevention of sporadic colorectal adenomas. N Engl J Med. 2006;355(9):873-884.
71. Corpet DE, Pierre F. Point: from animal models to prevention of colon cancer. Systematic review of chemoprevention in min mice and choice of the model system. Cancer Epidemiol Biomarkers Prev. 2003;12(5):391-400.
72. Itzkowitz SH, Yio X. Inflammation and cancer IV. Colorectal cancer in inflammatory bowel disease: the role of inflammation. Am J Physiol Gastrointest Liver Physiol. 2004;287(1):G7-17.
73. Heikkila K, Silander K, Salomaa V, et al. C-reactive protein-associated genetic variants and cancer risk: findings from FINRISK 1992, FINRISK 1997 and Health 2000 studies. Eur J Cancer. 2011;47(3):404-412.
74. Poole EM, Bigler J, Whitton J, Sibert JG, Potter JD, Ulrich CM. C-reactive protein genotypes and haplotypes, polymorphisms in NSAIDmetabolizing enzymes, and risk of colorectal polyps. Pharmacogenet Genomics. 2009;19(2):113-120.
75. Shinohara RT, Frangakis CE, Platz EA, Tsilidis K. Designs combining instrumental variables with case-control: estimating principal strata causal effects. Int J Biostat. 2012;8(1):1-21.
76. Boyle P, Boffetta P, Autier P. Diet, nutrition and cancer: public, media and scientific confusion. Ann Oncol.2008;19(10):1665-1667.
77. Ioannidis JP, Castaldi P, Evangelou E. A compendium of genome-wide associations for cancer: critical synopsis and reappraisal. J Natl Cancer Inst. 2010;102(12):846-858.
78. Altman DG, Simera I, Hoey J, Moher D, Schulz K. EQUATOR: reporting guidelines for health research. Lancet. 2008;371(9619):1149-1150.
79. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. PLoS Med. 2007;4(10):e296.
80. Gallo V, Egger M, McCormack V, et al. STrengthening the Reporting of OBservational studies in Epidemiology-Molecular Epidemiology (STROBE-ME): an extension of the STROBE Statement. PLoS Med. 2011;8(10):e1001117.