Application of credibility ceilings probes the robustness of meta-Analyses of biomarkers and cancer risk

Journal of Clinical Epidemiology

Volumn 68, Issue 2, 2015, Pages 163-174

  Papatheodorou, Stefania I ^a   Tsilidis, Konstantinos K ^b   Evangelou, Evangelos ^b   Ioannidis, John P A ^c,d  

^a CYPRUS UNIVERSITY OF TECHNOLOGY   (Cyprus)

^b UNIVERSITY OF IOANNINA   (Greece)

^c STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d STANFORD UNIVERSITY   (United States)

Author keywords

Biomarkers; Cancer; Credibility ceiling; Meta Analyses; Predictive intervals

Indexed keywords

BIOLOGICAL MARKER; TUMOR MARKER;

ANALYTIC METHOD; ARTICLE; CANCER RISK; CLINICAL PRACTICE; CONFIDENCE INTERVAL; CREDIBILITY CEILING METHOD; EFFECT SIZE; ENVIRONMENTAL FACTOR; HUMAN; MAXIMUM LIKELIHOOD METHOD; META ANALYSIS (TOPIC); PREDICTIVE VALUE; PRIORITY JOURNAL; PROBABILITY; SAMPLE SIZE; SENSITIVITY ANALYSIS; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICAL PARAMETERS; STATISTICAL SIGNIFICANCE; CHEMISTRY; CLINICAL TRIAL (TOPIC); EPIDEMIOLOGY; METHODOLOGY; NEOPLASMS; RISK; RISK FACTOR; SELECTION BIAS; STANDARDS; STATISTICAL BIAS;

BIAS (EPIDEMIOLOGY); CLINICAL TRIALS AS TOPIC; CONFOUNDING FACTORS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; HUMANS; META-ANALYSIS AS TOPIC; NEOPLASMS; ODDS RATIO; RESEARCH DESIGN; RISK FACTORS; SELECTION BIAS; TUMOR MARKERS, BIOLOGICAL;

EID: 84920564560     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2014.09.004     Document Type: Article

References (69)

1. J.J. Deeks, J. Dinnes, R. D'Amico, A.J. Sowden, C. Sakarovitch, and F. Song Evaluating non-randomised intervention studies Health Technol Assess 7 2003 iii-x, 1-173
2. N. Rifai, D.G. Altman, and P.M. Bossuyt Reporting bias in diagnostic and prognostic studies: time for action Clin Chem 54 2008 1101 1103
3. K.G. Moons, D.G. Altman, Y. Vergouwe, and P. Royston Prognosis and prognostic research: application and impact of prognostic models in clinical practice BMJ 338 2009 b606
4. P.A. Kyzas, D. Denaxa-Kyza, and J.P. Ioannidis Almost all articles on cancer prognostic markers report statistically significant results Eur J Cancer 43 2007 2559 2579
5. K.K. Tsilidis, S.I. Papatheodorou, E. Evangelou, and J.P. Ioannidis Evaluation of excess statistical significance in meta-Analyses of 98 biomarker associations with cancer risk J Natl Cancer Inst 104 2012 1867 1878
6. J.P. Ioannidis, and O.A. Panagiotou Comparison of effect sizes associated with biomarkers reported in highly cited individual articles and in subsequent meta-Analyses JAMA 305 2011 2200 2210
7. J.P. Ioannidis, and I. Tzoulaki Minimal and null predictive effects for the most popular blood biomarkers of cardiovascular disease Circ Res 110 2012 658 662
8. J.P. Ioannidis Biomarker failures Clin Chem 59 2013 202 204
9. D.J. Spiegelhalter, and P.J. Myles Evidence synthesis D.J. Spiegelhalter, K. Abrams, P.J. Myles, Bayesian approaches to clinical trials and health-care evaluations 2004 Chichester John Wiley Sons Ltd Chichester, New Hampshire, USA
10. R.J. Lilford, and D. Braunholtz The statistical basis of public policy: a paradigm shift is overdue BMJ 313 1996 603 607
11. D.M. Eddy, V. Hasselblad, and R. Shachter A Bayesian method for synthesizing evidence. The confidence profile method Int J Technol Assess Health Care 6 1990 31 55
12. R.L. Wolpert, and K.L. Mengersen Adjusted likelihoods for synthesizing empirical evidence from studies that differ in quality and design: effects of environmental tobacco smoke Stat Sci [Internet] 19 2004 450 471
13. S. Greenland Multiple-bias modelling for analysis of observational data - discussion J R Stat Soc Ser A Stat Soc [Internet] 168 2005 267 306
14. S. Thompson, U. Ekelund, S. Jebb, A.K. Lindroos, A. Mander, and S. Sharp A proposed method of bias adjustment for meta-Analyses of published observational studies Int J Epidemiol 40 2011 765 777
15. J.P. Ioannidis Commentary: adjusting for bias: a user's guide to performing plastic surgery on meta-Analyses of observational studies Int J Epidemiol 40 2011 777 779
16. G. Salanti, and J.P. Ioannidis Synthesis of observational studies should consider credibility ceilings J Clin Epidemiol 62 2009 115 122
17. J.A. Sterne, A.J. Sutton, J.P. Ioannidis, N. Terrin, D.R. Jones, and J. Lau Recommendations for examining and interpreting funnel plot asymmetry in meta-Analyses of randomised controlled trials BMJ 343 2011 d4002
18. J.P. Ioannidis, and T.A. Trikalinos An exploratory test for an excess of significant findings Clin trials 4 2007 245 253
19. J.P. Higgins, S.G. Thompson, J.J. Deeks, and D.G. Altman Measuring inconsistency in meta-Analyses BMJ 327 2003 557 560
20. Higgins JP, Thompson SG. Presenting random effects meta-Analyses: where are we going wrong? In 9th International Cochrane Colloquium. Lyon, France. 2001.
21. R. DerSimonian, and N. Laird Meta-Analysis in clinical trials Control Clin trials 7 1986 177 188
22. J.P. Higgins, and S.G. Thompson Quantifying heterogeneity in a meta-Analysis Stat Med 21 2002 1539 1558
23. M. Egger, G. Davey Smith, M. Schneider, and C. Minder Bias in meta-Analysis detected by a simple, graphical test BMJ 315 1997 629 634
24. J.P. Ioannidis Clarifications on the application and interpretation of the test for excess significance and its extensions J Math Psychol 57 2013 184 187
25. F. Veglia, S. Loft, G. Matullo, M. Peluso, A. Munnia, and F. Perera DNA adducts and cancer risk in prospective studies: a pooled analysis and a meta-Analysis Carcinogenesis 29 2008 932 936
26. C. Wang, Y. Yuan, and R.H. Hunt The association between Helicobacter pylori infection and early gastric cancer: a meta-Analysis The Am J Gastroenterol 102 2007 1789 1798
27. X.L. Zhuo, Y. Wang, W.L. Zhuo, and X.Y. Zhang Possible association of Helicobacter pylori infection with laryngeal cancer risk: an evidence-based meta-Analysis Arch Med Res 39 2008 625 628
28. W.L. Zhuo, B. Zhu, Z.L. Xiang, X.L. Zhuo, L. Cai, and Z.T. Chen Assessment of the relationship between Helicobacter pylori and lung cancer: a meta-Analysis Arch Med Res 40 2009 406 410
29. F. Donato, P. Boffetta, and M. Puoti A meta-Analysis of epidemiological studies on the combined effect of hepatitis B and C virus infections in causing hepatocellular carcinoma Int J Cancer 75 1998 347 354
30. C.G. Hobbs, J.A. Sterne, M. Bailey, R.S. Heyderman, M.A. Birchall, and S.J. Thomas Human papillomavirus and head and neck cancer: a systematic review and meta-Analysis Clin Otolaryngol 31 2006 259 266
31. M.L. Taylor, A.G. Mainous 3rd, and B.J. Wells Prostate cancer and sexually transmitted diseases: a meta-Analysis Fam Med 37 2005 506 512
32. S. Rinaldi, R. Cleveland, T. Norat, C. Biessy, S. Rohrmann, and J. Linseisen Serum levels of IGF-I, IGFBP-3 and colorectal cancer risk: results from the EPIC cohort, plus a meta-Analysis of prospective studies Int J Cancer 126 2010 1702 1715
33. J.K. Morris, L.M. George, T. Wu, and N.J. Wald Insulin-like growth factors and cancer: no role in screening. Evidence from the BUPA study and meta-Analysis of prospective epidemiological studies Br J Cancer 95 2006 112 117
34. T.J. Key, P.N. Appleby, G.K. Reeves, and A.W. Roddam Insulin-like growth factor 1 (IGF1), IGF binding protein 3 (IGFBP3), and breast cancer risk: pooled individual data analysis of 17 prospective studies The Lancet Oncol 11 2010 530 542
35. B. Chen, S. Liu, W. Xu, X. Wang, W. Zhao, and J. Wu IGF-I and IGFBP-3 and the risk of lung cancer: a meta-Analysis based on nested case-control studies J Exp Clin Cancer Res 28 2009 89
36. M.A. Rowlands, D. Gunnell, R. Harris, L.J. Vatten, J.M. Holly, and R.M. Martin Circulating insulin-like growth factor peptides and prostate cancer risk: a systematic review and meta-Analysis Int J Cancer 124 2009 2416 2429
37. P. Pisani Hyper-insulinaemia and cancer, meta-Analyses of epidemiological studies Arch Physiol Biochem 114 2008 63 70
38. Endogenous H, Prostate Cancer Collaborative G A.W. Roddam, N.E. Allen, P. Appleby, and T.J. Key Endogenous sex hormones and prostate cancer: a collaborative analysis of 18 prospective studies J Natl Cancer Inst 100 2008 170 183
39. T. Key, P. Appleby, I. Barnes, G. Reeves Breast Cancer Collaborative G Endogenous sex hormones and breast cancer in postmenopausal women: reanalysis of nine prospective studies J Natl Cancer Inst 94 2002 606 616
40. M. Barba, L. Yang, H.J. Schunemann, F. Sperati, S. Grioni, and S. Stranges Urinary estrogen metabolites and prostate cancer: a case-control study and meta-Analysis J Exp Clin Cancer Res 28 2009 135
41. L. Yin, N. Grandi, E. Raum, U. Haug, V. Arndt, and H. Brenner Meta-Analysis: longitudinal studies of serum vitamin D and colorectal cancer risk Aliment Pharmacol Ther 30 2 2009 113 125
42. L. Yin, E. Raum, U. Haug, V. Arndt, and H. Brenner Meta-Analysis of longitudinal studies: serum vitamin D and prostate cancer risk Cancer Epidemiol 33 2009 435 445
43. P. Chen, P. Hu, D. Xie, Y. Qin, F. Wang, and H. Wang Meta-Analysis of vitamin D, calcium and the prevention of breast cancer Breast Cancer Res Treat 121 2 2010 469 477
44. L. Gallicchio, K. Boyd, G. Matanoski, X.G. Tao, L. Chen, and T.K. Lam Carotenoids and the risk of developing lung cancer: a systematic review The Am J Clin Nutr 88 2008 372 383
45. H. Zhuo, A.H. Smith, and C. Steinmaus Selenium and lung cancer: a quantitative analysis of heterogeneity in the current epidemiological literature Cancer Epidemiol biomarkers Prev 13 2004 771 778
46. M. Saadatian-Elahi, T. Norat, J. Goudable, and E. Riboli Biomarkers of dietary fatty acid intake and the risk of breast cancer: a meta-Analysis Int J Cancer 111 2004 584 591
47. K. Buck, A.K. Zaineddin, A. Vrieling, J. Linseisen, and J. Chang-Claude Meta-Analyses of lignans and enterolignans in relation to breast cancer risk The Am J Clin Nutr 92 2010 141 153
48. J.A. Simon, Y.H. Chen, and S. Bent The relation of alpha-linolenic acid to the risk of prostate cancer: a systematic review and meta-Analysis The Am J Clin Nutr 89 2009 1558S 1564S
49. S.C. Larsson, E. Giovannucci, and A. Wolk Folate and risk of breast cancer: a meta-Analysis J Natl Cancer Inst 99 2007 64 76
50. S.M. Collin, C. Metcalfe, H. Refsum, S.J. Lewis, L. Zuccolo, and G.D. Smith Circulating folate, vitamin B12, homocysteine, vitamin B12 transport proteins, and risk of prostate cancer: a case-control study, systematic review, and meta-Analysis Cancer Epidemiol biomarkers Prev 19 2010 1632 1642
51. S.C. Larsson, N. Orsini, and A. Wolk Vitamin B6 and risk of colorectal cancer: a meta-Analysis of prospective studies JAMA 303 2010 1077 1083
52. K.K. Tsilidis, C. Branchini, E. Guallar, K.J. Helzlsouer, T.P. Erlinger, and E.A. Platz C-reactive protein and colorectal cancer risk: a systematic review of prospective studies Int J Cancer 123 2008 1133 1140
53. K. Heikkila, R. Harris, G. Lowe, A. Rumley, J. Yarnell, and J. Gallacher Associations of circulating C-reactive protein and interleukin-6 with cancer risk: findings from two prospective cohorts and a meta-Analysis Cancer Causes Control 20 2009 15 26
54. J.Q. Huang, G.F. Zheng, K. Sumanac, E.J. Irvine, and R.H. Hunt Meta-Analysis of the relationship between cagA seropositivity and gastric cancer Gastroenterology 125 2003 1636 1644
55. Y.S. Zhao, F. Wang, D. Chang, B. Han, and D.Y. You Meta-Analysis of different test indicators: Helicobacter pylori infection and the risk of colorectal cancer Int J colorectal Dis 23 2008 875 882
56. F. Islami, and F. Kamangar Helicobacter pylori and esophageal cancer risk: a meta-Analysis Cancer Prev Res 1 2008 329 338
57. J. Gutierrez, A. Jimenez, J. de Dios Luna, M.J. Soto, and A. Sorlozano Meta-Analysis of studies analyzing the relationship between bladder cancer and infection by human papillomavirus The J Urol 176 6 Pt 1 2006 2474 2481 discussion 81
58. J.S. Mandelblatt, P. Kanetsky, L. Eggert, and K. Gold Is HIV infection a cofactor for cervical squamous cell neoplasia? Cancer Epidemiol biomarkers Prev 8 1999 97 106
59. N. Khanjani, J.L. Hoving, A.B. Forbes, and M.R. Sim Systematic review and meta-Analysis of cyclodiene insecticides and breast cancer J Environ Sci Health C Environ Carcinog Ecotoxicol Rev 25 1 2007 23 52
60. M. Lopez-Cervantes, L. Torres-Sanchez, A. Tobias, and L. Lopez-Carrillo Dichlorodiphenyldichloroethane burden and breast cancer risk: a meta-Analysis of the epidemiologic evidence Environ Health Perspect 112 2004 207 214
61. Z.F. Zhang, and C.B. Begg Is Trichomonas vaginalis a cause of cervical neoplasia? Results from a combined analysis of 24 studies Int J Epidemiol 23 1994 682 690
62. O.A. Panagiotou, and J.P. Ioannidis Primary study authors of significant studies are more likely to believe that a strong association exists in a heterogeneous meta-Analysis compared with methodologists J Clin Epidemiol 65 2012 740 747
63. P. Boyle, P. Boffetta, and P. Autier Diet, nutrition and cancer: public, media and scientific confusion Ann Oncol 19 10 2008 1665 1667
64. J.P. Ioannidis Implausible results in human nutrition research BMJ 347 2013 f6698
65. J.D. Schoenfeld, and J.P. Ioannidis Is everything we eat associated with cancer? A systematic cookbook review The Am J Clin Nutr 97 2013 127 134
66. A.B. Hill The environment and disease: association or causation? Proc R Soc Med 58 1965 295 300
67. G.H. Guyatt, A.D. Oxman, H.J. Schunemann, P. Tugwell, and A. Knottnerus GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology J Clin Epidemiol 64 2011 380 382
68. J.P. Ioannidis, N.A. Patsopoulos, and E. Evangelou Uncertainty in heterogeneity estimates in meta-Analyses BMJ 335 2007 914 916
69. A. Lundh, and P.C. Gotzsche Recommendations by Cochrane Review Groups for assessment of the risk of bias in studies BMC Med Res Methodol 8 2008 22