Detecting small-study effects and funnel plot asymmetry in meta-analysis of survival data: A comparison of new and existing tests

Research Synthesis Methods

Volumn 9, Issue 1, 2018, Pages 41-50

  Debray, Thomas P A ^a   Moons, Karel G M ^a   Riley, Richard D ^b  

^a UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^b KEELE UNIVERSITY   (United Kingdom)

Author keywords

funnel plot; meta analysis; publication bias; RCT; small study effects; survival

Indexed keywords

FIBRINOGEN;

ALGORITHM; BLOOD; COMPUTER SIMULATION; CORONARY ARTERY DISEASE; HUMAN; META ANALYSIS (TOPIC); METABOLISM; METHODOLOGY; MORTALITY; ODDS RATIO; PATIENT DROPOUT; PATIENT PARTICIPATION; PROPORTIONAL HAZARDS MODEL; PUBLISHING; RANDOMIZED CONTROLLED TRIAL (TOPIC); REPRODUCIBILITY; RISK; SAMPLE SIZE; STATISTICAL MODEL; SURVIVAL ANALYSIS; TREATMENT OUTCOME;

ALGORITHMS; COMPUTER SIMULATION; CORONARY DISEASE; FIBRINOGEN; HUMANS; META-ANALYSIS AS TOPIC; MODELS, STATISTICAL; ODDS RATIO; PATIENT DROPOUTS; PATIENT PARTICIPATION; PROPORTIONAL HAZARDS MODELS; PUBLICATION BIAS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; RISK; SAMPLE SIZE; SURVIVAL ANALYSIS; TREATMENT OUTCOME;

EID: 85036579275     PISSN: None     EISSN: 17592887     Source Type: Journal    
DOI: 10.1002/jrsm.1266     Document Type: Article

References (39)

1. Rothstein H, Sutton AJ, Borenstein M. (Eds.) Chapter 10. Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments. Chichester, England; Hoboken, NJ: Wiley; 2005.
2. Ioannidis JP, Contopoulos-Ioannidis DG, Lau J. Recursive Cumulative Meta-analysis: a diagnostic for the evolution of total randomized evidence from group and individual patient data. J Clin Epidemiol. 1999;52:281-291.
3. Sterne JAC, Harbord RM. Funnel plots in meta-analysis. The Stat J. 2004;4:127-141.
4. Sterne JAC, Sutton AJ, Ioannidis JP, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343:d4002.
5. Deeks JJ, Higgins JPT, Altman DG. Chapter 9: Analysing data and undertaking meta-analyses. In: Higgins JP, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions. 5.1.0, Vol. 9: Cochrane; 2011. www.handbook.cochrane.org.
6. Jin Z-C, Zhou X-H, He J. Statistical methods for dealing with publication bias in meta-analysis. Stat Med. 2014;34:343-360.
7. Moreno SG, Sutton AJ, Ades AE, et al. Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study. BMC Med Res Methodol. 2009;9:2.
8. Macaskill P, Walter SD, Irwig L. A comparison of methods to detect publication bias in meta-analysis. Stat Med. 2001;20:641-654.
9. Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Comparison of two methods to detect publication bias in meta-analysis. JAMA. 2006;295:676-680.
10. Sterne JAC, Egger M, Moher D. Chapter 10: Addressing reporting biases. In: Higgins JPT, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions. 5.1.0, Vol. 10: Cochrane; 2011. www.cochrane-handbook.org.
11. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315:629-634.
12. Song F, Parekh S, Hooper L, et al. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010;14. https://doi.org/10.3310/hta14080
13. Sterne JA, Gavaghan D, Egger M. Publication and related bias in meta-analysis: Power of statistical tests and prevalence in the literature. J Clin Epidemiol. November 2000;53:1119-1129.
14. Thompson SG, Sharp SJ. Explaining heterogeneity in meta-analysis: a comparison of methods. Stat Med. 1999;18:2693-2708. https://doi.org/10.1002/(SICI)1097-0258(19991030)18:20<2693::AID-SIM235>3.0.CO;2-V
15. Harbord RM, Egger M, Sterne JAC. A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Stat Med. 2006;25:3443-3457. https://doi.org/10.1002/sim.2380
16. Irwig L, Macaskill P, Berry G, Glasziou P. Bias in meta-analysis detected by a simple, graphical test. Graphical test is itself biased. BMJ. 1998;316:470-471.
17. Cao X. Relative performance of expected and observed {Fisher} information in covariance estimation for maximum likelihood estimates. Ph.D. Thesis: Johns Hopkins University. Baltimore, Maryland; 2013.
18. Concato J, Peduzzi P, Holford TR, Feinstein AR. Importance of events per independent variable in proportional hazards analysis. I. Background, goals, and general strategy. J Clin Epidemiol. 1995;48:1495-1501.
19. Peduzzi P, Concato J, Feinstein AR, Holford TR. Importance of events per independent variable in proportional hazards regression analysis. II. Accuracy and precision of regression estimates. J Clin Epidemiol. 1995;48:1503-1510.
20. Gart JJ, Zweifel JR. On the bias of various estimators of the logit and its variance with application to quantal bioassay. Biometrika. 1967;54:181-187.
21. Parmar MKB, Torri V, Stewart L. Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. Stat Med. 1998;17:2815-2834. https://doi.org/10.1002/(SICI)1097-0258(19981230)17:24<2815::AID-SIM110>3.0.CO;2-8
22. Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Performance of tests and adjustments for publication bias in the presence of heterogeneity. Technical Report 05-01, Leicester, England: Dept of Health Sciences, University of Leicester; 2005.
23. Thompson S, Kaptoge S, White I, et al. Statistical methods for the time-to-event analysis of individual participant data from multiple epidemiological studies. Int J Epidemiol. 2010;39:1345-1359. https://doi.org/10.1093/ije/dyq063
24. Fibrinogen Studies Collaboration. Collaborative meta-analysis of prospective studies of plasma fibrinogen and cardiovascular disease. Eur J Cardiovasc Prev Rehabil. 2004;11:9-17.
25. Bohlius J, Schmidlin K, Brillant C, et al. Erythropoietin or Darbepoetin for patients with cancer–meta-analysis based on individual patient data. Cochrane Database Syst Rev. 2009:CD007303. https://doi.org/10.1002/14651858.CD007303.pub2
26. Pan A, Sun Q, Okereke OI, Rexrode KM, Hu FB. Depression and risk of stroke morbidity and mortality: A meta-analysis and systematic review. JAMA. 2011;306:1241-1249.
27. Burton A, Altman DG, Royston P, Holder RL. The design of simulation studies in medical statistics. Stat Med. 2006;25:4279-4292. https://doi.org/10.1002/sim.2673
28. Bender R, Augustin T, Blettner M. Generating survival times to simulate Cox proportional hazards models. Stat Med. 2005;24:1713-1723. https://doi.org/10.1002/sim.2059
29. Feuer EJ, Kessler LG, Baker SG, Triolo HE, Green DT. The impact of breakthrough clinical trials on survival in population based tumor registries. J Clin Epidemiol. 1991;44:141-153.
30. Qian J, Li B, Chen P-Y. Generating Survival Data in the Simulation Studies of Cox Model. IEEE; June 2010:93-96. http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=5514026, https://doi.org/10.1109/ICIC.2010.294
31. Jin Z-C, Wu C, Zhou X-H, He J. A modified regression method to test publication bias in meta-analyses with binary outcomes. BMC Med Res Methodol. 2014;14:132.
32. Rücker G, Schwarzer G, Carpenter J. Arcsine test for publication bias in meta-analyses with binary outcomes. Stat Med. 2008;27:746-763. https://doi.org/10.1002/sim.2971
33. Schwarzer G, Antes G, Schumacher M. Inflation of type I error rate in two statistical tests for the detection of publication bias in meta-analyses with binary outcomes. Stat Med. 2002;21:2465-2477. https://doi.org/10.1002/sim.1224
34. McShane BB, Bckenholt U, Hansen KT. Adjusting for Publication Bias in Meta-Analysis: An Evaluation of Selection Methods and Some Cautionary Notes. Perspect Psychol Sci. 2016;11:730-749. https://doi.org/10.1177/1745691616662243
35. Mavridis D, Sutton A, Cipriani A, Salanti G. A fully Bayesian application of the Copas selection model for publication bias extended to network meta-analysis. Stat Med. 2013;32:51-66. https://doi.org/10.1002/sim.5494
36. Sutton AJ, Song F, Gilbody SM, Abrams KR. Modelling publication bias in meta-analysis: A review. Stat Methods Med Res. 2000;9:421-445.
37. Copas JB. What works?: Selectivity models and meta-analysis. J R Stat Soc Ser A Stat Soc. 1999;162:95-109. https://doi.org/10.1111/1467-985X.00123
38. Rücker G, Carpenter JR, Schwarzer G. Detecting and adjusting for small-study effects in meta-analysis. Biom J. 2011;53:351-368. https://doi.org/10.1002/bimj.201000151
39. Terrin N, Schmid CH, Lau J, Olkin I. Adjusting for publication bias in the presence of heterogeneity. Stat Med. 2003;22:2113-2126. https://doi.org/10.1002/sim.1461