Statistical methods for dealing with publication bias in meta-analysis

Statistics in Medicine

Volumn 34, Issue 2, 2015, Pages 343-360

  Jin, Zhi Chao ^a   Zhou, Xiao Hua ^b   He, Jia ^a  

^a SECOND MILITARY MEDICAL UNIVERSITY   (China)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Funnel plots; Meta analysis; Publication bias

Indexed keywords

ACCURACY; ARCSINE BEGG TEST; ARCSINE REGRESSION METHOD; ARTICLE; ASYMMETRY OF FUNNEL PLOT; BAYES THEOREM; BEGG TEST; CHILDBIRTH; COMPUTER PROGRAM; COPAS SENSITIVITY ANALYSIS; DEAR AND BEGG SELECTION FUNCTION; DICHOTOMOUS OUTCOME; EFFECT SIZE; EGGER TEST; HARBORD TEST; HUMAN; IYENGAR AND GREENHOUSE SELECTION FUNCTION; LOGISTIC WEIGHT FUNCTION; MACASKILL TEST; MAXIMUM LIKELIHOOD METHOD; META ANALYSIS (TOPIC); OUTCOME VARIABLE; PETERS TEST; PUBLISHING; RANK CORRELATION TEST; REGRESSION ANALYSIS; ROSENTHAL FILE DRAWER METHOD; SAMPLE SIZE; SCHWARZER TEST; SELECTION MODEL; SENSITIVITY ANALYSIS; SOCIAL SUPPORT; STATISTICAL ANALYSIS; STATISTICAL CONCEPTS; STATISTICAL MODEL; STATISTICAL SIGNIFICANCE; STEP WEIGHT FUNCTION OF HEDGES; TRIM AND FILL METHOD; VAGINAL DELIVERY; DELIVERY; FEMALE; LITERATURE; PROCEDURES; STANDARDS; STATISTICAL BIAS; STATISTICS AND NUMERICAL DATA;

BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; DELIVERY, OBSTETRIC; FEMALE; HUMANS; LOGISTIC MODELS; META-ANALYSIS AS TOPIC; PUBLICATION BIAS; REVIEW LITERATURE AS TOPIC;

EID: 84916241549     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.6342     Document Type: Article

References (76)

1. Rosenthal R. The file drawer problem and tolerance for null results. Psychological Bulletin 1979; 86:638-641.
2. Song F, Eastwood AJ, Gilbody S, Duley L, Sutton AJ. Publication and related biases. Health Technology Assessment 2000; 4:1-115.
3. Rothstein H, Sutton AJ, Borenstein M. Publication Bias in Meta-analysis: Prevention, Assessment and Adjustments. Wiley: New York, 2005.
4. Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, Carpenter J, Rucker G, Harbord RM, Schmid CH, Tetzlaff J, Deeks JJ, Peters J, Macaskill P, Schwarzer G, Duval S, Altman DG, Moher D, Higgins JP. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. British Medical Journal 2011; 343:d4002.
5. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. British Medical Journal 1997; 315:629-634.
6. Light RJ, Pillemer DB. Summing Up: The Science of Reviewing Research. Harvard University Press.: Cambridge, MA, 1984.
7. Rucker G, Schwarzer G, Carpenter J. Arcsine test for publication bias in meta-analyses with binary outcomes. Statistics in Medicine 2008; 27:746-763.
8. Harbord RM, Egger M, Sterne JA. A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Statistics in Medicine 2006; 25:3443-3457.
9. Sterne JA, Egger M. Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. Journal of Clinical Epidemiology 2001; 54:1046-1055.
10. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994; 50:1088-1101.
11. Macaskill P, Walter SD, Irwig L. A comparison of methods to detect publication bias in meta-analysis. Statistics in Medicine 2001; 20:641-654.
12. Sterne JA, Gavaghan D, Egger M. Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology 2000; 53:1119-1129.
13. Schwarzer G, Antes G, Schumacher M. A test for publication bias in meta-analysis with sparse binary data. Statistics in Medicine 2007; 26:721-733.
14. Kulinskaya E, Morgenthaler S, Staudte RG. Meta Analysis: A Guide to Calibrating and Combining Statistical Evidence. John Wiley & Sons: Chichester, England, 2008.
15. Kulinskaya E, Morgenthaler S, Staudte RG. Variance stabilizing the difference of two binomial proportions. The American Statistician 2010; 64:350-356.
16. Kulinskaya E, Morgenthaler S, Staudte RG. Combining the evidence using stable weights. Research Synthesis Methods 2010; 1:284-296.
17. Rucker G. Small-study effects and heterogeneity in meta-analysis. PhD Thesis, University of Freiburg: City, 2010.
18. Copas J, Shi JQ. Meta-analysis, funnel plots and sensitivity analysis. Biostatistics 2000; 1:247-262.
19. Stern JM, Simes RJ. Publication bias: evidence of delayed publication in a cohort study of clinical research projects. British Medical Journal 1997; 315:640-645.
20. Galbraith RF. Graphical display of estimates having differing standard errors. Technometrics 1988; 30:271-281.
21. Galbraith RF. A note on graphical presentation of estimated odds ratios from several clinical trials. Statistics in Medicine 1988; 7:889-894.
22. Moreno SG, Sutton AJ, Ades AE, Stanley TD, Abrams KR, Peters JL, Cooper NJ. Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study. BMC Medical Research Methodology 2009; 9:2.
23. Moreno SG, Sutton AJ, Thompson JR, Ades AE, Abrams KR, Cooper NJ. A generalized weighting regression-derived meta-analysis estimator robust to small-study effects and heterogeneity. Statistics in Medicine 2012; 31:1407-1417.
24. Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Comparison of two methods to detect publication bias in meta-analysis. The Journal of the American Medical Association 2006; 295:676-680.
25. Schwarzer G, Antes G, Schumacher M. Inflation of type I error rate in two statistical tests for the detection of publication bias in meta-analyses with binary outcomes. Statistics in Medicine 2002; 21:2465-2477.
26. Copas J, Lozada-Can C. The radial plot in meta-analysis: approximations and applications. Journal of the Royal Statistical Society: Series C (Applied Statistics) 2009; 58:329-344.
27. Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Performance of tests and adjustments for publication bias in the presence of heterogeneity, Technical Report 05-01 Department of Health Sciences, University of Leicester: City, 2005.
28. Whitehead J. The design and analysis of sequential clinical trials. John Wiley & Sons: Horwood (Chichester and New York), 1983.
29. Thompson SG, Sharp SJ. Explaining heterogeneity in meta-analysis: a comparison of methods. Statistics in Medicine 1999; 18:2693-2708.
30. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000; 56:455-463.
31. Duval S, Tweedie R. A nonparametric "trim and fill" method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association 2000; 95:89-98.
32. Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity. Statistics in Medicine 2007; 26:4544-4562.
33. Terrin N, Schmid CH, Lau J, Olkin I. Adjusting for publication bias in the presence of heterogeneity. Statistics in Medicine 2003; 22:2113-2126.
34. Duva S, Weinhandl E. Correcting for Publication Bias in the Presence of Covariates. Minnesota Evidence-based Practice Center: City, September 2011.
35. Sutton AJ, Song F, Gilbody SM, Abrams KR. Modelling publication bias in meta-analysis: a review. Statistical Methods in Medical Research 2000; 9:421-445.
36. Iyengar S, Greenhouse J. Selection models and the file drawer problem. Statistical Science 1988; 3:109-117.
37. Hedges LV. Selection models and the file drawer problem: comment. Statistical Science 1988; 3:118-120.
38. Preston C, Ashby D, Smyth R. Adjusting for publication bias: modelling the selection process. Journal of Evaluation in Clinical Practice 2004; 10:313-322.
39. Dear KBG, Begg CB. An approach for assessing publication bias prior to performing a meta-analysis. Statistical Science 1992; 7:2378-2245.
40. Rufibach K. Selection models with monotone weight functions in meta analysis. Biometrical Journal 2011; 53:689-704.
41. Hedges LV. Modeling publication selection effects in meta-analysis. Statistical Science 1992; 7:246-255.
42. Vevea J, Hedges L. A general linear model for estimating effect size in the presence of publication bias. Psychometrika 1995; 60:419-435.
43. Vevea JL, Woods CM. Publication bias in research synthesis: sensitivity analysis using a priori weight functions. Psychological Methods 2005; 10:428-443.
44. Heckman J. Sample selection bias as a specification error. Journal of the econometric society 1979; 47:153-161.
45. Copas J. What works?: selectivity models and meta-analysis. Journal of the Royal Statistical Society, Series A 1999; 162:95-109.
46. Copas JB, Li HG. Inference for non-random samples. Journal of the Royal Statistical Society: Series B (Methodological) 1997; 59:55-95.
47. Copas JB, Shi JQ. A sensitivity analysis for publication bias in systematic reviews. Statistical Methods in Medical Research 2001; 10:251-265.
48. Carpenter JR, Schwarzer G, Rucker G, Kunstler R. Empirical evaluation showed that the Copas selection model provided a useful summary in 80% of meta-analyses. Journal of Clinical Epidemiology 2009; 62:624-631 e624.
49. Schwarzer G, Carpenter J, Rucker G. Empirical evaluation suggests Copas selection model preferable to trim-and-fill method for selection bias in meta-analysis. Journal of Clinical Epidemiology 2010; 63:282-288.
50. Copas J, Jackson D. A bound for publication bias based on the fraction of unpublished studies. Biometrics 2004; 60:146-153.
51. Copas JB. A likelihood-based sensitivity analysis for publication bias in meta-analysis. Journal of the Royal Statistical Society: Series C (Applied Statistics) 2013; 62:47-66.
52. Copas JB, Malley PF. A robust P-value for treatment effect in meta-analysis with publication bias. Statistics in Medicine 2008; 27:4267-4278.
53. Henmi M, Copas JB, Eguchi S. Confidence intervals and P-values for meta-analysis with publication bias. Biometrics 2007; 63:475-482.
54. Cleary RJ, Casella G. An application of Gibbs sampling to estimation in meta-analysis: accounting for publication bias. Journal of Educational and Behavioral Statistics 1997; 22:141-154.
55. Larose DT, Dey DK. Modeling publication bias using weighted distributions in a Bayesian framework. Computational Statistics & Data Analysis 1998; 26:279-302.
56. Silliman NP. Hierarchical selection models with applications in meta-analysis. Journal of the American Statistical Association 1997; 92:926-936.
57. Lambert PC, Sutton AJ, Burton PR, Abrams KR, Jones DR. How vague is vague? A simulation study of the impact of the use of vague prior distributions in MCMC using WinBUGS. Statistics in Medicine 2005; 24:2401-2428.
58. Givens GH, Smith DD, Tweedie RL. Publication bias in meta-analysis: a Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debate. Statistical Science 1997; 12:221-240.
59. Bennett DA, Latham NK, Stretton C, Anderson CS. Capture-recapture is a potentially useful method for assessing publication bias. Journal of Clinical Epidemiology 2004; 57:349-357.
60. Poorolajal J, Haghdoost AA, Mahmoodi M, Majdzadeh R, Nasseri-Moghaddam S, Fotouhi A. Capture-recapture method for assessing publication bias. Journal of Research in Medical Sciences 2010; 15:107-115.
61. Carpenter J, Rucker G, Schwarzer G. Assessing the sensitivity of meta-analysis to selection bias: a multiple imputation approach. Biometrics 2011; 67:1066-1072.
62. Baker R, Jackson D. Using journal impact factors to correct for the publication bias of medical studies. Biometrics 2006; 62:785-792.
63. Henmi M, Copas JB. Confidence intervals for random effects meta-analysis and robustness to publication bias. Statistics in Medicine 2010; 29:2969-2983.
64. Shi JQ, Copas J. Publication bias and meta-analysis for 2x2 tables: an average Markov chain Monte Carlo EM algorithm. Journal of the Royal Statistical Society: Series B 2002; 64:221-236.
65. Review Manager (RevMan) [Computer program]. Version 5. 1. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2011.
66. Development Core Team R. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0. 2011. (Available from: http://www.R-project.org/) [Accessed on 1 April 2014].
67. Viechtbauer W. Conducting meta-analyses in R with the metafor package. Journal of Statistical Software 2010; 36:1-48.
68. Schwarzer G. meta: an R package for meta-analysis. R News 2007; 7:40-45.
69. Rendina-Gobioff G, Kromre JD. PUB_BIAS: a SAS macro for detecting publication bias in meta-analysis, 2006. (Available from: http://analytics.ncsu.edu/sesug/2006/PO04_06.PDF) [Accessed on 10 May 2011].
70. StataCorp. Stata Statistical Software: Release 10. College Station. TX: StataCorp LP, 2007.
71. METABIAS. Stata module to test for small-study effects in meta-analysis. Boston College Department of Economics, 2000.
72. METATRIM. Stata module to perform nonparametric analysis of publication bias. Boston College Department of Economics, 2000.
73. Preston C. Statistical models of publication basis in meta-analysis. PhD Thesis, University of London: City, 2000.
74. Carpenter J, Rücker G, Schwarzer G. copas: an R package for fitting the Copas selection model. The R Journal 2009; 1:31-36.
75. Field AP, Gillett R. How to do a meta-analysis. British Journal of Mathematical and Statistical Psychology 2010; 63:665-694.
76. Hodnett ED, Gates S, Hofmeyr GJ, Sakala C. Continuous support for women during childbirth. Cochrane Database System Review 2013; 7:CD003766.