A comparison of 20 heterogeneity variance estimators in statistical synthesis of results from studies: a simulation study

Statistics in Medicine

Volumn 36, Issue 27, 2017, Pages 4266-4280

  Petropoulou, Maria ^a,b   Mavridis, Dimitris ^a,b  

^a UNIVERSITY OF IOANNINA   (Greece)

^b UNIVERSITY OF IOANNINA   (Greece)

Author keywords

coverage probability; heterogeneity variance estimators; length of confidence interval; mean absolute estimation error; simulation study

Indexed keywords

BOOTSTRAPPING; HUMAN; MARKOV CHAIN; MAXIMUM LIKELIHOOD METHOD; META ANALYSIS; OUTCOME ASSESSMENT; PROBABILITY; SIMULATION; SYNTHESIS; COMPARATIVE STUDY; COMPUTER SIMULATION; META ANALYSIS (TOPIC); MONTE CARLO METHOD; STATISTICAL ANALYSIS; STATISTICS;

COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; HUMANS; MARKOV CHAINS; META-ANALYSIS AS TOPIC; MONTE CARLO METHOD; STATISTICS AS TOPIC;

EID: 85032985433     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.7431     Document Type: Article

References (48)

1. Deeks JJ, Higgins JPT, Altman DG, eds. Chapter 9: Analysing data and undertaking meta-analyses. In: Higgins JPT, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions. Chichester (UK): John Wiley & Sons; 2008:244-293.
2. Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Front Matter, in: Introduction to Meta-Analysis. New York: Wiley; 2009.
3. Nikolakopoulou A, Mavridis D, Salanti G. Demystifying fixed and random effects meta-analysis. Evid Based Ment Health. 2014;17(2):53-57.
4. Veroniki AA, Jackson D, Viechtbauer W, et al. Methods to estimate heterogeneity variance and its uncertainty in meta-analysis. Research Synthesis Methods. 2015;7(1):55-79.
5. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177-188.
6. Hedges LV, Olkin I. Statistical Methods for Meta-Analysis. Orlando: Academic Press; 1985.
7. Paule RC, Mandel J. Consensus values and weighting factors. J Res Natl Bur Stand. 1982;87(5):377-385.
8. Kontopantelis E, Springate DA, Reeves D. A re-analysis of the Cochrane Library data: the dangers of unobserved heterogeneity in meta-analyses. PLoS One. 2013;8(7):e69930.
9. DerSimonian R, Kacker R. Random-effects model for meta-analysis of clinical trials: an update. Contemp Clin Trials. 2007;28(2):105-114.
10. Hartung J, Makambi KH. Reducing the number of unjustified significant results in meta-analysis. Commun Stat Simul Comput. 2003;32(4):1179-1190.
11. Hartung J, Makambi KH. Positive estimation of the between-study variance in meta-analysis. South African Statistical Journal. 2002;36(1):55-76.
12. Hunter JE, Schmidt FL. Methods of Meta-Analysis: Correcting Error and Bias in Research Findings. Thousand Oaks, CA: SAGE Publications; 2004.
13. Hardy RJ, Thompson SG. A likelihood approach to meta-analysis with random effects. Stat Med. 1996;15(6):619-629.
14. Thompson SG, Sharp SJ. Explaining heterogeneity in meta-analysis: a comparison of methods. Stat Med. 1999;18(20):2693-2708.
15. Sidik K, Jonkman JN. A comparison of heterogeneity variance estimators in combining results of studies. Stat Med. 2007;26(9):1964-1981. https://doi.org/10.1002/sim.2688
16. Morris CN. Parametric empirical Bayes inference: theory and applications. J Am Stat Assoc. 1983;78(381):47-55.
17. Sidik K, Jonkman JN. Simple heterogeneity variance estimation for meta-analysis. J R Stat Soc Ser C Appl Stat. 2005;54(2):367-384.
18. Rukhin AL. Estimating heterogeneity variance in meta-analysis. J R Stat Soc Ser B Stat Methodol. 2013;75(3):451-469.
19. Lunn DJ, Thomas A, Best N, Spiegelhalter D. WinBUGS—a Bayesian modelling framework: concepts, structure, and extensibility. Stat Comput. 2000;10:325-337.
20. Chung Y, Rabe-Hesketh S, Choi I-H. Avoiding zero between-study variance estimates in random-effects meta-analysis. Stat Med. 2014;32(23):4071-4089.
21. Chung Y, Rabe-Hesketh S, Dorie V, Gelman A, Liu J. A nondegenerate penalized likelihood estimator for variance parameters in multilevel models. Psychometrika. 2013;78(4):685-709.
22. Malzahn U, Böhning D, Holling H. Nonparametric estimation of heterogeneity variance for the standardised difference used in meta-analysis. Biometrika. 2000;87(3):619-632.
23. The Cochrane Collaboration. Review Manager (RevMan) [Computer Program]. Version 5.3. Copenhagen: The Nordic Cochrane Centre; 2014.
24. Bowden J, Tierney JF, Copas AJ, Burdett S. Quantifying, displaying and accounting for heterogeneity in the meta-analysis of RCTs using standard and generalised Q statistics. BMC Med Res Methodol. 2011;11:41.
25. Knapp G, Hartung J. Improved tests for a random effects meta-regression with a single covariate. Stat Med. 2003;22(17):2693-2710.
26. Kontopantelis E, Reeves D. Metaan: random-effects meta-analysis. Stata J. 2010;10:395-407.
27. StataCorp. Stata Statistical Software: Release 14. College Station, TX: StataCorp LP; 2015.
28. Novianti PW, Roes KCB, van der Tweel I. Estimation of between-trial variance in sequential meta-analyses: a simulation study. Contemp Clin Trials. 2014;37(1):129-138.
29. Viechtbauer W. Bias and efficiency of meta-analytic variance estimators in the random-effects model. J Educ Behav Stat. 2005;30(3):261-293.
30. Viechtbauer W. Metafor: meta-analysis package for R, 2013.
31. Schwarzer G, Carpenter JR, Rücker G. Meta-analysis with R. J Stat Softw. 2016;70. https://doi.org/10.18637/jss.v070.b01
32. R Development Core Team. R: A Language and Environment for Statistical Computing. Version 3.2.3. Vienna, Austria: R Foundation for Statistical Computing; 2015 http://www.R-project.org.
33. Harris R, Bradburn M, Deeks J, Harbord R, Altman D, Sterne J. Metan: fixed- and random-effects meta-analysis. Stata J. 2008;8:3-28.
34. Hedges LV. Distribution theory for Glass's estimator of effect size and related estimators. J Educ Behav Stat. 1981;6(2):107-128.
35. Glynn LG, Murphy AW, Smith SM, Schroeder K, Fahey T. Interventions used to improve control of blood pressure in patients with hypertension. Cochrane Database Syst Rev. 2010;17(3): CD005182. https://doi.org/10.1002/14651858.CD005182.pub4
36. Langan D, Higgins JP, Simmonds M. An empirical comparison of heterogeneity variance estimators in 12 894 meta-analyses. Research Synthesis Methods. 2015;6(2):195-205.
37. Hodnett ED, Gates S, Hofmeyr GJ, Sakala C. Continuous support for women during childbirth. Cochrane Database Syst Rev. 2014;10: CD003766.
38. Sturtz S, Ligges U, Gelman A. R2WinBUGS: a package for running WinBUGS from R. J Stat Softw. 2005;12(3):1-16.
39. Turner RM, Davey J, Clarke MJ, Thompson SG, Higgins JPT. Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane database of systematic reviews. Int J Epidemiol. 2012;41(3):818-827.
40. Rhodes KM, Turner RM, Higgins JPT. Predictive distributions were developed for the extent of heterogeneity in meta-analyses of continuous outcome data. J Clin Epidemiol. 2015;68(1):52-60.
41. Kontopantelis E, Reeves D. Performance of statistical methods for meta-analysis when true study effects are non-normally distributed: a simulation study. Stat Methods Med Res. 2010;21(4):409-426.
42. Deeks JJ. Issues in the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes. Stat Med. 2002;21(11):1575-1600.
43. Engels EA, Schmid CH, Terrin N, Olkin I, Lau J. Heterogeneity and statistical significance in meta-analysis: an empirical study of 125 meta-analyses. Stat Med. 2000;19(13):1707-1728.
44. Friedrich JO, Adhikari NKJ, Beyene J. Ratio of means for analyzing continuous outcomes in meta-analysis performed as well as mean difference methods. J Clin Epidemiol. 2011;64(5):556-564.
45. Bradburn MJ, Deeks JJ, Berlin JA, Localio AR. Much ado about nothing: a comparison of the performance of meta-analytical methods with rare events. Stat Med. 2007;26(1):53-77.
46. Kuss O. Statistical methods for meta analyses including information from studies without any events-add nothing to nothing and succeed nevertheless. Stat Med. 2015;34(7):1097-1116.
47. Sweeting MJ, Sutton AJ, Lambert PC. What to add to nothing? Use and avoidance of continuity corrections in meta-analysis of sparse data. Stat Med. 2004;23(9):1351-1375.
48. Panityakul T, Bumrungsup C, Knapp G. On estimating residual heterogeneity in random-effects meta-regression: a comparative study. Journal of Statistical Theory and Applications. 2013;12(3):253.