The heterogeneity statistic I2 can be biased in small meta-analyses

BMC Medical Research Methodology

Volumn 15, Issue 1, 2015, Pages

  Von Hippel, Paul T ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Bias; Heterogeneity; Meta analysis

Indexed keywords

ALGORITHM; BIOMETRY; HUMAN; MATHEMATICAL COMPUTING; META ANALYSIS (TOPIC); METHODOLOGY; PROCEDURES; REPRODUCIBILITY; RESEARCH; SOFTWARE; STANDARDS; STATISTICAL BIAS; STATISTICS AND NUMERICAL DATA;

ALGORITHMS; BIAS (EPIDEMIOLOGY); BIOMETRY; HUMANS; MATHEMATICAL COMPUTING; META-ANALYSIS AS TOPIC; REPRODUCIBILITY OF RESULTS; RESEARCH; RESEARCH DESIGN; SOFTWARE;

EID: 84928544928     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/s12874-015-0024-z     Document Type: Article

References (26)

1. Melsen WG, Bootsma MCJ, Rovers MM, Bonten MJM. The effects of clinical and statistical heterogeneity on the predictive values of results from meta-analyses. Clin Microbiol Infect. 2014;20(2):123-9.
2. Ioannidis JPA, Patsopoulos NA, Evangelou E. Uncertainty in heterogeneity estimates in meta-analyses. BMJ. 2007;335(7626):914-6.
3. Davey J, Turner RM, Clarke MJ, Higgins JP. "Characteristics of meta-analyses and their component studies in the Cochrane Database of Systematic Reviews: a cross-sectional, descriptive analysis". BMC Med Res Methodol. 2011;11(1):160.
4. Cochran WG. The combination of estimates from different experiments. Biometrics. 1954;10:101-29.
5. Hardy RJ, Thompson SG. Detecting and describing heterogeneity in meta-analysis. Stat Med. 1998;17(8):841-56.
6. Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21(11):1539-58.
7. Koedel C. An empirical analysis of teacher spillover effects in secondary school. Econ Educ Rev. 2009;28(6):682-92.
8. Koedel C, Parsons E, Podgursky M, Ehle M. Teacher preparation programs and teacher quality: are there real differences across programs? Washington, DC: American Institutes for Research; 2012. CALDER working paper 63.
9. von Hippel PT, Osborne C, Lincove A, Bellows L, Mills N. The challenges of seeking exceptional teacher preparation programs among many noisy estimates. Rochester, NY: Social Science Research Network; 2014. SSRN Scholarly Paper ID 2506935.
10. Kivimäki M, Batty GD, Ferrie JE, Kawachi I. Cumulative meta-analysis of job strain and CHD. Epidemiology. 2014;25(3):464-5.
11. Aune D, Saugstad OD, Henriksen T, Tonstad S. Physical activity and the risk of preeclampsia: a systematic review and meta-analysis. Epidemiology. 2014;25(3):331-43.
12. Crippa A, Discacciati A, Larsson SC, Wolk A, Orsini N. Coffee consumption and mortality from all causes, cardiovascular disease, and cancer: a dose-response meta-analysis. Am J Epidemiol. 2014;180(8):763-75.
13. Kim Y, Je Y. Dietary fiber intake and total mortality: a meta-analysis of prospective cohort studies. Am J Epidemiol. 2014;180(6):565-73.
14. Cochrane Collaborative, "Cochrane Library", 2015. [Online]. Available: http://www.cochranelibrary.com/. [Accessed: 25-Feb-2015].
15. Hedges LV, Vevea JL. Fixed- and random-effects models in meta-analysis. Psychol Methods. 1998;3(4):486-504.
16. Higgins JPT, Thompson SG, Spiegelhalter DJ. A re-evaluation of random-effects meta-analysis. J R Stat Soc A Stat Soc. 2009;172(1):137-59.
17. Rücker G, Schwarzer G, Carpenter JR, Schumacher M. "Undue reliance on I2 in assessing heterogeneity may mislead". BMC Med Res Methodol. 2008;8(1):79.
18. Biggerstaff BJ, Jackson D. The exact distribution of Cochran's heterogeneity statistic in one-way random effects meta-analysis. Stat Med. 2008;27(29):6093-110.
19. Hedges LV, Pigott TD. The power of statistical tests in meta-analysis. Psychol Methods. 2001;6(3):203-17.
20. Engels EA, Schmid CH, Terrin N, Olkin I, Lau J. Heterogeneity and statistical significance in meta-analysis: an empirical study of 125 meta-analyses. Stat Med. 2000;19(13):1707-28.
21. Bock ME, Judge GG, Yancey TA. A simple form for the inverse moments of non-central χ2 andF random variables and certain confluent hypergeometric functions. J Econometrics. 1984;25(1-2):217-34.
22. Turner RM, Davey J, Clarke MJ, Thompson SG, Higgins JP. Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane Database of Systematic Reviews. Int J Epidemiol. 2012;41(3):818-27.
23. Viechtbauer W. Bias and efficiency of meta-analytic variance estimators in the random-effects model. J Educ Behav Stat. 2005;30(3):261-93.
24. Chung Y, Rabe-Hesketh S, Choi I-H. Avoiding zero between-study variance estimates in random-effects meta-analysis. Stat Med. 2013;32(23):4071-89.
25. Hartung J, Knapp G. On confidence intervals for the among-group variance in the one-way random effects model with unequal error variances. J Stat Plann Infer. 2005;127(1-2):157-77.
26. Ray KK, Seshasai SRK, Erqou S, Sever P, Jukema JW, Ford I, et al. Statins and all-cause mortality in high-risk primary prevention: a meta-analysis of 11 randomized controlled trials involving 65,229 participants. Arch Intern Med. 2010;170(12):1024-31.