Exploring heterogeneity in meta-analyses: Needs, resources and challenges

Paediatric and Perinatal Epidemiology

Volumn 22, Issue SUPPL. 1, 2008, Pages 18-28

  Xu, Hairong ^a   Platt, Robert W ^b   Luo, Zhong Cheng ^a   Wei, Shuqin ^a   Fraser, William D ^a,c  

^a UNIVERSITY OF MONTREAL   (Canada)

^b MCGILL UNIVERSITY   (Canada)

^c UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

Heterogeneity; Meta analysis; Statistical methodology

Indexed keywords

CLINICAL ASSESSMENT; COCHRANE LIBRARY; CONFERENCE PAPER; HEALTH CARE; HEALTH CARE PLANNING; HEALTH SERVICE; HUMAN; MATHEMATICAL MODEL; MEDICAL LITERATURE; META ANALYSIS; PERINATAL CARE; REGRESSION ANALYSIS; STATISTICAL ANALYSIS; STATISTICAL SIGNIFICANCE;

EID: 38849126864     PISSN: 02695022     EISSN: 13653016     Source Type: Journal    
DOI: 10.1111/j.1365-3016.2007.00908.x     Document Type: Conference Paper

References (94)

1. Thompson SG. Why sources of heterogeneity in meta-analysis should be investigated. British Medical Journal 1994 309 : 1351 1355.
2. Thompson SG, Smith TC, Sharp SJ. Investigation underlying risk as a source of heterogeneity in meta-analysis. Statistics in Medicine 1997 16 : 2741 2758.
3. Brand R, Kragt H. Importance of trends in the interpretation of an overall odds ratio in the meta-analysis of clinical trials. Statistics in Medicine 1992 11 : 2077 2082.
4. Smith GD, Egger M. Commentary on the cholesterol papers: statistical problems. British Medical Journal 1994 308 : 1025 1027.
5. Gelber RD, Goldhirsch A. The evaluation of subsets in meta-analysis. Statistics in Medicine 1987 6 : 371 388.
6. Cochran WG. The combination of estimates from different experiments. Biometrics 1954 10 : 101 129.
7. Hardy RJ, Thompson SG. Detecting and describing heterogeneity in meta-analysis. Statistics in Medicine 1998 17 : 841 856.
8. Jones MP, O'Gorman TW, Lemke JH, Woolson RF. A Monte Carlo investigation of homogeneity tests of the odds ratio under various sample size configurations. Biometrics 1989 45 : 171 181.
9. Paul SR, Donner A. Small sample performance of tests for homogeneity of odds ratios in K 2X2 tables. Statistics in Medicine 1992 11 : 159 165.
10. Fleiss JL. Analysis of data from multiclinic trials. Controlled Clinical Trials 1986 7 : 267 275.
11. Jackson D. The power of the standard test for the presence of heterogeneity in meta analysis. Statistics in Medicine 2006 25 : 2688 2699.
12. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analysis. British Medical Journal 2003 327 : 557 560.
13. Breslow NE, Day NE. The analysis of case-control studies. In : Statistical Methods in Cancer Research, Vol. 1. Editor : Davis W. Lyon : IARC Scientific Publications, 1980 pp. 142 143.
14. Hedges LV, Olkin I. Fitting parametric fixed effect models to effect sizes: categorical models. In : Statistical Methods for Meta-Analysis. Editors : Hedges LV, Olkin I. New York : Academic Press, 1985 pp. 149 156.
15. Hardy RJ, Thompson SG. A likelihood approach to meta-analysis with random effects. Statistics in Medicine 1996 15 : 619 629.
16. Zelen M. The analysis of several 2 × 2 contingency tables. Biometrika 1971 58 : 129 137.
17. Rosenthal R. Parametric measures of effect size. In : The Handbook of Research Synthesis. Editors : Copper H, Hedges LV. New York : Russell Sage Foundation, 1994 pp. 231 244.
18. Higgins JPT, Thompson SG. Quantifying heterogeneity in meta-analysis. Statistics in Medicine 2002 21 : 1539 1558.
19. Schmid JE, Koch GG, LaVange LM. An overview of statistical issues and methods of meta-analysis. Journal of Biopharmaceutical Statistics 1991 1 : 103 120.
20. Galbraith RF. A note on graphical presentation of estimated odds ratios from several clinical trials. Statistics in Medicine 1988 7 : 889 894.
21. L'Abbé KA, Detsky AS, O'Rourke K. Meta-analysis in clinical research. Annals of Internal Medicine 1987 107 : 224 233.
22. Sharp SJ, Thompson SG, Altman DG. The relation between treatment benefit and underlying risk in meta-analysis. British Medical Journal 1996 313 : 735 738.
23. Song F. Exploring heterogeneity in meta-analysis: is L'Abbé plot useful? Journal of Clinical Epidemiology 1999 52 : 725 730.
24. DerSimonian R, Laird N. Meta analysis in clinical trials. Controlled Clinical Trials 1986 7 : 177 188.
25. Dempster AP, Laird NM, Rubin DB. Maximum likelihood from incomplete via the EM algorithm. Journal of the Royal Statistical Society 1977 B39 : 1 38.
26. Berlin JA, Laird NM, Sacks HS, Chalmers TC. A comparison of statistical methods for combining event rates from clinical trials. Statistics in Medicine 1989 8 : 141 151.
27. Mengersen KL, Tweedie RL, Biggerstaff BJ. The impact of method choice in meta-analysis. Australian Journal of Statistics 1995 37 : 19 44.
28. Villar J, Mackey ME, Carroli G, Donner A. Meta-analyses in systematic reviews of randomized controlled trials in perinatal medicine: comparison of fixed and random effects models. Statistics in Medicine 2001 20 : 3635 3647.
29. Greenland S. Quantitative methods in the review of epidemiologic literature. Epidemiologic Reviews 1987 9 : 1 30.
30. Peto R. Why do we need systematic overviews of randomized trials? Statistics in Medicine 1987 6 : 233 240.
31. Thompson SG, Pocock SJ. Can meta-analyses be trusted? Lancet 1991 338 : 1127 1130.
32. Spector TD, Thompson SG. The potential and limitations of meta analysis. Journal of Epidemiology and Community Health 1991 45 : 89 92.
33. Bailey KR. Inter-study differences: how should they influence the interpretation and analysis of results? Statistics in Medicine 1987 6 : 351 358.
34. Cochrane HIV/AIDS Group's Editorial Policy: Dealing with Heterogeneity and Statistical Analysis. http://www.igh.org/Cochrane/pdfs/EP_heterogeneity.pdf [last accessed April 1, 2007 J, Thompson S, Deeks J, Altman D. Statistical heterogeneity in systematic reviews of clinical trials: a critical appraisal of guidelines and practice. Journal of Health Services Research & Policy 2002 7 : 51 61.
35. Oxman AD, Guyatt GH. A consumers guide to subgroup analysis. Annals of Internal Medicine 1992 116 : 78 84.
36. Counsell CE, Clark MJ, Slattery J, Sandercock PAG. The miracle of DICE therapy for acute stroke: factor for fictional product of subgroup analysis? British Medical Journal 1994 309 : 1677 1681.
37. Berkey CS, Hoaglin DC, Mosteller F, Colditz GA. A random effects regression model for meta analysis. Statistics in Medicine 1995 14 : 395 411.
38. Thompson SG, Sharp SJ. Explaining heterogeneity in meta analysis: a comparison of methods. Statistics in Medicine 1999 18 : 2693 2708.
39. Higgins JP, Thompson SG. Controlling the risk of spurious findings from meta-regression. Statistics in Medicine 2004 23 : 1663 1682.
40. Sharp SJ. Meta-analysis regression. Stata Technical Bulletin 1998 42 : 16 22 (sbe23).
41. Stram DO. Meta analysis of published data using a linear mixed effects model. Biometrics 1996 52 : 536 544.
42. Begg CB, Pilote L. A model for incorporating historical controls into a meta analysis. Biometrics 1991 47 : 899 906.
43. McIntosh MW. The population risk as an explanatory variable in research synthesis of clinical trials. Statistics in Medicine 1996 15 : 1713 1728.
44. Cook RJ, Walter SD. A logistic model for trend in 2 × 2 × kappa tables with applications to meta analysis. Biometrics 1997 53 : 352 357.
45. Platt RW, Leroux BG, Breslow N. Generalized linear mixed models for meta-analysis. Statistics in Medicine 1999 18 : 643 654.
46. Smith TC, Spiegelhalter DJ, Thomas A. Bayesian approaches to meta analysis: a comparative study. Statistics in Medicine 1995 14 : 2685 2699.
47. Gilks WR, Thomas A, Spiegelhalter DJ. A language and program for complex Bayesian modelling. The Statistician 1994 43 : 169 177.
48. Rogatko A. Bayesian approach for meta analysis of controlled clinical trials. Communications in Statistics-Theory and Methods 1992 21 : 1441 1462.
49. Salanti G, Higgins JP, Trikalinos TA. Ioannidis JP. Bayesian meta-analysis and meta-regression for gene-disease associations and deviations from Hardy-Weinberg equilibrium. Statistics in Medicine 2007 26 : 553 567.
50. van Houwelingen HC, Arends LR, Stijnen T. Advanced methods in meta-analysis: multivariate approach and meta-regression. Statistics in Medicine 2002 21 : 589 624.
51. Schmid CH. Using Bayesian inference to perform meta-analysis. Evaluation and the Health Professions 2001 24 : 165 189.
52. Arends LR, Hoes AW, Lubsen J, Grobbee DE, Stijnen T. Baseline risk as predictor of treatment benefit: three clinical meta-re-analyses. Statistics in Medicine 2000 19 : 3497 3518.
53. Sharp SJ, Thompson SG. Analysing the relationship between treatment effect and underlying risk in meta analysis: comparison and development of approaches. Statistics in Medicine 2000 19 : 3251 3274.
54. Schmid CH. Exploring heterogeneity in randomised trials via meta-analysis. Drug Information Journal 1999 33 : 211 224.
55. Greenwood CMT, Midgley JP, Matthew AG, Logan AG. Statistical issues in a meta-regression analysis of randomized trials: impact on the dietary sodium intake and blood pressure relationship. Biometrics 1999 55 : 630 636.
56. Thompson SG, Higgins JPT. How should meta-regression analyses be undertaken and interpreted? Statistics in Medicine 2002 21 : 1559 1573.
57. Berlin JA, Antman EM. Advantages and limitations of meta-analytic regressions of clinical trial data. Online Journal of Current Clinical Trials 1994 Doc. No. 134.
58. Colditz GA, Burdick E, Mosteller F. Heterogeneity in meta analysis of data from epidemiologic studies: a commentary. American Journal of Epidemiology 1995 142 : 371 382.
59. Arthur W, Bennett W, Huffcutt A. Choice of software and programs in meta-analysis research: does it make a difference? Educational and Psychological Measurement 1994 54 : 776 787.
60. Egger M, Sterne JAC, Smith GD. Meta-analysis software. British Medical Journal 2000 316 : Doc. No. 7126 (http://www.bmj.com/archive/7126/7126ed9.htm).
61. Sterne JAC, Egger M, Sutton AJ. Meta-analysis software. In : Systematic Reviews in Health Care: Meta-Analysis in Context. Editors : Egger M, Smith DG, Altman DG. London : BMJ Pub. Group, 2001 pp. 336 346.
62. Hofmeyr GJ, Atallah AN, Duley L. Calcium supplementation during pregnancy for preventing hypertensive disorders and related problems. Cochrane Database of Systematic Reviews 2006 3 CD001059.
63. Lee C, Gong Y, Brok J, Boxall EH, Gluud C. Effects of hepatitis B immunisation in newborn infants of mothers positive for hepatitis B surface antigen: systematic review and meta analysis. British Medical Journal 2006 332 : 328 336.
64. Dennis CL. Psychosocial and psychological interventions for prevention of postnatal depression: systematic review. British Medical Journal 2005 331 : 15.
65. Hutton B, Sharma R, Fergusson D, Tinmouth A, Hebert P, Jamieson J, et al. Use of intravenous immunoglobin for treatment of recurrent miscarriage. A systematic review. BJOG 2007 114 : 134 142.
66. Crane JM, Butler B, Yong DC, Hannah ME. Misoprostol compared with prostaglandin E2 for labour induction in women at term with intact membranes and unfavourable cervix: a systematic review. BJOG 2006 113 : 1366 1376.
67. Xu H, Hofmeyr J, Roy C, Fraser W. Intrapartum amnioinfusion for meconium-stained amniotic fluid: a systematic review of randomised controlled trials. BJOG 2007 114 : 383 390.
68. Lin MG, Nuthalapaty FS, Carver AR, Case AS, Ramsey PS. Misoprostol for labor induction in women with term premature rupture of membranes. Obstetrics and Gynecology 2005 106 : 593 601.
69. Berghella V, Odibo AO, To MS, Rust MA, Althuisius SM. Cerclage for short cervix on ultrasonography: meta-analysis of trials using individual patient level data. Obstetrics and Gynecology 2005 106 : 181 189.
70. Sotiriadis A, Makrydimas G, Papatheodorou S, Ioannidis JP. Expectant, medical or surgical management of first trimester miscarriage: a meta analysis. Obstetrics and Gynecology 2005 105 : 1104 1113.
71. Okun N, Gronau KA, Hannah ME. Antibiotics for bacterial vaginosis or trichomonas vaginalis in pregnancy: a systematic review. Obstetrics and Gynecology 2005 105 : 857 868.
72. Sanchez-Ramos L, Kaunitz AM, Delke I. Progestational agents to prevent preterm birth: a meta analysis of randomzied controlled trials. Obstetrics and Gynecology 2005 105 : 273 279.
73. Dodd JM, Crowther CA, Cincotta R, Flenady V, Robinson JS. Progesterone supplementation for preventing preterm birth: a systematic review and meta analysis. Acta Obstetricia et Gynecologica Scandinavica 2005 84 : 526 533.
74. Roberts CL, Algert CS, Cameron CA, Torvaldsen S. A meta analysis of upright position in the second stage to reduce instrumental deliveries in women with epidural analgesia. Acta Obstetricia et Gynecologica Scandinavica 2005 84 : 794 798.
75. Mackenzie R, Walker M, Armson A, Hannah ME. Progesterone for the prevention of preterm birth among women at increased risk: a systematic review and meta-analysis of randomized controlled trials. American Journal of Obstetrics and Gynecology 2006 194 : 1234 1242.
76. Dodd JM, Crowther CA. Misoprostol versus cervagen for the induction of labour to terminate pregnancy in the second and third trimester: a systematic review. European Journal of Obstetrics, Gynecology and Reproductive Biology 2006 125 : 3 8.
77. Hutton EK, Hassan ES. Later vs early clamping of the umbilical cord in full-term neonates. Systematic review and meta analysis of controlled trials. JAMA 2007 297 : 1241 1252.
78. Conde-Agudelo A, Rosas-Bermudez A, Kafury-Goeta AC. Birth spacing and risk of adverse pregnancy outcomes. JAMA 2006 295 : 1809 1823.
79. Gavin NI, Gaynes BN, Lohr KN, Meltzer-Brody S, Gartlehner G, Swinson T. Perinatal depression. A systematic review of prevalence and incidence. Obstetrics and Gynecology 2005 106 : 1071 1083.
80. Lin J, August P. Genetic thrombophilias and preeclampsia: a meta analysis. Obstetrics and Gynecology 2005 105 : 182 192.
81. Lattimore KA, Donn SM, Kaciroti N, Kemper AR, Neal CR Jr., Vazquez DM. Selective serotonin reuptake inhibitor (SSRI) use during pregnancy and effects on the fetus and newborn: a meta analysis. Journal of Perinatology 2005 25 : 595 604.
82. Littleton HL, Breitkopf CR, Berenson AB. Correlates of anxiety symptoms during pregnancy and association with perinatal outcomes: a meta analysis. American Journal of Obstetrics and Gynecology 2007 196 : 424 432.
83. McDonald S, Murphy K, Beyene J, Ohlsson A. Perinatal outcomes of in vitro fertilization twins: a systematic review and meta-analyses. American Journal of Obstetrics and Gynecology 2005 193 : 141 152.
84. Howley HEA, Walker M, Rodger MA. A systematic review of the association between factor V Leiden or prothrombin gene variant and intrauterine growth restriction. American Journal of Obstetrics and Gynecology 2005 192 : 694 708.
85. Medica I, Kastrin A, Peterlin B. Genetic polymorphisms in vasoactive genes and preeclampsia: a meta analysis. European Journal of Obstetrics, Gynecology and Reproductive Biology 2007 131 : 115 126.
86. Liu Z, Xiong T, Meads C. Clinical effectiveness of treatment with hyperbaric oxygen for neonatal hypoxic-ischaemic encephalopathy: systematic review of Chinese literature. British Medical Journal 2006 333 : 374.
87. Xiong X, Buekens P, Fraser WD, Beck J, Offenbacher S. Periodontal disease and adverse pregnancy outcomes: a systematic review. BJOG 2006 113 : 135 143.
88. McDonagh MS, Osterweil P, Guise JM. The benefits and risks of inducing labouring patients with prior caesarean delivery: a systematic review. BJOG 2005 112 : 1007 1015.
89. Loe SM, Sanchez-Ramos L, Kaunitz A. Assessing the neonatal safety of indomethacin tocolysis: a systematic review with meta analysis. Obstetrics and Gynecology 2005 106 : 173 179.
90. Cramer K, Wiebe N, Hartling L, Crumley E, Vohra S. Heat loss prevention: a systematic review of occlusive skin wrap for premature neonates. Journal of Perinatology 2005 25 : 763 769.
91. Nassar N, Roberts CL, Barratt A, Bell JC, Olive EC, Peat B. Systematic review of outcomes of adverse external cephalic version and persistent breech presentation at term. Paediatric and Perinatal Epidemiology 2006 20 : 163 171.
92. Cnossen JS, de Ruyter-Hanhijarvi H, van der Post JA, Mol BW, Khan KS, ter Riet G. Accuracy of serum uric acid determination in predicting pre-eclampsia: a systematic review. Acta Obstetricia et Gynecologica Scandinavica 2006 85 : 519 525.
93. Geifman-Holtzman O, Grotegut CA, Gaughan JP. Diagnostic accuracy of noninvasive fetal Rh genotyping from maternal blood - a meta-analysis. American Journal of Obstetrics and Gynecology 2006 195 : 1163 1173.
94. Honest H, Bachmann LM, Ngai C, Gupta JK, Kleijnen J, Khan KS. The accuracy of maternal anthropometry measurements as predictor for spontaneous preterm birth - a systematic review. European Journal of Obstetrics, Gynecology and Reproductive Biology 2005 119 : 11 20.