Critical interpretation of Cochran's Q test depends on power and prior assumptions about heterogeneity

Research Synthesis Methods

Volumn 1, Issue 2, 2010, Pages 149-161

  Pereira, Tiago V ^a,b,c   Patsopoulos,, Nikolaos A ^c,d   Salanti, Georgia ^c   Ioannidis, John P A ^c,e,f,g  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

^b FEDERAL UNIVERSITY OF SÃO PAULO   (Brazil)

^c UNIVERSITY OF IOANNINA   (Greece)

^d HARVARD MEDICAL SCHOOL   (United States)

^e INSTITUTE OF COMPUTER SCIENCE   (Greece)

^f TUFTS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^g STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Bayes theorem; heterogeneity; meta analysis; power analysis; Q test

Indexed keywords

EID: 79961030655     PISSN: None     EISSN: 17592887     Source Type: Journal    
DOI: 10.1002/jrsm.13     Document Type: Article

References (22)

1. Higgins J, Thompson S, Deeks J, Altman D. Statistical heterogeneity in systematic reviews of clinical trials: a critical appraisal of guidelines and practice. Journal of Health Services Research and Policy 2002; 7:51–61.
2. Ioannidis JP. Differentiating biases from genuine heterogeneity: distinguishing artifactual from substantive effects. Publication Bias In meta-analysis: Prevention, Assessment and Adjustments, Rothstein H, Borenstein M, Sutton A (eds). Wiley: New York, 2009; 38:1740–1742.
3. Higgins JP. Commentary: heterogeneity in meta-analysis should be expected and appropriately quantified. International Journal of Epidemiology 2008; 37:1158–1160.
4. Ioannidis JP. Interpretation of tests of heterogeneity and bias in meta-analysis. Journal of Evaluation in Clinical Practice 2008; 14:951–957.
5. Ioannidis JP, Patsopoulos NA, Rothstein HR. Reasons or excuses for avoiding meta-analysis in forest plots. BMJ 2008; 336:1413–1415.
6. Ioannidis JP, Patsopoulos NA, Evangelou E. Uncertainty in heterogeneity estimates in meta-analyses. BMJ 2007; 335:914–916.
7. Rucker G, Schwarzer G, Carpenter JR, Schumacher M. Undue reliance on I(2) in assessing heterogeneity may mislead. BMC Medical Research Methodology 2008; 8:79.
8. Reis IM, Hirji KF, Afifi AA. Exact and asymptotic tests for homogeneity in several 2 × 2 tables. Statistics in Medicine 1999; 18:893–906.
9. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Statistics in Medicine 2002; 21:1539–1558.
10. Patsopoulos NA, Evangelou E, Ioannidis JP. Sensitivity of between-study heterogeneity in meta-analysis: proposed metrics and empirical evaluation. International Journal of Epidemiology 2008; 37:1148–1157.
11. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003; 327:557–560.
12. Patsopoulos NA, Evangelou E, Ioannidis JP. Heterogeneous views on heterogeneity. International Journal of Epidemiology 2009; 38:1740–1742.
13. Cochran WG. The combination of estimates from different experiments. Biometrics 1954; 10:110–129.
14. Huedo-Medina TB, Sanchez-Meca J, Marin-Martinez F, Botella J. Assessing heterogeneity in meta-analysis: Q statistic or I2 index? Psychological Methods 2006; 11:193–206.
15. Jackson D. The power of the standard test for the presence of heterogeneity in meta-analysis. Statistics in Medicine 2006; 25:2688–2699.
16. The Cochrane Library, Cochrane Handbook for Systematic Reviews of Interventions, 2005.
17. DerSimonian R, Laird N. Meta-analysis in clinical trials. Controlled Clinical Trials 1986; 7:177–188.
18. ls-Nielsen B, Gluud LL, Gluud C. Dopaminergic agonists for hepatic encephalopathy. Cochrane Database System Review 2004; CD003047.
19. Viechtbauer W. Confidence intervals for the amount of heterogeneity in meta-analysis. Statistics in Medicine 2007; 26:37–52.
20. Mulrow C, Lau J, Cornell J, Brand M. Pharmacotherapy for hypertension in the elderly. Cochrane Database System Review 2000; CD000028.
21. Wardlaw JM, del ZG, Yamaguchi T. Thrombolysis for acute ischaemic stroke. Cochrane Database System Review 2000; CD000213.
22. Deeks JJ. Issues in the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes. Statistics in Medicine 2002; 21:1575–1600.