Fixed or random effects meta-analysis? Common methodological issues in systematic reviews of effectiveness

International Journal of Evidence-Based Healthcare

Volumn 13, Issue 3, 2015, Pages 196-207

  Tufanaru, Catalin ^a   Munn, Zachary ^a   Stephenson, Matthew ^a   Aromataris, Edoardo ^a  

^a UNIVERSITY OF ADELAIDE   (Australia)

Author keywords

Effect size; Effectiveness; Fixed effects; Meta analysis; Random effects; Systematic review

Indexed keywords

COMPARATIVE EFFECTIVENESS; EFFECT SIZE; HUMAN; META ANALYSIS; STUDY DESIGN; SYSTEMATIC REVIEW; CROSSOVER PROCEDURE; EVIDENCE BASED MEDICINE; LITERATURE; META ANALYSIS (TOPIC); METHODOLOGY; OBSERVATIONAL STUDY; ODDS RATIO; ORGANIZATION AND MANAGEMENT; PRACTICE GUIDELINE; STANDARDS;

CROSS-OVER STUDIES; EVIDENCE-BASED MEDICINE; GUIDELINES AS TOPIC; HUMANS; META-ANALYSIS AS TOPIC; OBSERVATIONAL STUDIES AS TOPIC; ODDS RATIO; RESEARCH DESIGN; REVIEW LITERATURE AS TOPIC;

EID: 84966340497     PISSN: 17441595     EISSN: 17441609     Source Type: Journal    
DOI: 10.1097/XEB.0000000000000065     Document Type: Article

References (71)

1. Aromataris E, Pearson A. The systematic review: an overview. Am J Nurs 2014; 114: 47-55
2. Stern C, Jordan Z, McArthur A. Developing the review question and inclusion criteria. Am J Nurs 2014; 114: 53-6
3. Aromataris E, Riitano D. Systematic reviews: constructing a search strategy and searching for evidence. Am J Nurs 2014; 114: 49-56
4. Porritt K, Gomersall J, Lockwood C. JBI's systematic reviews: study selection and critical appraisal. Am J Nurs 2014; 114: 47-52
5. Munn Z, Tufanaru C, Aromataris E. JBI's systematic reviews: data extraction and synthesis. Am J Nurs 2014; 114: 49-54
6. Brignardello-Petersen R, Ioannidis JPA, Tomlinson G, Guyatt G. Surprising results of randomized trials. In: Guyatt G, Rennie D, Meade MO, Cook DJ, editors. Users' guide to the medical literature. A manual for evidence-based clinical practice, 3rd ed. New York: McGraw-Hill, 2015
7. Shrier I, Boivin JF, Steele RJ, et al. Should meta-analyses of interventions include observational studies in addition to randomized controlled trials? A critical examination of underlying principles. Am J Epidemiol 2007; 166: 1203-9
8. Doi SA, Barendregt JJ, Khan S, et al. Advances in the metaanalysis of heterogeneous clinical trials II: the quality effects model. Contemp Clin Trials 2015. May 21. pii: S1551-7144(15)30008-2. doi: 10.1016/j.cct.2015.05.010. [Epub ahead of print]
9. Thompson S, Ekelund U, Jebb S, et al. A proposed method of bias adjustment for meta-analyses of published observational studies. Int J Epidemiol 2011; 40: 765-77
10. Katikireddi SV, Egan M, Petticrew M. How do systematic reviews incorporate risk of bias assessments into the synthesis of evidence? A methodological study. J Epidemiol Community Health 2015; 69: 189-95
11. Jones B, Kenward MG. Design and analysis of cross-over trials. 3rd ed. New York: CRC Press; 2015
12. Senn SS. Cross-over trials in clinical research. 2nd ed. New York: Wiley; 2002
13. Bonate PL. Analysis of pretest-posttest designs. New York: Chapman & Hall/CRC; 2000
14. Hayes RJ, Moulton LH. Cluster randomised trials. Boca Raton: Chapman & Hall/CRC; 2009
15. Eldridge S, Kerry S. A practical guide to cluster randomised trials in health services research. Chichester: Wiley; 2012
16. Elbourne DR, Altman DG, Higgins JP, et al. Meta-analyses involving cross-over trials: methodological issues. Int J Epidemiol 2002; 31: 140-9
17. Morris SB, DeShon RP. Combining effect size estimates in meta-analysis with repeated measures and independentgroups designs. Psychol Methods 2002; 7: 105-25
18. Curtin F, Altman DG, Elbourne D. Meta-analysis combining parallel and cross-over clinical trials. I: continuous outcomes. Stat Med 2002; 21: 2131-44
19. Curtin F, Elbourne D, Altman DG. Meta-analysis combining parallel and cross-over clinical trials. II: binary outcomes. Stat Med 2002; 21: 2145-59
20. Curtin F, Elbourne D, Altman DG. Meta-analysis combining parallel and cross-over clinical trials. III: the issue of carryover. Stat Med 2002; 21: 2161-73
21. Donner A, Klar N. Issues in the meta-analysis of cluster randomized trials. Stat Med 2002; 21: 2971-80
22. Donner A, Piaggio G, Villar J. Statistical methods for the meta-analysis of cluster randomization trials. Stat Methods Med Res 2001; 10: 325-38
23. Guyatt G, Rennie D, MeadeMO, Cook DJ editors. Users' guide to the medical literature. A manual for evidence-based clinical practice. 3rd ed. New York: McGraw-Hill, 2015
24. Barratt A, Wyer PC, Hatala R, et al. Evidence-Based Medicine Teaching Tips Working Group. Tips for learners of evidencebased medicine: 1. Relative risk reduction, absolute risk reduction and number needed to treat. CMAJ 2004; 171: 353-8
25. Furuya-Kanamori L, Doi SA. The outcome with higher baseline risk should be selected for relative risk in clinical studies: a proposal for change to practice. J Clin Epidemiol 2014; 67: 364-7
26. Fleiss JL. Measures of effect size for categorical data. In: Harris Cooper Hedges LV, editors. The handbook of research synthesis. New York: Russell Sage Foundation, 1994
27. Fleiss JL, Berlin JA. Effect sizes for dichotomous data. In: Cooper H, Hedges LV, Valentine JC, editors. The handbook of research synthesis and meta-analysis. 2nd ed. New York: Russell Sage Foundation, 2009
28. Senn S. Odds ratios revisited. Evidence-Based Med 1998; 3: 71
29. Walter S. Odds ratios revisited. Evidence-Based Med 1998; 3: 71
30. Olkin I. Odds ratios revisited. Evidence-Based Med 1998; 3: 71
31. Altman D, Sackett D. Odds ratios revisited. Evidence-Based Med 1998; 3: 71-2
32. Cummings P. The relative merits of risk ratios and odds ratios. Arch Pediatr Adolesc Med 2009; 163: 438-45
33. Cummings P. Methods for estimating adjusted risk ratios. Stata J 2009; 9: 175-96
34. Murad MH, Montori VM, Ioannidis JPA, et al. Fixed-effects and random-effects models. In: Guyatt G, Rennie D, Meade MO, Cook DJ, editors. Users' guide to the medical literature. A manual for evidence-based clinical practice. 3rd ed. New York: McGraw-Hill, 2015
35. Cooper H, Hedges LV. Potentials and limitations of research synthesis. In: Cooper H, Hedges LV, editors. The handbook of research synthesis. NewYork: Russell Sage Foundation, 1994
36. Higgins JPT, Green S editors. Cochrane handbook for systematic reviews of interventions. Chichester, UK: John Wiley & Sons, 2008
37. Sutton AJ, Abrams KR, Jones DR, et al. Methods for metaanalysis in medical research. New York: Wiley; 2000
38. Normand SL. Meta-analysis: formulating, evaluating, combining, and reporting. Stat Med 1999; 18: 321-59
39. Hedges LV. Meta-analysis. J Educ Behav Stat 1992; 17: 279-96
40. Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. A basic introduction to fixed-effect and random-effects models for meta-analysis. Res Synth Methods 2010; 1: 97-111
41. Shadish WR, Haddock CK. Combining estimates of effect size. In: Cooper H, Hedges LV. The handbook of research synthesis. New York: Russell Sage Foundation, 1994. pp. 261-281
42. Cooper H, Hedges LV, Valentine JC. The handbook of research synthesis and meta-analysis. 2nd ed. New York: Russell Sage Foundation; 2009
43. Petitti DB. Meta-analysis, decision analysis, and cost-effectiveness analysis: methods for quantitative synthesis in.medicine. 2nd ed. New York: Oxford University Press; 2000
44. Card NA. Applied meta-analysis for social sciences research. New York: The Guilford Press; 2012
45. Cheung MWL. Meta-analysis. A structural equation modelling approach. Chichester: Wiley; 2015
46. Schmidt FL, Hunter JE. Methods of meta-analysis. Correcting error and bias in research findings. 3rd ed. Los Angeles: Sage; 2015
47. Mengersen K, Schmid CH, Jennions MD, Gurevitch J. Statistical models and approaches to inference. In: Koricheva J, Gurevitch J, Mengersen K, editors. Handbook of metaanalysis in ecology and evolution. Princeton: Princeton University Press, 2013. pp. 89-107
48. Ringquist EJ. Meta-analysis for public management and policy. San Francisco: Jossey-Bass Wiley; 2013
49. Lipsey MW, Wilson DB. Practical meta-analysis. Thousand Oaks: Sage; 2001
50. Egger M Davey SG, Altman DG editors. Systematic reviews in health care: meta-analysis in context. 2nd ed. London: BMJ Publishing Group, 2001
51. Khan K, Kunz R, Kleijnen J, Antes G. Systematic reviews to support evidence-based medicine. How to review and apply findings of healthcare research. 2nd ed. London: Hodder Arnold; 2011
52. Centre for Reviews and Dissemination (CRD). Systematic reviews: CRD's guidance for undertaking reviews in health care. York: Centre for Reviews and Dissemination, University of York; 2009
53. Doi SA, Barendregt JJ, Rao C. An updated method for risk adjustment in outcomes research. Value Health 2014; 17: 629-33
54. Stanley TD, Doucouliagos H. Neither fixed nor random: weighted least squares meta-analysis. Stat Med 2015; 34: 2116-27
55. Doi SA, Barendregt JJ, Khan S, et al. Advances in the metaanalysis of heterogeneous clinical trials I: the inverse variance heterogeneity model. Contemp Clin Trials 2015. May 21. pii: S1551-7144(15)30007-0. doi: 10.1016/j.cct. 2015.05.009. [Epub ahead of print]
56. Doi SA, Barendregt JJ, Khan S, et al. Advances in the metaanalysis of heterogeneous clinical trials II: the quality effects model. Contemp Clin Trials 2015. May 21. pii: S1551-7144(15)30008-2. doi: 10.1016/j.cct.2015.05.010. [Epub ahead of print]
57. Doi SA, Barendregt JJ, Onitilo AA. Methods for the bias adjustment of meta-analyses of published observational studies. J Eval Clin Pract 2013; 19: 653-7
58. Doi SA, Barendregt JJ, Mozurkewich EL. Meta-analysis of heterogeneous clinical trials: an empirical example. Contemp Clin Trials 2011; 32: 288-98
59. Al Khalaf MM, Thalib L, Doi SA. Combining heterogenous studies using the random-effects model is a mistake and leads to inconclusive meta-analyses. J Clin Epidemiol 2011; 64: 119-23
60. Doi SA, Thalib L. A quality-effects model for meta-analysis. Epidemiology 2008; 19: 94-100
61. Senn S. Trying to be precise about vagueness. Stat Med 2007; 26: 1417-30
62. Cornell JE, Mulrow CD, Localio R, et al. Random-effects meta-analysis of inconsistent effects: a time for change. Ann Intern Med 2014; 160: 267-70
63. Noma H. Confidence intervals for a random-effects metaanalysis based on Bartlett-type corrections. Stat Med 2011; 30: 3304-12
64. Brockwell SE, Gordon IR.A simplemethod for inference on an overall effect in meta-analysis. Stat Med 2007; 26: 4531-43
65. Brockwell SE, Gordon IR. A comparison of statistical methods for meta-analysis. Stat Med 2001; 20: 825-40
66. Platt RW, Leroux BG, Breslow N. Generalized linear mixed models for meta-analysis. Stat Med 1999; 18: 643-54
67. Aitkin M. Meta-analysis by random effect modelling in generalized linear models. Stat Med 1999; 18: 2343-51
68. Turner RM, Omar RZ, Yang M, et al. A multilevel model framework for meta-analysis of clinical trials with binary outcomes. Stat Med 2000; 19: 3417-32
69. Sheu CF1, Suzuki S. Meta-analysis using linear mixed models. Behav Res Methods Instrum Comput 2001; 33: 102-7
70. Stram DO. Meta-analysis of published data using a linear mixed-effects model. Biometrics 1996; 52: 536-44
71. Tufanaru C, Huang WJ, Tsay S-F, Chou S-S. Statistics for systematic review authors. Philadelphia: Lippincott Williams & Wilkins; 2012