Combining randomized and non-randomized evidence in network meta-analysis

Statistics in Medicine

Volumn 36, Issue 8, 2017, Pages 1210-1226

  Efthimiou, Orestis ^a   Mavridis, Dimitris ^a,b   Debray, Thomas P A ^c   Samara, Myrto ^d   Belger, Mark ^e   Siontis, George C M ^f   Leucht, Stefan ^d   Salanti, Georgia ^a,g  

^a UNIVERSITY OF IOANNINA   (Greece)

^b UNIVERSITY OF IOANNINA   (Greece)

^c UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^d TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^e ELI LILLY AND COMPANY   (United States)

^f UNIVERSITY OF BERN   (Switzerland)

^g UNIVERSITY OF BERN   (Switzerland)

Author keywords

cohort studies; mixed treatment comparison; multiple treatments meta analysis; observational data; observational evidence; observational studies

Indexed keywords

NEUROLEPTIC AGENT;

ARTICLE; CLINICAL DECISION MAKING; CLINICAL PRACTICE; CLINICAL STUDY; EVIDENCE BASED PRACTICE; HUMAN; IN-STENT RESTENOSIS; PERCUTANEOUS CORONARY INTERVENTION; SCHIZOPHRENIA; CLINICAL TRIAL (TOPIC); NETWORK META-ANALYSIS; RANDOMIZED CONTROLLED TRIAL (TOPIC); STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS; STATISTICS AND NUMERICAL DATA; TREATMENT OUTCOME;

CLINICAL TRIALS AS TOPIC; DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; NETWORK META-ANALYSIS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; STATISTICS AS TOPIC; TREATMENT OUTCOME;

EID: 85014384083     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.7223     Document Type: Article

References (63)

1. Reeves BC, Higgins JPT, Ramsay C, Shea B, Tugwell P, Wells GA. An introduction to methodological issues when including non-randomised studies in systematic reviews on the effects of interventions. Research Synthesis Methods 2013; 4:1–11.
2. Schünemann HJ, Tugwell P, Reeves BC, Akl EA, Santesso N, Spencer FA, Shea B, Wells G, Helfand M. Non-randomized studies as a source of complementary, sequential or replacement evidence for randomized controlled trials in systematic reviews on the effects of interventions. Research Synthesis Methods 2013; 4:49–62.
3. Faria R, Hernadez Alava M, Manca A, Wailoo AJ. The use of observational data to inform estimates of treatment effectiveness in technology appraisal: methods for comparative individual patient data. NICE DSU technical support document 17, 2015. http://www.nicedsu.org.uk/Observational-data-TSD(2973296).htm.
4. Cameron C, Fireman B, Hutton B, Clifford T, Coyle D, Wells G, Dormuth CR, Platt R, Toh S. Network meta-analysis incorporating randomized controlled trials and non-randomized comparative cohort studies for assessing the safety and effectiveness of medical treatments: challenges and opportunities. Systematic Reviews 2015; 4:147.
5. Bell H, Wailoo AJ, Hernandez M, Grieve R, Faria R, Gibson L, Grimm S: The use of real world data for the estimation of treatment effects in NICE decision making. NICE DSU technical support document, 2016. http://www.nicedsu.org.uk/Real-World-Data-RWD(3026863).htm.
6. Rothwell PM. External validity of randomised controlled trials: “To whom do the results of this trial apply?”. The Lancet 2005; 365:82–93.
7. Nikolakopoulou A, Chaimani A, Veroniki AA, Vasiliadis HS, Schmid CH, Salanti G. Characteristics of networks of interventions: a description of a database of 186 published networks. PLoS ONE 2014; 9:e86754.
8. Turner RM, Spiegelhalter DJ, Smith GCS, Thompson SG. Bias modelling in evidence synthesis. Journal of the Royal Statistical Society: Series A (Statistics in Society) 2009; 172:21–47.
9. Verde PE, Ohmann C. Combining randomized and non-randomized evidence in clinical research: a review of methods and applications. Research Synthesis Methods 2015; 6:45–62.
10. Spiegelhalter DJ, Best NG. Bayesian approaches to multiple sources of evidence and uncertainty in complex cost-effectiveness modelling. Statistics in Medicine 2003; 22:3687–3709.
11. Eddy DM, Shachter R. Meta-Analysis by the Confidence Profile Method (Har/Dskt edn). Academic Press: Boston, 1992.
12. Wolpert RL, Mengersen KL. Adjusted likelihoods for synthesizing empirical evidence from studies that differ in quality and design: effects of environmental tobacco smoke. Statistical Science 2004; 19:450–471.
13. Greenland S. Multiple-bias modelling for analysis of observational data. Journal of the Royal Statistical Society: Series A (Statistics in Society) 2005; 168:267–306.
14. Schmitz S, Adams R, Walsh C. Incorporating data from various trial designs into a mixed treatment comparison model. Statistics in Medicine 2013; 32:2935–2949.
15. Siontis GCM, Stefanini GG, Mavridis D, Siontis KC, Alfonso F, Pérez-Vizcayno MJ, Byrne RA, Kastrati A, Meier B, Salanti G, Jüni P, Windecker S. Percutaneous coronary interventional strategies for treatment of in-stent restenosis: a network meta-analysis. The Lancet 2015; 386:655–664.
16. Leucht S, Cipriani A, Spineli L, Mavridis D, Orey D, Richter F, Samara M, Barbui C, Engel RR, Geddes JR, Kissling W, Stapf MP, Lässig B, Salanti G, Davis JM. Comparative efficacy and tolerability of 15 antipsychotic drugs in schizophrenia: a multiple-treatments meta-analysis. Lancet 2013; 382:951–962.
17. Deeks JJ, Higgins JP, Altman DG. Analysing Data and Undertaking Meta-Analyses. In Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series, Higgins JP, Green S (eds). John Wiley & Sons, Ltd: Chichester, UK, 2008.
18. Haro JM, Edgell ET, Jones PB, Alonso J, Gavart S, Gregor KJ, Wright P, Knapp M. SOHO Study Group: The European Schizophrenia Outpatient Health Outcomes (SOHO) study: rationale, methods and recruitment. Acta Psychiatrica Scandinavica 2003; 107:222–232.
19. Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, Henry D, Altman DG, Ansari MT, Boutron I, Carpenter JR, Chan AW, Churchill R, Deeks JJ, Hróbjartsson A, Kirkham J, Jüni P, Loke YK, Pigott TD, Ramsay CR, Regidor D, Rothstein HR, Sandhu L, Santaguida PL, Schünemann HJ, Shea B, Shrier I, Tugwell P, Turner L, Valentine JC, Waddington H, Waters E, Wells GA, Whiting PF, Higgins JP. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ 2016; 355:i4919.
20. Salanti G, Higgins JP, Ades AE, Ioannidis JP. Evaluation of networks of randomized trials. Statistical Methods in Medical Research 2008; 17:279–301.
21. Dias S, Sutton AJ, Ades AE, Welton NJ. Evidence synthesis for decision making 2: a generalized linear modeling framework for pairwise and network meta-analysis of randomized controlled trials. Medical Decision Making 2013; 33:607–617.
22. Nikolakopoulou A, Mavridis D, Salanti G. Planning future studies based on the precision of network meta-analysis results. Statistics in Medicine 2016; 35:978–1000.
23. Higgins JPT, Whitehead A. Borrowing strength from external trials in a meta-analysis. Statistics in Medicine 1996; 15:2733–2749.
24. Efthimiou O, Debray TPA, van Valkenhoef G, Trelle S, Panayidou K, Moons KGM, Reitsma JB, Shang A, Salanti G. on behalf of GetReal Methods Review Group: GetReal in network meta-analysis: a review of the methodology. Research Synthesis Methods 2016; 7:236–263.
25. Lu G, Ades AE. Assessing evidence inconsistency in mixed treatment comparisons. Journal of the American Statistical Association 2006; 101:447–459.
26. Veroniki AA, Mavridis D, Higgins JP, Salanti G. Characteristics of a loop of evidence that affect detection and estimation of inconsistency: a simulation study. BMC Medical Research Methodology 2014; 14:106.
27. Dias S, Welton NJ, Caldwell DM, Ades AE. Checking consistency in mixed treatment comparison meta-analysis. Statistics in Medicine 2010; 29:932–944.
28. Cooper NJ, Sutton AJ, Morris D, Ades AE, Welton NJ. Addressing between-study heterogeneity and inconsistency in mixed treatment comparisons: application to stroke prevention treatments in individuals with non-rheumatic atrial fibrillation. Statistics in Medicine 2009; 28:1861–1881.
29. Salanti G, Marinho V, Higgins JPT. A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered. Journal of Clinical Epidemiology 2009; 62:857–864.
30. Del Giovane C, Vacchi L, Mavridis D, Filippini G, Salanti G. Network meta-analysis models to account for variability in treatment definitions: application to dose effects. Statistics in Medicine 2013; 32:25–39.
31. Warren FC, Abrams KR, Sutton AJ. Hierarchical network meta-analysis models to address sparsity of events and differing treatment classifications with regard to adverse outcomes. Statistics in Medicine 2014; 33:2449–2466.
32. Efthimiou O, Mavridis D, Cipriani A, Leucht S, Bagos P, Salanti G. An approach for modelling multiple correlated outcomes in a network of interventions using odds ratios. Statistics in Medicine 2014; 33:2275–2287.
33. Efthimiou O, Mavridis D, Riley RD, Cipriani A, Salanti G. Joint synthesis of multiple correlated outcomes in networks of interventions. Biostatistics 2015; 16:84–97.
34. Debray TP, Schuit E, Efthimiou O, Reitsma JB, Ioannidis JP, Salanti G, Moons KG. Workpackage on behalf of G: an overview of methods for network meta-analysis using individual participant data: when do benefits arise? Statistical Methods in Medical Research 2016. 962280216660741.
35. Dias S, Welton NJ, Marinho VCC, Salanti G, Higgins JPT, Ades AE. Estimation and adjustment of bias in randomized evidence by using mixed treatment comparison meta-analysis. Journal of the Royal Statistical Society: Series A (Statistics in Society) 2010; 173:613–629.
36. Neuenschwander B, Branson M, Spiegelhalter DJ. A note on the power prior. Statistics in Medicine 2009; 28:3562–3566.
37. Concato J, Shah N, Horwitz RI. Randomized, controlled trials, observational studies, and the hierarchy of research designs. The New England Journal of Medicine 2000; 342:1887–1892.
38. Benson K, Hartz AJ. A comparison of observational studies and randomized, controlled trials. New England Journal of Medicine 2000; 342:1878–1886.
39. Viswanathan M, Berkman ND, Dryden DM, Hartling L. Assessing Risk of Bias and Confounding in Observational Studies of Interventions or Exposures: Further Development of the RTI Item Bank. Agency for Healthcare Research and Quality (US): Rockville (MD), 2013[AHRQ Methods for Effective Health Care].
40. Valentine JC, Thompson SG. Issues relating to confounding and meta-analysis when including non-randomized studies in systematic reviews on the effects of interventions. Research Synthesis Methods 2013; 4:26–35.
41. Anglemyer A, Horvath HT, Bero L. Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials. Cochrane Database of Systematic Reviews 2014; 4 MR000034.
42. Welton NJ, Ades AE, Carlin JB, Altman DG, Sterne JC. Models for potentially biased evidence in meta-analysis using empirically based priors. Journal of the Royal Statistical Society: Series A (Statistics in Society) 2009; 172:119–136.
43. Spiegelhalter D, Abrams KR, Myles JP: Bayesian Approaches to Clinical Trials and Health-Care Evaluation. John Wiley & Sons, Ltd: Chichester, UK, 2003. DOI: 10.1002/0470092602.
44. Ibrahim JG, Chen M-H. Power prior distributions for regression models. Statistical Science 2000; 15:46–60.
45. Ibrahim JG, Chen M-H, Gwon Y, Chen F. The power prior: theory and applications. Statistics in Medicine 2015; 34:3724–3749.
46. Schmidli H, Gsteiger S, Roychoudhury S, O'Hagan A, Spiegelhalter D, Neuenschwander B. Robust meta-analytic-predictive priors in clinical trials with historical control information. Biometrics 2014; 70:1023–1032.
47. Mutsvari T, Tytgat D, Walley R. Addressing potential prior-data conflict when using informative priors in proof-of-concept studies. Pharmaceutical Statistics 2016; 15:28–36.
48. Prevost TC, Abrams KR, Jones DR. Hierarchical models in generalized synthesis of evidence: an example based on studies of breast cancer screening. Statistics in Medicine 2000; 19:3359–3376.
49. Sutton AJ, Abrams KR. Bayesian methods in meta-analysis and evidence synthesis. Statistical Methods in Medical Research 2001; 10:277–303.
50. Dias S, Welton NJ, Sutton AJ, Caldwell DM, Lu G, Ades AE. Evidence synthesis for decision making 4: inconsistency in networks of evidence based on randomized controlled trials. Medical Decision Making 2013; 33:641–656.
51. Salanti G, Del Giovane C, Chaimani A, Caldwell DM, Higgins JPT. Evaluating the quality of evidence from a network meta-analysis. PLoS ONE 2014; 9 e99682.
52. Krahn U, Binder H, König J. A graphical tool for locating inconsistency in network meta-analyses. BMC Medical Research Methodology 2013; 13:35.
53. Furukawa TA, Miura T, Chaimani A, Leucht S, Cipriani A, Noma H, Mitsuyasu H, Kanba S, Salanti G. Using the contribution matrix to evaluate complex study limitations in a network meta-analysis: a case study of bipolar maintenance pharmacotherapy review. BMC Research Notes 2016; 9:218.
54. Rücker G, Schwarzer G, Krahn U, König J: Netmeta: network meta-analysis using frequentist methods, 2015. Available at: http://www.r-Project.org.
55. Chaimani A, Higgins JPT, Mavridis D, Spyridonos P, Salanti G. Graphical tools for network meta-analysis in STATA. PLoS ONE 2013; 8 e76654.
56. Jackson D, White IR, Riley RD. Quantifying the impact of between-study heterogeneity in multivariate meta-analyses. Statistics in Medicine 2012; 31:3805–3820.
57. StataCorp. Stata Statistical Software: Release 13. StataCorp LP: College Station, TX, 2013.
58. White IR. Network meta-analysis. Stata Journal 2015; 15:951–985.
59. Lunn DJ, Thomas A, Best N, Spiegelhalter D. WinBUGS &Ndash; a Bayesian modelling framework: concepts, structure, and extensibility. Statistics and Computing 2000; 10:325–337.
60. Lunn D, Spiegelhalter D, Thomas A, Best N. The BUGS project: evolution, critique and future directions. Statistics in Medicine 2009; 28:3049–3067.
61. Bucher HC, Guyatt GH, Griffith LE, Walter SD. The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. Journal of Clinical Epidemiology 1997; 50:683–691.
62. Almalla M, Schröder J, Pross V, Marx N, Hoffmann R. Paclitaxel-eluting balloon versus everolimus-eluting stent for treatment of drug-eluting stent restenosis. Catheterization and Cardiovascular Interventions 2014; 83:881–887.
63. Salanti G, Ades AE, Ioannidis JPA. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. Journal of Clinical Epidemiology 2011; 64:163–171.