GetReal in network meta-analysis: a review of the methodology

Research Synthesis Methods

Volumn 7, Issue 3, 2016, Pages 236-263

  Efthimiou, Orestis ^a   Debray, Thomas P A ^b   van Valkenhoef, Gert ^c   Trelle, Sven ^d   Panayidou, Klea ^d   Moons, Karel G M ^b   Reitsma, Johannes B ^b   Shang, Aijing ^e   Salanti, Georgia ^a,d  

^a UNIVERSITY OF IOANNINA   (Greece)

^b UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^c UNIVERSITY MEDICAL CENTER GRONINGEN   (Netherlands)

^d UNIVERSITY OF BERN   (Switzerland)

^e F HOFFMANN LA ROCHE LTD   (Switzerland)

Author keywords

comparing multiple interventions; indirect treatment comparison; mixed treatment comparison; multiple treatment meta analysis

Indexed keywords

PLACEBO;

BIBLIOGRAPHIC DATABASE; CLINICAL TRIAL (TOPIC); COMPUTER SIMULATION; HUMAN; METHODOLOGY; NETWORK META-ANALYSIS; REGRESSION ANALYSIS; SOFTWARE; STATISTICAL MODEL; STATISTICS;

CLINICAL TRIALS AS TOPIC; COMPUTER SIMULATION; DATABASES, BIBLIOGRAPHIC; HUMANS; MODELS, STATISTICAL; NETWORK META-ANALYSIS; PLACEBOS; REGRESSION ANALYSIS; RESEARCH DESIGN; SOFTWARE; STATISTICS AS TOPIC;

EID: 84995758231     PISSN: None     EISSN: 17592887     Source Type: Journal    
DOI: 10.1002/jrsm.1195     Document Type: Article

References (195)

1. Achana FA, Cooper NJ, Dias S, Lu G, Rice SJ, Kendrick D, Sutton AJ. 2013. Extending methods for investigating the relationship between treatment effect and baseline risk from pairwise meta-analysis to network meta-analysis. Statistics in Medicine 32: 752–771. DOI:10.1002/sim.5539.
2. Ades AE. 2003. A chain of evidence with mixed comparisons: models for multi-parameter synthesis and consistency of evidence. Statistics in Medicine 22: 2995–3016. DOI:10.1002/sim.1566.
3. Ades AE, Caldwell DM, Reken S, Welton NJ, Sutton AJ, Dias S. 2013. Evidence synthesis for decision making 7: a reviewer's checklist. Medical Decision Making 33: 679–691. DOI:10.1177/0272989X13485156.
4. Ades AE, Mavranezouli I, Dias S, Welton NJ, Whittington C, Kendall T. 2010. Network meta-analysis with competing risk outcomes. Value in Health 13: 976–983. DOI:10.1111/j.1524-4733.2010.00784.x.
5. Ades AE, Sutton AJ. 2006. Multiparameter evidence synthesis in epidemiology and medical-decision making: current approaches. Journal of the Royal Statistical Society A 169: 5–35.
6. Ali S, Mealing S, Hawkins N, Lescrauwaet B, Bjork S, Mantovani L, Lampertico P. 2013. The use of individual patient-level data (IPD) to quantify the impact of pretreatment predictors of response to treatment in chronic hepatitis B patients. BMJ Open 3:. DOI:10.1136/bmjopen-2012-001309.
7. Bafeta A, Trinquart L, Seror R, Ravaud P. 2013. Analysis of the systematic reviews process in reports of network meta-analyses: methodological systematic review. BMJ 347: f3675.
8. Baker SG, Kramer BS. 2002. The transitive fallacy for randomized trials: if A bests B and B bests C in separate trials, is A better than C? BMC Medical Research Methodology 2: 13.
9. Ballesteros J. 2005. Orphan comparisons and indirect meta-analysis: a case study on antidepressant efficacy in dysthymia comparing tricyclic antidepressants, selective serotonin reuptake inhibitors, and monoamine oxidase inhibitors by using general linear models. Journal of Clinical Psychopharmacology 25: 127–131.
10. Berkey CS, Hoaglin DC, Antczak-Bouckoms A, Mosteller F, Colditz GA. 1998. Meta-analysis of multiple outcomes by regression with random effects. Statistics in Medicine 17: 2537–2550. DOI:10.1002/(SICI)1097-0258(19981130)17:22<2537::AID-SIM953>3.0.CO;2-C.
11. Bucher HC, Guyatt GH, Griffith LE, Walter SD. 1997. The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. Journal of Clinical Epidemiology 50: 683–691.
12. Caldwell DM, Ades AE, Higgins JPT. 2005. Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ 331: 897–900. DOI:10.1136/bmj.331.7521.897.
13. Caldwell DM, Welton NJ, Ades AE. 2010. Mixed treatment comparison analysis provides internally coherent treatment effect estimates based on overviews of reviews and can reveal inconsistency. Journal of Clinical Epidemiology 63: 875–882. DOI:10.1016/j.jclinepi.2009.08.025.
14. Caldwell DM, Welton NJ, Dias S, Ades AE. 2012. Selecting the best scale for measuring treatment effect in a network meta-analysis: a case study in childhood nocturnal enuresis. Research Synthesis Methods 3: 126–141.
15. Carlin BP, Hong H, Shamliyan TA, Sainfort F, Kane RL. 2013. Case Study Comparing Bayesian and Frequentist Approaches for Multiple Treatment Comparisons. (Prepared by the Minnesota Evidence-Based Practice Center under Contract No. 290-2007-10064-I2). AHRQ Publication No. 12(13)-EHC103-EF. Rockville, MD: Agency for Healthcare Research and Quality.
16. Chaimani A, Higgins JPT, Mavridis D, Spyridonos P, Salanti G. 2013a. Graphical tools for network meta-analysis in STATA. PLoS One 8: e76654. DOI:10.1371/journal.pone.0076654.
17. Chaimani A, Salanti G. 2012. Using network meta-analysis to evaluate the existence of small-study effects in a network of interventions. Research Synthesis Methods 3: 161–176.
18. Chaimani A, Vasiliadis HS, Pandis N, Schmid CH, Welton NJ, Salanti G. 2013b. Effects of study precision and risk of bias in networks of interventions: a network meta-epidemiological study. International Journal of Epidemiology 42: 1120–1131. DOI:10.1093/ije/dyt074.
19. Chung H, Lumley T. 2008. Graphical exploration of network meta-analysis data: the use of multidimensional scaling. Clinical Trials 5: 301–307. DOI:10.1177/1740774508093614.
20. Cipriani A, Barbui C, Rizzo C, Salanti G. 2012. What is a multiple treatments meta-analysis? Epidemiology and Psychiatric Sciences 21: 151–153. DOI:10.1017/S2045796011000837.
21. Cipriani A, Higgins JPT, Geddes JR, Salanti G. 2013. Conceptual and technical challenges in network meta-analysis. Annals of Internal Medicine 159: 130–137. DOI:10.7326/0003-4819-159-2-201307160-00008.
22. Coleman CI, Phung OJ, Cappelleri JC, Baker WL, Kluger J, White CM, Sobieraj DM. 2012. Use of Mixed Treatment Comparison in Systematic Reviews. (Prepared by the university of Connecticut/Harford Hospital Evidence-Based Practice Center under Contract No. 290-2007-10067-I). AHRQ Publication No. 12-EHC119-EF. Rockville, MD: Agency for Healthcare Research and Quality.
23. Cooper NJ, Peters J, Lai MC, Juni P, Wandel S, Palmer S, Paulden M, Conti S, Welton NJ, Abrams KR, Bujkiewicz S, Spiegelhalter D, Sutton AJ. 2011. How valuable are multiple treatment comparison methods in evidence-based health-care evaluation? Value in Health 14: 371–380. DOI:10.1016/j.jval.2010.09.001.
24. Cooper NJ, Sutton AJ, Morris D, Ades AE, Welton NJ. 2009. Addressing between-study heterogeneity and inconsistency in mixed treatment comparisons: application to stroke prevention treatments in individuals with non-rheumatic atrial fibrillation. Statistics in Medicine 28: 1861–1881. DOI:10.1002/sim.3594.
25. Coory M, Jordan S. 2010. Frequency of treatment-effect modification affecting indirect comparisons: a systematic review. PharmacoEconomics 28: 723–732. DOI:10.2165/11535670-000000000-00000.
26. Copas J. 1999. What works?: selectivity models and meta-analysis. Journal of the Royal Statistical Society: Series A Statistic Society 162: 95–109. DOI:10.1111/1467-985X.00123.
27. Cope S, Jansen JP. 2013. Quantitative summaries of treatment effect estimates obtained with network meta-analysis of survival curves to inform decision-making. BMC Medical Research Methodology 13: 147. DOI:10.1186/1471-2288-13-147.
28. Cucherat M, Izard V. 2009. Summary report: Indirect comparisons: methods and validity. HAS.
29. Dakin HA, Welton NJ, Ades AE, Collins S, Orme M, Kelly S. 2011. Mixed treatment comparison of repeated measurements of a continuous endpoint: an example using topical treatments for primary open-angle glaucoma and ocular hypertension. Statistics in Medicine. DOI:10.1002/sim.4284.
30. D'Ascenzo F, Biondi-Zoccai G. 2014. Network meta-analyses: the “white whale” for cardiovascular specialists. Journal of Cardiothoracic and Vascular Anesthesia 28: 169–173. DOI:10.1053/j.jvca.2013.01.004.
31. Debray TPA, Moons KGM, van Valkenhoef G, Efthimiou O, Hummel N, Groenwold RHH, Reitsma JB, on behalf of GetReal Methods Review Group. 2015. Get real in individual participant data (IPD) meta-analysis: a review of the methodology. Research Synthesis Methods. DOI:10.1002/jrsm.1160.
32. Deeks JJ. 2002. Issues in the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes. Statistics in Medicine 21: 1575–1600. DOI:10.1002/sim.1188.
33. Del Giovane C, Vacchi L, Mavridis D, Filippini G, Salanti G. 2013. Network meta-analysis models to account for variability in treatment definitions: application to dose effects. Statistics in Medicine 32: 25–39. DOI:10.1002/sim.5512.
34. Dewilde S, Hawkins N. 2012. Investigating incoherence gives insight: clopidogrel is equivalent to extended-release dipyridamole plus aspirin in secondary stroke prevention. Journal of Clinical Epidemiology 65: 835–845. DOI:10.1016/j.jclinepi.2012.01.019.
35. Dias S, Sutton AJ, Ades AE, Welton NJ. 2013a. Evidence synthesis for decision making 2: a generalized linear modeling framework for pairwise and network meta-analysis of randomized controlled trials. Medical Decision Making International Journal of Society Medical and Decision Making 33: 607–617. DOI:10.1177/0272989X12458724.
36. Dias S, Sutton AJ, Welton NJ, Ades AE. 2013b. Evidence synthesis for decision making 3: heterogeneity – subgroups, meta-regression, bias, and bias-adjustment. Medical Decision Making 33: 618–640. DOI:10.1177/0272989X13485157.
37. Dias S, Welton NJ, Ades AE. 2010a. Study designs to detect sponsorship and other biases in systematic reviews. Journal of Clinical Epidemiology 63: 587–588. DOI:10.1016/j.jclinepi.2010.01.005.
38. Dias S, Welton NJ, Caldwell DM, Ades AE. 2010b. Checking consistency in mixed treatment comparison meta-analysis. Statistics in Medicine 29: 932–944. DOI:10.1002/sim.3767.
39. Dias S, Welton NJ, Marinho VCC, Salanti G, Higgins JPT, Ades AE. 2010c. Estimation and adjustment of bias in randomized evidence by using mixed treatment comparison meta-analysis. Journal of the Royal Statistical Society A 173: 613–629.
40. Dias S, Welton NJ, Sutton AJ, Ades AE. 2013c. Evidence synthesis for decision making 5: the baseline natural history model. Medical Decision Making 33: 657–670. DOI:10.1177/0272989X13485155.
41. Dias S, Welton NJ, Sutton AJ, Caldwell DM, Lu G, Ades AE. 2013d. Evidence synthesis for decision making 4: inconsistency in networks of evidence based on randomized controlled trials. Medical Decision Making 33: 641–656. DOI:10.1177/0272989X12455847.
42. Ding Y, Fu H. 2012. Bayesian indirect and mixed treatment comparisons across longitudinal time points. Statistics in Medicine. DOI:10.1002/sim.5688.
43. Donegan S, Williamson P, D'Alessandro U, Garner P, Tudur Smith C. 2013a. Combining individual patient data and aggregate data in mixed treatment comparison meta-analysis: Individual patient data may be beneficial if only for a subset of trials. Statistics in Medicine 32: 914–930. DOI:10.1002/sim.5584.
44. Donegan S, Williamson P, D'Alessandro U, Tudur Smith C. 2013b. Assessing key assumptions of network meta-analysis: a review of methods. Research Synthesis Methods 4: 291–323. DOI:10.1002/jrsm.1085.
45. Donegan S, Williamson P, D'Alessandro U, Tudur Smith C. 2012. Assessing the consistency assumption by exploring treatment by covariate interactions in mixed treatment comparison meta-analysis: individual patient-level covariates versus aggregate trial-level covariates. Statistics in Medicine 31: 3840–3857. DOI:10.1002/sim.5470.
46. Donegan S, Williamson P, Gamble C, Tudur SC. 2010. Indirect comparisons: a review of reporting and methodological quality. PLoS One 5: e11054. DOI:10.1371/journal.pone.0011054.
47. Eckermann S, Coory M, Willan AR. 2009. Indirect comparison: relative risk fallacies and odds solution. Journal of Clinical Epidemiology 62: 1031–1036. DOI:10.1016/j.jclinepi.2008.10.013.
48. Eddy DM, Shachter R. 1992. Meta-analysis by the Confidence Profile Method. Har/Dskt edn.Boston: Academic Press.
49. Edwards SJ, Clarke MJ, Wordsworth S, Borrill J. 2009. Indirect comparisons of treatments based on systematic reviews of randomised controlled trials. International Journal of Clinical Practice 63: 841–854. DOI:10.1111/j.1742-1241.2009.02072.x.
50. Efthimiou O, Mavridis D, Cipriani A, Leucht S, Bagos P, Salanti G. 2014a. An approach for modelling multiple correlated outcomes in a network of interventions using odds ratios. Statistics in Medicine 33: 2275–2287. DOI:10.1002/sim.6117.
51. Efthimiou O, Mavridis D, Riley RD, Cipriani A, Salanti G. 2014b. Joint synthesis of multiple correlated outcomes in networks of interventions. Biostatistics (Oxford, England). DOI:10.1093/biostatistics/kxu030.
52. Egger M, Smith GD, Phillips AN. 1997. Meta-analysis: principles and procedures. BMJ 315: 1533–1537. DOI:10.1136/bmj.315.7121.1533.
53. EUnetHTA – European network for Health Technology Assessment (last). 2013. Comparators and comparisons: Direct and indirect comparisons. Available http://www.eunethta.eu/sites/5026.fedimbo.belgium.be/files/Direct%20and%20indirect%20comparisons.pdf
54. Fadda V, Maratea D, Trippoli S, Messori A. 2011. Results can be summarised in a simple figure. BMJ 342: d1555–d1555. DOI:10.1136/bmj.d1555.
55. Falissard B, Zylberman M, Cucherat M, Izard V, Meyer F. 2009. Real medical benefit assessed by indirect comparison. Thérapie 64: 225–232. DOI:10.2515/therapie/2009032.
56. Franchini AJ, Dias S, Ades AE, Jansen JP, Welton NJ. 2012. Accounting for correlation in network meta-analysis with multi-arm trials. Research Synthesis Methods 3: 142–160.
57. Gartlehner G, Moore CG. 2008. Direct versus indirect comparisons: a summary of the evidence. The International Journal of Technology Assessment in Health Care 24: 170–177. DOI:10.1017/S0266462308080240.
58. Gasparrini A, Armstrong B, Kenward MG. 2012. Multivariate meta-analysis for non-linear and other multi-parameter associations. Statistics in Medicine 31: 3821–3839. DOI:10.1002/sim.5471.
59. Glenny AM, Altman DG, Song F, Sakarovitch C, Deeks JJ, D'Amico R, Bradburn M, Eastwood AJ. 2005. Indirect comparisons of competing interventions. Health TechnolAssess 9: 1–iv.
60. Gleser L, Olkin LV. 2009. Stochastically dependent effect sizes. In Cooper H, Hedges LV (eds.) The Handbook of Research Synthesis and Meta-analysis. Russell Sage Foundation.
61. Govan L, Ades AE, Weir CJ, Welton NJ, Langhorne P. 2010. Controlling ecological bias in evidence synthesis of trials reporting on collapsed and overlapping covariate categories. Statistics in Medicine 29: 1340–1356. DOI:10.1002/sim.3869.
62. Greco T, Landoni G, Biondi-Zoccai G, D'Ascenzo F, Zangrillo A. 2013. A Bayesian network meta-analysis for binary outcome: how to do it. Statistical Methods in Medical Research. DOI:10.1177/0962280213500185.
63. Greenland S. 2005. Multiple-bias modelling for analysis of observational data. Journal of the Royal Statistical Society: Series A Statistic Society 168: 267–306. DOI:10.1111/j.1467-985X.2004.00349.x.
64. Greenland S. 2003. The impact of prior distributions for uncontrolled confounding and response bias: a case study of the relation of wire codes and magnetic fields to childhood leukemia. Journal of the American Statistical Association 98: 47–54.
65. Griffin S, Bojke L, Main C, Palmer S. 2006. Incorporating direct and indirect evidence using Bayesian methods: an applied case study in ovarian cancer. Value in Health 9: 123–131. DOI:10.1111/j.1524-4733.2006.00090.x.
66. Hawkins N, Scott DA, Woods B. 2009a. How far do you go? Efficient searching for indirect evidence. Medical Decision Making 29: 273–281. DOI:10.1177/0272989X08330120.
67. Hawkins N, Scott DA, Woods BS, Thatcher N. 2009b. No study left behind: a network meta-analysis in non-small-cell lung cancer demonstrating the importance of considering all relevant data. Value in Health 12: 996–1003. DOI:10.1111/j.1524-4733.2009.00541.x.
68. Higgins JPT, Jackson D, Barrett JK, Lu G, Ades AE, White IR. 2012. Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies. Research Synthesis Methods 3: 98–110.
69. Higgins JPT, Whitehead A. 1996. Borrowing strength from external trials in a meta-analysis. Statistics in Medicine 15: 2733–2749. DOI:10.1002/(SICI)1097-0258(19961230)15:24<2733::AID-SIM562>3.0.CO;2-0.
70. Hoaglin DC, Hawkins N, Jansen JP, Scott DA, Itzler R, Cappelleri JC, Boersma C, Thompson D, Larholt KM, Diaz M, Barrett A. 2011. Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 2. Value in Health 14: 429–437. DOI:10.1016/j.jval.2011.01.011.
71. Hong H, Carlin BP, Chu H, Shamliyan TA, Wang S, Kane RL. 2013a. A Bayesian missing data framework for multiple continuous outcome mixed treatment comparisons. In AHRQ Methods for Effective Health Care. Rockville (MD): Agency for Healthcare Research and Quality (US).
72. Hong H, Carlin BP, Shamliyan TA, Wyman JF, Ramakrishnan R, Sainfort F, Kane RL. 2013b. Comparing Bayesian and frequentist approaches for multiple outcome mixed treatment comparisons. Medical Decision Making. DOI:10.1177/0272989X13481110.
73. Ioannidis JP. 2009. Integration of evidence from multiple meta-analyses: a primer on umbrella reviews, treatment networks and multiple treatments meta-analyses. CMAJ 181: 488–493. DOI:10.1503/cmaj.081086.
74. Ioannidis JP. 2006. Indirect comparisons: the mesh and mess of clinical trials. Lancet 368: 1470–1472. DOI:10.1016/S0140-6736(06)69615-3.
75. Jackson D, Barrett JK, Rice S, White IR, Higgins JPT. 2014. A design-by-treatment interaction model for network meta-analysis with random inconsistency effects. Statistics in Medicine 33: 3639–3654. DOI:10.1002/sim.6188.
76. Jackson D, Riley R, White IR. 2011. Multivariate meta-analysis: potential and promise. Statistics in Medicine 30: 2481–2498. DOI:10.1002/sim.4172.
77. Jackson D, White IR, Thompson SG. 2010. Extending DerSimonian and Laird's methodology to perform multivariate random effects meta-analyses. Statistics in Medicine 29: 1282–1297. DOI:10.1002/sim.3602.
78. Jansen JP. 2012. Network meta-analysis of individual and aggregate level data. Research Synthesis Methods 3: 177–190.
79. Jansen JP. 2011. Network meta-analysis of survival data with fractional polynomials. BMC Medical Research Methodology 11: 61. DOI:10.1186/1471-2288-11-61.
80. Jansen JP, Cope S. 2012. Meta-regression models to address heterogeneity and inconsistency in network meta-analysis of survival outcomes. BMC Medical Research Methodology 12: 152. DOI:10.1186/1471-2288-12-152.
81. Jansen JP, Crawford B, Bergman G, Stam W. 2008. Bayesian meta-analysis of multiple treatment comparisons: an introduction to mixed treatment comparisons. Value in Health 11: 956–964. DOI:10.1111/j.1524-4733.2008.00347.x.
82. Jansen JP, Fleurence R, Devine B, Itzler R, Barrett A, Hawkins N, Lee K, Boersma C, Annemans L, Cappelleri JC. 2011a. Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. Value Health International Society For Pharmacoeconomics and Outcomes Research 14: 417–428. DOI:10.1016/j.jval.2011.04.002.
83. Jansen JP, Fleurence R, Devine B, Itzler R, Barrett A, Hawkins N, Lee K, Boersma C, Annemans L, Cappelleri JC. 2011b. Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. Value in Health 14: 417–428. DOI:10.1016/j.jval.2011.04.002.
84. Jansen JP, Naci H. 2013. Is network meta-analysis as valid as standard pairwise meta-analysis? It all depends on the distribution of effect modifiers. BMC Medicine 11: 159. DOI:10.1186/1741-7015-11-159.
85. Jansen JP, Schmid CH, Salanti G. 2012. Directed acyclic graphs can help understand bias in indirect and mixed treatment comparisons. Journal of Clinical Epidemiology 65: 798–807. DOI:10.1016/j.jclinepi.2012.01.002.
86. Jonas DE, Wilkins TM, Bangdiwala S, Bann CM, Morgan LC, Thaler KJ, Amick HR, Gartlehner G. 2013. Findings of Bayesian Mixed Treatment Comparison Meta-Analysis: Comparison and Exploration Using Real-word Trial Data and Simulation. (Prepared by RTI-UNC Evidence-Based Practice Center under Contract No. 290-2007-10056-I). AHRQ Publication No. 13-EHC039-EF. Rockville, MD: Agency for Healthcare Research and Quality.
87. Jones B, Roger J, Lane PW, Lawton A, Fletcher C, Cappelleri JC, Tate H, Moneuse P. 2011. Statistical approaches for conducting network meta-analysis in drug development. Pharmaceutical Statistics 10: 523–531. DOI:10.1002/pst.533.
88. Julious SA, Wang SJ. 2008. How biased are indirect comparisons, particularly when comparisons are made over time in controlled trials. Drug Information Journal 42: 625.
89. Kirkham JJ, Riley RD, Williamson PR. 2012. A multivariate meta-analysis approach for reducing the impact of outcome reporting bias in systematic reviews. Statistics in Medicine 31: 2179–2195. DOI:10.1002/sim.5356.
90. König J, Krahn U, Binder H. 2013. Visualizing the Flow of Evidence in Network Meta-analysis and Characterizing Mixed Treatment Comparisons. Statistics in Medicine n/a–n/a. DOI: 10.1002/sim.6001
91. Krahn U, Binder H, Konig J. 2013. A graphical tool for locating inconsistency in network meta-analyses. BMC Medical Research Methodology 13: 35. DOI:10.1186/1471-2288-13-35.
92. Lee AW. 2013. Review of mixed treatment comparisons in published systematic reviews shows marked increase since 2009. Journal of Clinical Epidemiology. DOI:10.1016/j.jclinepi.2013.07.014.
93. Lin L, Zhang J, Chu H. 2015. pcnetmeta: patient-centered network meta-analysis. Available at: http://www.r-project.org/
94. Li T, Puhan MA, Vedula SS, Singh S, Dickersin K, The Ad Hoc Network Meta-analysis Methods Meeting Working Group. 2011. Network meta-analysis-highly attractive but more methodological research is needed. BMC Medicine 9: 79. DOI:10.1186/1741-7015-9-79.
95. Lu G, Ades A. 2009. Modeling between-trial variance structure in mixed treatment comparisons. Biostatistics 10: 792–805. DOI:10.1093/biostatistics/kxp032.
96. Lu G, Ades AE. 2006. Assessing evidence inconsistency in mixed treatment comparisons. Journal of the American Statistical Association 101: 447–459.
97. Lu G, Ades AE. 2004. Combination of direct and indirect evidence in mixed treatment comparisons. Statistics in Medicine 23: 3105–3124. DOI:10.1002/sim.1875.
98. Lu G, Ades AE, Sutton AJ, Cooper NJ, Briggs AH, Caldwell DM. 2007. Meta-analysis of mixed treatment comparisons at multiple follow-up times. Statistics in Medicine 26: 3681–3699. DOI:10.1002/sim.2831.
99. Lu G, Welton NJ, Higgins JPT, White IR, Ades AE. 2011. Linear inference for mixed treatment comparison meta-analysis: a two-stage approach. Research Synthesis Methods 2: 43–60.
100. Lumley T. 2002. Network meta-analysis for indirect treatment comparisons. Statistics in Medicine 21: 2313–2324. DOI:10.1002/sim.1201.
101. Lunn DJ, Thomas A, Best N, Spiegelhalter D. 2000. WinBUGS – a Bayesian modelling framework: concepts, structure, and extensibility. Statistics and Computing 10: 325–337. DOI:10.1023/A:1008929526011.
102. Lunn D, Spiegelhalter D, Thomas A, Best N. 2009. The BUGS project: evolution, critique and future directions. Statistics in Medicine 28: 3049–3067. DOI:10.1002/sim.3680.
103. Madan J, Chen Y-F, Aveyard P, Wang D, Yahaya I, Munafo M, Bauld L, Welton N. 2014. Synthesis of evidence on heterogeneous interventions with multiple outcomes recorded over multiple follow-up times reported inconsistently: a smoking cessation case-study. Journal of the Royal Statistical Society: Series A Statistic Society 177: 295–314. DOI:10.1111/rssa.12018.
104. Madan J, Stevenson MD, Cooper KL, Ades AE, Whyte S, Akehurst R. 2011. Consistency between direct and indirect trial evidence: is direct evidence always more reliable? Value in Health 14: 953–960. DOI:10.1016/j.jval.2011.05.042.
105. Malone DC. 2007. Using indirect comparisons in pharmacoeconomic studies – time for implementation. Clinical Therapeutics 29: 2454–2455. DOI:10.1016/j.clinthera.2007.11.011.
106. Mavridis D, Salanti G. 2013. A practical introduction to multivariate meta-analysis. Statistical Methods in Medical Research 22: 133–158. DOI:10.1177/0962280211432219.
107. Mavridis D, Sutton A, Cipriani A, Salanti G. 2013. A fully Bayesian application of the Copas selection model for publication bias extended to network meta-analysis. Statistics in Medicine 32: 51–66. DOI:10.1002/sim.5494.
108. Mills EJ, Bansback N, Ghement I, Thorlund K, Kelly S, Puhan MA, Wright J. 2011a. Multiple treatment comparison meta-analyses: a step forward into complexity. Journal of Clinical Epidemiology 3: 193–202. DOI:10.2147/CLEP.S16526.
109. Mills EJ, Ghement I, O'Regan C, Thorlund K. 2011b. Estimating the power of indirect comparisons: a simulation study. PLoS One 6: e16237. DOI:10.1371/journal.pone.0016237.
110. Mills EJ, Ioannidis JP, Thorlund K, Schunemann HJ, Puhan MA, Guyatt GH. 2012a. How to use an article reporting a multiple treatment comparison meta-analysis. JAMA 308: 1246–1253. DOI:10.1001/2012.jama.11228.
111. Mills EJ, Kanters S, Thorlund K, Chaimani A, Veroniki AA, Ioannidis JP. 2013a. The effects of excluding treatments from network meta-analyses: survey. BMJ 347: f5195.
112. Mills EJ, Thorlund K, Ioannidis JP. 2013b. Demystifying trial networks and network meta-analysis. BMJ 346: f2914.
113. Mills EJ, Thorlund K, Ioannidis JP. 2012b. Calculating additive treatment effects from multiple randomized trials provides useful estimates of combination therapies. Journal of Clinical Epidemiology 65: 1282–1288. DOI:10.1016/j.jclinepi.2012.07.012.
114. Naci H, Fleurence R. 2011. Using indirect evidence to determine the comparative effectiveness of prescription drugs: do benefits outweigh risks? Health Outcomes Research medical 2: 241–249.
115. Naci H, O'Connor AB. 2013. Assessing comparative effectiveness of new drugs before approval using prospective network meta-analyses. Journal of Clinical Epidemiology 66: 812–816. DOI:10.1016/j.jclinepi.2013.04.002.
116. Naudet F, Millet B, Charlier P, Reymann JM, Maria AS, Falissard B. 2013. Which placebo to cure depression? A thought-provoking network meta-analysis. BMC Medicine 11: 230. DOI:10.1186/1741-7015-11-230.
117. Neupane B, Richer D, Bonner AJ, Kibret T, Beyene J. 2014. Network meta-analysis using R: a review of currently available automated packages. PLoS ONE 9: e115065. DOI:10.1371/journal.pone.0115065.
118. Nikolakopoulou A, Chaimani A, Veroniki AA, Vasiliadis HS, Schmid CH, Salanti G. 2014. Characteristics of networks of interventions: a description of a database of 186 published networks. PLoS One 9: e86754. DOI:10.1371/journal.pone.0086754.
119. Nixon RM, Bansback N, Brennan A. 2007. Using mixed treatment comparisons and meta-regression to perform indirect comparisons to estimate the efficacy of biologic treatments in rheumatoid arthritis. Statistics in Medicine 26: 1237–1254. DOI:10.1002/sim.2624.
120. Norton EC, Miller MM, Wang JJ, Coyne K, Kleinman LC. 2012. Rank reversal in indirect comparisons. Value in Health 15: 1137–1140. DOI:10.1016/j.jval.2012.06.001.
121. Ohlssen D, Price KL, Amy XH, Hong H, Kerman J, Fu H, Quartey G, Heilmann CR, Ma H, Carlin BP. 2013. Guidance on the implementation and reporting of a drug safety Bayesian network meta-analysis. Pharmaceutical Statistics. DOI:10.1002/pst.1592.
122. O'Regan C, Ghement I, Eyawo O, Guyatt GH, Mills EJ. 2009. Incorporating multiple interventions in meta-analysis: an evaluation of the mixed treatment comparison with the adjusted indirect comparison. Trials 10: 86. DOI:10.1186/1745-6215-10-86.
123. Ouwens MJNM, Philips Z, Jansen JP. 2010. Network meta-analysis of parametric survival curves. Research Synthesis Methods 1: 258–271.
124. Panayidou K, Gsteiger S, Kilcher G, Egger M, Carreras M, Efthimiou O, Debray TPA, Trelle S, Hummel N, on behalf of GetReal Methods Review Group. 2015. Get Real in mathematical modelling: A review of methods predicting drug effectiveness from randomized trial data. Research Synthesis Methods Submitted.
125. Piepho H-P. 2014. Network-meta analysis made easy: detection of inconsistency using factorial analysis-of-variance models. BMC Medical Research Methodology 14: 61. DOI:10.1186/1471-2288-14-61.
126. Piepho H-P, Madden LV, Williams ER. 2015. Multiplicative interaction in network meta-analysis. Statistics in Medicine 34: 582–594. DOI:10.1002/sim.6372.
127. Piepho HP, Williams ER, Madden LV. 2012. The use of two-way linear mixed models in multitreatment meta-analysis. Biometrics 68: 1269–1277.
128. Plummer M. 2003. JAGS: a program for analysis of Bayesian graphical models using Gibbs sampling.
129. Price MJ, Welton NJ, Ades AE. 2011a. Parameterization of treatment effects for meta-analysis in multi-state Markov models. Statistics in Medicine 30: 140–151. DOI:10.1002/sim.4059.
130. Price MJ, Welton NJ, Briggs AH, Ades AE. 2011b. Model averaging in the presence of structural uncertainty about treatment effects: influence on treatment decision and expected value of information. Value in Health 14: 205–218. DOI:10.1016/j.jval.2010.08.001.
131. R Core Team. 2014. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. http://www.R-project.org
132. Rücker G. 2012. Network meta-analysis, electrical networks and graph theory. Research Synthesis Methods 3: 312–324.
133. Rücker G, Schwarzer G. 2014. Reduce dimension or reduce weights? Comparing two approaches to multi-arm studies in network meta-analysis. Statistics in Medicine 33: 4353–4369. DOI:10.1002/sim.6236.
134. Rücker G, Schwarzer G, Krahn U, König J. 2015. netmeta: network meta-analysis using frequentist methods. Available at: http://www.r-project.org/
135. Salanti G. 2012. Indirect and mixed-treatment comparison, network, or multiple-treatments meta-analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool. Research Synthesis Methods 3: 80–97. DOI:10.1002/jrsm.1037.
136. Salanti G, Ades AE, Ioannidis JPA. 2011. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. Journal of Clinical Epidemiology 64: 163–171. DOI:10.1016/j.jclinepi.2010.03.016.
137. Salanti G, Dias S, Welton NJ, Ades AE, Golfinopoulos V, Kyrgiou M, Mauri D, Ioannidis JP. 2010. Evaluating novel agent effects in multiple-treatments meta-regression. Statistics in Medicine 29: 2369–2383. DOI:10.1002/sim.4001.
138. Salanti G, Higgins JP, Ades AE, Ioannidis JP. 2008a. Evaluation of networks of randomized trials. Statistical Methods in Medical Research 17: 279–301. DOI:10.1177/0962280207080643.
139. Salanti G, Kavvoura FK, Ioannidis JP. 2008b. Exploring the geometry of treatment networks. Annals of Internal Medicine 148: 544–553.
140. Salanti G, Marinho V, Higgins JP. 2009. A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered. Journal of Clinical Epidemiology 62: 857–864. DOI:10.1016/j.jclinepi.2008.10.001.
141. Saramago P, Sutton AJ, Cooper NJ, Manca A. 2012. Mixed treatment comparisons using aggregate and individual participant level data. Statistics in Medicine 31: 3516–3536. DOI:10.1002/sim.5442.
142. SAS Institute. 2011. The SAS System for Windows. Release 9.2. Cary, NC: SAS Inst.
143. Schmid CH, Trikalinos TA, Olkin I. 2013. Bayesian network meta-analysis for unordered categorical outcomes with incomplete data. Research Synthesis Methodsn/a–n/a. DOI. DOI:10.1002/jrsm.1103.
144. Schmidli H, Wandel S, Neuenschwander B. 2013. The network meta-analytic-predictive approach to non-inferiority trials. Statistical Methods in Medical Research 22: 219–240. DOI:10.1177/0962280211432512.
145. Schmitz S, Adams R, Walsh C. 2013. Incorporating data from various trial designs into a mixed treatment comparison model. Statistics in Medicine. DOI:10.1002/sim.5764.
146. Schmitz S, Adams R, Walsh C. 2012. The use of continuous data versus binary data in MTC models: a case study in rheumatoid arthritis. BMC Medical Research Methodology 12: 167. DOI:10.1186/1471-2288-12-167.
147. Senn S, Gavini F, Magrez D, Scheen A. 2013. Issues in performing a network meta-analysis. Statistical Methods in Medical Research 22: 169–189. DOI:10.1177/0962280211432220.
148. Signorovitch J, Erder MH, Xie J, Sikirica V, Lu M, Hodgkins PS, Wu EQ. 2012. Comparative effectiveness research using matching-adjusted indirect comparison: an application to treatment with guanfacine extended release or atomoxetine in children with attention-deficit/hyperactivity disorder and comorbid oppositional defiant disorder. Pharmacoepidemiol. Saf 21(Suppl 2): 130–137. DOI:10.1002/pds.3246.
149. Snapinn S, Jiang Q. 2011. Indirect comparisons in the comparative efficacy and non-inferiority settings. Pharmaceutical Statistics 10: 420–426. DOI:10.1002/pst.509.
150. Soares MO, Dumville JC, Ades AE, Welton NJ. 2014. Treatment comparisons for decision making: facing the problems of sparse and few data. Journal of the Royal Statistical Society: Series A (Statistics in Society) 177: 259–279. DOI:10.1111/rssa.12010.
151. Sobieraj DM, Cappelleri JC, Baker WL, Phung OJ, White CM, Coleman CI. 2013. Methods used to conduct and report Bayesian mixed treatment comparisons published in the medical literature: a systematic review. BMJ Open 3. DOI:10.1136/bmjopen-2013-003111.
152. Song F, Altman DG, Glenny AM, Deeks JJ. 2003. Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses. BMJ 326: 472. DOI:10.1136/bmj.326.7387.472.
153. Song F, Clark A, Bachmann MO, Maas J. 2012. Simulation evaluation of statistical properties of methods for indirect and mixed treatment comparisons. BMC Medical Research Methodology 12: 138. DOI:10.1186/1471-2288-12-138.
154. Song F, Harvey I, Lilford R. 2008. Adjusted indirect comparison may be less biased than direct comparison for evaluating new pharmaceutical interventions. Journal of Clinical Epidemiology 61: 455–463. DOI:10.1016/j.jclinepi.2007.06.006.
155. Song F, Loke YK, Walsh T, Glenny AM, Eastwood AJ, Altman DG. 2009. Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews. BMJ 338: b1147.
156. Song F, Xiong T, Parekh-Bhurke S, Loke YK, Sutton AJ, Eastwood AJ, Holland R, Chen YF, Glenny AM, Deeks JJ, Altman DG. 2011. Inconsistency between direct and indirect comparisons of competing interventions: meta-epidemiological study. BMJ 343: d4909.
157. Spiegelhalter DJ, Best NG. 2003. Bayesian approaches to multiple sources of evidence and uncertainty in complex cost-effectiveness modelling. Statistics in Medicine 22: 3687–3709. DOI:10.1002/sim.1586.
158. Spiegelhalter DJ, Best NG, Carlin BP, Van Der Linde A. 2002. Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society, Series B: Statistical Methodology 64: 583–639. DOI:10.1111/1467-9868.00353.
159. Spineli LM, Higgins JP, Cipriani A, Leucht S, Salanti G. 2013. Evaluating the impact of imputations for missing participant outcome data in a network meta-analysis. Clinical Trials London England 10: 378–388. DOI:10.1177/1740774512470317.
160. Stan Development Team. 2014. Stan modeling language users guide and reference manual, version 2.5.0.
161. StataCorp. 2013. Stata Statistical Software: Release 13. College Station, TX: StataCorp LP.
162. Sturtz S, Bender R. 2012. Unsolved issues of mixed treatment comparison meta-analysis: network size and inconsistency. Research Synthesis Methods 3: 300–311.
163. Sutton A, Ades AE, Cooper N, Abrams K. 2008. Use of indirect and mixed treatment comparisons for technology assessment. PharmacoEconomics 26: 753–767.
164. Sutton AJ, Cooper NJ, Jones DR. 2009. Evidence synthesis as the key to more coherent and efficient research. BMC Medical Research Methodology 9: 29. DOI:10.1186/1471-2288-9-29.
165. Tan SH, Bujkiewicz S, Sutton A, Dequen P, Cooper N. 2013. Presentational approaches used in the UK for reporting evidence synthesis using indirect and mixed treatment comparisons. Journal of Health Services Research & Policy 18: 224–232. DOI:10.1177/1355819613498379.
166. Tan SH, Cooper NJ, Bujkiewicz S, Welton NJ, Caldwell DM, Sutton AJ. 2014. Novel presentational approaches were developed for reporting network meta-analysis. Journal of Clinical Epidemiology. DOI:10.1016/j.jclinepi.2013.11.006.
167. Thorlund K, Mills E. 2012a. Stability of additive treatment effects in multiple treatment comparison meta-analysis: a simulation study. Journal of Clinical Epidemiology 4: 75–85. DOI:10.2147/CLEP.S29470.
168. Thorlund K, Mills EJ. 2012b. Sample size and power considerations in network meta-analysis. Systematic Reviews 1: 41. DOI:10.1186/2046-4053-1-41.
169. Thorlund K, Thabane L, Mills EJ. 2013. Modelling heterogeneity variances in multiple treatment comparison meta-analysis-are informative priors the better solution? BMC Medical Research Methodology 13: 2. DOI:10.1186/1471-2288-13-2.
170. Thorlund K, Zafari Z, Druyts E, Mills EJ, Sadatsafavi M. 2014. The impact of incorporating Bayesian network meta-analysis in cost-effectiveness analysis – a case study of pharmacotherapies for moderate to severe COPD. Cost Effectiveness and Resource Allocation CE 12: 8. DOI:10.1186/1478-7547-12-8.
171. Trinquart L, Abbe A, Ravaud P. 2012a. Impact of reporting bias in network meta-analysis of antidepressant placebo-controlled trials. PLoS One 7: e35219. DOI:10.1371/journal.pone.0035219.
172. Trinquart L, Chatellier G, Ravaud P. 2012b. Adjustment for reporting bias in network meta-analysis of antidepressant trials. BMC Medical Research Methodology 12: 150. DOI:10.1186/1471-2288-12-150.
173. Turner RM, Spiegelhalter DJ, Smith GCS, Thompson SG. 2009. Bias modelling in evidence synthesis. Journal of the Royal Statistical Society: Series A Statistic Society 172: 21–47. DOI:10.1111/j.1467-985X.2008.00547.x.
174. Tu YK, Faggion CM. 2012. A primer on network meta-analysis for dental research. ISRN Dentistry 2012: 276520. DOI:10.5402/2012/276520.
175. van Houwelingen HC, Arends LR, Stijnen T. 2002. Advanced methods in meta-analysis: multivariate approach and meta-regression. Statistics in Medicine 21: 589–624.
176. van Valkenhoef G, Ades AE. 2013. Evidence synthesis assumes additivity on the scale of measurement: response to ‘Rank reversal in indirect comparisons’ by Norton et al. Value in Health 16: 449–451. DOI:10.1016/j.jval.2012.11.012.
177. van Valkenhoef G, Kuiper J. 2015. gemtc: network meta-analysis using Bayesian. Available at: http://www.r-project.org/
178. van Valkenhoef G, Lu G, de Brock B, Hillege H, Ades AE, Welton NJ. 2012a. Automating network meta-analysis. Research Synthesis Methods 3: 285–299.
179. van Valkenhoef G, Tervonen T, de Brock B, Hillege H. 2012b. Algorithm parameterization of mixed treatment comparisons. Statistics and Computing 22: 1099–1111.
180. van Valkenhoef G, Tervonen T, Zhao J, de Brock B, Hillege HL, Postmus D. 2012c. Multicriteria benefit–risk assessment using network meta-analysis. Journal of Clinical Epidemiology 65: 394–403. DOI:10.1016/j.jclinepi.2011.09.005.
181. Veroniki AA, Vasiliadis HS, Higgins JP, Salanti G. 2013. Evaluation of inconsistency in networks of interventions. International Journal of Epidemiology 42: 332–345. DOI:10.1093/ije/dys222.
182. Viechtbauer W. 2010. Conducting meta-analyses in R with the metafor package. Journal of Statistical Software 36: 1–48. DOI:10.18637/jss.v036.i03.
183. Walter SD. 2000. Choice of effect measure for epidemiological data. Journal of Clinical Epidemiology 53: 931–939. DOI:10.1016/S0895-4356(00)00210-9.
184. Warren FC, Abrams KR, Sutton AJ. 2014. Hierarchical network meta-analysis models to address sparsity of events and differing treatment classifications with regard to adverse outcomes. Statistics in Medicine. DOI:10.1002/sim.6131.
185. Wells GA, Sultan SA, Chen L, Khan M, Coyle D. 2009. Indirect evidence: Indirect treatment comparisons in meta-analysis. Ottawa Canadian Agency for Drugs and Technologies in Health. https://www.cadth.ca/media/pdf/H0462_itc_tr_e.pdf
186. Welton NJ, Caldwell DM, Adamopoulos E, Vedhara K. 2009. Mixed treatment comparison meta-analysis of complex interventions: psychological interventions in coronary heart disease. American Journal of Epidemiology 169: 1158–1165. DOI:10.1093/aje/kwp014.
187. Welton NJ, Cooper NJ, Ades AE, Lu G, Sutton AJ. 2008. Mixed treatment comparison with multiple outcomes reported inconsistently across trials: evaluation of antivirals for treatment of influenza A and B. Statistics in Medicine 27: 5620–5639. DOI:10.1002/sim.3377.
188. Welton NJ, Sutton AJ, Cooper N, Abrams KR, Ades AE. 2012. Mixed and indirect treatment comparisons. In Evidence Synthesis for Decision Making in Healthcare. New York: John Wiley & Sons.
189. Welton NJ, Willis SR, Ades AE. 2010. Synthesis of survival and disease progression outcomes for health technology assessment of cancer therapies. Research Synthesis Methods 1: 239–257.
190. White IR, Barrett JK, Jackson D, Higgins JPT. 2012. Consistency and inconsistency in network meta-analysis: model estimation using multivariate meta-regression. Research Synthesis Methods 3: 111–125.
191. Wolpert RL, Mengersen KL. 2004. Adjusted likelihoods for synthesizing empirical evidence from studies that differ in quality and design: effects of environmental tobacco smoke. Statistical Science 19: 450–471.
192. Woods BS, Hawkins N, Scott DA. 2010. Network meta-analysis on the log-hazard scale, combining count and hazard ratio statistics accounting for multi-arm trials: a tutorial. BMC Medical Research Methodology 10: 54. DOI:10.1186/1471-2288-10-54.
193. Xiong T, Parekh-Bhurke S, Loke YK, Abdelhamid A, Sutton AJ, Eastwood AJ, Holland R, Chen YF, Walsh T, Glenny AM, Song F. 2013. Overall similarity and consistency assessment scores are not sufficiently accurate for predicting discrepancy between direct and indirect comparison estimates. Journal of Clinical Epidemiology 66: 184–191. DOI:10.1016/j.jclinepi.2012.06.022.
194. Yang G, Liu D, Liu RY, Xie M, Hoaglin DC. 2014. Efficient network meta-analysis: a confidence distribution approach. Statistical Methodology. DOI:10.1016/j.stamet.2014.01.003.
195. Zhang J, Carlin BP, Neaton JD, Soon GG, Nie L, Kane R, Virnig BA, Chu H. 2013. Network meta-analysis of randomized clinical trials: reporting the proper summaries. Clinical Trials. DOI:10.1177/1740774513498322.