Bibliographic study showed improving statistical methodology of network meta-analyses published between 1999 and 2015

Journal of Clinical Epidemiology

Volumn 82, Issue , 2017, Pages 20-28

  Petropoulou, Maria ^a   Nikolakopoulou, Adriani ^a,b   Veroniki, Areti Angeliki ^c   Rios, Patricia ^c   Vafaei, Afshin ^c   Zarin, Wasifa ^c   Giannatsi, Myrsini ^d   Sullivan, Shannon ^c   Tricco, Andrea C ^c,e   Chaimani, Anna ^a   Egger, Matthias ^b   Salanti, Georgia ^a,b  

^a UNIVERSITY OF IOANNINA   (Greece)

^b UNIVERSITY OF BERN   (Switzerland)

^c ST MICHAEL'S HOSPITAL   (Canada)

^d UNIVERSITY OF MANCHESTER   (United Kingdom)

^e UNIVERSITY OF TORONTO   (Canada)

Author keywords

Inconsistency; Indirect evidence; Meta epidemiology; Mixed treatment comparisons; Multiple interventions; Reporting

Indexed keywords

BIBLIOGRAPHIC DATABASE; CLINICAL RESEARCH; DRUG THERAPY; MEDICAL LITERATURE; MEDICAL RESEARCH; NETWORK META-ANALYSIS; PRIORITY JOURNAL; PUBLICATION; PUBLISHING; RANDOMIZED CONTROLLED TRIAL (TOPIC); REVIEW; SYSTEMATIC REVIEW (TOPIC); BIOMETRY; HUMAN; PROCEDURES; STATISTICS AND NUMERICAL DATA;

BIOMETRY; DATABASES, BIBLIOGRAPHIC; HUMANS; NETWORK META-ANALYSIS;

EID: 85010332741     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2016.11.002     Document Type: Review

References (58)

1. [1] Nikolakopoulou, A., Chaimani, A., Veroniki, A.A., Vasiliadis, H.S., Schmid, C.H., Salanti, G., Characteristics of networks of interventions: a description of a database of 186 published networks. PLoS One, 9, 2014, e86754.
2. [2] Bafeta, A., Trinquart, L., Seror, R., Ravaud, P., Analysis of the systematic reviews process in reports of network meta-analyses: methodological systematic review. BMJ, 347, 2013, f3675.
3. [3] Lee, A.W., Review of mixed treatment comparisons in published systematic reviews shows marked increase since 2009. J Clin Epidemiol 67 (2014), 138–143.
4. [4] Achana, F., Hubbard, S., Sutton, A., Kendrick, D., Cooper, N., An exploration of synthesis methods in public health evaluations of interventions concludes that the use of modern statistical methods would be beneficial. J Clin Epidemiol 67 (2014), 376–390.
5. [5] Higgins, J.P.T., Welton, N.J., Network meta-analysis: a norm for comparative effectiveness?. Lancet 386 (2015), 628–630.
6. [6] Bafeta, A., Trinquart, L., Seror, R., Ravaud, P., Reporting of results from network meta-analyses: methodological systematic review. BMJ, 348, 2014, g1741.
7. [7] Song, F., Loke, Y.K., Walsh, T., Glenny, A.-M., Eastwood, A.J., Altman, D.G., Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews. BMJ, 338, 2009, b1147.
8. [8] Glenny, A.M., Altman, D.G., Song, F., Sakarovitch, C., Deeks, J.J., D'Amico, R., et al. Indirect comparisons of competing interventions. Health Technol Assess 9 (2005), 1–134 [iii–iv].
9. [9] Donegan, S., Williamson, P., Gamble, C., Tudur-Smith, C., Indirect comparisons: a review of reporting and methodological quality. PLoS One, 5, 2010, e11054.
10. [10] Caldwell, D.M., Gibb, D.M., Ades, A.E., Validity of indirect comparisons in meta-analysis. Lancet, 369, 2007, 270.
11. [11] Mavridis, D., Giannatsi, M., Cipriani, A., Salanti, G., A primer on network meta-analysis with emphasis on mental health. Evid Based Ment Health 18 (2015), 40–46.
12. [12] Cipriani, A., Higgins, J.P.T., Geddes, J.R., Salanti, G., Conceptual and technical challenges in network meta-analysis. Ann Intern Med 159 (2013), 130–137.
13. [13] Wood, L., Egger, M., Gluud, L.L., Schulz, K.F., Jüni, P., Altman, D.G., et al. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ 336 (2008), 601–605.
14. [14] Savović, J., Jones, H.E., Altman, D.G., Harris, R.J., Jüni, P., Pildal, J., et al. Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials. Ann Intern Med 157 (2012), 429–438.
15. [15] Sterne, J.A.C., Jüni, P., Schulz, K.F., Altman, D.G., Bartlett, C., Egger, M., Statistical methods for assessing the influence of study characteristics on treatment effects in “meta-epidemiological” research. Stat Med 21 (2002), 1513–1524.
16. [16] Rhodes, K.M., Turner, R.M., Higgins, J.P.T., Empirical evidence about inconsistency among studies in a pair-wise meta-analysis. Res Synth Methods, 2015, 10.1002/jrsm.1193.
17. [17] Turner, R.M., Davey, J., Clarke, M.J., Thompson, S.G., Higgins, J.P., Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane Database of Systematic Reviews. Int J Epidemiol 41 (2012), 818–827.
18. [18] Higgins, J.P.T., Thompson, S.G., Deeks, J.J., Altman, D.G., Measuring inconsistency in meta-analyses. BMJ 327 (2003), 557–560.
19. [19] Nüesch, E., Trelle, S., Reichenbach, S., Rutjes, A.W.S., Tschannen, B., Altman, D.G., et al. Small study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study. BMJ, 341, 2010, c3515.
20. [20] Kjaergard, L.L., Villumsen, J., Gluud, C., Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med 135 (2001), 982–989.
21. [21] Dechartres, A., Trinquart, L., Boutron, I., Ravaud, P., Influence of trial sample size on treatment effect estimates: meta-epidemiological study. BMJ, 346, 2013, f2304.
22. [22] Egger, M., Juni, P., Bartlett, C., Holenstein, F., Sterne, J., How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess Winch Engl 7 (2003), 1–76.
23. [23] Song, F., Altman, D.G., Glenny, A.M., Deeks, J.J., Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses. BMJ, 326, 2003, 472.
24. [24] Song, F., Xiong, T., Parekh-Bhurke, S., Loke, Y.K., Sutton, A.J., Eastwood, A.J., et al. Inconsistency between direct and indirect comparisons of competing interventions: meta-epidemiological study. BMJ, 343, 2011, d4909.
25. [25] Veroniki, A.A., Vasiliadis, H.S., Higgins, J.P., Salanti, G., Evaluation of inconsistency in networks of interventions. Int J Epidemiol 42 (2013), 332–345.
26. [26] Chaimani, A., Vasiliadis, H.S., Pandis, N., Schmid, C.H., Welton, N.J., Salanti, G., Effects of study precision and risk of bias in networks of interventions: a network meta-epidemiological study. Int J Epidemiol 42 (2013), 1120–1131.
27. [27] Salanti, G., Indirect and mixed-treatment comparison, network, or multiple-treatments meta-analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool. Res Synth Methods 3 (2012), 80–97.
28. [28] Jansen, J.P., Naci, H., Is network meta-analysis as valid as standard pairwise meta-analysis? It all depends on the distribution of effect modifiers. BMC Med, 11, 2013, 159.
29. [29] Dias, S., Sutton, A.J., Ades, A.E., Welton, N.J., Evidence synthesis for decision making 2: a generalized linear modeling framework for pairwise and network meta-analysis of randomized controlled trials. Med Decis Making 33 (2013), 607–617.
30. [30] Jansen, J.P., Fleurence, R., Devine, B., Itzler, R., Barrett, A., Hawkins, N., et al. Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. Value Health 14 (2011), 417–428.
31. [31] Jansen, J.P., Trikalinos, T., Cappelleri, J.C., Daw, J., Andes, S., Eldessouki, R., et al. Indirect treatment comparison/network meta-analysis study questionnaire to assess relevance and credibility to inform health care decision making: an ISPOR-AMCP-NPC Good Practice Task Force report. Value Health 17 (2014), 157–173.
32. [32] Efthimiou, O., Debray, T.P.A., van Valkenhoef, G., Trelle, S., Panayidou, K., Moons, K.G.M., et al. GetReal in network meta-analysis: a review of the methodology. Res Synth Methods 7 (2016), 236–263.
33. [33] White, I.R., Barrett, J.K., Jackson, D., Higgins, J.P.T., Consistency and inconsistency in network meta-analysis: model estimation using multivariate meta-regression. Res Synth Methods 3 (2012), 111–125.
34. [34] Higgins, J.P.T., Jackson, D., Barrett, J.K., Lu, G., Ades, A.E., White, I.R., Consistency and insconsistency in network meta-analysis: concepts and models for multi-arm studies. Res Synth Methods 3 (2012), 98–110.
35. [35] van Valkenhoef, G., Lu, G., de Brock, B., Hillege, H., Ades, A.E., Welton, N.J., Automating network meta-analysis. Res Synth Methods 3 (2012), 285–299.
36. [36] Chaimani, A., Salanti, G., Visualizing assumptions and results in network meta-analysis: the network graphs package. Stata J 15 (2015), 905–950.
37. [37] Chaimani, A., Higgins, J.P.T., Mavridis, D., Spyridonos, P., Salanti, G., Graphical tools for network meta-analysis in STATA. PLoS One, 8, 2013, e76654.
38. [38] Rücker, Gerta, Schwarzer, Guido, Krahn, Ulrike, König, Jochem, netmeta: Network meta-analysis using frequentist methods. 2015 R package version 0.8-0. Available at https://CRAN.R-project.org/package=netmeta Accessed December 1, 2016.
39. [39] White, I.R., Network meta-analysis. Stata J 15 (2015), 951–985.
40. [40] McGowan, J., Sampson, M., Salzwedel, D.M., Cogo, E., Foerster, V., Lefebvre, C., Press peer review of electronic search strategies: 2015 guideline statement. J Clin Epidemiol 75 (2016), 40–46.
41. [41] Donegan, S., Williamson, P., D'Alessandro, U., Tudur Smith, C., Assessing key assumptions of network meta-analysis: a review of methods. Res Synth Methods 4 (2013), 291–323.
42. [42] Rücker, G., Schwarzer, G., Ranking treatments in frequentist network meta-analysis works without resampling methods. BMC Med Res Methodol, 15, 2015, 58.
43. [43] Salanti, G., Ades, A.E., Ioannidis, J.P., Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol 64 (2011), 163–171.
44. [44] Hutton, B., Salanti, G., Caldwell, D.M., Chaimani, A., Schmid, C.H., Cameron, C., et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med 162 (2015), 777–784.
45. [45] Cox, D.R., Stuart, A., Some quick sign tests for trend in location and dispersion. Biometrika 42 (1955), 80–95.
46. [46] R Core Team. R: A language and environment for statistical computing. 2014, R Foundation for Statistical Computing, Vienna, Austria Available at http://www.R-project.org Accessed December 1, 2016.
47. [47] Pohlert T. trend: Non-Parametric Trend Tests and Change-Point Detection. R package version 0.2.0. Available at https://CRAN.R-project.org/package=trend. Accessed December 1, 2016.
48. [48] Bucher, H.C., Guyatt, G.H., Griffith, L.E., Walter, S.D., The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J Clin Epidemiol 50 (1997), 683–691.
49. [49] Dias, S., Welton, N.J., Caldwell, D.M., Ades, A.E., Checking consistency in mixed treatment comparison meta-analysis. Stat Med 29 (2010), 932–944.
50. [50] Chaimani, A., Salanti, G., Using network meta-analysis to evaluate the existence of small-study effects in a network of interventions. Res Synth Methods 3 (2012), 161–176.
51. [51] Mavridis, D., Efthimiou, O., Leucht, S., Salanti, G., Publication bias and small-study effects magnified effectiveness of antipsychotics but their relative ranking remained invariant. J Clin Epidemiol 69 (2015), 161–169.
52. [52] Mavridis, D., Sutton, A., Cipriani, A., Salanti, G., A fully Bayesian application of the Copas selection model for publication bias extended to network meta-analysis. Stat Med 32 (2013), 51–66.
53. [53] Chambers, J.D., Naci, H., Wouters, O.J., Pyo, J., Gunjal, S., Kennedy, I.R., et al. An assessment of the methodological quality of published network meta-analyses: a systematic review. PLoS One, 10, 2015, e0121715.
54. [54] Ades, A.E., Caldwell, D.M., Reken, S., Welton, N.J., Sutton, A.J., Dias, S., Evidence synthesis for decision making 7: a reviewer's checklist. Med Decis Making 33 (2013), 679–691.
55. [55] Li, T., Puhan, M.A., Vedula, S.S., Singh, S., Dickersin, K., Ad Hoc Network Meta-analysis Methods Meeting Working Group. Network meta-analysis-highly attractive but more methodological research is needed. BMC Med, 9, 2011, 79.
56. [56] Dias, S., Welton, N.J., Sutton, A.J., Caldwell, D.M., Lu, G., Ades, A.E., Evidence synthesis for decision making 4: inconsistency in networks of evidence based on randomized controlled trials. Med Decis Making 33 (2013), 641–656.
57. [57] Sutton, A.J., Higgins, J.P.T., Recent developments in meta-analysis. Stat Med 27 (2008), 625–650.
58. [58] Veroniki, A.A., Mavridis, D., Higgins, J.P., Salanti, G., Characteristics of a loop of evidence that affect detection and estimation of inconsistency: a simulation study. BMC Med Res Methodol, 14, 2014, 106.