Dealing with missing outcome data in meta-analysis

Research Synthesis Methods

Volumn 11, Issue 1, 2020, Pages 2-13

  Mavridis, Dimitris ^a,b   White, Ian R ^c  

^a UNIVERSITY OF IOANNINA   (Greece)

^b UNIVERSITÉ PARIS DESCARTES   (France)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

informative missingness odds ratio; informative missingness parameter; meta analysis; missing data; missing not at random

Indexed keywords

HALOPERIDOL; MIRTAZAPINE;

DEPRESSION; HUMAN; INFORMATION PROCESSING; META ANALYSIS (TOPIC); METHODOLOGY; PROBABILITY; PROCEDURES; RANDOMIZED CONTROLLED TRIAL (TOPIC); REPRODUCIBILITY; SCHIZOPHRENIA; STATISTICAL ANALYSIS; STATISTICAL BIAS; STATISTICAL MODEL; TREATMENT OUTCOME; UNCERTAINTY;

BIAS; DATA COLLECTION; DATA INTERPRETATION, STATISTICAL; DEPRESSION; HALOPERIDOL; HUMANS; META-ANALYSIS AS TOPIC; MIRTAZAPINE; MODELS, STATISTICAL; PROBABILITY; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; SCHIZOPHRENIA; TREATMENT OUTCOME; UNCERTAINTY;

EID: 85069973362     PISSN: None     EISSN: 17592887     Source Type: Journal    
DOI: 10.1002/jrsm.1349     Document Type: Review

References (41)

1. Council NR. The Prevention and Treatment of Missing Data in Clinical Trials. Washington, D.C: National Academies Press; 2010 https://doi.org/10.17226/12955.
2. Little RJ, D'Agostino R, Cohen ML, et al. The prevention and treatment of missing data in clinical trials. N Engl J Med. 2012;367(14):1355-1360. https://doi.org/10.1056/NEJMsr1203730
3. Molenberghs G, Kenward MG, Wiley InterScience (Online service). Missing Data in Clinical Studies. Wiley; 2007.
4. Sterne JAC, White IR, Carlin JB, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ. 2009;338. http://www.bmj.com/content/338/bmj.b2393. Accessed July 7, 2017(jun29 1).
5. Carpenter JR, Kenward MG. In: National Institute for Health Research, ed. Missing Data in Clinical Trials—A Practical Guide. Birmingham: John Wiley & Sons; 2008 http://missingdata.org.uk. Accessed July 7, 2017.
6. Higgins JP, Deeks JJ, Altman DG. Special topics in statistics. In: Cochrane Handbook for Systematic Reviews of Interventions. Chichester, UK: John Wiley & Sons, Ltd; 2008:481-529. https://doi.org/10.1002/9780470712184.ch16.
7. Hollis S, Campbell F. What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ. 1999;319(7211). http://www.bmj.com/content/319/7211/670. Accessed July 7, 2017
8. Elobeid MA, Padilla MA, McVie T, et al. Missing data in randomized clinical trials for weight loss: scope of the problem, state of the field, and performance of statistical methods. Gething PW, ed. PLoS ONE. 2009;4(8):e6624. https://doi.org/10.1371/journal.pone.0006624
9. Kenward MG, Goetghebeur EJT, Molenberghs G. Sensitivity analysis for incomplete categorical data. Stat Modelling. 2001;1(1):31-48. https://doi.org/10.1191/147108201128078
10. White IR, Horton NJ, Carpenter J, Statistics reader in medical and social, Pocock SJ. Strategy for intention to treat analysis in randomised trials with missing outcome data. BMJ 2011;342. http://www.bmj.com/content/342/bmj.d40. Accessed July 21, 2017.
11. Little RJ, Rubin DB. Statistical Analysis with Missing Data. Hoboken, NJ: John Wiley & Sons; 2014.
12. White IR, Carpenter J, Evans S, Schroter S. Eliciting and using expert opinions about dropout bias in randomized controlled trials. Clin Trials. 2007;4(2):125-139. https://doi.org/10.1177/1740774507077849
13. Leucht S, Engel RR, Bauml J, Davis JM. Is the superior efficacy of new generation antipsychotics an artifact of LOCF? Schizophr Bull. 2006;33(1):183-191. https://doi.org/10.1093/schbul/sbl025
14. White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011;30(4):377-399. https://doi.org/10.1002/sim.4067
15. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340. http://www.bmj.com/content/340/bmj.c332. Accessed July 7, 2017(mar23 1).
16. Bell ML, Fiero M, Horton NJ, Hsu C-H. Handling missing data in RCTs; a review of the top medical journals. BMC Med Res Methodol. 2014;14(1):118. https://doi.org/10.1186/1471-2288-14-118.
17. Hussain JA, Bland M, Langan D, Johnson MJ, Currow DC, White IR. Quality of missing data reporting and handling in palliative care trials demonstrates that further development of the CONSORT statement is required: a systematic review. J Clin Epidemiol. May 2017. https://doi.org/10.1016/j.jclinepi.2017.05.009;88:81-91.
18. Akl EA, Shawwa K, Kahale LA, et al. Reporting missing participant data in randomised trials: systematic survey of the methodological literature and a proposed guide. BMJ Open. 2015;5(12):e008431. https://doi.org/10.1136/bmjopen-2015-008431
19. Chan A-W, Altman DG. Epidemiology and reporting of randomised trials published in PubMed journals. Lancet. 2005;365(9465):1159-1162. https://doi.org/10.1016/S0140-6736(05)71879-1
20. Beich A, Thorsen T, Rollnick S. Screening in brief intervention trials targeting excessive drinkers in general practice: systematic review and meta-analysis. BMJ. 2003;327(7414). http://www.bmj.com/content/327/7414/536. Accessed July 7, 2017
21. White I. Intention-to-treat analysis was over-zealous—but this does not affect findings. BMJ. 2003;327(7414):536-542. https://doi.org/10.1136/bmj.327.7414.536
22. Higgins JPT, Altman DG, Sterne JAC. Chapter 8: Assessing risk of bias in included studies. In: Higgins JPT, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (Updated March 2011). The Cochrane Collaboration, 2011 Available from www.handbook.cochrane.org.
23. Savović J, Weeks L, Sterne JAC, et al. Evaluation of the Cochrane collaboration's tool for assessing the risk of bias in randomized trials: focus groups, online survey, proposed recommendations and their implementation. Syst Rev. 2014;3(1):1-12. https://doi.org/10.1186/2046-4053-3-37
24. Mavridis D, Chaimani A, Efthimiou O, Leucht S, Salanti G. Addressing missing outcome data in meta-analysis. Evid Based Ment Health. 2014;17(3):85-89. https://doi.org/10.1136/eb-2014-101900
25. Spineli LM, Pandis N, Salanti G. Reporting and handling missing outcome data in mental health: a systematic review of Cochrane systematic reviews and meta-analyses. Res Synth Methods. 2015;6(2):175-187. https://doi.org/10.1002/jrsm.1131
26. Gamble C, Hollis S. Uncertainty method improved on best-worst case analysis in a binary meta-analysis. J Clin Epidemiol. 2005;58(6):579-588. https://doi.org/10.1016/j.jclinepi.2004.09.013
27. Ebrahim S, Akl EA, Mustafa RA, et al. Addressing continuous data for participants excluded from trial analysis: a guide for systematic reviewers. J Clin Epidemiol. 2013;66(9):1014-1021.e1. https://doi.org/10.1016/j.jclinepi.2013.03.014
28. Higgins JP, White IR, Wood AM. Imputation methods for missing outcome data in meta-analysis of clinical trials. Clin Trials. 2008;5(3):225-239. https://doi.org/10.1177/1740774508091600
29. Molenberghs G, Fitzmaurice GM, Kenward MG, Tsiatis AA (Anastasios A, Verbeke G. Handbook of Missing Data Methodology. https://www.crcpress.com/Handbook-of-Missing-Data-Methodology/Molenberghs-Fitzmaurice-Kenward-Tsiatis-Verbeke/p/book/9781439854617. Accessed February 7, 2019.
30. White IR, Higgins JPT, Wood AM. Allowing for uncertainty due to missing data in meta-analysis—part 1: two-stage methods. Stat Med. 2008;27(5):711-727. https://doi.org/10.1002/sim.3008
31. Mavridis D, White IR, Higgins JPT, Cipriani A, Salanti G. Allowing for uncertainty due to missing continuous outcome data in pairwise and network meta-analysis. Stat Med. 2015;34(5):721-741. https://doi.org/10.1002/sim.6365
32. Spineli LM, Higgins JP, Cipriani A, Leucht S, Salanti G. Evaluating the impact of imputations for missing participant outcome data in a network meta-analysis. Clin Trials. 2013;10(3):378-388. https://doi.org/10.1177/1740774512470317
33. Leacy FP, Floyd S, Yates TA, White IR. Analyses of sensitivity to the missing-at-random assumption using multiple imputation with delta adjustment: application to a tuberculosis/HIV prevalence survey with incomplete HIV-status data. Am J Epidemiol. 2017;185(4):304-315. https://doi.org/10.1093/aje/kww107
34. White IR, Welton NJ, Wood AM, Ades AE, Higgins JPT. Allowing for uncertainty due to missing data in meta-analysis—part 2: hierarchical models. Stat Med. 2008;27(5):728-745. https://doi.org/10.1002/sim.3007
35. Turner NL, Dias S, Ades AE, Welton NJ. A Bayesian framework to account for uncertainty due to missing binary outcome data in pairwise meta-analysis. Stat Med. 2015;34(12):2062-2080. https://doi.org/10.1002/sim.6475
36. Adams CE, Bergman H, Irving CB, Lawrie S. Haloperidol versus placebo for schizophrenia. In: Adams CE, ed. Cochrane Database of Systematic Reviews. Chichester, UK: John Wiley & Sons, Ltd; 2013 CD003082. https://doi.org/10.1002/14651858.CD003082.pub3.
37. Cipriani A, Furukawa TA, Salanti G, et al. Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: a systematic review and network meta-analysis. Lancet February. 2018. https://doi.org/10.1016/S0140-6736(17)32802-7;391(10128):1357-1366.
38. White IR, Higgins JPT. Meta-analysis with missing data. Stata J. 2009;9(1):57-69.
39. Chaimani A, Mavridis D, Higgins J, Salanti G, White IR. Allowing for informative missingness in aggregate data meta-analysis with continuous or binary outcomes: extensions to metamiss. Stata J. 2018;18(3):716-740.
40. Mavridis D, Salanti G, Furukawa TA, Cipriani A, Chaimani A, White IR. Allowing for uncertainty due to missing and LOCF imputed outcomes in meta-analysis. Stat Med. October 2018. https://doi.org/10.1002/sim.8009;38(5):720-737.
41. White IR. Sensitivity analysis: the elicitation and use of expert opinion. In: Molenberghs G, Fitzmaurice G, Kenward MG, Tsiatis A, Verbeke G, eds. Handbook of Missing Data Methodology. Boca Raton, FL: Chapman and Hall/CRC; 2015.