Multiple imputation for multilevel data with continuous and binary variables

Statistical Science

Volumn 33, Issue 2, 2018, Pages 160-183

  Audigier, Vincent ^a   White, Ian R ^b,c   Jolani, Shahab ^d   Debray, Thomas P A ^e   Quartagno, Matteo ^c,f   Carpenter, James ^c,f   van Buuren, Stef ^g,h   Resche Rigon, Matthieu ^i,j  

^a Bioinformatique et Chimie Moléculaire   (France)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

^d MAASTRICHT UNIVERSITY   (Netherlands)

^e UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^f LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

^g UTRECHT UNIVERSITY   (Netherlands)

^h TNO   (Netherlands)

ⁱ SAINT LOUIS HOSPITAL   (France)

^j PARIS DESCARTES UNIVERSITY   (France)

more..

Author keywords

Fully conditional specification; Joint modelling; Missing data; Mixed data; Multilevel data; Multiple imputation; Systematically missing values

Indexed keywords

EID: 85046824732     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/18-STS646     Document Type: Article

References (80)

1. ALBERT, A. and ANDERSON, J.A. (1984). On the existence of maximum likelihood estimates in logistic regression models. Biometrika 71 1-10. MR0738319
2. ALLISON, P. (2002). Missing Data. Sage, Thousand Oaks, CA.
3. ANDRIDGE, R.R. (2011). Quantifying the impact of fixed effects modeling of clusters in multiple imputation for cluster randomized trials. Biom. J. 53 57-74. MR2767378
4. ASPAROUHOV, T. and MUTHéN, B. (2010). Multiple imputation with Mplus. Technical report. Available at http://www. statmodel.com/download/Imputations7.pdf.
5. AUDIGIER, V. and RESCHE-RIGON, M. (2017). micemd: Multiple imputation by chained equations with multilevel data. R package version 1.2.0.
6. AUDIGIER, V., WHITE, I.R., JOLANI, S., DEBRAY, T.P.A., QUARTAGNO, M., CARPENTER, J., VAN BUUREN, S. and RESCHE-RIGON, M. (2018). Supplement to "Multiple imputation for multilevel data with continuous and binary variables." DOI:10.1214/18-STS646SUPPA, DOI:10.1214/18-STS646SUPPB.
7. BARTLETT, J.W., SEAMAN, S.R., WHITE, I.R. and CARPENTER, J.R. (2015). Multiple imputation of covariates by fully conditional specification: Accommodating the substantive model. Stat. Methods Med. Res. 24 462-487. MR3372102
8. BATES, D., MäCHLER, M., BOLKER, B. and WALKER, S. (2015). Fitting linear mixed-effectsmodels using lme4. J. Stat. Softw. 67 1-48.
9. BLOSSFELD, H.-P., GüNTHER RÖSBACH, H. and VON MAURICE, J., eds. (2011). Education as a Lifelong Process: The German National Educational Panel Study (NEPS). VS Verlag für Sozialwissenschaften, Wiesbaden, Germany.
10. BOS, W., LANKES, E.-M., PRENZEL, M., SCHWIPPERT, K. and VALTIN, R., eds. (2003). Erste Ergebnisse aus IGLU: Schülerleistungen Am Ende der Vierten Jahrgangsstufe Im Internationalen Vergleich [the First]. Waxmann, Münster, Germany.
11. CARPENTER, J. and KENWARD, M. (2013). Multiple Imputation and Its Application, 1st ed. Wiley, New York.
12. CARRIG, M.M., MANRIQUE-VALLIER, D., RANBY, K.W., REITER, J. and HOYLE, R.H. (2015). A nonparametric, multiple imputation-based method for the retrospective integration of data sets. Multivar. Behav. Res. 50 383-397.
13. CURRAN, P.J. and HUSSONG, A.M. (2009). Integrative data analysis: The simultaneous analysis of multiple data sets. Psychol. Methods 14 81-100.
14. CURRAN, P.J., HUSSONG, A.M., CAI, L., HUANG, W., CHASSIN, L., SHER, K.J. and ZUCKER, R.A. (2008). Pooling data from multiple longitudinal studies: The role of item response theory in integrative data analysis. Dev. Psychol. 44 365-380.
15. DEBRAY, T., RILEY, R., ROVERS, M., REITSMA, J., MOONS, K. and ON BEHALF OF THE COCHRANE IPD META-ANALYSIS METHODS GROUP (2015b). Individual participant data (IPD) meta-analyses of diagnostic and prognostic modeling studies: Guidance on their use. PLoS Med. 12 e1001886.
16. DEBRAY, T., MOONS, K., VAN VALKENHOEF, G., EFTHIMIOU, O., HUMMEL, N., GROENWOLD, R. and REITSMA, J.O. (2015a). Get real in individual participant data (IPD) meta-analysis: A review of the methodology. Res. Synth. Methods 6 293-309.
17. DERSIMONIAN, R. and LAIRD, N. (1986). Meta-analysis in clinical trials. Control. Clin. Trials 7 177-188.
18. DRECHSLER, J. (2015). Multiple imputation of multilevel missing data-rigor versus simplicity. J. Educ. Behav. Stat. 40 69-95.
19. ENDERS, C. (2010). Applied Missing Data Analysis. Guilford Press, New York.
20. ENDERS, C.K., KELLER, B.T. and LEVY, R. (2017). A fully conditional specification approach to multilevel imputation of categorical and continuous variables. Psychol. Methods.
21. ENDERS, C., MISTLER, S. and KELLER, B. (2016). Multilevel multiple imputation: A review and evaluation of joint modeling and chained equations imputation. Psychological Methods 21 222-240.
22. ERLER, N.S., RIZOPOULOS, D., VAN ROSMALEN, J., JADDOE, V.W.V., FRANCO, O.H. and LESAFFRE, E.M.E.H. (2016). Dealing with missing covariates in epidemiologic studies: A comparison between multiple imputation and a full Bayesian approach. Stat. Med. 35 2955-2974. MR3528236
23. FIRTH, D. (1993). Bias reduction of maximum likelihood estimates. Biometrika 80 27-38. MR1225212
24. GELMAN, A. (2006). Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper). Bayesian Anal. 1 515-533. MR2221284
25. GEMAN, S. and GEMAN, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6 721-741.
26. GLOBAL RESEARCH ON ACUTE CONDITIONS TEAM (GREAT) NETWORK (2013). Managing acute heart failure in the ED- case studies from the acute heart failure academy. Available at http://www.greatnetwork.org.
27. GOLDSTEIN, H., BONNET, G. and ROCHER, T. (2007). Multilevel structural equation models for the analysis of comparative data on educational performance. J. Educ. Behav. Stat. 32 252-286.
28. GOLDSTEIN, H., CARPENTER, J., KENWARD, M.G. and LEVIN, K.A. (2009). Multilevel models with multivariate mixed response types. Stat. Model. 9 173-197. MR2756416
29. GRAHAM, J.W. (2012). Missing Data: Analysis and Design. Springer, New York. MR2952499
30. GRUND, S., LüDTKE, O. and ROBITZSCH, A. (2016). Multiple imputation of missing covariate values in multilevel models with random slopes: A cautionary note. Behav. Res. Methods 48 640-649.
31. HUGHES, R.A., WHITE, I.R., SEAMAN, S., CARPENTER, J., TILLING, K. and STERNE, J. (2014). Joint modelling rationale for chained equations. BMC Med. Res. Methodol. 14 28.
32. JACKSON, D., WHITE, I.R. and RILEY, R.D. (2013). A matrixbased method of moments for fitting the multivariate random effects model for meta-analysis and meta-regression. Biom. J. 55 231-245. MR3045843
33. JOLANI, S. (2018). Hierarchical imputation of systematically and sporadically missing data: An approximate Bayesian approach using chained equations. Biom. J. 60 333-351.
34. JOLANI, S., DEBRAY, T.P.A., KOFFIJBERG, H., VAN BUUREN, S. and MOONS, K.G.M. (2015). Imputation of systematically missing predictors in an individual participant data meta-analysis: A generalized approach using MICE. Stat. Med. 34 1841-1863. MR3334696
35. KROPKO, J., GOODRICH, B., GELMAN, A. and HILL, J. (2014). Multiple imputation for continuous and categorical data: Comparing joint multivariate normal and conditional approaches. Polit. Anal. 22 497-519.
36. KUNKEL, D. and KAIZAR, E.E. (2017). A comparison of existing methods for multiple imputation in individual participant data meta-analysis. Stat. Med. 36 3507-3532. MR3696506
37. LANGAN, D., HIGGINS, J.P.T. and SIMMONDS, M. (2017). Comparative performance of heterogeneity variance estimators in meta-analysis: A review of simulation studies. Res. Synth. Methods 8 181-198.
38. LASSUS, J., GAYAT, E., MUELLER, C., PEACOCK, W., SPINAR, J., HARJOLA, V., VAN KIMMENADE, R., PATHAK, A., MUELLER, T. et al. (2013). Incremental value of biomarkers to clinical variables for mortality prediction in acutely decompensated heart failure: The multinational observational cohort on acute heart failure (MOCA) study. Int. J. Cardiol. 168 2186-2194.
39. LEE, K. and CARLIN, J. (2010). Multiple imputation for missing data: Fully conditional specification versus multivariate normal imputation. Am. J. Epidemiol. 171 624-632.
40. LEE, Y., NELDER, J.A. and PAWITAN, Y. (2006). Generalized Linear Models with Random Effects: Unified Analysis via HLikelihood. Monographs on Statistics and Applied Probability 106. Chapman & Hall/CRC, Boca Raton, FL. With 1 CD-ROM (Windows). MR2259540
41. LITTLE, R. (1988). Missing-data adjustments in large surveys. J. Bus. Econom. Statist. 6 287-296.
42. LITTLE, R.J.A. and RUBIN, D.B. (2002). Statistical Analysis with Missing Data, 2nd ed. Wiley-Interscience, Hoboken, NJ. MR1925014
43. LIU, J., GELMAN, A., HILL, J., SU, Y.-S. and KROPKO, J. (2014). On the stationary distribution of iterative imputations. Biometrika 101 155-173. MR3180663
44. LONGFORD, N.T. (2008). Missing data. In Handbook of Multilevel Analysis 377-399. Springer, New York. MR2412943
45. MATHEW, T. and NORDSTRöM, K. (2010). Comparison of onestep and two-step meta-analysis models using individual patient data. Biom. J. 52 271-287. MR2756877
46. MCNEISH, D. and STAPLETON, L.M. (2016). Modeling clustered data with very few clusters. Multivar. Behav. Res. 51 495-518.
47. MEBAZAA, A., GAYAT, E., LASSUS, J., MEAS, T., MUELLER, C. et al. (2013). Association between elevated blood glucose and outcome in acute heart failure: Results from an international observational cohort. J. Am. Coll. Cardiol. 61 820-829.
48. MENG, X. (1994). Multiple-imputation inferences with uncongenial sources of input (with discussion). Statist. Sci. 10 538-573.
49. MORRIS, T.P., WHITE, I.R. and CROWTHER, M.J. (2017). Using simulation studies to evaluate statistical methods. ArXiv eprints.
50. MULLIS, I., MARTIN, M., GONZALEZ, E. and KENNEDY, A. (2003). Pirls 2001 international report: Iea's study of reading literacy achievement in primary school in 35 countries. Available at: https://timssandpirls.bc.edu/pirls2001i/pdf/p1_IR_book.pdf.
51. NOH, M. and LEE, Y. (2007). REML estimation for binary data in GLMMs. J. Multivariate Anal. 98 896-915. MR2325413
52. PINHEIRO, J. and BATES, D. (2000). Mixed-Effects Models in S and S-PLUS. Springer, New York.
53. PINHEIRO, J., BATES, D., DEBROY, S. and SARKAR, D. (2016). nlme: Linear and nonlinear mixed effects models. R package version 3.1-128.
54. QUARTAGNO, M. and CARPENTER, J.R. (2016a). Multiple imputation for IPD meta-analysis: Allowing for heterogeneity and studies with missing covariates. Stat. Med. 35 2938-2954. MR3528235
55. QUARTAGNO, M. and CARPENTER, J. (2016b). jomo: A package for multilevel joint modelling multiple imputation. R package version 2.2-0.
56. RAGHUNATHAN, T., LEPKOWSKI, J.M., VAN HOEWYK, J. and SOLENBERGER, P. (2001). A multivariate technique for multiply imputing missing values using a sequence of regression models. Surv. Methodol. 27 85-96.
57. REITER, J., RAGHUNATHAN, T.E. and KINNEY, S.K. (2006). The importance of modeling the sampling design in multiple imputation for missing data. Surv. Methodol. 32 143.
58. RESCHE-RIGON, M. and WHITE, I. (2016). Multiple imputation by chained equations for systematically and sporadically missing multilevel data. Stat. Methods Med. Res. DOI:10.1177/0962280216666564.
59. RESCHE-RIGON, M., WHITE, I.R., BARTLETT, J.W., PETERS, S.A.E., THOMPSON, S.G. and GROUP, P.S. (2013). Multiple imputation for handling systematically missing confounders in meta-analysis of individual participant data. Stat. Med. 32 4890-4905. MR3127183
60. RILEY, R.D., LAMBERT, P.C., STAESSEN, J.A., WANG, J., GUEYFFIER, F., THIJS, L. and BOUTITIE, F. (2008). Metaanalysis of continuous outcomes combining individual patient data and aggregate data. Stat. Med. 27 1870-1893. MR2420350
61. RILEY, R.D., ENSOR, J., SNELL, K.I.E., DEBRAY, T.P.A., ALTMAN, D.G., MOONS, K.G.M. and COLLINS, G.S. (2016). External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: Opportunities and challenges. BMJ 353 i3140.
62. ROBERT, C.P. (2007). The Bayesian Choice: From Decision- Theoretic Foundations to Computational Implementation, 2nd ed. Springer, New York. MR2723361
63. RUBIN, D.B. (1976). Inference and missing data. Biometrika 63 581-592. MR0455196
64. RUBIN, D.B. (1987). Multiple Imputation for Nonresponse in Surveys. Wiley, New York. MR0899519
65. SCHAFER, J.L. (1997). Analysis of Incomplete Multivariate Data. Monographs on Statistics and Applied Probability 72. Chapman & Hall, London. MR1692799
66. SCHAFER, J.L. and YUCEL, R.M. (2002). Computational strategies for multivariate linear mixed-effects models with missing values. J. Comput. Graph. Statist. 11 437-457. MR1938143
67. SIMMONDS, M., HIGGINS, J., STEWART, L., TIERNEY, J., CLARKE, M. and THOMPSON, S. (2005). Meta-analysis of individual patient data from randomized trials: A review of methods used in practice. Clin. Trials 2 209-217.
68. TANNER, M.A. and WONG, W.H. (1987). The calculation of posterior distributions by data augmentation. J. Amer. Statist. Assoc. 82 528-550. MR0898357
69. R CORE TEAM (2016). R: A Language and Environment for Statistical Computing. Version 3.3.0. R Foundation for Statistical Computing, Vienna, Austria.
70. VAN BUUREN, S. (2007). Multiple imputation of discrete and continuous data by fully conditional specification. Stat. Methods Med. Res. 16 219-242. MR2371007
71. VAN BUUREN, S. (2011). Multiple imputation of multilevel data. In The Handbook of Advanced Multilevel Analysis (J.J. Hox, ed.) 173-196. Routledge, New York.
72. VAN BUUREN, S. (2012). Flexible Imputation of Missing Data (Chapman & Hall/CRC Interdisciplinary Statistics). Chapman & Hall/CRC, London.
73. VAN BUUREN, S. and GROOTHUIS-OUDSHOORN, K. (2011). mice: Multivariate imputation by chained equations in R.J. Stat. Softw. 45 1-67.
74. VAN BUUREN, S., BRAND, J.P.L., GROOTHUISOUDSHOORN, C.G.M. and RUBIN, D.B. (2006). Fully conditional specification in multivariate imputation. J. Stat. Comput. Simul. 76 1049-1064. MR2307507
75. VINK, G., LAZENDIC, G. and VAN BUUREN, S. (2015). Partitioned predictive mean matching as a multilevel imputation technique. Psychol. Test Assess. Model. 57 577-594.
76. WAGSTAFF, D. and HAREL, O. (2011). A closer examination of three small-sample approximations to the multiple-imputation degrees of freedom. Stata J. 11 403-419.
77. YUCEL, R.M. (2011). Random covariances and mixed-effects models for imputing multivariate multilevel continuous data. Stat. Model. 11 351-370. MR2906705
78. ZHAO, Y. and LONG, Q. (2016). Multiple imputation in the presence of high-dimensional data. Stat. Methods Med. Res. 25 2021-2035. MR3553324
79. ZHAO, E. and YUCEL, R. (2009). Performance of sequential imputation method in multilevel applications. In Proceedings of the Survey Research Methods Section (JSM 2009) 2800-2810. Amer. Statist. Assoc., Alexandria, VA.
80. ZHU, J. and RAGHUNATHAN, T.E. (2015). Convergence properties of a sequential regression multiple imputation algorithm. J. Amer. Statist. Assoc. 110 1112-1124. MR3420688