Multilevel multiple imputation: A review and evaluation of joint modeling and chained equations imputation

Psychological Methods

Volumn 21, Issue 2, 2016, Pages 222-240

  Enders, Craig K ^a,b   Mistler, Stephen A ^a   Keller, Brian T ^a,c  

^a ARIZONA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c SAS INSTITUTE INC   (United States)

Author keywords

Missing data; Multilevel modeling; Multiple imputation

Indexed keywords

COMPUTER SIMULATION; JOINT; MODEL; STATISTICAL MODEL; THEORETICAL MODEL; HUMAN; METHODOLOGY; MULTILEVEL ANALYSIS;

COMPUTER SIMULATION; HUMANS; MULTILEVEL ANALYSIS; RESEARCH DESIGN;

EID: 84951310155     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/met0000063     Document Type: Article

References (64)

1. Agresti, A. (2012). Categorical data analysis (3rd ed.). Hoboken, NJ: Wiley
2. Agresti, A. (2015). Foundations of linear and generalized linear models. Hoboken, NJ: Wiley
3. Aitchison, J., & Bennett, J. A. (1970). Polychotomous quantal response by maximum indicant. Biometrika, 57, 253-262. http://dx. doi. org/10. 1093/biomet/57. 2. 253
4. Albert, J. H., & Chib, S. (1993). Bayesian analysis of binary and polychotomous response data. Journal of the American Statistical Association, 88, 669-679. http://dx. doi. org/10. 1080/01621459. 1993. 10476321
5. Allison, P. D. (2005, April). Imputation of categorical variables with PROC MI. Paper presented at the SAS Users Group International. Allison, P. D. (2002). Missing data. Newbury Park, CA: Sage
6. Andridge, R. R. (2011). Quantifying the impact of fixed effects modeling of clusters in multiple imputation for cluster randomized trials. Biometrical Journal Biometrische Zeitschrift, 53, 57-74. http://dx. doi. org/10. 1002/bimj. 201000140
7. Asparouhov, T., & Muthén, B. (2010). Multiple imputation with Mplus. Retrieved from http://www. statmodel. com/download/Imputations7. pdf
8. Bernaards, C. A., Belin, T. R., & Schafer, J. L. (2007). Robustness of a multivariate normal approximation for imputation of incomplete binary data. Statistics in Medicine, 26, 1368-1382. http://dx. doi. org/10. 1002/sim. 2619
9. Browne, W. J., & Draper, D. (2000). Implementation and performance issues in the Bayesian and likelihood fitting of multilevel models. Computational Statistics, 15, 391-420. http://dx. doi. org/10. 1007/s001800000041
10. Carpenter, J. R., Goldstein, H., & Kenward, M. G. (2011). REALCOMIMPUTE software for multilevel multiple imputation with mixed response types. Journal of Statistical Software, 45, 1-14. http://dx. doi. org/10. 18637/jss. v045. i05
11. Carpenter, J. R., & Kenward, M. G. (2013). Multiple imputation and its application. West Sussex, UK: Wiley. http://dx. doi. org/10. 1002/9781119942283
12. Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001). A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychological Methods, 6, 330-351. http://dx. doi. org/10. 1037/1082-989X. 6. 4. 330
13. Cowles, K. (1996). Accelerating Monte Carlo Markov chain convergence for cumulative-link generalized linear models. Statistics and Computing, 6, 101-111. http://dx. doi. org/10. 1007/BF00162520
14. Demirtas, H., Freels, S. A., & Yucel, R. M. (2008). Plausibility of multivariate normality assumption when multiple imputing non-Gaussian continuous outcomes: A simulation assessment. Journal of Statistical Computation and Simulation, 78, 69-84. http://dx. doi. org/10. 1080/10629360600903866
15. Enders, C. K. (2010). Applied missing data analysis. New York, NY: Guilford Press
16. Enders, C. K., & Baraldi, A. N. (in press). Missing data methods. In P. Irwing, T. Booth, & D. Hughes (Eds.), Handbook of psychometrics. Oxford, UK: Wiley-Blackwell
17. Finch, J. F., West, S. G., & MacKinnon, D. P. (1997). Effects of sample size and nonnormality on the estimation of mediated effects in latent variable models. Structural Equation Modeling, 4, 87-107. http://dx. doi. org/10. 1080/10705519709540063
18. Finney, S. J., & DiStefano, C. (2013). Nonnormal and categorical data in structural equation models. In G. R. Hancock & R. O. Mueller (Eds.), A second course in structural equation modeling (2nd ed., pp. 439-492). Charlotte, NC: Information Age
19. Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2013). Bayesian data analysis (2nd ed.). Boca Raton, FL: Chapman and Hall
20. Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. Cambridge, UK: Cambridge University Press
21. Gelman, A., & Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457-511. http://dx. doi. org/10. 1214/ss/1177011136
22. Goldstein, H., Bonnet, G., & Rocher, T. (2007). Multilevel structural equation models for the analysis of comparative data on educational performance. Journal of Educational and Behavioral Statistics, 32, 252-286. http://dx. doi. org/10. 3102/1076998606298042
23. Goldstein, H., Carpenter, J., Kenward, M. G., & Levin, K. A. (2009). Multilevel models with multivariate mixed response types. Statistical Modelling, 9, 173-197. http://dx. doi. org/10. 1177/1471082X0800900301
24. Graham, J. W. (2012). Missing data: Analysis and design. New York, NY: Springer. http://dx. doi. org/10. 1007/978-1-4614-4018-5
25. Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007). How many imputations are really needed? Some practical clarifications of multiple imputation theory. Prevention Science, 8, 206-213. http://dx. doi. org/10. 1007/s11121-007-0070-9
26. Horton, N. J., Lipsitz, S. R., & Parzen, M. (2003). A potential for bias when rounding in multiple imputation. The American Statistician, 57, 229-232. http://dx. doi. org/10. 1198/0003130032314
27. Hughes, R. A., White, I. R., Seaman, S. R., Carpenter, J. R., Tilling, K., & Sterne, J. A. C. (2014). Joint modeling rationale for chained equations. BMC Medical Research Methodology, 14, 1-10. http://dx. doi. org/10. 1186/1471-2288-14-28
28. Jackman, S. (2000). Estimation and inference via Bayesian simulation: An introduction to Markov Chain Monte Carlo. American Journal of Political Science, 44, 375-404. http://dx. doi. org/10. 2307/2669318
29. Johnson, V. E., & Albert, J. H. (1999). Ordinal data modeling. New York, NY: Springer
30. Kaplan, D. (1988). The impact of specification error on the estimation, testing and improvement of structural equation models. Multivariate Behavioral Research, 23, 69-86. http://dx. doi. org/10. 1207/s15327906mbr2301_4
31. Kasim, R. M., & Raudenbush, S. W. (1998). Application of Gibbs sampling to nested variance components models with heterogeneous withingroup variance. Journal of Educational and Behavioral Statistics, 23, 93-116. http://dx. doi. org/10. 3102/10769986023002093
32. Keller, B. T., & Enders, C. K. (2014, May). A latent variable chained equations approach for multilevel multiple imputation. Paper presented at the Modern Modeling Methods Conference, Storrs, CT
33. Little, R. J. A., & Rubin, D. B. (2002). Statistical analysis with missing data (2nd ed.). Hoboken, NJ: Wiley. http://dx. doi. org/10. 1002/9781119013563
34. Lüdtke, O., Marsh, H. W., Robitzsch, A., & Trautwein, U. (2011). A 2-2 taxonomy of multilevel latent contextual models: Accuracy-bias tradeoffs in full and partial error correction models. Psychological Methods, 16, 444-467. http://dx. doi. org/10. 1037/a0024376
35. Meinfelder, F. (2011). Package "mice. "Retrieved from cran. r-project. org/web/packages/baboon/baboon. pdf on 5-16-2015
36. Meng, X.-L. (1994). Multiple-imputation inferences with uncongenial sources of input. Statistical Science, 9, 538-558
37. Mistler, S. A. (2013, April). A SAS macro for applying multiple imputation to multilevel data. Paper presented at the SAS Global Forum, San Francisco, CA
38. Montague, M., Krawec, J., Enders, C., & Dietz, S. (2014). The effects of cognitive strategy instruction on math problem solving of middle school students of varying abilities. Journal of Educational Psychology, 106, 469-481. http://dx. doi. org/10. 1037/a0035176
39. Muthén, L. K., & Muthén, B. O. (1998-2012). Mplus user's guide (7th ed.). Los Angeles, CA: Muthén & Muthén
40. Raghunathan, T. E., Lepkowski, J. M., van Hoewyk, J., & Solenberger, P. (2001). A multivariate technique for multiply imputing missing values using a sequence of regression models. Survey Methodology, 27, 85-95
41. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage
42. Reiter, J. P., Raghunathan, T. E., & Kinney, S. K. (2006). The importance of modeling the survey design in multiple imputation for missing data. Survey Methodology, 32, 143-150
43. Rubin, D. B. (1976). Inference and missing data. Biometrika, 63, 581-592. http://dx. doi. org/10. 1093/biomet/63. 3. 581
44. Rubin, D. B. (1987). Multiple imputation for nonresponse in surveys. Hoboken, NJ: Wiley. http://dx. doi. org/10. 1002/9780470316696
45. Rubin, D. B. (1996). Multiple imputation after 18 years. Journal of the American Statistical Association, 91, 473-489. http://dx. doi. org/10. 1080/01621459. 1996. 10476908
46. Schafer, J. L. (1997). Analysis of incomplete multivariate data. New York, NY: Chapman & Hall. http://dx. doi. org/10. 1201/9781439821862
47. Schafer, J. L. (2001). Multiple imputation with PAN. In A. G. Sayer & L. M. Collins (Eds.), New methods for the analysis of change (pp. 355-377). Washington, DC: American Psychological Association. http://dx. doi. org/10. 1037/10409-012
48. Schafer, J. L. (2003). Multiple imputation in multivariate problems when the imputation and analysis models differ. Statistica Neerlandica, 57, 19-35. http://dx. doi. org/10. 1111/1467-9574. 00218
49. Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147-177. http://dx. doi. org/10. 1037/1082-989X. 7. 2. 147
50. Schafer, J. L., & Olsen, M. K. (1998). Multiple imputation for multivariate missing-data problems: A data analyst's perspective. Multivariate Behavioral Research, 33, 545-571. http://dx. doi. org/10. 1207/s15327906mbr3304_5
51. Schafer, J. L., & Yucel, R. M. (2002). Computational strategies for multivariate linear mixed effects models with missing data. Journal of Computational and Graphical Statistics, 11, 437-457. http://dx. doi. org/10. 1198/106186002760180608
52. Scott, M. A., Shrout, P. E., & Weinberg, S. L. (2013). Multilevel model notation-Establishing the commonalities. In M. A. Scott, J. S. Simonoff, & B. D. Marx (Eds.), The Sage handbook of multilevel modeling (pp. 21-38). Newbury Park, CA: Sage. http://dx. doi. org/10. 4135/9781446247600. n2
53. Sinharay, S., Stern, H. S., & Russell, D. (2001). The use of multiple imputation for the analysis of missing data. Psychological Methods, 6, 317-329. http://dx. doi. org/10. 1037/1082-989X. 6. 4. 317
54. Taljaard, M., Donner, A., & Klar, N. (2008). Imputation strategies for missing continuous outcomes in cluster randomized trials. Biometrical Journal, 50, 329-345. http://dx. doi. org/10. 1002/bimj. 200710423
55. van Buuren, S. (2007). Multiple imputation of discrete and continuous data by fully conditional specification. Statistical Methods in Medical Research, 16, 219-242. http://dx. doi. org/10. 1177/0962280206074463
56. van Buuren, S. (2011). Multiple imputation of multilevel data. In J. K. Roberts & J. J. Hox (Eds.), The handbook of advanced multilevel analysis (pp. 173-196). New York, NY: Routledge
57. van Buuren, S. (2012). Flexible imputation of missing data. New York, NY: Chapman & Hall. http://dx. doi. org/10. 1201/b11826
58. van Buuren, S., Brand, J. P. L., Groothuis-Oudshoorn, C. G. M., & Rubin, D. B. (2006). Fully conditional specification in multivariate imputation. Journal of Statistical Computation and Simulation, 76, 1049-1064. http://dx. doi. org/10. 1080/10629360600810434
59. van Buuren, S., & Groothuis-Oudshoorn, K. (2011). MICE: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45, 1-67
60. van Buuren, S., Groothuis-Oudshoorn, K., Robitzsch, A., Vink, G., Doove, L., & Jolani, S. (2014). Package "mice. "Retrieved from cran. r-project. org/web/packages/mice/mice. pdf on 5-18-2014
61. Yucel, R. M. (2008). Multiple imputation inference for multivariate multilevel continuous data with ignorable non-response. Philosophical Transactions of the Royal Society of London Series A, Mathematical and Physical Sciences, 366, 2389-2403. http://dx. doi. org/10. 1098/rsta. 2008. 0038
62. Yucel, R. M. (2011). Random-covariances and mixed-effects models for imputing multivariate multilevel continuous data. Statistical Modelling, 11, 351-370. http://dx. doi. org/10. 1177/1471082X1001100404
63. Yucel, R. M., He, Y., & Zaslavsky, A. M. (2008). Using calibration to improve rounding in imputation. The American Statistician, 62, 1-5. http://dx. doi. org/10. 1198/000313008X300912
64. Zhao, E., & Yucel, R. M. (2009, August). Performance of sequential imputation method in multilevel applications. Paper presented at the American Statistical Association Joint Statistical Meetings, Washington, DC