The treatment of incomplete data: Reporting, analysis, reproducibility, and replicability

Social Science and Medicine

Volumn 209, Issue , 2018, Pages 169-173

  Sidi, Yulia ^a   Harel, Ofer ^a  

^a UNIVERSITY OF CONNECTICUT   (United States)

Author keywords

Incomplete data; Missing data; Multiple imputation; Replicability; Reproducibility

Indexed keywords

ARTICLE; CASE STUDY; CHECKLIST; EDITOR; EMPLOYMENT; HUMAN; PHYSICIAN; PUBLICATION; REPRODUCIBILITY; SCIENTIST; STATISTICAL ANALYSIS; INFORMATION PROCESSING; METHODOLOGY; STANDARDS;

DATA COLLECTION; HUMANS; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN;

EID: 85047391834     PISSN: 02779536     EISSN: 18735347     Source Type: Journal    
DOI: 10.1016/j.socscimed.2018.05.037     Document Type: Note

References (52)

1. Amemiya, T., Tobit models: a survey. J. Econom. 24:1–2 (1984), 3–61.
2. American Psychological Association, Publication Manual of the American Psychological Association. sixth ed., 2010, American Psychological Association, Washington, DC.
3. Bell, M.L., Fiero, M., Horton, N.J., Hsu, C.-H., Handling missing data in rcts; a review of the top medical journals. BMC Med. Res. Meth., 14(1), 2014, 118.
4. Burzykowski, T., Carpenter, J., Coens, C., Evans, D., France, L., Kenward, M., Lane, P., Matcham, J., Morgan, D., Phillips, A., et al. Missing data: discussion points from the psi missing data expert group. Pharmaceut. Stat. 9:4 (2010), 288–297.
5. Carpenter, J., Kenward, M., Multiple Imputation and its Application. 2012, John Wiley & Sons.
6. Collins, L.M., Schafer, J.L., Kam, C.-M., A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychol. Meth., 6(4), 2001, 330.
7. Daniels, M.J., Hogan, J.W., Missing Data in Longitudinal Studies: Strategies for Bayesian Modeling and Sensitivity Analysis. 2008, CRC Press.
8. Eekhout, I., de Boer, R.M., Twisk, J.W., de Vet, H.C., Heymans, M.W., Missing data: a systematic review of how they are reported and handled. Epidemiology 23:5 (2012), 729–732.
9. Harel, O., Inferences on missing information under multiple imputation and two-stage multiple imputation. Stat. Meth. 4:1 (2007), 75–89.
10. Harel, O., Strategies for Data Analysis with Two Types of Missing Values. 2009, Lap Lambert Academic Publishing GmbH KG.
11. Harel, O., Boyko, J., Mi??ing data: should we c?re?. Am. J. Publ. Health 103:2 (2013), 200–201 https://www.ncbi.nlm.nih.gov/pubmed/23237157.
12. Harel, O., Mitchell, E.M., Perkins, N.J., Cole, S.R., Tchetgen Tchetgen, E.J., Sun, B., Schisterman, E.F., Multiple imputation for incomplete data in epidemiologic studies. Am. J. Epidemiol. 187:3 (2018), 576–584.
13. Harel, O., Pellowski, J., Kalichman, S., Are we missing the importance of missing values in hiv prevention randomized clinical trials? review and recommendations. AIDS Behav. 16:6 (2012), 1382–1393.
14. Harel, O., Zhou, X.-H., Multiple imputation: review of theory, implementation and software. Stat. Med. 26:16 (2007), 3057–3077.
15. Heckman, J.J., The common structure of statistical models of truncation, sample selection and limited dependent variables and a simple estimator for such models. Ann. Econ. Soc. Meas. 5:4 (1976), 475–492.
16. Horvitz, D.G., Thompson, D.J., A generalization of sampling without replacement from a finite universe. J. Am. Stat. Assoc. 47:260 (1952), 663–685.
17. Karahalios, A., Baglietto, L., Carlin, J.B., English, D.R., Simpson, J.A., A review of the reporting and handling of missing data in cohort studies with repeated assessment of exposure measures. BMC Med. Res. Meth., 12(1), 2012, 96.
18. Leek, J.T., Peng, R.D., Opinion: reproducible research can still be wrong: adopting a prevention approach. Proc. Natl. Acad. Sci. Unit. States Am. 112:6 (2015), 1645–1646.
19. Little, R.J., A test of missing completely at random for multivariate data with missing values. J. Am. Stat. Assoc. 83:404 (1988), 1198–1202.
20. Little, R.J., Pattern-mixture models for multivariate incomplete data. J. Am. Stat. Assoc. 88:421 (1993), 125–134.
21. Little, R.J., D'agostino, R., Cohen, M.L., Dickersin, K., Emerson, S.S., Farrar, J.T., Frangakis, C., Hogan, J.W., Molenberghs, G., Murphy, S.A., et al. The prevention and treatment of missing data in clinical trials. N. Engl. J. Med. 367:14 (2012), 1355–1360.
22. Little, R.J., Rubin, D.B., Statistical Analysis with Missing Data, vol. 333, 2014, John Wiley & Sons.
23. Mackinnon, A., The use and reporting of multiple imputation in medical research–a review. J. Intern. Med. 268:6 (2010), 586–593.
24. Manly, C.A., Wells, R.S., Reporting the use of multiple imputation for missing data in higher education research. Res. High. Educ. 56:4 (2015), 397–409.
25. Masconi, K.L., Matsha, T.E., Echouffo-Tcheugui, J.B., Erasmus, R.T., Kengne, A.P., Reporting and handling of missing data in predictive research for prevalent undiagnosed type 2 diabetes mellitus: a systematic review. EPMA J., 6(1), 2015, 7.
26. Molenberghs, G., Beunckens, C., Sotto, C., Kenward, M.G., Every missingness not at random model has a missingness at random counterpart with equal fit. J. Roy. Stat. Soc. B 70:2 (2008), 371–388.
27. Nguyen, C.D., Strazdins, L., Nicholson, J.M., Cooklin, A.R., Impact of missing data strategies in studies of parental employment and health: missing items, missing waves, and missing mothers. Soc. Sci. Med., 2018 in this issue.
28. Nicholson, J.S., Deboeck, P.R., Howard, W., Attrition in developmental psychology: a review of modern missing data reporting and practices. Int. J. Behav. Dev. 41:1 (2017), 143–153.
29. Novo, A., Schafer, J., Norm: Analysis of Multivariate Normal Datasets with Missing Values. R Package Version 1.0-9.5. 2013 https://CRAN.R-project.org/package=norm.
30. NRC, The Prevention and Treatment of Missing Data in Clinical Trials. 2011, National Academies Press.
31. Perkins, N.J., Cole, S.R., Harel, O., Tchetgen Tchetgen, E.J., Sun, B., Mitchell, E.M., Schisterman, E.F., Principled approaches to missing data in epidemiologic studies. Am. J. Epidemiol. 187:3 (2018), 568–575.
32. Peugh, J.L., Enders, C.K., Missing data in educational research: a review of reporting practices and suggestions for improvement. Rev. Educ. Res. 74:4 (2004), 525–556.
33. Powney, M., Williamson, P., Kirkham, J., Kolamunnage-Dona, R., A review of the handling of missing longitudinal outcome data in clinical trials. Trials, 15(1), 2014, 237.
34. Rezvan, P.H., Lee, K.J., Simpson, J.A., The rise of multiple imputation: a review of the reporting and implementation of the method in medical research. BMC Med. Res. Meth., 15(1), 2015, 30.
35. Robins, J.M., Rotnitzky, A., Semiparametric efficiency in multivariate regression models with missing data. J. Am. Stat. Assoc. 90:429 (1995), 122–129.
36. Robins, J.M., Rotnitzky, A., Zhao, L.P., Estimation of regression coefficients when some regressors are not always observed. J. Am. Stat. Assoc. 89:427 (1994), 846–866.
37. Rubin, D.B., Inference and missing data. Biometrika 63:3 (1976), 581–592.
38. Rubin, D.B., Multiple Imputation for Nonresponse in Surveys, vol. 81, 2004, John Wiley & Sons.
39. Rubin, D.B., Schenker, N., Multiple imputation in health-are databases: an overview and some applications. Stat. Med. 10:4 (1991), 585–598.
40. Saltelli, A., Chan, K., Scott, E.M., et al. Sensitivity Analysis, vol. 1, 2000, Wiley New York.
41. ® 9.3 User's Guide. 2011, SAS Institute Inc, Cary, NC.
42. Schafer, J.L., Multiple imputation: a primer. Stat. Meth. Med. Res. 8:1 (1999), 3–15.
43. Schafer, J.L., Graham, J.W., Missing data: our view of the state of the art. Psychol. Meth., 7(2), 2002, 147.
44. Shen, Z., Nested Multiple Imputations. PhD thesis, 2000, Harvard University.
45. Siddique, J., Harel, O., Crespi, C.M., Addressing missing data mechanism uncertainty using multiple-model multiple imputation: application to a longitudinal clinical trial. Ann. Appl. Stat., 6(4), 2012, 1814.
46. Siddique, J., Harel, O., Crespi, C.M., Hedeker, D., Binary variable multiple-model multiple imputation to address missing data mechanism uncertainty: application to a smoking cessation trial. Stat. Med. 33:17 (2014), 3013–3028.
47. StataCorp, Stata: Release 13. Statistical Software. 2013, StataCorp LP, College Station, TX.
48. Sterne, J.A., White, I.R., Carlin, J.B., Spratt, M., Royston, P., Kenward, M.G., Wood, A.M., Carpenter, J.R., Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ, 338, 2009, b2393.
49. Sullivan, T.R., Yelland, L.N., Lee, K.J., Ryan, P., Salter, A.B., Treatment of missing data in follow-up studies of randomised controlled trials: a systematic review of the literature. Clin. Trials 14:4 (2017), 387–395.
50. Sun, B., Perkins, N.J., Cole, S.R., Harel, O., Mitchell, E., Schisterman, E.F., Tchetgen Tchetgen, E.J., Inverse probability weighted estimation for monotone and nonmonotone missing data. Am. J. Epidemiol. 187:3 (2018), 585–591.
51. Wood, A.M., White, I.R., Thompson, S.G., Are missing outcome data adequately handled? a review of published randomized controlled trials in major medical journals. Clin. Trials 1:4 (2004), 368–376.
52. Yucel, R., Impact of the non-distinctness and non-ignorability on the inference by multiple imputation in multivariate multilevel data: a simulation assessment. J. Stat. Comput. Simulat. 87:9 (2017), 1813–1826.