Tree-based prediction on incomplete data using imputation or surrogate decisions

Information Sciences

Volumn 311, Issue , 2015, Pages 163-181

  Cevallos Valdiviezo, H ^a   Van Aelst, S ^a,b  

^a GHENT UNIVERSITY   (Belgium)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Conditional inference tree; Missing data; Multiple imputation; Prediction; Surrogate decision

Indexed keywords

CLASSIFICATION (OF INFORMATION); FORECASTING;

CONDITIONAL INFERENCE; EMPIRICAL - COMPARISONS; MEAN SQUARED PREDICTION ERRORS; MISCLASSIFICATION RATES; MISSING DATA; MULTIPLE IMPUTATION; PREDICTION PERFORMANCE; SURROGATE DECISION;

TREES (MATHEMATICS);

EID: 84927722807     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2015.03.018     Document Type: Article

References (48)

1. A. Asuncion, D.J. Newman, UCI Machine Learning Repository, 2007.
2. G.E. Batista, M.C. Monard, An analysis of four missing data treatment methods for supervised learning, in: Applied Artificial Intelligence, vol. 17, pp. 519-533.
3. L. Breiman Bagging predictors Mach. Learn. 24 1996 123 140
4. L. Breiman Arcing classifiers Ann. Statist. 26 1998 801 849
5. L. Breiman Random forests Mach. Learn. 45 2001 5 32
6. L. Breiman, J. Friedman, R. Olshen, and C. Stone Classification and Regression Trees 1984 Chapman and Hall, CRC
7. P. Bühlmann, and B. Yu Analyzing bagging Ann. Stat. 30 2002 927 961
8. L.F. Burgette, and J.P. Reiter Multiple imputation for missing data via sequential regression trees Am. J. Epidemiol. 172 2010 1070 1076
9. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm J. Roy. Stat. Soc. B 39 1977 1 38
10. T.G. Dietterich, and E.B. Kong Machine learning bias, statistical bias, and statistical variance of decision tree algorithms Mach. Learn. 255 1995 0 13
11. L.L. Doove, S. Van Buuren, and E. Dusseldorp Recursive partitioning for missing data imputation in the presence of interaction effects Comput. Stat. Data Anal. 72 2014 92 104
12. B. Efron Bootstrap methods: another look at the jackknife Ann. Stat. 7 1979 1 26
13. A.J. Feelders Handling missing data in trees: surrogate splits or statistical imputation PKDD'99: Proceedings of the Third European Conference on Principles of Data Mining and Knowledge Discovery Lecture Notes in Computer Science vol. 1704 1999 Springer-Verlag London, UK 329 334
14. S. Geman, E. Bienenstock, R. Doursat, Neural Networks and the Bias/Variance Dilemma, 1992.
15. A. Hapfelmeier, T. Hothorn, and K. Ulm Recursive partitioning on incomplete data using surrogate decisions and multiple imputation Comput. Stat. Data Anal. 56 2012 1552 1565
16. A. Hapfelmeier, and K. Ulm Variable selection by Random Forests using data with missing values Comput. Stat. Data Anal. 80 2014 129 139
17. T. Hastie, R. Tibshirani, and J. Friedman The Elements of Statistical Learning: Data Mining, Inference, and Prediction second ed. 2009 Springer New York
18. Y. He, Missing Data Imputation for Tree-Based Models, Ph.D. thesis, University of California, Los Angeles, 2006.
19. N.J. Horton, and K.P. Kleinman Much ado about nothing: a comparison of missing data methods and software to fit incomplete data regression models Am. Stat. 61 2007 79 90
20. T. Hothorn, K. Hornik, C. Strobl, A. Zeileis, Party: A Laboratory for Recursive part(y)itioning, R Package Version 0.9-99996, 2011.
21. T. Hothorn, K. Hornik, and A. Zeileis Unbiased recursive partitioning: a conditional inference framework J. Comput. Graph. Stat. 15 2006 651 674
22. A. Kapelner, J. Bleich, Prediction with Missing Data via Bayesian Additive Regression Trees, 2013, arXiv.org stat.ML.
23. M.A. Klebanoff, and S.R. Cole Use of multiple imputation in the epidemiologic literature Am. J. Epidemiol. 168 2008 355 357
24. S.G. Liao, Y. Lin, D.D. Kang, D. Chandra, J. Bon, N. Kaminski, F.C. Sciurba, and G.C. Tseng Missing value imputation in high-dimensional phenomic data: imputable or not, and how? BMC Bioinform. 15 2014 346
25. A. Liaw, and M. Wiener Classification and regression by randomForest R News 2 2002 18 22
26. R.J.A. Little, D.B. Rubin, Statistical Analysis with Missing Data, 2002.
27. G. Louppe, Understanding Random Forests from Theory to Practice, Ph.D. thesis, University of Liege, 2014.
28. R.J. Marshall, and P. Kitsantas Stability and structure of CART and SPAN search generated data partitions for the analysis of low birth weight J. Data Sci. 10 2012 61 73
29. A. Peters, T. Hothorn, and B. Lausen ipred: Improved predictors R News 2 2002 33 36
30. J.R. Quinlan, C4.5: Programs for Machine Learning, vol. 1, 1993.
31. R Development Core Team, R: A Language and Environment for Statistical Computing, Technical Report, Vienna, Austria, 2011.
32. A. Rieger, T. Hothorn, C. Strobl, Random Forests with Missing Values in the Covariates, Technical Report 79, Ludwig-Maximilians-Universität Munich, Germany, 2010.
33. D.B. Rubin The Bayesian bootstrap Ann. Stat. 9 1981 130 134
34. D.B. Rubin Multiple Imputation for Nonresponse in Surveys 1987 John Wiley & Sons New York
35. D.B. Rubin Multiple imputation after 18+ years J. Am. Stat. Assoc. 91 1996 473 489
36. M. Saar-Tsechansky, and F. Provost Handling missing values when applying classification models J. Mach. Learn. Res. 8 2007 1625 1657
37. J.L. Schafer Analysis of Incomplete Multivariate Data 1997 Chapman & Hall
38. A.D. Shah, J.W. Bartlett, J. Carpenter, O. Nicholas, and H. Hemingway Comparison of random forest and parametric imputation models for imputing missing data using MICE: a CALIBER study Am. J. Epidemiol. 179 2014 764 774
39. D.J. Stekhoven, and P. Bühlmann Missforest-Non-parametric missing value imputation for mixed-type data Bioinformatics 28 2012 112 118
40. M.A. Tanner, and W.H. Wong The calculation of posterior distributions by data augmentation J. Am. Stat. Assoc. 82 1987 528 540
41. T.M. Therneau, B. Atkinson, rpart: Recursive Partitioning, R Package Version 3.1-50; R Port by B. Ripley, 2011.
42. R. Tibshirani Bias, variance and prediction error for classification rules Monogr. Soc. Res. Child Dev. 79 1996 1 14
43. O. Troyanskaya, M. Cantor, G. Sherlock, P. Brown, T. Hastie, R. Tibshirani, D. Botstein, and R.B. Altman Missing value estimation methods for DNA microarrays Bioinformatics 17 2001 520 525
44. W. Vach Logistic Regression with Missing Values in the Covariates 1994 Springer New York
45. S. Van Buuren Flexible Imputation of Missing Data 2012 Chapman and Hall/CRC
46. S. Van Buuren, J.P. Brand, C.G. Groothuis-Oudshoorn, and D.B. Rubin Fully conditional specification in multivariate imputation J. Stat. Comput. Simul. 76 2006 1049 1064
47. S. Van Buuren, and K. Groothuis-Oudshoorn MICE: multivariate imputation by chained equations in R J. Stat. Software 45 2011 1 67
48. I.R. White, and J.B. Carlin Bias and efficiency of multiple imputation compared with complete-case analysis for missing covariate values Stat. Med. 29 2010 2920 2931