Adjusted weight voting algorithm for random forests in handling missing values

Pattern Recognition

Volumn 69, Issue , 2017, Pages 52-60

  Xia, Jing ^a   Zhang, Shengyu ^a   Cai, Guolong ^b   Li, Li ^b   Pan, Qing ^c   Yan, Jing ^b   Ning, Gangmin ^a  

^a ZHEJIANG UNIVERSITY   (China)

^b ZHEJIANG HOSPITAL   (China)

^c ZHEJIANG UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Imputation approaches; Missing values; Random forests; Surrogate decisions; Weighted voting

Indexed keywords

CLASSIFICATION (OF INFORMATION);

IMPUTATION APPROACHES; MISSING VALUES; RANDOM FORESTS; SURROGATE DECISIONS; WEIGHTED VOTING;

DECISION TREES;

EID: 85019456114     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2017.04.005     Document Type: Article

References (39)

1. Larrañaga, P., Calvo, B., Santana, R., Bielza, C., Galdiano, J., Inza, I., Lozano, J.A., Armañanzas, R., Santafé, G., Pérez, A., Machine learning in bioinformatics. Briefings Bioinf. 7 (2006), 86–112.
2. Harper, P.R., A review and comparison of classification algorithms for medical decision making. Health Policy 71 (2005), 315–331.
3. Sebastiani, F., Machine learning in automated text categorization. ACM Comput. Surv. 34 (2002), 1–47.
4. Kong, S.G., Heo, J., Abidi, B.R., Paik, J., Abidi, M.A., Recent advances in visual and infrared face recognition—a review. Comput. Vision Image Understanding 97 (2005), 103–135.
5. Fu, X., Ren, Y., Yang, G., Pan, Q., Gong, S., Li, L., Yan, J., Ning, G., A computational model for heart failure stratification. Computing in Cardiology, 2011, IEEE, 2011, 385–388.
6. Fialho, A.S., Kaymak, U., Almeida, R.J., Cismondi, F., Vieira, S.M., Reti, S.R., Sousa, J.M., Finkelstein, S.N., Probabilistic fuzzy prediction of mortality in intensive care units. Fuzzy Systems (FUZZ-IEEE), 2012 IEEE International Conference on, IEEE, 2012, 1–8.
7. Cutler, D.R., Edwards, T.C. Jr, Beard, K.H., Cutler, A., Hess, K.T., Gibson, J., Lawler, J.J., Random forests for classification in ecology. Ecology 88 (2007), 2783–2792.
8. Díaz-Uriarte, R., De Andres, S.A., Gene selection and classification of microarray data using random forest. BMC Bioinf., 7, 2006, 1.
9. Verikas, A., Gelzinis, A., Bacauskiene, M., Mining data with random forests: A survey and results of new tests. Pattern Recognit. 44 (2011), 330–349.
10. Chen, X., Ishwaran, H., Random forests for genomic data analysis. Genomics 99 (2012), 323–329.
11. Rokach, L., Decision forest: twenty years of research. Inf. Fusion 27 (2016), 111–125.
12. Breiman, L., Random forests. Machine Learning, 2001, Kluwer Academic Publishers, 5–32.
13. Hapfelmeier, A., Hothorn, T., Ulm, K., Strobl, C., A new variable importance measure for random forests with missing data. Stat. Comput. 24 (2014), 21–34.
14. Breiman, L., Friedman, J.H., Olshen, R., Stone, C.J., Classification and Regression Trees, vol. 81, 1984, Wadsworth, Systat Statistics ® Spss Inc. United States of America, 17–23.
15. Biau, G., Analysis of a random forests model. J. Mach. Learn. Res. 13 (2012), 1063–1095.
16. Bernard, S., Heutte, L., Adam, S., Influence of hyperparameters on random forest accuracy. Multiple Classifier Systems, 2009, Springer, 171–180.
17. Robnik-Šikonja, M., Improving random forests. Machine Learning: ECML 2004, 2004, Springer, 359–370.
18. Kim, H., Kim, H., Moon, H., Ahn, H., A weight-adjusted voting algorithm for ensembles of classifiers. J. Korean Stat. Soc. 40 (2011), 437–449.
19. Li, H.B., Wang, W., Ding, H.W., Dong, J., Trees weighting random forest method for classifying high-dimensional noisy data, e-Business Engineering (ICEBE). 2010 IEEE 7th International Conference on, IEEE, 2010, 160–163.
20. Stekhoven, D.J., Bühlmann, P., MissForest—non-parametric missing value imputation for mixed-type data. Bioinformatics 28 (2012), 112–118.
21. Karahalios, A., Baglietto, L., Carlin, J.B., English, D.R., Simpson, J.A., A review of the reporting and handling of missing data in cohort studies with repeated assessment of exposure measures. BMC Med. Res. Methodol., 12, 2012, 96.
22. Baraldi, A.N., Enders, C.K., An introduction to modern missing data analyses. J. School Psychol. 48 (2010), 5–37.
23. García-Laencina, P.J., Sancho-Gómez, J.-L., Figueiras-Vidal, A.R., Pattern classification with missing data: a review. Neural Comput. Appl. 19 (2010), 263–282.
24. Lichman, M., UCI Machine Learning Repository. available online http://archive.ics.uci.edu/ml, 2013.
25. Hernández-Pereira, E.M., Álvarez-Estévez, D., Moret-Bonillo, V., Automatic classification of respiratory patterns involving missing data imputation techniques. Biosyst. Eng. 138 (2015), 65–76.
26. Abreu, P.H., Amaro, H., Silva, D.C., Machado, P., Abreu, M.H., Afonso, N., Dourado, A., Overall survival prediction for women breast cancer using ensemble methods and incomplete clinical data. XIII Mediterranean Conference on Medical and Biological Engineering and Computing 2013, 2014, Springer, 1366–1369.
27. Polikar, R., DePasquale, J., Mohammed, H.S., Brown, G., Kuncheva, L.I., Learn++. MF: a random subspace approach for the missing feature problem. Pattern Recognit. 43 (2010), 3817–3832.
28. Conroy, B., Eshelman, L., Potes, C., Xu-Wilson, M., A dynamic ensemble approach to robust classification in the presence of missing data. Mach. Learn., 2015, 1–21.
29. Nanni, L., Lumini, A., Brahnam, S., A classifier ensemble approach for the missing feature problem. Artif. Intell. Med. 55 (2012), 37–50.
30. Shah, A.D., Bartlett, J.W., Carpenter, J., Nicholas, O., Hemingway, H., Comparison of random forest and parametric imputation models for imputing missing data using MICE: a CALIBER study. Am. J. Epidemiol., 2014, 10.1093/aje/kwt312.
31. Ghannad-Rezaie, M., Soltanian-Zadeh, H., Ying, H., Dong, M., Selection–fusion approach for classification of datasets with missing values. Pattern Recognit. 43 (2010), 2340–2350.
32. Juszczak, P., Duin, R.P., Combining one-class classifiers to classify missing data. Multiple Classifier Systems, 2004, Springer, 92–101.
33. Valdiviezo, H.C., Van Aelst, S., Tree-based prediction on incomplete data using imputation or surrogate decisions. Inf. Sci. 311 (2015), 163–181.
34. Feelders, A., Handling missing data in trees: surrogate splits or statistical imputation. European Conference on Principles of Data Mining and Knowledge Discovery, 1999, Springer, 329–334.
35. Hapfelmeier, A., Hothorn, T., Ulm, K., Recursive partitioning on incomplete data using surrogate decisions and multiple imputation. Comput. Stat. Data Anal. 56 (2012), 1552–1565.
36. Twala, B., An empirical comparison of techniques for handling incomplete data using decision trees. Appl. Artif. Intell. 23 (2009), 373–405.
37. Rieger, A., Hothorn, T., Strobl, C., Random forests with missing values in the covariates. http://epub.ub.uni-muenchen.de/11481, 2010.
38. Breiman, L., Cutler, A., Random forests. available online http://www.stat.berkeley.edu/∼breiman/RandomForests/, 2008.
39. Oba, S., Sato, M.A., Takemasa, I., Monden, M., Matsubara, K., Ishii, S., A Bayesian missing value estimation method for gene expression profile data. Bioinformatics 19 (2003), 2088–2096.