An improved random forest algorithm for class-imbalanced data classification and its application in PAD risk factors analysis

Open Electrical and Electronic Engineering Journal

Volumn 7, Issue SPEC ISS 1, 2013, Pages 62-70

  Yao, Dengju ^a,b   Yang, Jing ^a   Zhan, Xiaojuan ^c  

^a HARBIN ENGINEERING UNIVERSITY   (China)

^b HARBIN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^c HEILONGJIANG INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Class imbalanced problem; Classification; Disease risk factors; PAD; Random forest; Sampling with replacement

Indexed keywords

CLASS-IMBALANCED PROBLEM; DISEASE RISKS; PAD; RANDOM FORESTS; SAMPLING WITH REPLACEMENT;

CLASSIFICATION (OF INFORMATION); FORESTRY; LEARNING ALGORITHMS; LEARNING SYSTEMS;

DECISION TREES;

ALGORITHMS; CLASSIFICATION; FORESTRY; PROBLEM SOLVING; SAMPLING;

EID: 84879153481     PISSN: None     EISSN: 18741290     Source Type: Journal    
DOI: 10.2174/1874129001307010062     Document Type: Article

References (34)

1. J. Stolfo, W. Fan, W. Lee, A. Prodromidis, and K. Chan, "Costbased modeling for fraud and intrusion detection: results from the jam project", In: DARPA Information Survivability Conference and Exposition, 2000, pp. 130-144.
2. M. Kubat, R. Holte, and S. Matwin, "Machine learning for the detection of oil spills in satellite radar images", Mach. Learn., vol. 30, pp. 195-215, Feb1998.
3. T. Fawcett. "In vivo spam filtering: A challenge problem for data mining", ACM SIGKDD Explor., vol. 5, pp. 140-148, Dec 2003.
4. Y. Xu, J. T. Lee, and B. Wang, "A study of feature selection for text categorization on imbalanced data", J. Comput. Res. Dev., vol. 43, pp. 58-62, 2006.
5. C. L. Wang, C. Ding, and R. F. Meraz, "PSol: A positive sample only learning algorithm for finding non-coding RNA genes", Bioinformatics, vol. 22, pp. 2590-2596, Aug 2006.
6. O. Sangyoon, M. S. Lee, and B. T. Zhang, "Ensemble learning with active example selection for imbalanced biomedical data classification", IEEE ACM Trans. Comput. BI, vol. 8, pp. 316-325, Mar 2011.
7. L. Breiman, "Random forests", Mach. Learn., vol. 45, pp. 5-32, 2001.
8. C. Strobl, A. L. Boulesteix, T. Kneib, T. Augustin, and A. Zeileis, "Conditional variable importance for random forests", BMC Bioinforma., vol. 9, pp. 307, Jul 2008.
9. N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, "SMOTE: synthetic minority over-sampling technique", J. Artif. Intell. Res., vol. 16, pp. 321-357, 2002.
10. A. Tsymbal, M. Pechenizkiy, and P. Cunningham, "Sequential genetic search for ensemble feature selection", In: Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, 2005, pp. 877-882.
11. A. Zadrozny, J. Langford, and N. Abe, "Cost-sensitive learning by cost-proportionate example weighting", In: Proc of the 3rd Internal Conference on Data Mining, 2003, pp. 435-442.
12. M. D. Castillo, and J. I. Serrano, "A multi-strategy approach for digital text categorization from imbalanced documents", ACM S Igkdd Explor. Newslett., 2004, vol. 6, pp. 70-79.
13. J. X. Chen, T. H. Cheng and L. F. Chan, "An application of classification analysis for skewed class distribution in therapeutic drug monitoring-the case of vancomycin", In: Proceedings of the IDEAS Workshop on Medical Information Systems: The Digital Hospital, 2004, pp. 35-39.
14. K. Yoon and S. Kwek, "An unsupervised learning approach to resolving the data imbalanced issue in supervised learning problems in functional genomics", Neural Comput. Appl., vol. 16, pp. 295-306, 2007.
15. M. R. David, A. M. Alison, A. M. Brett, McKinney, E. James, J. Crowe and H. M. Jason, "Feature Selection using a Random Forests Classifier for the Integrated Analysis of Multiple Data Types", In: 2006 IEEE Symposium on Computational Intelligence and Bioinformatics and Computational Biology, 2006, pp. 1-8.
16. K. Mohammed, C. Sounak and P. Mihail, "Predicting disease risks from highly imbalanced data using random forest", BMC Med. Informa. Decis., pp. 11-20, Jul 2011.
17. J. R. Ding, A. Bashashati, A. Roth, K. Tse, T. Zeng, M. Hirst, M. A. Marra, A. Condon, S. Aparicio, and S. P. Shah, "Feature-based classifiers for somatic mutation detection in tumor normal paired sequencing data", Bioinformatics, vol. 28, no. 2, pp. 167-175, Jan, 2012
18. N. Briones, and V. Dinu, "Data mining of high density genomic variant data for prediction of Alzheimer's disease risk", BMC Med. Genet., pp. 1-12, Jan 2012.
19. C. Strobl, A. L. Boulesteix, T. Kneib, T. Augustin, and A. Zeileis, "Conditional variable importance for random forests", BMC Bioinforma., vol. 9, pp. 307-319, Jul 2008
20. A. Verikas, A. Gelzinis, and M. Bacauskiene, "Mining data with random forests: A survey and results of new tests", Pattern Recognit., vol. 44, no. 2, pp. 330-349, Feb 2011
21. J. B. Gray, and G. Fan, "Classification tree analysis using TARGET", Comput. Stat. Data Anal., vol. 52, pp. 1362-1372, Jan 2008.
22. L. T. Wang, X. Q. Dingm, and C. Fang, "Accurate localizaion of facial feature points based on random forest classifier", J. Tsinghua Uni., vol. 49, no. 4, pp. 543-546, Mar 2009.
23. C. Deng, and M. Z. Guo, "A new co-training-style random forest for computer aided diagnosis", J. Intell. Inf. Syst., vol 36, pp. 253-281, Nov 2011
24. L. Breiman, "Bagging predictors", Mach. Learn., vol. 24, no. 2, pp. 123-140, Aug 1996
25. Q. Zou, M. Z. Guo, Y. Liu, and J. Wang Jun, "A Classification Method for Class-Imbalanced Data and Its Application on Bioinformatics", J. Comput. Res. Dev., vol. 47, no. 8, pp. 1407-1414, Aug 2010.
26. X. Li, L.X. Wang, and S. Y. Jiang, "Ensemble learning based feature selection for imbalanced problems", J. Shandong Uni. (Eng. Sci)., vol. 41, no. 3, pp. 7-22, Mar 2011.
27. N. Meinshausen, "Quantile Regression Forests", J. Mach. Learn., Res., vol. 7, pp. 983-999, Dec 2006.
28. D. Delen, G. Walker, and A. Kadam, "Predicting breast cancer survivability: a comparison of three data mining methods", Artif. Intell. Med., vol. 34, pp. 113-127, Jul 2004.
29. J. H. Warner, Q. W. Liang, M. Sarkar, P. E. Mendes, and H. J. Roethig, "Adaptive regression modeling of biomarkers of potential harm in a population of U.S. adult cigarette smokers and nonsmokers", BMC Med. Res. Methodol., pp. 1-10, Mar 2010.
30. Available at: http://archive.ics.uci.edu/ml/.
31. X. Y. Liu, J. X. Wu, and Z. H. Zhou, "A cascade-based classification method for class-imbalanced data", J. Nanjing Uni. (Nat. Sci.), vol. 42, no. 2, pp. 148-155, Feb 2006.
32. W. R. Hiatt, "Medical treatment of peripheral arterial disease and claudication", N. Engl. J. Med., vol. 344, no. 21, pp.1608-1621, May 2001.
33. D. Mukherjee, "Peripheral and cerebrovascular atherosclerotic disease in diabetes mellitus", Best Pract. Res. Clin. Endocrinol. Metab., vol. 23, no. 3, pp. 335-345, Jun 2009.
34. W. G. Touw, J. R. Bayjanov, L. Overmars, L. Backus, J. Beokhorst, and S. A. Hijum, "Data mining in the Life Science with Random Forest: a walk in the park or lost in the jungle", Brief Bioinforma., pp. 1-12, Jun 2012.