Resampling-based ensemble methods for online class imbalance learning

IEEE Transactions on Knowledge and Data Engineering

Volumn 27, Issue 5, 2015, Pages 1356-1368

  Wang, Shuo ^a   Minku, Leandro L ^a   Yao, Xin ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Bagging; Class imbalance; ensemble learning; online learning; resampling

Indexed keywords

COMPUTER CONTROL SYSTEMS; DATA COMMUNICATION SYSTEMS; FAULT DETECTION; INTRUSION DETECTION; REAL TIME CONTROL; REAL TIME SYSTEMS; SOCIAL NETWORKING (ONLINE);

BAGGING; CLASS IMBALANCE; ENSEMBLE LEARNING; ONLINE LEARNING; RESAMPLING;

E-LEARNING;

EID: 84926617955     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2014.2345380     Document Type: Article

References (34)

1. L. L. Minku, "Online ensemble learning in the presence of concept drift, " Ph.D. dissertation, School Comput. Sci., Univ. Birmingham, Birmingham, U.K., 2010.
2. H. He and E. A. Garcia, "Learning from imbalanced data, " IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1263-1284, Sep. 2009.
3. N. C. Oza and S. Russell, "Experimental comparisons of online and batch versions of bagging and boosting, " in Proc. 7th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2001, pp. 359-364.
4. J. Meseguer, V. Puig, and T. Escobet, "Fault diagnosis using a timed discrete-event approach based on interval observers: Application to sewer networks, " IEEE Trans. Syst., Man Cybern. A, Syst., Humans, vol. 40, no. 5, pp. 900-916, Sep. 2010.
5. G. M. Weiss, "Mining with rarity: A unifying framework, " ACM SIGKDD Explorations Newslett., vol. 6, no. 1, pp. 7-19, 2004.
6. S. Wang, L. L. Minku, and X. Yao, "A learning framework for online class imbalance learning, " in Proc. IEEE Symp. Comput. Intell. Ensemble Learn., 2013, pp. 36-45.
7. N. Japkowicz and S. Stephen, "The class imbalance problem: A systematic study, " Intell. Data Anal., vol. 6, no. 5, pp. 429-449, 2002.
8. N. C. Oza, "Online bagging and boosting, " in Proc. IEEE Int. Conf. Syst., Man Cybern., 2005, pp. 2340-2345.
9. J. V. Hulse, T. M. Khoshgoftaar, and A. Napolitano, "Experimental perspectives on learning from imbalanced data, " in Proc. 24th Int. Conf. Mach. Learn., 2007, pp. 935-942.
10. C. Elkan, "The foundations of cost-sensitive learning, " in Proc. 17th Int. Joint Conf. Artif. Intell., 2001, pp. 973-978.
11. L. Breiman, "Bagging predictors, " Mach. Learn., vol. 24, no. 2, pp. 123-140, 1996.
12. S. Chen, H. He, K. Li, and S. Desai, "MuSeRA: Multiple selectively recursive approach towards imbalanced stream data mining, " in Proc. Int. Joint Conf. Neural Netw., 2010, pp. 1-8.
13. S. Chen and H. He, "Towards incremental learning of nonstationary imbalanced data stream: A multiple selectively recursive approach, " Evolving Syst., vol. 2, no. 1, pp. 35-50, 2010.
14. G. Ditzler and R. Polikar, "Incremental learning of concept drift from streaming imbalanced data, " IEEE Trans. Knowl. Data Eng., vol. 25, no. 10, pp. 2283-2301, Oct. 2013.
15. H. M. Nguyen, E. W. Cooper, and K. Kamei, "Online learning from imbalanced data streams, " in Proc. Int. Conf. Soft Comput. Pattern Recognit., 2011, pp. 347-352.
16. L. L. Minku and X. Yao, "DDD: A new ensemble approach for dealing with concept drift, " IEEE Trans. Knowl. Data Eng., vol. 24, no. 4, pp. 619-633, Apr. 2012.
17. A. Ghazikhani, R. Monsefi, and H. S. Yazdi, "Recursive least square perceptron model for non-stationary and imbalanced data stream classification, " Evolving Syst., vol. 4, no. 2, pp. 119-131, 2013.
18. B. Mirza, Z. Lin, and K.-A. Toh, "Weighted online sequential extreme learning machine for class imbalance learning, " Neural Process. Lett., vol. 38, no. 3, pp. 465-486, 2013.
19. D. C. Montgomery, Design and Analysis of Experiments. Great Britain, U.K.: Wiley, 2004.
20. T. Jo and N. Japkowicz, "Class imbalances versus small disjuncts, " ACM SIGKDD Explorations Newslett., vol. 6, pp. 40-49, 2004.
21. R. C. Prati, G. E. Batista, and M. C. Monard, "Class imbalances versus class overlapping: An analysis of a learning system behavior, " Lecture Notes Comput. Sci., vol. 2972, pp. 312-321, 2004.
22. V. Garcia, J. Sanchez, and R. Mollineda, "An empirical study of the behavior of classifiers on imbalanced and overlapped data sets, " Progress Pattern Recognit., Image Anal. Appl., vol. 4756, pp. 397-406, 2007.
23. K. Napierala and J. Stefanowski, "Identification of different types of minority class examples in imbalanced data, " Hybrid Artif. Intell. Syst., vol. 7209, pp. 139-150, 2012.
24. "2009 PHM challenge competition data set, " The Prognostics and Health Management Society (PHM Society) [Online]. Available: http://www.phmsociety.org/references/datasets, 2009.
25. M. P. Michaelides, V. Reppa, C. Panayiotou, and M. Polycarpou, "Contaminant event monitoring in intelligent buildings using a multi-zone formulation, " in Proc. 8th IFAC Symp. Fault Detection, Supervision Safety Tech. Processes, 2012, vol. 8, pp. 492-497.
26. G. Hulten, L. Spencer, and P. Domingos, "Mining time-changing data streams, " in Proc. 7th ACM SIGKDD Int. Conf. Knowl. Discovery Data Min., 2001, pp. 97-106.
27. MOA Massive online analysis: Real time analytics for data streams [Online]. Available: http://moa.cms.waikato.ac.nz/, 2010.
28. S. Wang, L. L. Minku, D. Ghezzi, D. Caltabiano, P. Tino, and X. Yao, "Concept drift detection for online class imbalance learning, " in Proc. Int. Joint Conf. Neural Netw., 2013, pp. 1-8.
29. S. Wang, L. L. Minku, and X. Yao, "Online class imbalance learning and its applications in fault detection, " Int. J. Comput. Intell. Appl., vol. 12, pp. 1 340 001(1-19), 2013.
30. M. Kubat and S. Matwin, "Addressing the curse of imbalanced training sets: One-sided selection, " in Proc. 14th Int. Conf. Mach. Learn., 1997, pp. 179-186.
31. S. Ding, H. Zhao, Y. Zhang, X. Xu, and R. Nie, "Extreme learning machine: Algorithm, theory and applications, " Artif. Intell. Rev., Apr. 2014, DOI: 10.1007/s10462-013-9405-z.
32. C. A. Pierce, R. A. Block, and H. Aguinis, "Cautionary note on reporting eta-squared values from multifactor anova designs, " Educ. Psychol. Meas., vol. 64, pp. 916-924, 2004.
33. S. W. Greenhouse and S. Geisser, "On methods in the analysis of profile data, " Psychometrika, vol. 24, no. 2, pp. 95-112, 1959.
34. R. Polikar, "Ensemble based systems in decision making, " IEEE Circuits Syst. Mag., vol. 6, no. 3, pp. 21-45, Third Quarter 2006