Comparative study between incremental and ensemble learning on data streams: Case study

Journal of Big Data

Volumn 1, Issue 1, 2014, Pages

  Zang, Wenyu ^a,b   Zhang, Peng ^b   Zhou, Chuan ^b   Guo, Li ^b  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b University of Chinese Academy of Sciences   (China)

Author keywords

Big data streams; Concept drift; Ensemble learning; Incremental learning

Indexed keywords

BIG DATA;

BIG DATA STREAM; CASE-STUDIES; COMPARATIVES STUDIES; CONCEPT DRIFTS; DATA SIZE; DATA STREAM; ENSEMBLE LEARNING; INCREMENTAL LEARNING; REAL-WORLD; STREAM DATA;

LEARNING SYSTEMS;

EID: 84942770326     PISSN: None     EISSN: 21961115     Source Type: Journal    
DOI: 10.1186/2196-1115-1-5     Document Type: Article

References (30)

1. Widmer G, Kubat M: Learning in the presence of concept drift and hidden contexts. Mach Learn 1996,23(1):69–101.
2. Zhang P, Zhu X, Shi Y: Categorizing and mining concept drifting data streams. Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining 2008, 812–820.
3. Giraud-Carrier C: A note on the utility of incremental learning. AI Commun 2000,13(4):215–223.
4. Polikar R: Ensemble based systems in decision making. Circ Syst Mag 2006,6(3):21–45.
5. Tsymbal A: The problem of concept drift: definitions and related work. Computer Science Department, Trinity College Dublin; 2004.
6. Domingos P, Hulten G: Mining high-speed data streams. 2000, 71–80.
7. Hulten G, Spencer L, Domingos P: Mining time-changing data streams. 2001, 97–106.
8. Hua C, Xiao-gang Z, Jing Z, Li-hua D: A simplified learning algorithm of incremental Bayesian. 2009.
9. Deng L, Droppo J, Acero A: Incremental Bayes learning with prior evolution for tracking nonstationary noise statistics from noisy speech data. 2003.
10. Alcobé JR: Incremental augmented Naive Bayes classifiers. 2004, 16: 539.
11. Laskov P, Gehl C, Krüger S, Müller K-R: Incremental support vector learning: analysis, implementation and applications. J Mach Learn Res 2006, 7: 1909–1936.
12. Syed NA, Liu H, Huan S, Kah L, Sung K: Handling concept drifts in incremental learning with support vector machines. 1999, 317–321.
13. Fung G, Mangasarian OL: Incremental support vector machine classification. 2002, 247–260.
14. Zheng J, Yu H, Shen F, Zhao J: An online incremental learning support vector machine for large-scale data. Artificial neural networks–ICANN 2010, 76–81.
15. Ruping S: Incremental learning with support vector machines. 2001, 641–642.
16. Xiao R, Wang J, Zhang F: An approach to incremental SVM learning algorithm. 2000, 268–273.
17. Tseng C-Y, Chen M-S: Incremental SVM model for spam detection on dynamic email social networks. 2009, 4: 128–135.
18. Cauwenberghs G, Poggio T: Incremental and decremental support vector machine learning. Advances in neural information processing systems 2001, 409–415.
19. Street WN, Kim Y: A Streaming Ensemble Algorithm (SEA) for large-scale classification.
20. Kolter JZ, Maloof MA: Dynamic weighted majority: a new ensemble method for tracking concept drift. 2003, 123–130.
21. Yeon K, Song MS, Kim Y, Choi H, Park C: Model averaging via penalized regression for tracking concept drift. J Comput Graph Stat 2010.,19(2):
22. Wang H, Fan W, Yu PS, Han J: Mining concept-drifting data streams using ensemble classifiers. 2003, 226–235.
23. Zhang P, Zhu X, Shi Y: Categorizing and mining concept drifting data streams. 2008, 812–820.
24. Fan W, Chu F, Wang H, Yu PS: Pruning and dynamic scheduling of cost-sensitive ensembles. 2002, 146–151. Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press, 1999
25. Fan W: Systematic data selection to mine concept-drifting data streams.
26. Zhao Q-L, Jiang Y-H, Xu M: A fast ensemble pruning algorithm based on pattern mining process. Data Min Knowl Discov 2009,19(2):277–292. 10.1007/s10618-009-0138-1
27. Lu Z, Wu X, Zhu X, Bongard J: Ensemble pruning via individual contribution ordering.
28. Kuncheva LI: Classifier ensembles for changing environments. Multiple classifier systems 2004, 1–15.
29. Zhang P, Zhu X, Tan J, Guo L: Classifier and cluster ensembles for mining concept drifting data streams. 2010, 1175–1180.
30. Minku LL, White AP, Yao X: The impact of diversity on online ensemble learning in the presence of concept drift. IEEE Trans Knowl Data Eng 2010, 5: 730–742.