Reacting to different types of concept drift: The accuracy updated ensemble algorithm

IEEE Transactions on Neural Networks and Learning Systems

Volumn 25, Issue 1, 2014, Pages 81-94

  Brzezinski, Dariusz ^a   Stefanowski, Jerzy ^a  

^a POZNAN UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Concept drift; data stream mining; ensemble classifier; nonstationary environments

Indexed keywords

CLASSIFICATION ACCURACY; CLASSIFICATION ALGORITHM; CONCEPT DRIFTS; DATA STREAM MINING; ENSEMBLE ALGORITHMS; ENSEMBLE APPROACHES; ENSEMBLE CLASSIFIERS; NON-STATIONARY ENVIRONMENT;

ALGORITHMS; DATA COMMUNICATION SYSTEMS; SENSOR NETWORKS;

DATA MINING;

EID: 84891166135     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2251352     Document Type: Article

References (40)

1. J. Gama, Knowledge Discovery from Data Streams, 1st ed. London, U.K.: Chapman &Hall, 2010
2. L. I. Kuncheva, "Classifier ensembles for detecting concept change in streaming data: Overview and perspectives," in Proc. 2nd Workshop SUEMA, 2008, pp. 5-10
3. W. N. Street and Y. Kim, "A streaming ensemble algorithm (SEA) for large-scale classification," in Proc. 7th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2001, pp. 377-382
4. Y. Cao, H. He, and H. Man, "SOMKE: Kernel density estimation over data streams by sequences of self-organizing maps," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 8, pp. 1254-1268, Aug. 2012
5. I. Zliobaite, "Adaptive training set formation," Ph.D. dissertation, Dept. Comput. Sci., Vilnius Univ., Vilnius, Lithuania, 2010
6. P. Domingos and G. Hulten, "Mining high-speed data streams," in Proc. 6th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2000, pp. 71-80
7. L. I. Kuncheva, "Classifier ensembles for changing environments," in Proc. 5th Int. Workshop Multiple Classifier Syst., 2004, pp. 1-15
8. L. I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms. New York, USA: Wiley, 2004
9. N. C. Oza, "Online ensemble learning," Ph.D. dissertation, Computer Science Division, Univ. California, Berkeley, CA, USA, Sep. 2001
10. H. Wang, W. Fan, P. S. Yu, and J. Han, "Mining concept-drifting data streams using ensemble classifiers," in Proc. 9th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2003, pp. 226-235
11. K. Nishida, K. Yamauchi, and T. Omori, "ACE: Adaptive classifiersensemble system for concept-drifting environments," in Proc. 6th Int. Workshop Multiple Classifier Syst., 2005, pp. 176-185 (Pubitemid 41422616)
12. D. Brzezinski and J. Stefanowski, "Accuracy updated ensemble for data streams with concept drift," in Proc. 6th HAIS Int. Conf. Hybrid Artif. Intell. Syst., II, 2011, pp. 155-163
13. A. Bifet, G. Holmes, R. Kirkby, and B. Pfahringer, "MOA: Massive online analysis," J. Mach. Learn. Res., vol. 11, no. 5, pp. 1601-1604, May 2010
14. M. M. Masud, J. Gao, L. Khan, J. Han, and B. Thuraisingham, "A practical approach to classify evolving data streams: Training with limited amount of labeled data," in Proc. 8th IEEE Int. Conf. Data Mining, Dec. 2008, pp. 929-934
15. M. Kmieciak and J. Stefanowski, "Handling sudden concept drift in Enron message data streams," Control Cybern., vol. 40, no. 3, pp. 667-695, Mar. 2011
16. L. L. Minku, A. P. White, and X. Yao, "The impact of diversity on online ensemble learning in the presence of concept drift," IEEE Trans. Knowl. Data Eng., vol. 22, no. 5, pp. 730-742, May 2010
17. A. Tsymbal, "The problem of concept drift: Definitions and related works," Dept. Comput. Sci., Trinity College Dublin, Dublin, Ireland, Tech. Rep. TCD-CS-2004-15, 2004
18. G. Widmer and M. Kubat, "Learning in the presence of concept drift and hidden contexts," Mach. Learn., vol. 23, no. 1, pp. 69-101, Apr. 1996 (Pubitemid 126737384)
19. A. Bifet and R. Gavalda, "Learning from time-changing data with adaptive windowing," in Proc. 7th SIAM Int. Conf. Data Mining, 2007, pp. 443-448
20. E. Cohen and M. J. Strauss, "Maintaining time-decaying stream aggregates," J. Algorithms, vol. 59, no. 1, pp. 19-36, Apr. 2006 (Pubitemid 44262106)
21. G. Hulten, L. Spencer, and P. Domingos, "Mining time-changing data streams," in Proc. 7th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2001, pp. 97-106
22. E. S. Page, "Continuous inspection schemes," Biometrika, vol. 41, nos. 1-2, pp. 100-115, Jun. 1954
23. J. Gama, P. Medas, G. Castillo, and P. Rodrigues, "Learning with drift detection," in Proc. 17th SBIA Brazilian Symp. Artif. Intell., 2004, pp. 286-295 (Pubitemid 39751638)
24. M. Baena-Garcia, J. D. Campo-Avila, R. Fidalgo, A. Bifet, R. Gavalda, and R. Morales-Bueno, "Early drift detection method," in Proc. 4th Int. Workshop Knowl. Discovery Data Streams, 2006, pp. 1-10
25. N. C. Oza and S. J. Russell, "Experimental comparisons of online and batch versions of bagging and boosting," in Proc. 7th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2001, pp. 359-364
26. A. Bifet, G. Holmes, and B. Pfahringer, "Leveraging bagging for evolving data streams," in Proc. Eur. Conf. Mach. Learn./PKDD, I, 2010, pp. 135-150
27. L. L. Minku and X. Yao, "DDD: A new ensemble approach for dealing with concept drift," IEEE Trans. Knowl. Data Eng., vol. 24, no. 4, pp. 619-633, Apr. 2012
28. J. Z. Kolter and M. A. Maloof, "Dynamic weighted majority: An ensemble method for drifting concepts," J. Mach. Learn. Res., vol. 8, pp. 2755-2790, Dec. 2007
29. A. Kehagias and V. Petridis, "Predictive modular neural networks for time series classification," Neural Netw., vol. 10, no. 1, pp. 31-49, Jan. 1997 (Pubitemid 27086444)
30. R. Kirkby, "Improving Hoeffding trees," Ph.D. dissertation, Dept. Comput. Sci., Univ. Waikato, Hamilton, New Zealand, 2007
31. R. Elwell and R. Polikar, "Incremental learning of concept drift in nonstationary environments," IEEE Trans. Neural Netw., vol. 22, no. 10, pp. 1517-1531, Oct. 2011
32. D. Brzezinski, "Mining data streams with concept drift," M.S. thesis, Inst. Comput. Sci., Poznan Univ. Technology, Poznan, Poland, 2010
33. A. Frank and A. Asuncion. (2010). UCI Machine Learning Repository [Online]. Available: http://archive.ics.uci.edu/ml
34. W. Fan, "Systematic data selection to mine concept-drifting data streams," in Proc. 10th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2004, pp. 128-137 (Pubitemid 40114923)
35. W. Fan, Y. A. Huang, H. Wang, and P. S. Yu, "Active mining of data streams," in Proc. 4th SIAM Int. Conf. Data Mining, Apr. 2004, pp. 457-461
36. I. Zliobaite, "Combining time and space similarity for small size learning under concept drift," in Proc. 18th ISMIS Int. Symp., 2009, pp. 412-421
37. L. Breiman, J. Friedman, C. J. Stone, and R. A. Olshen, Classification and Regression Trees (Wadsworth Statistics/Probability). Belmont, CA, USA: Wadsworth, 1984
38. M. Harries, "SPLICE-2 comparative evaluation: Electricity pricing," School of Computer Science and Engineering, Univ. New South Wales, New South Wales, Australia, Tech. Rep. 9905, 1999
39. A. Bifet, G. Holmes, B. Pfahringer, R. Kirkby, and R. Gavalda, "New ensemble methods for evolving data streams," in Proc. 15th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, Jul. 2009, pp. 139-148
40. J. Demsar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learn. Res., vol. 7, no. 1, pp. 1-30, Jan. 2006. (Pubitemid 43022939)