KNN classifier with self adjusting memory for heterogeneous concept drift

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn 0, Issue , 2016, Pages 291-300

  Losing, Viktor ^a,b   Hammer, Barbara ^a   Wersing, Heiko ^b  

^a HONDA RESEARCH INSTITUTE EUROPE GMBH   (Germany)

^b BIELEFELD UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BIG DATA; DATA MINING; LEARNING ALGORITHMS; NEAREST NEIGHBOR SEARCH;

CONCEPT DRIFTS; DATA DISTRIBUTION; DATA STREAM; ID DATUM; K NEAREST NEIGHBOR (K NN) ALGORITHM; MEMORY MODELING; NONSTATIONARY DATA; PRIORI KNOWLEDGE; SELF-ADJUSTING; STATIONARY DISTRIBUTION;

BENCHMARKING;

EID: 85014515695     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2016.141     Document Type: Conference Paper

References (38)

1. L. S, "The age of big data, " New York Times, 2012. [Online]. Available: http://www.nytimes.com/2012/02/12/sunday-review/big-datas-impact-in-The-world.html?r=2&scp=1&sq=Big%20Data&st=cse.
2. M. Chen, S. Mao, and Y. Liu, "Big data: A survey, " Mobile Netw. and Appl., vol. 19, no. 2, 2014. [Online]. Available: http://dx.doi.org/10.1007/s11036-013-0489-0.
3. L. Atzori, A. Iera, and G. Morabito, "The internet of things: A survey, " Computer networks, vol. 54, no. 15, pp. 2787-2805, 2010.
4. J. Gama, P. Medas, G. Castillo, and P. Rodrigues, "Learning with drift detection, " in Advances in artificial intelligence-SBIA 2004. Springer, 2004, pp. 286-295.
5. J. Z. Kolter and M. A. Maloof, "Dynamic weighted majority: An ensemble method for drifting concepts, " The Journal of Machine Learning Research, vol. 8, pp. 2755-2790, 2007.
6. R. Elwell and R. Polikar, "Incremental learning of concept drift in nonstationary environments, " IEEE Transactions on Neural Networks, vol. 22, no. 10, pp. 1517-1531, Oct 2011.
7. S. Schiaffino, P. Garcia, and A. Amandi, "eteacher: Providing personalized assistance to e-learning students, " Computers & Education, vol. 51, no. 4, pp. 1744-1754, 2008.
8. S. A. Dudani, "The distance-weighted k-nearest-neighbor rule, " Systems, Man and Cybernetics, IEEE Transactions on, no. 4, pp. 325-327, 1976.
9. J. Gama, I. Zliobait?e, A. Bifet, M. Pechenizkiy, and A. Bouchachia, "A survey on concept drift adaptation, " ACM Computing Surveys (CSUR), vol. 46, no. 4, p. 44, 2014.
10. G. Ditzler, M. Roveri, C. Alippi, and R. Polikar, "Learning in non stationary environments: A survey, " Computational Intelligence Magazine, IEEE, vol. 10, no. 4, pp. 12-25, 2015.
11. A. Bifet and R. Gavalda, "Learning from time-changing data with adaptive windowing." in SDM, vol. 7. SIAM, 2007, p. 2007.
12. T. Dasu, S. Krishnan, S. Venkatasubramanian, and K. Yi, "An information-Theoretic approach to detecting changes in multidimensional data streams, " in In Proc. Symp. on the Interface of Statistics, Computing Science, and Applications. Citeseer, 2006.
13. A. Bifet, B. Pfahringer, J. Read, and G. Holmes, "Efficient data stream classification via probabilistic adaptive windows, " in Proceedings of the 28th Annual ACM Symposium on Applied Computing, ser. SAC'13. New York, NY, USA: ACM, 2013, pp. 801-806. [Online]. Available: http://doi.acm.org/10.1145/2480362.2480516.
14. G. Widmer and M. Kubat, "Learning in the presence of concept drift and hidden contexts, " Machine learning, vol. 23, no. 1, pp. 69-101, 1996.
15. R. Klinkenberg and T. Joachims, "Detecting concept drift with support vector machines." in ICML, 2000, pp. 487-494.
16. P. Domingos and G. Hulten, "Mining high-speed data streams, " in Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 2000, pp. 71-80.
17. G. Jaber, A. Cornúejols, and P. Tarroux, "Online learning: Searching for the best forgetting strategy under concept drift, " in Neural Information Processing. Springer, 2013, pp. 400-408.
18. A. Bifet, G. Holmes, and B. Pfahringer, "Leveraging bagging for evolving data streams, " in Machine learning and knowledge discovery in databases. Springer, 2010, pp. 135-150.
19. N. C. Oza, "Online bagging and boosting, " in Systems, man and cybernetics, 2005 IEEE international conference on, vol. 3. IEEE, 2005, pp. 2340-2345.
20. Y. Freund, R. Schapire, and N. Abe, "A short introduction to boosting, " Journal-Japanese Society For Artificial Intelligence, vol. 14, no. 771- 780, p. 1612, 1999.
21. P. Zhang, B. J. Gao, X. Zhu, and L. Guo, "Enabling fast lazy learning for data streams, " in Data Mining (ICDM), 2011 IEEE 11th International Conference on. IEEE, 2011, pp. 932-941.
22. Y.-N. Law and C. Zaniolo, "An adaptive nearest neighbor classification algorithm for data streams, " in Knowledge Discovery in Databases: PKDD 2005. Springer, 2005, pp. 108-120.
23. E. S. Xioufis, M. Spiliopoulou, G. Tsoumakas, and I. Vlahavas, "Dealing with concept drift and class imbalance in multi-label stream classification, " in Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence - Volume Volume 2, ser. IJCAI'11. AAAI Press, 2011, pp. 1583-1588. [Online]. Available: http://dx.doi.org/10.5591/978-1-57735-516-8/IJCAI11-266.
24. R. C. Atkinson and R. M. Shiffrin, "Human memory: A proposed system and its control processes, " The psychology of learning and motivation, vol. 2, pp. 89-195, 1968.
25. Y. Dudai, "The neurobiology of consolidations, or, how stable is the engram?" Annu. Rev. Psychol., vol. 55, pp. 51-86, 2004.
26. G. A. Miller, "The magical number seven, plus or minus two: Some limits on our capacity for processing information." Psychological review, vol. 63, no. 2, p. 81, 1956.
27. D. Arthur and S. Vassilvitskii, "k-means++: The advantages of careful seeding, " in Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms. Society for Industrial and Applied Mathematics, 2007, pp. 1027-1035.
28. H. Zhang, "The optimality of naive bayes, " AA, vol. 1, no. 2, p. 3, 2004.
29. G. Cauwenberghs and T. Poggio, "Incremental and decremental support vector machine learning, " in Proc. NIPS, 2001.
30. A. Bifet, G. Holmes, R. Kirkby, and B. Pfahringer, "Moa: Massive online analysis, " The Journal of Machine Learning Research, vol. 11, pp. 1601-1604, 2010.
31. W. N. Street and Y. Kim, "A streaming ensemble algorithm (sea) for large-scale classification, " in Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ser. KDD'01. New York, NY, USA: ACM, 2001, pp. 377-382. [Online]. Available: http://doi.acm.org/10.1145/502512.502568.
32. M. Harries and N. S. Wales, "Splice-2 comparative evaluation: Electricity pricing, " 1999.
33. M. Baena-Garcia, J. del Campo-Av ila, R. Fidalgo, A. Bifet, R. Gavalda, and R. Morales-Bueno, "Early drift detection method, " in Fourth international workshop on knowledge discovery from data streams, vol. 6, 2006, pp. 77-86.
34. L. I. Kuncheva and C. O. Plumpton, "Adaptive learning rate for online linear discriminant classifiers, " in Structural, Syntactic, and Statistical Pattern Recognition. Springer, 2008, pp. 510-519.
35. I. Zliobaite, "How good is the electricity benchmark for evaluating concept drift adaptation, " arXiv preprint arXiv:1301.3524, 2013.
36. J. Gama, R. Rocha, and P. Medas, "Accurate decision trees for mining high-speed data streams, " in Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 2003, pp. 523-528.
37. N. C. Oza and S. Russell, "Experimental comparisons of online and batch versions of bagging and boosting, " in Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 2001, pp. 359-364.
38. L. Breiman, J. Friedman, R. Olshen, and C. Stone, Classification and Regression Trees. Monterey, CA: Wadsworth and Brooks, 1984.