Learning concept drift in nonstationary environments using an ensemble of classifiers based approach

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2008, Pages 3455-3462

  Karnick, Matthew ^a   Ahiskali, Metin ^a   Muhlbaier, Michael D ^a   Polikar, Robi ^a  

^a Rowan University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS; NEURAL NETWORKS;

CHANGING ENVIRONMENTS; CLASSIFIER MODELS; CONCEPT DRIFTS; ENSEMBLE OF CLASSIFIERS; FUNCTION OF TIMES; MAJORITY VOTING; NONSTATIONARY ENVIRONMENTS; UNDERLYING PROBLEMS;

CLASSIFIERS;

EID: 56349087953     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2008.4634290     Document Type: Conference Paper

References (23)

1. S. Grossberg, "Nonlinear neural networks: Principles, mechanisms, and architectures," Neural Networks, vol. 1, no. 1, pp. 17-61, 1988.
2. D. P. Helmbold and P. M. Long, "Tracking drifting concepts by minimizing disagreements," Machine Learning, vol. 14, no. 1, pp. 27-45, 1994.
3. A. Kuh, T. Petsche, and R. L. Rivest, "Learning time-varying concepts," Advances in Neural Information Processing, San Mateo, CA: Morgan Kaufmann, 1991, pp. 183-189.
4. J. C. Schlimmer and R. H. Granger, "Incremental Learning from Noisy Data," Machine Learning, vol. 1, no. 3, pp. 317-354, Sept.1986.
5. G. Widmer and M. Kubat, "Learning in the presence of concept drift and hidden contexts," Machine Learning, vol. 23, no. 1, pp. 69-101, 1996.
6. R. Klinkenberg and T. Joachims, "Detecting concept drift with support vector machines," 17th International Conference on Machine Learning, 2000, pp. 487-494.
7. R. Klinkenberg, "Learning Drifting Concepts: Example Selection vs. Example Weighting," Intelligent Data Analysis, Incremental Learning Systems Capable of Dealing with Concept Drift, vol. 8, no. 3, pp. 281-300, 2004.
8. M. A. Maloof and R. S. Michalski, "Incremental learning with partial instance memory," Artificial Intelligence, vol. 154, no. 1-2, pp. 95-126, Apr.2004.
9. J. Gama, P. Medas, G. Castillo, and P. Rodrigues, "Learning with Drift Detection," Advances in Artificial Intelligence - SBIA 2004, Lecture Notes in Computer Science, vol. 3171, 2004, pp. 286-295.
10. th Int. Conference on Data Mining (ICDM '06.), 2006, pp. 1113-1118.
11. L. Cohen, G. Avrahami-Bakish, M. Last, A. Kandel, and O. Kipersztok, "Real-time data mining of non-stationary data streams from sensor networks," Information Fusion, (in press), 2007.
12. L. Rutkowski, "Adaptive probabilistic neural networks for pattern classification in time-varying environment," IEEE Transactions on Neural Networks, vol. 15, no. 4, pp. 811-827, 2004.
13. A. Tsymbal, "Technical Report: The problem of concept drift: definitions and related work," Trinity College, Dublin, Ireland,TCD-CS-2004-15,2004.
14. L. I. Kuncheva, "Classifier Ensembles for Changing Environments," Multiple Classifier Systems (MCS 2004), Lecture Notes in Computer Science , vol. 3077, 2004, pp. 1-15.
15. A. Blum, "Empirical Support for Winnow and Weighted-Majority Algorithms: Results on a Calendar Scheduling Domain," Machine Learning, vol. 26, no. 1, pp. 5-23, Jan.1997.
16. N. Oza, "Online Ensemble Learning." Ph.D. Dissertation, University of California, Berkeley, 2001.
17. K. Nishida, K. Yamauchi, and O. Takashi, "ACE: Adaptive Classifiers-Ensemble System for Concept-Drifting Environments," Multiple Classifier Systems, Lecture Notes in Computer Science ,N. Oza, R. Polikar, J. Kittler, and F. Roli, Eds. vol. 3541, 2005, pp. 176-185.
18. J. Z. Kolter and M. A. Maloof, "Dynamic weighted majority: a new ensemble method for tracking concept drift," 3rd IEEE Int. Conf. on Data Mining (ICDM 2003), 2003, pp. 123-130.
19. W N. Street and Y. Kim, "A streaming ensemble algorithm (SEA) for large-scale classification," Seventh ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD-01), 2001, pp. 377-382.
20. D. Muhlbaier and R. Polikar, "An Ensemble Approach for Incremental Learning in Nonstationary Environments," 7th. Int. Workshop on Multiple Classifier Systems, Lecture Notes in Computer Science, vol. 4472, Berlin: Springer, 2007, pp. 490-500.
21. M. D. Muhlbaier and R. Polikar, "Multiple Classifiers Based Incremental Learning Algorithm for Learning in Nonstationary Environments," Int. Conf. on Machine Learning and Cybernetics, vol. 6, 2007, pp. 3618-3623.
22. Y. Freund and R. E. Schapire, "Decision-theoretic generalization of on-line learning and an application to boosting," Journal of Computer and System Sciences, vol. 55.no. 1, pp. 119-139, 1997.
23. R. Polikar, L. Udpa, S. S. Udpa, and V. Honavar, "Learn++: An incremental learning algorithm for supervised neural networks," IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews, vol. 31, no. 4, pp. 497-508, 2001.