Model averaging via penalized regression for tracking concept drift

Journal of Computational and Graphical Statistics

Volumn 19, Issue 2, 2010, Pages 457-473

  Yeon, Kyupil ^a   Song, Moon Sup ^a   Kim, Yongdai ^a   Choi, Hosik ^b   Park, Cheolwoo ^c  

^a Seoul National University   (South Korea)

^b Hoseo University   (South Korea)

^c UNIVERSITY OF GEORGIA   (United States)

Author keywords

Data stream; Drifting concept; Ensemble method; Model combiner

Indexed keywords

EID: 77956700814     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/jcgs.2010.08104     Document Type: Article

References (23)

1. Breiman, L. (1996), "Bagging Predictors," Machine Learning, 24 (2), 123-140. [459]
2. Chu, F., Wang, Y, and Zaniolo, C. (2004), "Mining Noisy Data Streams via a Discriminative Model," in Proceedings of the 7th International Conference, DS 2004, Padova, Italy, Berlin/Heidelberg: Springer, pp. 47-59. [460]
3. Freund, Y., and Schapire, R. E. (1997), "A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting," Journal of Computer and System Science, 55 (1), 119-139. [459]
4. Gama, J., Medas, P., Castillo, G., and Rodrigues, P. (2004), "Learning With Drift Detection," in Proceedings of the 17th Brazilian Symposium on Artificial Intelligence, Sao Luis, Maranhao, Brazil, 2004, Berlin/Heidelberg: Springer, pp. 286-295. [470]
5. Hall, P., Müller, H.-G., and Wu, P.-S. (2006), "Real-Time Density and Mode Estimation With Application to Time-Dynamic Mode Tracking," Journal of Computational and Graphical Statistics, 15 (1), 82-100. [458]
6. Harries, M. (1999), "Splice-2 Comparative Evaluation: Electricity Pricing," technical report, School of Computer Science and Engineering, The University of South Wales. [470]
7. Hulten, G., Spencer, L., and Domingos, P. (2001), "Mining Time-Changing Data Streams," in Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA: ACM Press, pp. 97-106. [467]
8. -Jacobs, R. A. (1995), "Methods for Combining Experts' Probability Assessments," Neural Computation, 7, 867-888. [462]
9. Joachims, T. (2000), "Estimating the Generalization Performance of a SVM Efficiently," in Proceedings of ICML-00, 17th International Conference on Machine Learning, ed. P. Langley, San Francisko and Stanford: Kaufmann Publishers, pp. 431-438. Available at citeseer.ist.psu.edu/article/ joachims99estimating.html. [459]
10. -Kim, J., Kim, Y., and Kim, Y. (2008), "A Gradient-Based Optimization Algorithm for Lasso," Journal of Computational and Graphical Statistics, 17,994-1009. [463,464]
11. Klinkenberg, R. (2004), "Learning Drifting Concepts: Example Selection vs. Example Weighting," Intelligent Data Analysis, 8 (3), 281-300. [459]
12. Klinkenberg, R., and Joachims, T. (2000), "Detecting Concept Drift With Support Vector Machines," in Proceedings of the 17th International Conference on Machine Learning, San Francisco, CA, USA, 2000, San Francisco: Morgan Kaufmann, pp. 487-494. [459]
13. Kolter, J. Z., and Maloof, M. A. (2005), "Using Additive Expert Ensembles to Cope With Concept Drift," in Proceedings of the Twenty-Second International Conference on Machine Learning, New York: ACM Press, pp. 449-456. [461]
14. Koychev, I. (2004), "Experiments With Two Approaches for Tracking Drifting Concepts," Serdica Journal of Computing, 1, 27-44. [470]
15. q Penalty," Computational Statistics and Data Analysis, 51, 6380-6394. [472]
16. Schlimmer, J. C, and Granger, R. H. (1986), "Incremental Learning From Noisy Data," Machine Learning, 1 (3), 317-354. [470]
17. Street, W N., and Kim, Y. S. (2001), "A Streaming Ensemble Algorithm (SEA) for Large-Scale Classification," in Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 2001, New York: ACM Press, pp. 377-382. [459,469]
18. Tsymbal, A., Pechenizkiy, M., Cunningham, P., and Puuronen, S. (2008), "Dynamic Integration of Classifiers for Handling Concept Drift," Information Fusion, 9 (1), 56-68. [467]
19. Wang, H., Fan, W., Yu, P. S., and Han, J. (2003), "Mining Concept Drifting Data Streams Using Ensemble Classifiers," in Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, D.C., 2003, New York: ACM Press, pp. 226-235. [460,467]
20. Wegman, E. J., and Marchette, D. J. (2003), "On Some Techniques for Streaming Data: A Case Study of Internet Packet Headers," Journal of Computational and Graphical Statistics, 12 (4), 893-914. [458]
21. Widmer, G., and Kubat, M. (1996), "Learning in the Presence of Concept Drift and Hidden Contexts," Machine Learning, 23 (2), 69-101. [459]
22. Wolpert, D. H. (1992), "Stacked Generalization," Neural Networks, 5 (2), 241-259. [459,460]
23. Yang, Y, Wu, X., and Zhu, X. (2005), "Proactive-Reactive Prediction for Data Streams," Technical Report CS-05-03, Computer Science, University of Vermont. [467]