Using additive expert ensembles to cope with concept drift

ICML 2005 - Proceedings of the 22nd International Conference on Machine Learning

Volumn , Issue , 2005, Pages 449-456

  Kolter, Jeremy Z ^a   Maloof, Marcus A ^a  

^a GEORGETOWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DATABASE SYSTEMS; EXPERT SYSTEMS; ONLINE SYSTEMS;

EXPERT ENSEMBLE ALGORITHM; ONLINE LEARNING; PREDICTION ALGORITHMS;

LEARNING SYSTEMS;

EID: 31844453033     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1102351.1102408     Document Type: Conference Paper

References (16)

1. Blum, A. (1997). Empirical support for Winnow and Weighted-Majority algorithms. Machine Learning, 26, 5-23.
2. Bousquet, O., & Warmuth, M. K. (2003). Tracking a small set of experts by mixing past posteriors. Journal of Machine Learning Research, 3, 363-396.
3. Cesa-Bianchi, N., Freund, Y., Haussler, D., Helmbold, D. P., Schapire, R. E., & Warmuth, M. K. (1997). How to use expert advice. Journal of the ACM, 44, 427-485.
4. Freund, Y., & Schapire, R. (1997). A decision-theoretic generalization of on-line learning and an application to boosting. J. Computer and Sys. Sciences, 55, 119-139.
5. Haussler, D., Kivinen, J., & Warmuth, M. (1998). Sequential predictions of individual sequences under general loss functions. IEEE Transactions on Information Theory, 44, 1906-1925.
6. Helmbold, D. P., & Long, P. M. (1994). Tracking drifting concepts by minimising disagreements. Machine Learning, 14, 27-45.
7. Herbster, M., & Warmuth, M. K. (1998). Tracking the best expert. Machine Learning, 32, 151-178.
8. Kolter, J. Z., & Maloof, M. A. (2003). Dynamic weighted majority. Proceedings of the 3rd IEEE ICDM Conference (pp. 123-130). IEEE Press.
9. Littlestone, N. (1988). Learning quickly when irrelevant attributes abound: A new linear-threshold algorithm. Machine Learning, 2, 285-318.
10. Littlestone, N., & Warmuth, M. K. (1994). The weighted majority algorithm. Information and Computation, 108, 212-261.
11. Monteleoni, C., & Jaakkola, T. S. (2004). Online learning of non-stationary sequences. Proceedings of the 16th NIPS Conference. MIT Press.
12. Schlimmer, J., & Granger, R. (1986). Beyond incremental processing: Tracking concept drift. Proceedings of the 5th AAAI Conference (pp. 502-507). AAAI Press.
13. Street, W., & Kim, Y. (2001). A streaming ensemble algorithm (SEA) for large-scale classification. Proceedings of the 7th SIGKDD Conference (pp. 377-382). ACM Press.
14. Vovk, V. (1990). Aggregating strategies. Proceedings of the 3rd COLT Workshop (pp. 371-386). Morgan Kaufmann.
15. Vovk, V. (1998). A game of prediction with expert advice. J. of Computer and System Sciences, 56, 153-173.
16. Widmer, G., & Kubat, M. (1996). Learning in the presence of concept drift and hidden contexts. Machine Learning, 23, 69-101.