Boosting classifiers for drifting concepts

Intelligent Data Analysis

Volumn 11, Issue 1, 2007, Pages 3-28

  Scholz, Martin ^a   Klinkenberg, Ralf ^a  

^a TU DORTMUND UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 41849096368     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/ida-2007-11102     Document Type: Article

References (56)

1. J.S. Aguilar-Ruiz and P.R. Cohen, ACM Symposium on Applied Computing (SAC-2004), Special Track on Data Streams, in: Proceedings of the 2004 ACM Symposium on Applied Computing (SAC), Nicosia, Cyprus, March 14-17, 2004, H. Haddad, A. Omicini, R.L. Wainwright and L.M. Liebrock, eds, 2004. http://www.informatik.unitrier.de/~ley/db/conf/sac/sac2004.html.
2. J.S. Aguilar-Ruiz and F.J. Ferrer-Troyano, ACM Symposium on Applied Computing (SAC-2006), Special Track on Data Streams, In Proceedings of the 2006 ACM Symposium on Applied Computing (SAC), 2006.
3. J.S. Aguilar-Ruiz and J. Gama, eds, Second International Workshop on Knowledge Discovery from Data Streams, Porto, Portugal, October 7th 2005. In conjunction with ECML/PKDD-2005, 16th European Conference on Machine Learning (ECML) and 9th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD). http://www.niaad.liacc.up.pt/~jgama/IWKDDS/.
4. J. Allan, Incremental relevance feedback for information filtering, in: Proc. 19th Annual ACM SIGIR Conf. on Research and Development in Information Retrieval (SIGIR '96), Zürich, Swiss, August 18-22, 1996, H.P. Frei, ed., New York, NY, USA, 1996, pp. 270-278, ACM Press.
5. M. Balabanovic, An adaptive web page recommendation service, in: Proc. First Int'l Conf. on Autonomous Agents, W.L. Johnson, ed., New York, NY, USA, 1997, pp. 378-385, ACM Press.
6. C.L. Blake and C.J. Merz, UCI Repository of machine learning databases. Dept. of Information and Computer Sciences, University of California - Irvine (UCI), Irvine, CA, USA, 1998. http://www.ics.uci.edu/ ~mlearn/MLRepository.html.
7. L. Breiman, Bagging predictors, Machine Learning 13(2) (1996), 30-37.
8. L. Breiman, Random forests, Machine Learning 45(1) (2001), 5-32.
9. W.W. Cohen, Learning rules that classify e-mail, in: Proceedings of the 1996 AAAI Spring Symposium on Machine Learning in Information Access (MLIA '96), Stanford, CA, USA, 1996. AAAI Press.
10. P. Domingos and G. Hulten, Mining High Speed Data Streams, in: Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '00), 2000, 71-80.
11. W. Fan, Systematic Data Selection to Mine Concept-Drifting Data Streams, in: Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '04), Seattle, WA, USA, 2004, pp. 128-137, ACM Press.
12. S. Fischer, R. Klinkenberg, I. Mierswa and O. Ritthoff, YALE: Yet Another Learning Environment - Tutorial. Technical Report C1-136/02, Collaborative Research Center 531, University of Dortmund, Dortmund, Germany, June 2002. ISSN 1433-3325. http://yale.sf.net/.
13. Y. Freund and R.R. Schapire, A decision - theoretic generalization of on-line learning and an application to boosting, Journal of Computer and System Sciences 55(1) (1997), 119-139, 1997.
14. J. Fürnkranz and P. Flach, ROC 'n' Rule Learning - Towards a Better Understanding of Covering Algorithms, Machine Learning 58(1) (2005), 39-77.
15. J. Gama and J.S. Aguilar-Ruiz, eds, First International Workshop on Knowledge Discovery in Data Streams, Pisa, Italy, September 24th 2004. In conjunction with ECML/PKDD-2004, 15th European Conference on Machine Learning (ECML) and 8th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD). http://www.lsi.us.es/~aguilar/ecml2004/.
16. U. Heilemann and H.J. Münch, Classification of West German business cycles. Technical Report 11, Collaborative Research Center on Reduction of Complexity for Multivariate Data (SFB 475), University of Dortmund, Dortmund, Germany, 1999.
17. D.P. Helmbold and P.M. Long, Tracking drifting concepts using random examples, in: Proceedings of the Fourth Annual Workshop on Computational Learning Theory (COLT '91), L.G. Valiant and M.K. Warmuth, eds, San Mateo, CA, USA, 1991, pp. 13-23, Morgan Kaufmann.
18. D.P. Helmbold and P.M. Long, Tracking drifting concepts by minimizing disagreements, Machine Learning 14 (1994), 27-45.
19. G. Hulten, L. Spencer and P. Domingos, Mining Time-Changing Data Streams, in: Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '01), 2001, pp. 97-106.
20. T. Joachims, Estimating the generalization performance of a SVM efficiently, in: Proceedings of the International Conference on Machine Learning, P. Langley, ed., San Francisco, CA, USA, 2000, pp. 431-438, Morgan Kaufman. http://www.joachims.org/, http://www.cs.cornell.edu/People/tj/.
21. T. Joachims, D. Freitag and T. Mitchell, WebWatcher: A tour guide for the world wide web, in: Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), (Vol. 1), Morgan Kaufmann, 1997, pp. 770-777, http://www.joachims.org/.
22. G.H. John and P. Langley, Static Versus Dynamic Sampling for Data Mining, in: Proceedings of the Second International Conference on Knowledge Discovery in Databases and Data Mining, 1996.
23. R. Klinkenberg, Maschinelle Lernverfahren zum adaptiven Informationsfiltern bei sich verändernden Konzepten. Master's thesis, Computer Science Department, University of Dortmund, Dortmund, Germany, February 1998. http://www.ralf-klinkenberg.de/doc/klinkenberg_98a.ps.gz, http://www.ralf-klinkenberg.de/doc/klinkenberg_98a.pdf.gz.
24. R. Klinkenberg, Predicting phases in business cycles under concept drift, in: LLWA 2003 - Tagungsband der GI-Workshop-Woche Lehren - Lernen - Wissen - Adaptivität, Proceedings of the Workshop Week Teaching - Learning - Knowledge - Adaptivity of the National German Computer Science Society (GI)/Annual Workshop on Machine Learning, A. Hotho and G. Stumme, eds, Karlsruhe, Germany, October 2003, pp. 3-10, http://km.aifb.uni-karlsruhe.de/ws/ LLWA/fgml/final/klinkenberg.pdf, http://www.ralf-klinkenberg.de/doc/ klinkenberg_2003a.ps.gz.
25. R. Klinkenberg, Learning drifting concepts: Example selection vs. example weighting, Intelligent Data Analysis (IDA), Special Issue on Incremental Learning Systems Capable of Dealing with Concept Drift 8(3) (May 2004), 281-300.
26. R. Klinkenberg and T. Joachims, Detecting concept drift with support vector machines, in: Proceedings of the Seventeenth International Conference on Machine Learning (ICML), P. Langley, ed., San Francisco, CA, USA, 2000, pp. 487-494, Morgan Kaufmann. http://www.ralf-klinkenberg.de/doc/ klinkenberg_joachims_2000a.ps.gz.
27. R. Klinkenberg and I. Renz, Adaptive information filtering: Learning in the presence of concept drifts, in: Workshop Notes of the ICML/AAAI-98 Workshop Learning for Text Categorization, M. Sahami, M. Craven, T. Joachims and A. McCallum, eds, Menlo Park, CA, USA, 1998, pp. 33-40, AAAI Press, http://www.ralf-klinkenberg.de/doc/klinkenberg_renz_98a.ps.gz, http://www.ralf-klinkenberg.de/doc/klinkenberg_renz_98a.pdf.gz.
28. R. Klinkenberg and S. Rüping, Concept drift and the importance of examples, in: Text Mining - Theoretical Aspects and Applications, J. Franke, G. Nakhaeizadeh and I. Renz, eds, Physica-Verlag, Berlin, Germany, 2003, pp. 55-77.
29. J.Z. Kolter and M.A. Maloof, Using Additive Expert Ensembles to Cope with Concept Drift, in: Proceedings of the 22nd International Conference on Machine Learning (ICML-2005), New York, NY, USA, 2005, pp. 449-456, ACM Press. http://www.cs.georgetown.edu/~maloof/.
30. M. Kubat, J. Gama and P.E. Utgoff, Intelligent Data Analysis (IDA) Journal, Special Issue on Incremental Learning Systems Capable of Dealing with Concept Drift, Vol. 8, No. 3. 2004.
31. A. Kuh, T. Petsche and R.L. Rivest, Learning time-varying concepts, in: Advances in Neural Information Processing Systems, (Vol. 3), San Mateo, CA, USA, 1991, pp. 183-189, Morgan Kaufmann.
32. G. Kunisch, Anpassung und Evaluierung statistischer Lernverfahren zur Behandlung dynamischer Aspekte in Data Mining, Master thesis, Fachbereich Informatik, Universität Ulm, Germany, June 1996.
33. K. Lang, NewsWeeder: Learning to filter netnews, in: Proceedings of the Twelfth International Conference on Machine Learning (ICML '95), San Francisco, CA, USA, 1995, pp. 331-339, Morgan Kaufmann.
34. C. Lanquillon, Dynamic neural classification. Master thesis, Fachbereich Informatik, Universität Braunschweig, Germany, October 1997.
35. H.K.H. Lee and M.A. Clyde, Lossless Online Bayesian Bagging, Journal of Machine Learning Research 5 (February 2004), 143-151.
36. T. Mitchell, R. Caruana, D. Freitag, J. McDermott and D. Zabowski, Experience with a learning personal assistant, Communications of the ACM(CACM) 37(7) (July 1994), 81-91.
37. K. Morik and S. Rüping, A multistrategy approach to the classification of phases in business cycles, in: Machine Learning: ECML 2002, Vol. 2430 of Lecture Notes in Artificial Intelligence, T. Elomaa, H. Mannila and H. Toivonen, eds Berlin, 2002, pp. 307-318, Springer.
38. G. Nakhaeizadeh, I. Bruha and C. Taylor, eds, Workshop Notes on Dynamically Changing Domains: Theory Revision and Context Dependence Issues, 9th European Conf. on Machine Learning (ECML '97), Prague, Czech Republic, April 1997.
39. N.C. Oza and S. Russell, Online Bagging and Boosting, in: Eighth International Workshop on Artificial Intelligence and Statistics, Key West, Florida, USA, 2001.
40. O. Ritthoff, R. Klinkenberg, S. Fischer, I. Mierswa and S. Felske, YALE: Yet Another Machine Learning Environment, in: LLWA 01 - Tagungsband der GI-Workshop-Woche Lernen - Lehren - Wissen - Adaptivität, R. Klinkenberg, S. Rüping, A. Fick, N. Henze, C. Herzog, R. Molitor and O. Schröder, eds, number 763 in Forschungsberichte des Fachbereichs Informatik, Universität Dortmund, Dortmund, Germany, October 2001, pp. 84-92, ISSN 0933-6192. http://yale.sf.net/.
41. S. Rüping, mySVM Manual, Universität Dortmund, Lehrstuhl Informatik VIII, 2000. http://www-ai.cs.unidortmund.de/SOFTWARE/MYSVM/.
42. S. Rüping, Incremental learning with support vector machines, in: Proceedings of the 2001 IEEE International Conference on Data Mining (ICDM '01), N. Cercone, T.Y. Lin and X. Wu, eds, IEEE, 2001, pp. 641-642.
43. G. Salton and C. Buckley, Term weighting approaches in automatic text retrieval, Information Processing and Management 24(5) (1988), 513-523.
44. M. Scholz, Comparing Knowledge-Based Sampling to Boosting. Technical Report 26, Collaborative Research Center on the Reduction of Complexity for Multivariate Data Structures (SFB 475), University of Dortmund, Dortmund, Germany, 2005.
45. M. Scholz, Knowledge-Based Sampling for Subgroup Discovery, in: Local Pattern Detection, Volume LNAI 3539 of Lecture Notes in Artificial Intelligence, K. Morik, J.-F. Boulicaut and A. Siebes, eds, Springer, 2005, pp. 171-189.
46. M. Scholz, Sampling-Based Sequential Subgroup Mining, in: Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '05), R.L. Grossman, R. Bayardo, K. Bennett and J. Vaidya, eds, Chicago, Illinois, USA, August 2005, pp. 265-274, ACM Press.
47. M. Scholz and R. Klinkenberg, An Ensemble Classifier for Drifting Concepts, in: Proceedings of the Second International Workshop on Knowledge Discovery in Data Streams, J. Gama and J.S. Aguilar-Ruiz, ed, Porto, Portugal, October 2005, pp. 53-64, In conjunction with ECML/PKDD '05, 16th European Conference on Machine Learning (ECML) and 9th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD). http://www.niaad.liacc.up.pt/~jgama/IWKDDS/.
48. K.O. Stanley, Learning Concept Drift with a Committee of Decision Trees. Technical Report AI-03-302, Department of Computer Sciences, University of Texas at Austin, Austin, TX, USA, 2003.
49. W.N. Street and Y. Kim, A Streaming Ensemble Algorithm (SEA) for Large-Scale Classification, in: Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '01), 2001, pp. 377-382.
50. C. Taylor, G. Nakhaeizadeh and C. Lanquillon, Structural change and classification, in: Workshop Notes on Dynamically Changing Domains: Theory Revision and Context Dependence Issues, 9th European Conf. on Machine Learning (ECML '97), Prague, Czech Republic, G. Nakhaeizadeh, I. Bruha and C. Taylor, eds, April 1997, pp. 67-78,.
51. W. Theis and C. Weihs, Clustering techniques for the detection of business cycles. Technical Report 40, Collaborative Research Center on the Reduction of Complexity for Multivariate Data Structures (SFB 475), University of Dortmund, Dortmund, Germany, 1999.
52. P.E. Utgoff, Incremental induction of decision trees, Machine Learning 4 (1989), 161-186.
53. G. Veltmann, Einsatz Eines Multiagentensystems Zur Erstellung Eines Persönlichen Pressespiegels, Master's thesis, Computer Science Department, University of Dortmund, Dortmund, Germany, May 1997.
54. H. Wang, W. Fan, P.S. Yu and J. Han, Mining Concept-Drifting Data Streams using Ensemble Classifiers, in: Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '03), L. Getoor, T.E. Senator, P. Domingos and C. Faloutsos, eds, Washington, DC, USA, 2003, pp. 226-235, ACM Press.
55. G. Widmer and M. Kubat, Learning in the presence of concept drift and hidden contexts, Machine Learning 23(2) (1996), 69-101.
56. I. Witten and E. Frank, Data Mining - Practical Machine Learning Tools and Techniques with Java Implementations, Morgan Kaufmann, 2000.