Concept drift detection via competence models

Artificial Intelligence

Volumn 209, Issue 1, 2014, Pages 11-28

  Lu, Ning ^a   Zhang, Guangquan ^a   Lu, Jie ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Case base maintenance; Classification; Competence model; Concept drift; Incremental supervised learning

Indexed keywords

EID: 84893974910     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2014.01.001     Document Type: Article

References (63)

1. J. Gao, W. Fan, and J. Han On appropriate assumptions to mine data streams: analysis and practice Proceedings of the Seventh IEEE International Conference on Data Mining Omaha, October 28-31 2007 143 152
2. P. Zhang, X. Zhu, and Y. Shi Categorizing and mining concept drifting data streams Proceedings of the Fourteenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining Las Vegas, Nevada, USA, August 24-27 2008 812 820
3. Z. Ouyang, M. Zhou, T. Wang, and Q. Wu Mining concept-drifting and noisy data streams using ensemble classifiers Proceedings of the International Conference on Artificial Intelligence and Computational Intelligence (AICI) China, November 7-8 2009 360 364
4. G. Widmer, and M. Kubat Learning in the presence of concept drift and hidden contexts Mach. Learn. 23 1996 69 101 (Pubitemid 126737384)
5. G. Hulten, L. Spencer, and P. Domingos Mining time-changing data streams Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining San Francisco, California, August 26-29 2001 97 106
6. L. Cohen, G. Avrahami, M. Last, and A. Kandel Info-fuzzy algorithms for mining dynamic data streams Appl. Soft Comput. 8 2008 1283 1294
7. C.-P. Wei, and I.T. Chiu Turning telecommunications call details to churn prediction: a data mining approach Expert Syst. Appl. 23 2002 103 112
8. G. Widmer, and M. Kubat Effective learning in dynamic environments by explicit context tracking Proceedings of the European Conference on Machine Learning (ECML-93) Vienna, Austria, April 5-7, 1993 Lecture Notes on Artificial Intelligence 1993 Springer 227 243
9. K.O. Stanley Learning concept drift with a committee of decision trees 2003 UT-AI-TR-03-302
10. G. Forman Tackling concept drift by temporal inductive transfer Proceedings of the Twenty-Ninth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval Seattle, Washington, USA, August 6-11 2006 252 259
11. A. Tsymbal, M. Pechenizkiy, P. Cunningham, and S. Puuronen Dynamic integration of classifiers for handling concept drift Inf. Fusion 9 2008 56 68 (Pubitemid 47589061)
12. M.A. Maloof, and R.S. Michalski Incremental learning with partial instance memory Artif. Intell. 154 2004 95 126
13. W.N. Street, and Y. Kim A streaming ensemble algorithm (SEA) for large-scale classification Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining San Francisco, California, August 26-29 2001 377 382
14. H. Wang, W. Fan, P.S. Yu, and J. Han Mining concept-drifting data streams using ensemble classifiers Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining Washington, D.C., August 24-27 2003 226 235
15. M. Last Online classification of nonstationary data streams Intell. Data Anal. 6 2002 129 147
16. W.-F. Hsiao, and T.-M. Chang An incremental cluster-based approach to spam filtering Expert Syst. Appl. 34 2008 1599 1608 (Pubitemid 350298190)
17. R. Klinkenberg Learning drifting concepts: Example selection vs. example weighting Intell. Data Anal. 8 2004 281 300
18. S.J. Delany, P. Cunningham, A. Tsymbal, and L. Coyle A case-based technique for tracking concept drift in spam filtering Knowl.-Based Syst. 18 2005 187 195 (Pubitemid 41013901)
19. S.J. Delany, and P. Cunningham An analysis of case-base editing in a spam filtering system Proceedings of the Seventh European Conference in Case-Based Reasoning Madrid, Spain, August/September 2004 128 141
20. D.W. Aha, D. Kibler, and M.K. Albert Instance-based learning algorithms Mach. Learn. 6 1991 37 66 (Pubitemid 21727227)
21. P. Cunningham, N. Nowlan, S.J. Delany, and M. Haahr A case-based approach to spam filtering that can track concept drift Proceedings of the ICCBRÊ=03 Workshop on Long-Lived CBR Systems Trondheim, Norway June 2003
22. A. Tsymbal The problem of concept drift: Definitions and related work April 2004 Department of Computer Science, Trinity College Dublin Ireland TCD-CS-2004-15
23. M. Salganicoff Tolerating concept and sampling shift in lazy learning using prediction error context switching Artif. Intell. Rev. 11 1997 133 155 (Pubitemid 127508236)
24. R. Elwell, and R. Polikar Incremental learning of concept drift in nonstationary environments IEEE Trans. Neural Netw. 22 2011 1517 1531
25. M.M. Richter Introduction M. Lenz, Case-Based Reasoning Technology: From Foundations to Applications 1998 Springer Heidelberg 1 15
26. B. Smyth, and M.T. Keane Remembering to forget: A competence-preserving case deletion policy for case-based reasoning systems Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence San Francisco, August 20-25 1995 Morgan Kaufmann 377 382
27. J. Zhu, and Q. Yang Remembering to add: Competence-preserving case-addition policies for case-base maintenance Proceedings of the Sixteenth International Joint Conference in Artificial Intelligence (IJCAI) Stockholm, Sweden, July 31-August 6 1999 234 241
28. B. Smyth, and E. McKenna Competence models and the maintenance problem Comput. Intell. 17 2001 235 249 (Pubitemid 32609472)
29. S. Massie, S. Craw, and N. Wiratunga Complexity profiling for informed case-base editing Proceedings of the Eighth European Conference (ECCBR) Fethiye, Turkey, September 4-7 2006 325 339 (Pubitemid 44743946)
30. S. Craw, S. Massie, and N. Wiratunga Informed case base maintenance: a complexity profiling approach Proceedings of the Twenty-Second National Conference on Artificial Intelligence, vol. 2 Vancouver, British Columbia, Canada, July 22-26 2007 1618 1621 (Pubitemid 350149798)
31. R. Pan, Q. Yang, and S.J. Pan Mining competent case bases for case-based reasoning Artif. Intell. 171 2007 1039 1068 (Pubitemid 47633399)
32. D.C. Wilson, and D.B. Leake Maintaining case-based reasoners: Dimensions and directions Comput. Intell. 17 2001 196 213 (Pubitemid 32609470)
33. N. Lu, G. Zhang, and J. Lu Detecting Change via Competence Model Proceedings of the Eighteenth International Conference on Case-Based Reasoning Research and Development Alessandria, Italy, July 19-22 2010 201 212
34. I. Žliobaitė Adaptive training set formation PhD thesis 2010 Vilnius University Vilnius
35. D. Kifer, S. Ben-David, and J. Gehrke Detecting change in data streams Toronto, Canada, August 31-September 3 Proceedings of the Thirtieth International Conference on Very Large Databases vol. 30 2004 180 191
36. T. Dasu, S. Krishnan, S. Venkatasubramanian, and K. Yi An information-theoretic approach to detecting changes in multi-dimensional data streams Proceedings of the Thirty-Eighth Symposium on the Interface of Statistics, Computing Science and Applications (Interface Ê=06) Pasadena, CA, May 24-27 2006 1 24
37. J.P. Patist Optimal window change detection Proceedings of the Seventh IEEE International Conference on Data Mining Workshops (ICDMW Ê=07) Omaha, NE, USA, Oct 28-31 2007 557 562
38. A. Bifet, and R. Gavaldà Learning from time-changing data with adaptive windowing Proceedings of the Seventh SIAM International Conference on Data Mining (SDMÊ=07) Minneapolis, MN, USA, Apr. 26-28 2007 443 448
39. J. Gama, P. Medas, G. Castillo, and P. Rodrigues Learning with drift detection Proceedings of the Seventeenth Brazilian Symposium on Artificial Intelligence Sao Luis, Maranhao, Brazil, September 29-October 1 2004 286 295 (Pubitemid 39751638)
40. M. Baena-García, J. Campo-Ávila, R. Fidalgo, A. Bifet, R. Gavaldà, and R. Morales-Bueno Early drift detection method ECML/PKDD 2006, Workshop on Knowledge Discovery from Data Streams Berlin, Germany, Sep. 18 2006 77 86
41. Y. Yasumura, N. Kitani, and K. Uehara Quick adaptation to changing concepts by sensitive detection Proceedings of the Twentieth International Conference on Industrial, Engineering, and Other Applications of Applied Intelligent Systems Kyoto, June 26-29 2007 855 864 (Pubitemid 350270791)
42. P. Li, X. Hu, Q. Liang, and Y. Gao Concept drifting detection on noisy streaming data in random ensemble decision trees Proceedings of the Sixth International Conference on Machine Learning and Data Mining in Pattern Recognition Leipzig, July 23-25 2009 236 250
43. B. Su, Y.D. Shen, and W. Xu Modeling concept drift from the perspective of classifiers IEEE Conference on Cybernetics and Intelligent Systems (CIS Ê=08) Chengdu, China, Sep. 21-24 2008 1055 1060
44. F. Wilcoxon Individual comparisons by ranking methods Biom. Bull. 1 1945 80 83
45. A. Kolmogoroff Confidence limits for an unknown distribution function Ann. Math. Stat. 12 1941 461 463
46. N.V. Smirnov Approximate laws of distribution of random variables from empirical data Usp. Mat. Nauk 10 1944 179 206
47. B. Efron, and R.J. Tibshirani An Introduction to the Bootstrap 1993 Chapman and Hall New York
48. K. Nishida, and K. Yamauchi Detecting concept drift using statistical testing Proceedings of the Tenth International Conference on Discovery Science (DS Ê=07) Sendai, Japan, Oct. 1-4 2007 264 269
49. Y. Freund, and R.E. Schapire A decision-theoretic generalization of on-line learning and an application to boosting J. Comput. Syst. Sci. 55 2007 119 139
50. G. Welch, and G. Bishop An introduction to the Kalman filter Technical Report TR-95-041 1995 University of North Carolina
51. C. Englund, and A. Verikas A hybrid approach to outlier detection in the offset lithographic printing process Eng. Appl. Artif. Intell. 18 2005 759 768 (Pubitemid 40773972)
52. F. Angiulli, R.B.-E. Zohary, and L. Palopoli Outlier detection using default reasoning Artif. Intell. 172 2008 1837 1872
53. A. Dries, and U. Rückert Adaptive concept drift detection Stat. Anal. Data Min. 2 2009 311 327
54. S. Massie, S. Craw, and N. Wiratunga What is CBR competence? BCS-SGAI Expert Update 8 2005 7 10
55. B. Smyth, and E. McKenna Modelling the competence of case-bases Proceedings of the Fourth European Workshop on Advances in Case-Based Reasoning Dublin, Ireland September 1998 208 220 (Pubitemid 128145899)
56. E. McKenna, and B. Smyth Competence-guided case discovery Proceedings of the Twenty-First SGES International Conference on Knowledge Based Systems and Applied Artificial Intelligence Cambridge UK, December 10-12 2001 97 108
57. H. Brighton, and C. Mellish Advances in instance selection for instance-based learning algorithms Data Min. Knowl. Discov. 6 2002 153 172 (Pubitemid 37113870)
58. E. Koehler, E. Brown, and S.J.-P.A. Haneuse On the assessment of Monte Carlo error in simulation-based statistical analyses Am. Stat. 63 2009 155 162
59. K.J. Berry, and P.W. Mielke Moment approximations as an alternative to the F test in analysis of variance Br. J. Math. Stat. Psychol. 36 1983 202 206
60. J.D. Opdyke Fast permutation tests that maximize power under conventional Monte Carlo sampling for pairwise and multiple comparisons J. Mod. Appl. Stat. Methods 2 2004 27 49 (Pubitemid 40665037)
61. K.V. Mardia Families of Bivariate Distributions 1970 Griffin London
62. B. Smyth, and E. McKenna An efficient and effective procedure for updating a competence model for case-based reasoners Proceedings of Eleventh European Conference on Machine Learning (ECML Ê=00) Barcelona, Catalonia, Spain, May 31-June 2 2000 357 368
63. K.R. Gee Using latent semantic indexing to filter spam Proceedings of Eighteenth Annual ACM Symposium on Applied Computing (SAC Ê=03) Melbourne, FL, USA, Mar. 9-12 2003 460 464