Drift mining in data: A framework for addressing drift in classification

Computational Statistics and Data Analysis

Volumn 57, Issue 1, 2013, Pages 377-391

  Hofer, Vera ^a   Krempl, Georg ^b  

^a UNIVERSITY OF GRAZ   (Austria)

^b OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

Concept drift; Drift mining; Verification latency

Indexed keywords

CERTAIN FACTOR; CLASS LABELS; CLASSIFICATION MODELS; CONCEPT DRIFTS; CONDITIONAL DISTRIBUTION; CREDIT SCORING; DATA SETS; EXPLANATORY VARIABLES; FAST ESTIMATION; JOINT DISTRIBUTIONS; LEAST SQUARE; MINING TECHNIQUES; MIXING PROPORTIONS; OPTIMAL DECISION BOUNDARY; TIME POINTS; TIME-PERIODS;

COMPUTATIONAL METHODS;

DATA HANDLING;

EID: 84865411615     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2012.07.007     Document Type: Article

References (34)

1. N.M. Adams, D.K. Tasoulis, C. Anagnostopoulos, and D.J. Hand Temporally-adaptive linear classification for handling population drift in credit scoring Y. Lechevallier, G. Saporta, Proceedings of the 19th International Conference on Computational Statistics COMPSTAT 2010 2010 Springer 167 176
2. R. Alaiz-Rodríguez, A. Guerrero-Curieses, and J. Cid-Sueiro Class and subclass probability re-estimation to adapt classifiers in the presence of concept drift Neurocomputing 74 16 2011 2614 2623
3. S. Ben-David, J. Blitzer, K. Crammer, and F. Pereira Analysis of representations for domain adaptation B. Schölkopf, J.C. Platt, T. Hoffman, Proceedings of the 20th Annual Conference on Neural Information Processing Systems NIPS 2006 Advances in Neural Information Processing Systems vol. 20 2007 MIT Press Vancouver, Canada 137 144
4. M. Böttcher, F. Höppner, and M. Spiliopoulou On exploiting the power of time in data mining Association for Computing Machinery, Special Interest Group on Knowledge Discovery in Data, Explorations Newsletter 10 2 2008 3 11
5. M. Böttcher, M. Spott, and R. Kruse An algorithm for anticipating future decision trees from concept-drifting data M. Bramer, F. Coenen, M. Petridis, Proceedings of AI-2008 Research and Development in Intelligent Systems vol. 25 2009 Springer London 293 306 No. 7
6. O. Chapelle, B. Schölkopf, and A. Zien Semi-Supervised Learning 2006 MIT Press
7. T.M. Cover, and J.A. Thomas Elements of Information Theory second ed. 2006 Wiley-Interscience
8. I. Currie, M. Durban, and P.H.C. Eilers Generalized linear array models with applications to multidimensional smoothing Journal of the Royal Statistical Society. Series B 68 2 2006 259 280
9. W. Dai, Q. Yang, G.-R. Xue, and Y. Yu Boosting for transfer learning Z. Ghahramani, Proceedings of the Twenty-Fourth International Conference ICML 2007 ACM International Conference Proceedings Series vol. 227 2007 193 200
10. S.J. Delany, P. Cunningham, A. Tsymbal, and L. Coyle A case-based technique for tracking concept drift in spam filtering Knowledge-Based Systems 18 2005 187 195
11. T. Fawcett, and P.A. Flach The response to Webb and Ting's on the application of ROC analysis to predict class performance under varying class distributions Machine Learning 58 1 2005 33 38
12. G. Forman Quantifying counts and costs via classification Data Mining and Knowledge Discovery 17 2 2008 164 206
13. D.J. Hand Measuring classifier performance: a coherent alternative to the area under the ROC curve Machine Learning 77 1 2009 103 123
14. Kauermann, G.; Schellhase, C.; 2012. Density estimation: a comparison with a penalized mixture approach. Computational Statistics, in press (http://dx.doi.org/10.1007/s00180-011-0289-6).
15. Kelly, M.G.; Hand, D.J.; Adams, N.M.; 1999. The impact of changing populations on classifier performance. In: Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 367-371.
16. G. Krempl The algorithm APT to classify in concurrence of latency and drift J. Gama, E. Bradley, J. Hollmén, Advances in Intelligent Data Analysis X Lecture Notes in Computer Science vol. 7014 2011 Springer Berlin, Heidelberg 222 233
17. G. Krempl, and V. Hofer Classification in the presence of drift and latency M. Spiliopoulou, H. Wang, D.J. Cook, J. Pei, W. Wang, O.R. Zaïane, X. Wu, 2011 IEEE 11th International Conference on Data Mining Workshops ICDMW 2011 IEEE Vancouver, BC, Canada 596 603
18. L.I. Kuncheva Classifier ensembles for detecting concept change in streaming data: overview and perspectives O. Okun, G. Valentini, Proceedings of the Second Workshop on Supervised and Unsupervised Ensemble Methods and their Applications SUEMA2008 Studies in Computational Intelligence vol. 245 2008 Springer 5 10
19. A. Lucas Updating scorecards: removing the mystique L.C. Thomas, D.B. Edelman, J.N. Crook, Readings in Credit Scoring 2004 Oxford University Press 93 110
20. G. Marrs, R. Hickey, and M. Black The impact of latency on online classification learning with concept drift Y. Bi, M.-A. Williams, Knowledge Science, Engineering and Management Lecture Notes in Computer Science vol. 6291 2010 Springer 459 469
21. O. Pons Functional Estimation for Densities, Regression Models and Processes 2011 World Scientific Publishing and Co.; Pvt. Ltd.
22. J. Quinnero-Candela, M. Sugiyama, A. Schwaighofer, and N.D. Lawrence Datset Shift in Machine Learning 2009 The MIT Press
23. M. Saerens, P. Latinne, and C. Decaestecker Adjusting the outputs of a classifier to new a priori probabilities: a simple procedure Neural Computing 14 2001 21 41
24. J.C. Schlimmer, and R.H. Granger Beyond incremental processing: tracking concept drift Association for the Advancement of Artificial Intelligence (AAAI) 1986 502 507
25. D.W. Scott Multivariate Density Estimation: Theory, Practice, and Visualization Wiley Series in Probability and Statistics 2008 John Wiley & Sons, Inc.
26. M.A. Stephens Asymptotic results for goodness-of-fit statistics with unknown parameters Annals of Statistics 4 2 1976 357 369
27. A. Storkey When training and test sets are different: characterising learning transfer Dataset Shift in Machine Learning 2009 MIT Press 1 28
28. F. Tortorella An optimal reject rule for binary classifiers F.J. Ferri, J.M. Inesta, A. Amin, P. Pudil, Advances in Pattern Recognition: Joint IAPR International Workshops, SSPR 2000 and SPR 2000 Lecture Notes in Computer Science vol. 1876 2000 Springer Heidelberg 611 620
29. Tsymbal, A.; 2004. The problem of concept drift: definitions and related work. Tech. Rep.; Department of Computer Science. Trinity College Dublin.
30. A. Vezhnevets, and J. Buhmann Agnostic domain adaptation R. Mester, M. Felsberg, Pattern Recognition - 33rd DAGM Symposium Lecture Notes in Computer Science 2011 376 385
31. V. Vinciotti, and D.J. Hand Local versus global models for classification problems: fitting models where it matters The American Statistician 57 2 2003 124 131
32. G.I. Webb, and K.M. Ting On the application of ROC analysis to predict classification performance under varying class distributions Machine Learning 58 2005 25 32
33. Z. Zhang, and J. Zhou Transfer estimation of evolving class priors in data stream classification Pattern Recognition 43 2010 3151 3161
34. Zliobaite I.; 2009. Learning under concept drift: an overview. Tech. Rep.; Vilnius University.