Adapting a classification rule to local and global shift when only unlabelled data are available

European Journal of Operational Research

Volumn 243, Issue 1, 2015, Pages 177-189

  Hofer, Vera ^a  

^a UNIVERSITY OF GRAZ   (Austria)

Author keywords

Concept drift; Dataset shift; Global drift; Local drift; Verification latency

Indexed keywords

FORECASTING; LARGE DATASET; MIXTURES; POPULATION STATISTICS; PREDICTIVE ANALYTICS;

CONCEPT DRIFTS; DATASET SHIFTS; GLOBAL DRIFT; LOCAL DRIFT; VERIFICATION LATENCIES;

PROBABILITY DISTRIBUTIONS;

EID: 84921438319     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2014.11.022     Document Type: Article

References (48)

1. Alaiz-Rodríguez R., Guerrero-Curieses A., and Cid-Sueiro J. Class and subclass probability re-estimation to adapt classifiers in the presence of concept drift Neurocomputing 74 2011 2614 2623
2. Beninel F., Biernacki C., Bouveyron C., Jacques J., and Lourme A. Parametric link models for knowledge transfer in statistical learning. Knowledge Transfer: Practices, types and challenges 2012 Nova Publishers
3. Bickel S., Brückner M., and Scheffer T. Discriminative learning under covariate shift Journal of Machine Learning Research 10 2009 2137 2155
4. Bickel S., and Scheffer T. Dirichlet-enhanced spam filtering based on biased samples Advances in neural information processing systems 2007 MIT Press 161 168
5. Biernacki C., Beninel F., and Bretagnolle V. A generalized discriminant rule when training population and test population differ on their discriptive parameters Biometrics 58 2002 387 397
6. Biernacki C., and Lourme A. Simultaneous t-model-based clustering for data differing over time period: Application for understanding companies financial health Case Studies in Business, Industry and Government Statistics 4 2 2011 73 82
7. Bifet A., and Gavaldà R. Learning from time-changing data with adaptive windowing C. Apte, D. Skillicorn, B. Liu, S. Parthasarathy, Proceedings of the seventh SIAM international conference on data mining 2007 443 448
8. Bifet A., Holmes G., Pfahringer B., Kirkby R., and Gavalda R. New ensemble methods for evolving datastreams Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining 2009 ACM New York, NY, USA 139 148
9. Bouveyron C., and Jacques J. Adaptive linear models for regression: Improving prediction when population has changed Pattern Recognition Letters 31 14 2010 2237 2247
10. Bouveyron C., and Jacques J. Adaptive mixtures of regression: Improving predictive inference when population has changed Communications in Statistics: Simulation and Computation 43 10 2014 2570 2592
11. Cieslak D.A., and Chawla N.V. A framework for monitoring classifiers' performance: When and why failure occurs? Knowledge Information Systems 18 1 2008 83 108
12. Crook J.N., Edelman D.B., and Thomas L.C. Recent developments in consumer credit risk assessment European Journal of Operational Research 183 2 2007 1447 1465
13. Delany S.J., Cunningham P., Tsymbal A., and Coyle L. A case-based technique for tracking concept drift in spam filtering Knowledge-Based Systems 18 2005 187 195
14. Dinh C.V., Duin R.P., Piqueras-Salazar I., and Loog M. Fidos: A generalized Fisher based feature extraction method for domain shift Pattern Recognition 46 9 2013 2510 2518
15. Ditzler G., Rosen G., and Polikar R. Transductive learning algorithms for nonstationary environments International joint conference on neural networks 2012 Institute of Electrical and Electronics Engineers (IEEE) 945 952
16. Forman G. Tackling concept drift by temporal inductive transfer Proceedings of the ACM SIGIR conference 2006 ACM Press 252 259
17. Forman G. Quantifying counts and costs via classification International Journal of Data Mining and Knowledge Discovery 17 2 2008 164 206
18. Hand D.J. Classifier technology and the illusion of progress Statistical Science 21 2006 1 14
19. Hand D.J. Measuring classifier performance: a coherent alternative to the area under the ROC curve Machine Learning 77 1 2009 103 123
20. Hand D.J., and Vinciotti V. Local versus global models for classification problems: Fitting models where it matters The American Statistician 57 2 2003 124 131
21. Hofer V., and Krempl G. Drift mining in data: A framework for addressing drift in classification Computational Statistics and Data Analysis 57 1 2013 377 391
22. Huang J., Smola A.J., Gretton A., Borgwardt K.M., and Schölkopf B. Correcting sample selection bias by unlabelled data Advances in neural information processing systems Vol. 19 2006 MIT Press 601 608
23. Jacques J., and Biernacki C. Extension of model-based classification for binary data when training and test population differ Journal of Applied Statistics 37 5 2008 749 766
24. Jing J., and Xiang Z.C. Instance weighting for domain adaptation in nlp Proceedings of the 45th annual meeting of the association of computational linguistics 2007 Association for Computational Linguistics 264 271
25. Kelly M.G., Hand D.J., and Adams N.M. The impact of changing populations on classifier performance Proceedings of the fifth ACM SIGKDD international conference on knowledge discovery and data mining 1999 ACM New York, NY, USA 367 371
26. Klinkenberg R., and Joachims T. Detecting concept drift with support vector machines P. Langley, Proceedings of the seventh international conference on machine learning 2000 Stanford University, Stanford, CA, USA 487 494
27. Krempl G. The algorithm APT to classify in concurrence of latency and drift J. Gama, E. Bradley, J. Hollmén, Advances in intelligent data analysis Lecture Notes in Computer Science Vol. 7014 2011 Springer Berlin/Heidelberg 222 233
28. Krempl G., and Hofer V. Classification in the presence of drift and latency Handling concept drift and reoccurring contexts in adaptive information systems Proceedings of the 11th IEEE international conference on data mining workshops 2011 Institute of Electrical and Electronics Engineers (IEEE) 596 603
29. Kuncheva L.I. Classifier ensembles for detecting concept change in streaming data: Overview and perspectives O. Okun, G. Valentini, Proceedings of the second workshop on supervised and unsupervised ensemble methods and their applications (SUEMA'08) Studies in Computational Intelligence Vol. 245 2008 Springer 5 10
30. Levina E., and Bickel P. The earth mover's distance is the Mallow distance: Some insights from statistics Proceedings of the eighth international conference on computer vision, Vol. 2 2001 Institute of Electrical and Electronics Engineers (IEEE) 251 256
31. Ling H., and Okada K. An efficient earth mover's distance algorithm for robust histogram comparison IEEE Transactions on Pattern Analysis and Machine Intelligence 29 5 2007 840 853
32. Lourme A., and Biernacki C. Simultaneous Gaussian models-based clustering for samples of multiple origins Computational Statistics 28 1 2013 371 391
33. Mallow C.L. A note on asymptotic joint normality Annals of Mathematical Statistics 43 2 1972 508 515
34. Marrs G., Hickey R., and Black M. The impact of latency on online classification learning with concept drift Y. Bi, M.-A. Williams, Knowledge science, engineering and management Lecture Notes in Computer Science Vol. 6291 2010 Springer 459 469
35. Moreo-Torres J.G., Raeder T., Alaiz-Rodríguez R., Chawla N.V., and Herrera F. A unifying view on dataset shift in classification Pattern Recognition 45 2012 521 530
36. Quinnero-Candela J., Sugiyama M., and Schwaighofer A. Dataset shift in machine learning 2009 The MIT Press
37. Rubner Y., Tomasi C., and Gubias L.J. The earth mover's distance as a metric for image retrieval International Journal of Computer Vision 40 2 2000 99 121
38. Saerens M., Latinne P., and Decaestecker C. Adjusting the outputs of a classifier to new a priori probabilities: A simple procedure Neural Computing 14 2001 21 41
39. Schlimmer J.C., and Granger R.H. Beyond incremental processing: Tracking concept drift Proceedings of the fifth national conference on artificial intelligence 1986 American Association on Artificial Intelligence 502 507
40. Scobey P., and Kabe D. Direct solutions to some multidimensional transportation problems Transportation Science 15 1981 1 15
41. Shimodaira H. Improving predictive inference under covariate shift by weighting the log-likelihood function Journal of Statistical Planning and Inference 90 2000 227 244
42. Sugiyama M., Nakajima S., Kashima H., von Bünau P., and Kawanabe M. Direct importance estimation with model selection and its application to covariate shift adaptation Advances in neural information processing systems 2008 MIT Press 1433 1440
43. Sugiyama M., Suzuki T., Nakajima S., Kashima H., von Bünau P., and Kawanabe M. Direct importance estimation for covariate shift adaptation Annals of the Institute of Stastistical Mathematics 60 4 2008 699 746
44. Sun J., and Li H. Dynamic financial distress prediction using instance selection for the disposal of concept drift Expert Systems with Applications 38 2011 2566 2576
45. Tsymbal A., Pechenizkiy M., Cunningham P., and Puuronen S. Dynamic integration of classifiers for handling concept drift Information Fusion 9 2008 56 68
46. Yamada M., Sugiyama M., and Matsui T. Semi-supervised speaker identification under covariate shift Signal Processing 90 2010 2353 2361
47. Yang Y. Adaptive credit scoring with kernel learning methods European Journal of Operational Research 183 3 2007 1521 1536
48. Zhang Z., and Zhou J. Transfer estimation of evolving class priors in data stream classification Pattern Recognition 43 2010 3151 3161