EWMA model based shift-detection methods for detecting covariate shifts in non-stationary environments

Pattern Recognition

Volumn 48, Issue 3, 2015, Pages 659-669

  Raza, Haider ^a   Prasad, Girijesh ^a   Li, Yuhua ^a  

^a UNIVERSITY OF ULSTER   (United Kingdom)

Author keywords

Covariate shift; Dataset shift detection; EWMA; Non stationary environments

Indexed keywords

ALGORITHMS; MULTIVARIANT ANALYSIS; STATISTICAL TESTS; TIME SERIES;

COVARIATE SHIFTS; DATASET SHIFTS; EWMA; EXPONENTIALLY WEIGHTED MOVING AVERAGE; MODEL-BASED CONTROL CHART; NON-STATIONARY ENVIRONMENT; ORTHOGONAL TRANSFORMATIONS; STATISTICAL HYPOTHESIS TEST;

BLIND SOURCE SEPARATION;

EID: 84916887759     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.07.028     Document Type: Article

References (49)

1. H. Shimodaira Improving predictive inference under covariate shift by weighting the log-likelihood function J. Stat. Plan. Inference 90 2 2000 227 244
2. R. Elwell, and R. Polikar Incremental learning of concept drift in non-stationary environments IEEE Trans. Neural Netw. 22 10 2011 1517 1531
3. Y. Kawahara, and M. Sugiyama Sequential change-point detection based on direct density-ratio estimation Stat. Anal. Data Min. 5 2 2012 114 127
4. H. Raza, G. Prasad, Y. Li, EWMA based two-stage dataset shift-detection in non-stationary environments, in: Proceedings of the Artificial Intelligence Applications and Innovations, 2013, pp. 625-635.
5. H. Raza, G. Prasad, Y. Li, Dataset shift detection in non-stationary environments using EWMA charts, in: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 2013, pp. 3151-3156.
6. S. Liu, M. Yamada, N. Collier, and M. Sugiyama Change-point detection in time-series data by relative density-ratio estimation Neural Netw. 43 2013 72 83 Retrieved from http://www.sciencedirect.com/science/article/pii/S0893608013000270
7. B. Blankertz, G. Curio, K. Müller, N. Group, and K.B. Franklin Classifying single trial EEG: towards brain computer interfacing Adv. Neural Inf. Process. Syst. 14 2002 157 164
8. S. Bickel, and T. Scheffer Dirichlet-enhanced spam filtering based on biased samples Adv. Neural Inf. Process. Syst. 19 2007 161 168
9. N. Ye, S. Vilbert, and Q. Chen Computer intrusion detection through EWMA for autocorrelated and uncorrelated data IEEE Trans. Reliab. 52 1 2003 75 82
10. G.W. Snedecor, and W.G. Cochran Statistical Methods eight ed. 1989 Iowa State University Press Ames, Iowa
11. C.M. Douglas Introduction to Statistical Quality Control 5th ed. 2007 John Wiley & Sons USA
12. H. Mann, and D. Whitney On a test of whether one of two random variables is stochastically larger than the other Ann. Math. Stat. 18 1 1947 50 60
13. W.A. Shewhart Statistical Method from the Viewpoint of Quality Control 1939 Dover Publications Mineola, NY
14. M. Basseville, and I. Nikiforov Detection of Abrupt Changes: Theory and Application 1993 Prentice-Hall Cliffs, Englewood
15. C. Alippi, and M. Roveri Just-in-time adaptive classifier - Part I: detecting nonstationary changes IEEE Trans. Neural Netw. 19 7 2008 1145 1153
16. C. Alippi, G. Boracchi, and M. Roveri A just-in-time adaptive classification system based on the intersection of confidence intervals rule Neural Netw. 24 8 2011 791 800
17. M. Markou, and S. Singh Novelty detection: a review - Part 1: statistical approaches Signal Process. 83 12 2003 2481 2497
18. M. Markou, and S. Singh Novelty detection: a review - Part 2: neural networks Signal Process. 83 12 2003 2499 2521
19. F. Gustafsson The marginalize likelihood ratio test for detecting abrupt changes IEEE Trans. Autom. Control 41 1 1996 66 78
20. M. Sugiyama, T. Suzuki, and T. Kanamori Density Ratio Estimation in Machine Learning 2012 Cambridge University Press New York, USA
21. C. Alippi, G. Boracchi, and M. Roveri Just-in-time classifiers for recurrent concepts IEEE Trans. Neural Netw. Learn. Syst. 24 4 2013 620 634
22. A.J. Storkey When training and test sets are different: characterising learning transfer Dataset Shift in Machine Learning Section 12 2010 MIT Press Cambridge, Massachusetts 3 28
23. M.J.G. Torres, T. Raeder, R. Alaiz-Rodríguez, N.V. Chawla, and F. Herrera A unifying view on dataset shift in classification Pattern Recognit. 45 1 2012 521 530
24. M. Sugiyama, A. Schwaighofer, and N.D. Lawrence Dataset Shift in Machine Learning 2009 The MIT Press Cambridge, Massachusetts
25. G. Widmer, and M. Kubat Learning in the presence of concept drift and hidden contexts Mach. Learn. 101 23 1996 69 101
26. K. Wang, C.A. Fu, J.X. Yu, Mining changes of classification by correspondence tracing, in: Proceedings of the 3rd SIAM International Conference on Data Mining (SDM-03), 2003, pp. 95-106.
27. N. Japkowicz, Assessing the impact of changing environments on classifier performance, in: Proceedings of the 21st Canadian Conference in Artificial Intelligence, 2008, pp. 13-24.
28. Y. Yang, X. Wu, and X. Zhu Conceptual equivalence for contrast mining in classification learning Data Knowl. Eng. 67 3 2008 413 429
29. D.a. Cieslak, and N.V. Chawla A framework for monitoring classifiers' performance: when and why failure occurs? Knowl. Inf. Syst. 18 1 2008 83 108
30. M.G. Kelly, D.J. Hand, N.M. Adams, The impact of changing populations on classifier performance, in: Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, vol. 32, no. 2, 1998, pp. 367-371.
31. S. Bickel, Learning under Differing Training and Test Distributions, University of Potsdam, 2009.
32. S.W. Roberts Control chart tests based on geometric moving averages Technometrics 1 3 1959 239 250
33. T.C. Mills Time Series Techniques For Economists 1991 Cambridge University Press New York, USA
34. D. Montgomery, and C. Mastrangelo Some statistical process control methods for autocorrelated data J. Qual. Technol. 23 3 1991 179 204
35. M.B. Connie, C.M. Douglas, and C.R. George Robustness of the EWMA control chart to non-normality J. Qual. Technol. 31 3 1999 309
36. Table of Critical Values for The Two-Sample Test. Available from: 〈http://www.soest.hawaii.edu/wessel/courses/gg313/Critical-KS.pdf〉 (online).
37. C.A. Lowry, W.H. Woodall, C.W. Champ, and S.E. Rigdon A multivariate exponentially weighted moving average control chart Technometrics 34 1 1992 46 53
38. S. Sharad, and C. George Designing a multivariate EWMA control chart J. Qual. Technol. 29 1 1997 8
39. L. Yumin An improvement for MEWMA in multivariate process control Comput. Ind. Eng. 31 3 1996 779 781
40. A. Miguel, A Review of Dimension Reduction Techniques, 1997.
41. K. Pearson LIII. On lines and planes of closest fit to systems of points in space The London, Edinburgh, and Dublin Philosophical... 1901 559 572
42. A. Hyvärinen, and E. Oja Independent Component Analysis: Algorithms and Applications Neural Netw. 13 4-5 2000 411 430
43. A.J. Bell, and T.J. Sejnowski An information-maximization approach to blind separation and blind deconvolution Neural Comput. 7 6 1995 1129 1159
44. X.-L. Li, Blind spatiotemopral separation of second and/or higher-order correlated sources by entropy rate minimization, in: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Dallas, TX, no. 1, 2010, pp. 1934-1937.
45. R.A. Johnson, and D.W. Wichern Applied Multivariate Statistical Analysis, 6th ed. vol. 5 2007 Prentice Hall New York 210 258
46. G. Dornhege, B. Blankertz, G. Curio, and K.-R. Müller Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms IEEE Trans. Biomed. Eng. 51 6 2004 993 1002
47. C. Alippi, G. Boracchi, M. Roveri, Change detection tests using the ICI rule, in: Proceedings of the International Joint Conference on Neural Networks, July 2010, pp. 1-7.
48. J.M. Lucas, and M.S. Saccucci Exponentially weighted moving average control schemes: properties and enhancements Technometrics 32 1 1990 1
49. G.E.P. Box, and G.M. Jenkins Time Series Analysis, Forecasting and Control, Series in. Holden-Day, San Francisco 1970 John Wiley & Sons USA