Learning in Nonstationary Environments: A Survey

IEEE Computational Intelligence Magazine

Volumn 10, Issue 4, 2015, Pages 12-25

  Ditzler, Gregory ^a   Roveri, Manuel ^b   Alippi, Cesare ^b   Polikar, Robi ^c  

^a University of Arizona   (United States)

^b POLITECNICO DI MILANO   (Italy)

^c Rowan University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CELLULAR TELEPHONE SYSTEMS; E-LEARNING; EMBEDDED SYSTEMS;

ADAPTIVE MODELING; CYBER PHYSICAL SYSTEMS (CPSS); INTERNET OF THINGS TECHNOLOGIES; NON-STATIONARITIES; NON-STATIONARY ENVIRONMENT; PROBABILISTIC PROPERTIES; REAL-WORLD SCENARIO; SOFTWARE FAULT;

PROBABILITY DISTRIBUTIONS;

EID: 84945281802     PISSN: 1556603X     EISSN: None     Source Type: Journal    
DOI: 10.1109/MCI.2015.2471196     Document Type: Review

References (134)

1. Z.-H. Zhou, N. V. Chawla, Y. Jin, and G. J. Williams, "Big data opportunities and challenges: Discussions from data analytics perspectives," IEEE Comput. Intell. Mag., vol. 9, no. 4, pp. 62-74, Nov.
2. P. Huijse, P. A. Estevez, P. Protopapas, J. C. Principe, and P. Zegers, "Computational intelligence challenges and applications on large-scale astronomical time series databases," IEEE Comput. Intell. Mag., vol. 9, no. 3, pp. 27-39, Aug.
3. Y. Zhai, Y.-S. Ong, and I. W. Tsang, "The emerging big dimensionality," IEEE Comput. Intell. Mag., vol. 9, no. 3, pp. 14-26, Aug.
4. X. Wu, X. Zhu, G.-Q. Wu, and W. Ding, "Data mining with big data," IEEE Trans. Knowledge Data Eng., vol. 26, no. 1, pp. 97-107, Jan.
5. National Research Council, Frontiers in Massive Data Analysis. Washington, D.C.: National Academies Press
6. A. Tsymbal, "The problem of concept drift: Definitions and related work," Comput. Sci. Dept., Trinity College, Dublin, Ireland, Tech. Rep., Apr. 2004, vol. 106.
7. J. Gama, I. Žliobaite, A. Bifet, M. Pechenizkiy, and A. Bouchachia, "A survey on concept drift adaptation," ACM Comput. Surv., vol. 46, no. 4, p. 44, Apr.
8. D. H. Widyantoro, T. R. Iorger, and J. Yen, "An adaptive algorithm for learning changes in user interests," in Proc. 8th Conf. Information Knowledge Management, 1999, pp. 405-412.
9. D. H. Widyantoro, T. R. Ioerge, and J. Yen, "Tracking changes in user interests with a few relevance judgments," in Proc. ACM Int. Conf. Information Knowledge Management, 2003, pp. 548-551.
10. R. Elwell and R. Polikar, "Incremental learning of concept drift in nonstationary environments," IEEE Trans. Neural Netw., vol. 22, no. 10, pp. 1517-1531, Oct.
11. C. Alippi, Intelligence for Embedded Systems. Berlin, Germany: Springer-Verlag
12. J. Sarnelle, A. Sanchez, R. Capo, J. Haas, and R. Polikar, "Quantifying the limited and gradual concept drift assumption," in Proc. Int. Joint Conf. Neural Networks
13. W. Zang, P. Zhang, C. Zhou, and L. Guo, "Comparative study between incremental and ensemble learning on data streams: Case study," J. Big Data, vol. 1, no. 5, pp. 1-16, June
14. R. Polikar, L. Udpa, S. S. Udpa, and V. Honavar, "Learn++: An incremental learning algorithm for supervised neural networks," IEEE Trans. Syst. Man Cybern., vol. 31, no. 4, pp. 497-508, Nov.
15. A. Bifet, G. Holmes, B. Pfahringer, R. Kirkby, and R. Gavalda, "New ensemble methods for evolving data streams," in Proc. Knowledge Data Discovery, 2009, pp. 139-148.
16. L. I. Kuncheva, "Classifier ensembles for changing environments," in Proc. 5th Int. Workshop Multiple Classifier Systems, 2004, pp. 1-15.
17. G. Carpenter and S. Grossberg, "ART 2: Self-organization of stable category recognition codes for analog input patterns," Appl. Opt., vol. 26, no. 23, pp. 4919-4930, Dec.
18. P. Domingos and G. Hulten, "A general framework for mining massive data streams," J. Comput. Graph. Stat., vol. 12, no. 4, pp. 945-949
19. A. Bifet, G. Holmes, B. Pfahringer, and R. Gavalda, "Improving adaptive bagging methods for evolving data streams," in Proc. 1st Asian Conf. Machine Learning: Advances Machine Learning, 2009, pp. 27-37.
20. A. Bifet, "Adaptive learning and mining for data streams and frequent patterns," Ph.D. dissertations, Universitat Politecnica de Catalunya, Catalunya, Spain
21. G. Widmer and M. Kubat, "Learning in the presence of concept drift and hidden contexts," Mach. Learn., vol. 23, no. 1, pp. 69-101, Apr.
22. C. Bishop, Pattern Recognition and Machine Learning. Berlin, Germany: Springer-Verlag
23. O. Chapelle, B. Scholköpf, and A. Zien, Semi-Supervised Learning. Cambridge, MA: MIT Press
24. G. Carpenter, S. Grossberg, and J. Reynolds, "ARTMAP: A self-organizing neural network architecture for fast supervised learning and pattern recognition," in Proc. Int. Joint Conf. Neural Networks, 1991, pp. 863-868.
25. G. Carpenter, S. Grossberg, N. Markuzon, J. Reynolds, and D. Rosen, "Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps," IEEE Trans. Neural Netw., vol. 3, no. 5, pp. 698-713, Sept.
26. N. Littlestone and M. K. Warmuth, "The weighted majority algorithm," Inform. Comput., vol. 108, no. 2, pp. 212-261, Feb.
27. J. Quiñonero-Candela, M. Sugiyama, A. Schwaighofer, and N. Lawrence, Dataset Shift in Machine Learning. Cambridge, MA: MIT Press
28. M. Sugiyama and M. Kawanabe, Machine Learning in Non-Stationary Environments. Cambridge, MA: MIT Press
29. M. Sugiyama, S. Nakajima, H. Kashima, P. V. Buenau, and M. Kawanabe, "Direct importance estimation with model selection and its application to covariate shift adaptation," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2008, pp. 1433-
30. M. Sugiyama, M. Krauledat, and K. R. Müller, "Covariate shift adaptation by importance weighted cross validation," J. Mach. Learn. Res., vol. 8, pp. 985-1005, May
31. S. J. Pan and Q. Yang, "A survey on transfer learning," IEEE Trans. Knowledge Data Eng., vol. 22, no. 10, pp. 1345-1359, Oct.
32. Y. Mansour, M. Mohri, and A. Rostamizadeh, "Domain adaptation with multiple sources," in Advances Neural Information Processing Systems. Cambridge, MA: MIT Press, 2009, pp. 1041-
33. S. Ben-David, J. Blitzer, K. Crammer, A. Kulesza, F. Pereira, and J. W. Vaughan, "A theory of learning from different domains," Mach. Learn., vol. 79, nos. 1-2, pp. 151-175, May
34. G. Schweikert, C. Widmer, B. Schölkopf, and G. Rtsch, "An empirical analysis of domain adaptation algorithms for genomic sequence analysis," in Proc. Advances Neural Information Processing Systems, 2009, pp. 1433-
35. N. Oza, "On-line ensemble learning," Ph.D. dissertation, Univ. California, Berkeley, CA
36. A. Bifet and E. Frank, "Sentiment knowledge discovery in Twitter streaming data," in Proc. Int. Conf. Discovery Science, 2010, pp. 1-15.
37. J. G. Caporaso, C. L. Lauber, E. K. Costello, D. Berg-Lyons, A. Gonzalez, J. Stombaugh, D. Knights, P. Gajer, J. Ravel, N. Fierer, J. Gordon, and R. Knight, "Moving pictures of the human microbiome," Genome Biol., vol. 12, no. 5, p. R50
38. N. Fierer and J. Ladau, "Predicting microbial distributions in space and time," Nature Methods, vol. 9, no. 6, pp. 549-551
39. C. Alippi and M. Roveri, "Just-in-time adaptive classifiers-part II: Designing the classifier," IEEE Trans. Neural Netw., vol. 19, no. 12, pp. 2053-2064, Dec.
40. C. Alippi, G. Boracchi, and M. Roveri, "Just in time classifiers: Managing the slow drift case," in Proc. Int. Joint Conf. Neural Networks, 2009, pp. 114-120.
41. J. Gama, P. Medas, G. Castillo, and P. Rodrigues, "Learning with drift detection," in Proc. Advances Artificial Intelligence-SBIA, 2004, pp. 286-295.
42. A. Bifet and R. Gavalda, "Learning from time-changing data with adaptive windowing," in Proc. SIAM Int. Conf. Data Mining
43. C. Alippi, G. Boracchi, and M. Roveri, "Just-in-time classifiers for recurrent concepts," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 4, pp. 620-634, Apr.
44. M. Basseville and I. V. Nikiforov, Detection of Abrupt Changes: Theory and Application, vol. 104. Englewood Cliffs, NJ: Prentice Hall
45. D. Kifer, S. Ben-David, and J. Gehrke, "Detecting change in data streams," in Proc. 30th Int. Conf. Very Large Data Bases, 2004, vol. 30, pp. 180-191.
46. G. Ditzler and R. Polikar, "Hellinger distance based drift detection for nonstationary environments," in Proc. IEEE Symp. Computational Intelligence Dynamic Uncertain Environments, 2011, pp. 41-48.
47. J. P. Patist, "Optimal window change detection," in Proc. 7th IEEE Int. Conf. Data Mining Workshops, 2007, pp. 557-562.
48. A. Bifet and R. Gavalda, "Kalman filters and adaptive windows for learning in data streams," in Proc. Int. Conf. Discovery Science, 2006, pp. 29-40.
49. C. Alippi and M. Roveri, "An adaptive cusum-based test for signal change detection," in Proc. Int. Symp. Circuits Systems, 2006, pp. 1-4.
50. C. Alippi and M. Roveri, "Just-in-time adaptive classif iers-Part I: Detecting nonstationary changes," IEEE Trans. Neural Netw., vol. 19, no. 7, pp. 1145-1153, July
51. C. Alippi, G. Boracchi, and M. Roveri, "Change detection tests using the ICI rule," in Proc. Int. Joint Conf. Neural Networks, 2010, pp. 1-7.
52. C. Alippi, G. Boracchi, and M. Roveri, "Just-in-time ensemble of classifiers," in Proc. Int. Joint Conf. Neural Networks, 2012, pp. 1-8.
53. L. Cohen, G. Avrahami-Bakish, M. Last, A. Kandel, and O. Kipersztok, "Real-time data mining of non-stationary data streams from sensor networks," Inform. Fusion, vol. 9, no. 3, pp. 344-353, July
54. M. Harel, K. Crammer, R. El-Yaniv, and S. Mannor, "Concept drift detection through resampling," in Proc. Int. 31st Conf. Machine Learning, 2014. pp. 1009-
55. K. Nishida and K. Yamauchi, "Learning, detecting, understanding, and predicting concept changes," in Proc. Int. Joint Conf. Neural Networks, 2009, pp. 2280-
56. M. Baena-García, J. del Campo-Ávila, R. Fidalgo, A. Bifet, R. Gavaldá, and R. Morales- Bueno, "Early drift detection method," in Proc. 4th Int. Workshop Knowledge Discovery from Data Streams, 2006, pp. 1-4.
57. K. Nishida and K. Yamauchi, "Detecting concept drift using statistical testing," in Discovery Science. Berlin, Germany: Springer-Verlag, 2007, pp. 264-269.
58. D. M. Hawkins, Q. Peihua, and W. K. Chang, "The changepoint model for statistical process control," J. Qual. Technol., vol. 35, no. 4, pp. 355-366, Oct.
59. G. J. Ross, D. K. Tasoulis, and N. M. Adams, "Nonparametric monitoring of data streams for changes in location and scale," Technometrics, vol. 53, no. 4, pp. 379-389
60. A. Wald, "Sequential tests of statistical hypotheses," Ann. Math. Stat., vol. 16, no. 2, pp. 117-186, June
61. P. Armitage and P. Armitage, Sequential Medical Trials. Oxford, U.K.: Blackwell
62. S. Sakthithasan, R. Pears, and Y. S. Koh, "One pass concept change detection for data streams," in Advances in Knowledge Discovery and Data Mining, Berlin, Germany: Springer- Verlag, 2013, pp. 461-472.
63. R. Pears, S. Sakthithasan, and Y. S. Koh, "Detecting concept change in dynamic data streams," Mach. Learn., vol. 97, no. 3, pp. 259-293, Jan.
64. I. Frías-Blanco, J. del Campo-Ávila, G. Ramos-Jiménez, R. Morales-Bueno, A. Ortiz- Díaz, and Y. Caballero-Mota, "Online and non-parametric drift detection methods based on hoeffdings bounds," IEEE Trans. Knowledge Data Eng., vol. 27, no. 3, pp. 810-823, Aug.
65. C. Alippi, G. Boracchi, and M. Roveri, "A just-in-time adaptive classification system based on the intersection of confidence intervals rule," Neural Netw., vol. 24, no. 8, pp. 791-800, Oct.
66. C. Alippi, G. Boracchi, and M. Roveri, "A hierarchical, nonparametric, sequential change-detection test," in Proc. Int. Joint Conf. Neural Networks, 2011, pp. 2889-
67. G. Boracchi, M. Michaelides, and M. Roveri, "A cognitive monitoring system for contaminant detection in intelligent buildings," in Proc. Int. Joint Conf. Neural Networks, July 2014, pp. 69-76.
68. C. Alippi, G. Boracchi, and M. Roveri, "An effective just-in-time adaptive classifier for gradual concept drifts," in Proc. Int. Joint Conf. Neural Networks, 2011, pp. 1675-
69. I. Koychev, "Gradual forgetting for adaptation to concept drift," in Proc. ECAI Workshop Current Issues Spatio-Temporal Reasoning, 2000, pp. 101-106.
70. E. Cohen and M. Strauss, "Maintaining time-decaying stream aggregates," in Proc. 22nd ACM SIGMOD-SIGACT-SIGART Symp. Principles Database Systems, 2003, pp. 223-233.
71. R. Klinkenberg, "Learning drifting concepts: Example selection vs. example weighting," Intell. Data Anal., vol. 8, no. 3, pp. 281-300, Aug.
72. J. S. Vitter, "Random sampling with a reservoir," ACM Trans. Math. Softw., vol. 11, no. 1, pp. 37-57, Mar.
73. C. C. Aggarwal, "On biased reservoir sampling in the presence of stream evolution," in Proc. 32nd Int. Conf. Very Large Data Bases, 2006, pp. 607-618.
74. W. Ng and M. Dash, "A test paradigm for detecting changes in transactional data streams," in Database Systems for Advanced Applications. Berlin, Germany: Springer-Verlag, 2008, pp. 204-219.
75. P. Domingos and G. Hulton, "Mining high-speed data streams," in Proc. 6th ACM SIGKDD Int. Conf. Knowledge Discovery Data Mining, 2000, pp. 71-80.
76. G. Hulten, L. Spencer, and P. Domingos, "Mining time-changing data streams," in Proc. Conf. Knowledge Discovery Data, 2001, pp. 97-106.
77. J. Liu, X. Li, and W. Zhong, "Ambiguous decision trees for mining concept-drifting data streams," Pattern Recognit. Lett., vol. 30, no. 15, pp. 1347-1355, Nov.
78. L. Cohen, G. Avrahami, M. Last, and A. Kandel, "Info-fuzzy algorithms for mining dynamic data streams," Appl. Soft Comput., vol. 8, no. 4, pp. 1283-1294, Sept.
79. L. Cohen, G. Avrahami-Bakish, M. Last, A. Kandel, and O. Kipersztok, "Real-time data mining of non-stationary data streams from sensor networks," Inform. Fusion, vol. 9, no. 3, pp. 344-353, July
80. Y. Ye, S. Squartini, and F. Piazza, "Online sequential extreme learning machine in nonstationary environments," Neurocomputing, vol. 116, pp. 94-101, Sept.
81. A. Tsymbal, M. Pechenizkiy, P. Cunningham, and S. Puuronen, "Dynamic integration of classifiers for handling concept drift," Inform. Fusion, vol. 9, no. 1, pp. 56-68, Jan.
82. S. Grossberg, "Nonlinear neural networks: Principles, mechanisms, and architectures," Neural Netw., vol. 1, no. 1, pp. 17-61
83. G. Ditzler, G. Rosen, and R. Polikar, "Discounted expert weighting for concept drift," in Proc. IEEE Symp. Computational Intelligence Dynamic Uncertain Environments, 2013, pp. 61-67.
84. G. Ditzler, G. Rosen, and R. Polikar, "Domain adaptation bounds for multiple expert systems under concept drift," in Proc. Int. Joint Conf. Neural Networks, 2014, pp. 595-601.
85. L. L. Minku, A. P. White, and X. Yao, "The impact of diversity on online ensemble learning in the presence of concept drift," IEEE Trans. Knowledge Data Eng., vol. 22, no. 5, pp. 731-742, May
86. L. L. Minku and X. Yao, "DDD: A new ensemble approach for dealing with concept drift," IEEE Trans. Knowledge Discovery Data Eng., vol. 24, no. 4, pp. 619-633, Apr.
87. W. N. Street and Y. Kim, "A streaming ensemble algorithm (SEA) for large-scale classification," in Proc. 7th ACM SIGKDD Int. Conf. Knowledge Discovery Data Mining, 2001, pp. 377-382.
88. M. Scholz and R. Klinkenberg, "An ensemble classifier for drifting concepts," in Proc. 2nd Int. Workshop Knowledge Discovery Data Streams, 2005, pp. 53-64.
89. A. Pocock, P. Yiapanis, J. Singer, M. Lujan, and G. Brown, "Online nonstationary boosting," in Proc. Int. Workshop Multiple Classifier Systems, 2010, pp. 205-214.
90. J. Kolter and M. Maloof, "Dynamic weighted majority: An ensemble method for drifting concepts," J. Mach. Learn. Res., vol. 8, pp. 2755-2790, Dec.
91. D. Brzezinski and J. Stephanowski, "Reacting to different types of concept drift: The accuracy updated ensemble algorithm," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 1, pp. 81-94, Jan.
92. H. Abdulsalam, D. Skillicorn, and P. Martin, "Classification using streaming random forests," IEEE Trans. Knowledge Data Eng., vol. 23, no. 1, pp. 22-36, Jan.
93. Y. Freund and R. Shapire, "A decision-theoretic generalization of on-line learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, pp. 119-139, Aug.
94. S. Chen, H. He, K. Li, and S. Sesai, "MuSeRA: Multiple selectively recursive approach towards imbalanced stream data mining," in Proc. Int. Joint Conf. Neural Networks, 2010, pp. 2857-
95. R. Elwell and R. Polikar, "Incremental learning in nonstationary environments with controlled forgetting," in Proc. Int. Joint Conf. Neural Networks, 2009, pp. 771-778.
96. P. Ruvolo and E. Eaton, "ELLA: An efficient lifelong learning algorithm," in Proc. Int. Conf. Machine Learning, 2013, pp. 507-515.
97. P. Ruvolo and E. Eaton, "Scalable lifelong learning with active task selection," in Proc. AAAI Conf. Artificial Intelligence, 2013, pp. 33-39.
98. H. He and E. A. Garcia, "Learning from imbalanced data," IEEE Trans. Data Knowledge Discovery, vol. 12, no. 9, pp. 1263-1284, Sept.
99. N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, "SMOTE: Synthetic minority over-sampling technique," J. Artif. Intell. Res., vol. 16, pp. 321-357, June
100. N. V. Chawla, N. Japkowicz, and A. Kolcz, "Editorial: Special issue on learning from imbalanced data sets," SIGKDD Expl., vol. 6, no. 1, pp. 1-6, June
101. J. Gao, B. Ding, W. Fan, J. Han, and P. S. Yu, "Classifying data streams with skewed class distributions and concept drifts," IEEE Internet Comput., vol. 12, no. 6, pp. 37-49, Nov.-Dec.
102. J. Gao, W. Fan, J. Han, and P. S. Yu, "A general framework for mining conceptdrifting data streams with skewed distributions," in Proc. SIAM Int. Conf. Data Mining, 2007, pp. 203-208.
103. K. Wu, A. Edwards, W. Fan, J. Gao, and K. Zhang, "Classifying imbalanced data streams via dynamic feature group weighting with importance sampling," in Proc. SIAM Int. Conf. Data Mining, 2014, pp. 722-730.
104. S. Chen and H. He, "SERA: Selectively recursive approach towards nonstationary imbalanced stream data mining," in Proc. Int. Joint Conf. Neural Networks, 2009, pp. 552-529.
105. S. Chen and H. He, "Towards incremental learning of nonstationary imbalanced data stream: A multiple selectively recursive approach," Evolving Syst., vol. 2, no. 1, pp. 35-50, Mar.
106. G. Ditzler and R. Polikar, "Incremental learning of concept drift from streaming imbalanced data," IEEE Trans. Knowledge Data Eng., vol. 25, no. 10, pp. 2283-2301, Oct.
107. G. Ditzler and R. Polikar, "An incremental learning framework for concept drift and class imbalance," in Proc. Int. Joint Conf. Neural Networks, 2010, pp. 736-473.
108. S. Wang and X. Yao, "Using class imbalance learning for software defect prediction," IEEE Trans. Reliab., vol. 62, no. 2, pp. 434-443, June
109. S. Wang, L. L. Minku, and X. Yao, "Resampling-based ensemble methods for online class imbalance learning," IEEE Trans. Knowledge Data Eng., vol. 27, no. 5, pp. 1356-1368, May
110. E. S. Xioufis, M. Spiliopoulou, G. Tsoumakas, and I. Vlahavas, "Dealing with concept drift and class imbalance in multi-label stream classification," in Proc. Int. Joint Conf. Artificial Intelligence, 2011, pp. 1583-
111. K. Yamauchi, "Incremental learning and model selection under virtual concept drifting environments," in Proc. Int. Joint Conf. Neural Networks, 2010, pp. 1-8.
112. G. Ditzler, G. Rosen, and R. Polikar, "Transductive learning algorithms for nonstationary environments," in Proc. Int. Joint Conf. Neural Networks, 2012, pp. 1-8.
113. G. Ditzler and R. Polikar, "Semi-supervised learning in nonstationary environments," in Proc. Int. Joint Conf. Neural Networks, 2011, pp. 2741-
114. M. Ackermann, C. Lammersen, M. Mrtens, C. Raupach, C. Sohlerand, and K. Swierkot, "StreamKM++: A clustering algorithms for data streams," in Proc. 12th Workshop Algorithm Engineering Experiments, 2010, pp. 1-31.
115. C. Aggarwal, J. Han, J. Wang, and P. Yu, "A framework for clustering evolving data streams," in Proc. 29th Int. Conf. Very Large Data Bases, 2003, pp. 81-92.
116. F. Cao, M. Ester, W. Qian, and A. Zhou, "Density-based clustering over an evolving data stream with noise," in Proc. SIAM Conf. Data Mining, 2006, pp. 328-339.
117. I. Zliobaite, A. Bifet, B. Pfahringer, and G. Holmes, "Active learning with drifting streaming data," IEEE Trans. Neural Networks Learn. Syst., vol. 25, no. 1, pp. 27-39, Jan.
118. P. Zhang, X. Zhu, J. Tan, and L. Guo, "Classifier and cluster ensembles for mining concept drifting data streams," in Proc. Int. Conf. Data Mining, 2010, pp. 1175-
119. G. Krempl and V. Hofer, "Classification in presence of drift and latency," in Proc. IEEE Int. Conf. Data Mining Workshops, 2011, pp. 596-603.
120. R. Alaiz-Rodriguez, A. Guerrero-Curieses, and J. Cid-Sueiro, "Class and subclass probability re-estimation to adapt a classifier in the presence of concept drift," Neurocomputing, vol. 74, no. 16, pp. 2614-2623, Sept.
121. V. Hofer and G. Krempl, "Drift mining in data: A framework for addressing drift in classification," Comput. Stat. Data Anal., vol. 57, no. 1, pp. 377-391, Jan.
122. G. Krempl, "The algorithm apt to classify in concurrence of latency and drift," Adv. Intell. Data Anal., vol. 7014, pp. 222-233
123. K. Dyer and R. Polikar, "Semi-supervised learning in initially labeled non-stationary environments with gradual drift," in Proc. Int. Joint Conf. Neural Networks, 2012, pp. 1-9.
124. K. B. Dyer, R. Capo, and R. Polikar, "COMPOSE: A semi-supervised learning framework for initially labeled non-stationary streaming data," IEEE Trans. Neural Networks Learn. Syst., vol. 25, no. 1, pp. 12-26, Jan.
125. R. Capo, K. B. Dyer, and R. Polikar, "Active learning in nonstationary environments," in Proc. Int. Joint Conf. Neural Networks, 2013, pp. 1-8.
126. C. Alippi, G. Boracchi, and M. Roveri, "A hierarchical, nonparametric, sequential change-detection test," in Proc. Int. Joint Conf. Neural Networks, 2011, pp. 2889-
127. A. Bifet, G. Holmes, R. Kirkby, and B. Pfahringer, "MOA: Massive online analysis," J. Mach. Learn. Res., vol. 11, pp. 1601-1604, Mar.
128. G. D. F. Morales and A. Bifet, "SAMOA: Scalable advanced massive online analysis," J. Mach. Learn. Res., vol. 16, pp. 149-153, Jan.
129. A. Narasimhamurthy and L. I. Kuncheva, "A framework for generating data to simulate changing environments," in Proc. IASTED Artificial Intelligence Applications, 2007, pp. 384-389
130. S. Delany, P. Cunningham, and A. Tsymbal, "A comparison of ensemble and casebase maintenance techniques for handling concept drift in spam filtering," in Proc. Int. Conf. Artificial Intelligence, 2006, pp. 340-345.
131. I. Žliobaité, "Change with delayed labeling: When is it detectable?" in Proc. IEEE Int. Conf. Data Mining Workshops, 2010, pp. 843-850.
132. J. Gao, F. Liang, W. Fan, Y. Sun, and J. Han, "Graph-based consensus maximization among multiple supervised and unsupervised models," in Proc. Advances Neural Information Processing Systems, 2009, pp. 585-593.
133. J. Gao, F. Liang, W. Fan, Y. Sun, and J. Han, "Graph-based consensus maximization among multiple supervised and unsupervised models," IEEE Trans. Knowledge Discovery Data Eng., vol. 25, no. 1, pp. 15-28, Oct.
134. S. Xie, J. Gao, W. Fan, D. Turaga, and P. S. Yu, "Class-distribution regularized consensus maximization for alleviating overfitting in model combination," in Proc. 20th ACM SIGKDD Int. Conf. Knowledge Discovery Data Mining, 2014, pp. 303-312.