Transfer estimation of evolving class priors in data stream classification

Pattern Recognition

Volumn 43, Issue 9, 2010, Pages 3151-3161

  Zhang, Zhihao ^a   Zhou, Jie ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Concept drift; Prior estimation; Transfer learning

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA COMMUNICATION SYSTEMS; DATA MINING;

CONCEPT DRIFTS; DATA STREAM CLASSIFICATIONS; ESTIMATION METHODS; ESTIMATION PERFORMANCE; PARAMETER ESTIMATION METHOD; SMALL SAMPLE EFFECTS; SYNTHETIC AND REAL DATA; TRANSFER LEARNING;

PARAMETER ESTIMATION;

EID: 79960376903     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.03.021     Document Type: Article

References (39)

1. M. Gaber, A. Zaslavsky, S. Krishnaswamy, Mining data streams: a review, ACM Sigmod Record 34 (2) (2005) 18-26. (Pubitemid 41260006)
2. ® in Theoretical Computer Science 1 (2) (2005) 117-236. (Pubitemid 44111222)
3. S. Vucetic, Z. Obradovic, Classification on data with biased class distribution, in: ECML, 2001, pp. 527-538. (Pubitemid 33331097)
4. N. Japkowicz, The class imbalance problem: a systematic study, Intelligent Data Analysis 6 (5) (2002) 429-449.
5. R. Barandela, J. Sanchez, V. Garcia, E. Rangel, Strategies for learning in class imbalance problems, Pattern Recognition 36 (3) (2003) 849-851.
6. G. Batista, R. Prati, M. Monard, A study of the behavior of several methods for balancing machine learning training data, SIGKDD Explorations 6 (1) (2004) 20-29.
7. A. Tsymbal, The problem of concept drift: definitions and related work, Technical Report, Department of Computer Science Trinity College, Dublin, Ireland, 2004.
8. H. Wang, W. Fan, P. Yu, J. Han, Mining concept-drifting data streams using ensemble classifiers, in: KDD, 2003, pp. 226-235.
9. J. Kolter, M. Maloof, Dynamic weighted majority: an ensemble method for drifting concepts, The Journal of Machine Learning Research 8 (December) (2007) 2755-2790.
10. D. Widyantoro, J. Yen, Relevant data expansion for learning concept drift from sparsely labeled data, IEEE Transactions on Knowledge and Data Engineering 17 (3) (2005) 401-412. (Pubitemid 40320171)
11. H. Wang, J. Yin, J. Pei, P. Yu, J. Yu, Suppressing model overfitting in mining concept-drifting data streams, in: KDD, 2006, pp. 736-741. (Pubitemid 44535583)
12. G. Forman, Tackling concept drift by temporal inductive transfer, in: SIGIR, 2006, pp. 252-259.
13. P. Zhang, X. Zhu, Y. Shi, Categorizing and mining concept drifting data streams, in: KDD, 2008, pp. 812-820.
14. X. Zhu, Semi-supervised learning literature survey, Technical Report 1530, Computer Sciences Department, University of Wisconsin-Madison, Wisconsin, USA, 2005.
15. V. Vapnik, Estimation of Dependences Based on Empirical Data, Springer, New York, USA, 2006.
16. T. Joachims, Transductive inference for text classification using support vector machines, in: ICML, 1999, pp. 200-209.
17. R. El-Yaniv, D. Pechyony, Stable transductive learning, in: COLT, 2006, pp. 35-49. (Pubitemid 44072184)
18. D. Boes, On the estimation of mixing distributions, The Annals of Mathematical Statistics 37 (1) (1966) 177-188.
19. D. Kazakos, Recursive estimation of prior probabilities using a mixture, IEEE Transactions on Information Theory 23 (2) (1977) 203-211.
20. G. Dattatreya, L. Kanal, Asymptotically efficient estimation of prior probabilities in multiclass finite mixtures, IEEE Transactions on Information Theory 37 (3) (1991) 482-489. (Pubitemid 21646303)
21. G. McLachlan, J. Wiley, W. InterScience, Discriminant Analysis and Statistical Pattern Recognition, Wiley, New York, USA, 1992.
22. G. Forman, Quantifying trends accurately despite classifier error and class imbalance, in: KDD, 2006, pp. 157-166. (Pubitemid 44535513)
23. M. Saerens, P. Latinne, C. Decaestecker, Adjusting the outputs of a classifier to new a priori probabilities: a simple procedure, Neural Computation 14 (1) (2002) 21-41.
24. P. Latinne, M. Saerens, C. Decaestecker, Adjusting the outputs of a classifier to new a priori probabilities may significantly improve classification accuracy: evidence from a multi-class problem in remote sensing, in: ICML, 2001, pp. 298-305.
25. D. Miller, S. Pal, Transductive methods for the distributed ensemble classification problem, Neural Computation 19 (3) (2007) 856-884.
26. C. Yang, J. Zhou, Non-stationary data sequence classification using online class priors estimation, Pattern Recognition 41 (8) (2008) 2656-2664.
27. S. Raudys, A. Jain, Small sample size effects in statistical pattern recognition: recommendations for practitioners, IEEE Transactions on Pattern Analysis and Machine Intelligence 13 (3) (1991) 252-264.
28. S. Pan, Q. Yang, A Survey on Transfer Learning, Department of Computer Science and Engineering, Hong Kong University of Science and Technology, Hong Kong, China, 2008.
29. A. Ng, M. Jordan, On discriminative vs. generative classifiers: a comparison of logistic regression and naive Bayes, in: NIPS, 2002, pp. 841-848.
30. C. Bishop, Pattern Recognition and Machine Learning, Springer, New York, USA, 2006.
31. J. Shao, Mathematical Statistics, Springer, New York, USA, 2003.
32. W. Dai, Q. Yang, G. Xue, Y. Yu, Boosting for transfer learning, in: ICML, 2007, pp. 193-200.
33. R. Raina, A. Battle, H. Lee, B. Packer, A. Ng, Self-taught learning: transfer learning from unlabeled data, in: ICML, 2007, pp. 759-766.
34. W. Dai, Y. Chen, G. Xue, Q. Yang, Y. Yu, Translated learning: transfer learning across different feature spaces, in: NIPS, 2008, pp. 353-360.
35. M. Sugiyama, S. Nakajima, H. Kashima, P. von Bunau, M. Kawanabe, Direct importance estimation with model selection and its application to covariate shift adaptation, in: NIPS, 2008, pp. 1433-1440.
36. H. Shimodaira, Improving predictive inference under covariate shift by weighting the log-likelihood function, Journal of Statistical Planning and Inference 90 (2) (2000) 227-244.
37. I. Csiszar, Information-type measures of difference of probability distributions and indirect observations, Studia Scientiarum Mathematicarum Hungarica 2 (1967) 299-318.
38. J. Lin, Divergence measures based on the Shannon entropy, IEEE Transactions on Information Theory 37 (1) (1991) 145-151.
39. S. Hettich, S. Bay, UCI KDD archive, 1999. [Online]. Available: .