Exploiting unlabeled data to enhance ensemble diversity

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2010, Pages 619-628

  Zhang, Min Ling ^a   Zhou, Zhi Hua ^b  

^a SOUTHEAST UNIVERSITY   (China)

^b NANJING UNIVERSITY   (China)

Author keywords

Diversity; Ensemble learning; Unlabeled data

Indexed keywords

BASE LEARNERS; DIVERSITY; ENSEMBLE LEARNING; ENSEMBLE METHODS; ERROR PRONES; GENERALIZATION ABILITY; LABELED DATA; SEMI-SUPERVISED; UNLABELED DATA;

DATA MINING; OPTIMIZATION;

LEARNING SYSTEMS;

EID: 79951751034     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2010.12     Document Type: Conference Paper

References (22)

1. K. Bennett, A. Demiriz, and R. Maclin, "Exploiting unlabeled data in ensemble methods," in Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Edmonton, Canada, 2002, pp. 289-296.
2. C. Blake, E. Keogh, and C. J. Merz, "UCI repository of machine learning databases [http://www.ics.uci.edu/~mlearn/mlrepository.html]," Department of Information and Computer Science, University of California, Irvine, CA, Tech. Rep., 1998.
3. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proceedings of the 11th Annual Conference on Computational Learning Theory, Madison, WI, 1998, pp. 92-100.
4. L. Breiman, "Bagging predictors," Machine Learning, vol. 24, no. 2, pp. 123-140, 1996. (Pubitemid 126724382)
5. O. Chapelle, B. Schölkopf, and A. Zien, Semi-Supervised Learning. Cambridge, MA: MIT Press, 2006.
6. K. Chen and S. Wang, "Regularized boost for semi-supervised learning," in Advances in Neural Information Processing Systems 20, J. C. Platt, D. Koller, Y. Singer, and S. Roweis, Eds. Cambridge, MA: MIT Press, 2008, pp. 281-288.
7. F. d'Alché Buc, Y. Grandvalet, and C. Ambroise, "Semi-supervised marginboost," in Advances in Neural Information Processing Systems 14, T. G. Dietterich, S. Becker, and Z. Ghahramani, Eds. Cambridge, MA: MIT Press, 2002, pp. 553-560.
8. T. G. Dietterich, "Ensemble methods in machine learning," in Proceedings of the 1st International Workshop on Multiple Classifier Systems, Cagliari, Italy, 2000, pp. 1-15.
9. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," in Lecture Notes in Computer Science 904, P. M. B. Vitányi, Ed. Berlin: Springer, 1995, pp. 23-37.
10. S. Hettich and S. D. Bay, "The UCI KDD archive [http://kdd.ics.uci. edu]". Department of Information and Computer Science, University of California, Irvine, CA, Tech. Rep., 1998.
11. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation, and active learning," in Advances in Neural Information Processing Systems 7, G. Tesauro, D. S. Touretzky, and T. K. Leen, Eds. Cambridge, MA: MIT Press, 1995, pp. 231-238.
12. L. I. Kuncheva and C. J. Whitaker, "Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy," Machine Learning, vol. 51, no. 2, pp. 181-207, 2003.
13. M. Li and Z.-H. Zhou, "SETRED: Self-training with editing," in Proceedings of the 9th Pacific-Asia Conference on Knowledge Discovery and Data mining, Hanoi, Vietnam, 2005, pp. 611-621.
14. -, "Improve computer-aided diagnosis with machine learning techniques using undiagnosed samples," IEEE Transactions on Systems, Man and Cybernetics - Part A: Systems and Humans, vol. 37, no. 6, pp. 1088-1098, 2007. (Pubitemid 350130846)
15. X. Lu and A. K. Jain, "Ethnicity identification from face images," in Proceedings of SPIE International Symposium on Defense and Security, Kissimmee, FL, 2004, pp. 114-123.
16. P. K. Mallapragada, R. Jin, A. K. Jain, and Y. Liu, "Semi-boost: Boosting for semi-supervised learning," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 11, pp. 2000-2014, 2009.
17. L. Mason, P. Bartlett, J. Baxter, and M. Frean, "Functional gradient techniques for combining hypotheses," in Advances in Large Margin Classifiers, A. Smola, P. Bartlett, B. Schölkopf, and D. Schuurmans, Eds. Cambridge, MA: MIT Press, 2000, pp. 221-246.
18. H. Valizadegan, R. Jin, and A. K. Jain, "Semi-supervised boosting for multi-class classification," in Proceedings of the 19th European Conference on Machine Learning, Antwerp, Belgium, 2008, pp. 522-537.
19. D. H. Wolpert, "Stacked generalization," Neural Networks, vol. 5, no. 2, pp. 241-259, 1992.
20. Z.-H. Zhou, "When semi-supervised learning meets ensemble learning," in Proceedings of the 8th International Workshop on Multiple Classifier Systems, Reykjavik, Iceland, 2009, pp. 529-538.
21. Z.-H. Zhou and M. Li, "Tri-training: Exploiting unlabeled data using three classifiers," IEEE Transactions on Knowledge and Data Engineering, vol. 17, no. 11, pp. 1529-1541, 2005. (Pubitemid 41704840)
22. -, "Semi-supervised learning by disagreement," Knowledge and Information Systems, vol. 24, no. 3, pp. 415-439, 2010.