Exploiting unlabeled data in ensemble methods

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2002, Pages 289-296

  Bennett, Kristin P ^a   Demiriz, Ayhan ^b   Maclin, Richard ^c  

^a Rensselaer Polytechnic Institute   (United States)

^b VERIZON   (United States)

^c UNIVERSITY OF MINNESOTA DULUTH   (United States)

Author keywords

Boosting; Classification; Ensemble learning; Semi supervised learning

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); DATA STRUCTURES; DECISION THEORY; NEURAL NETWORKS;

BOOSTING; ENSEMBLE LEARNING; ENSEMBLE METHODS; SEMISUPERVISED ENSEMBLE METHOD; UNLABELED DATA;

LEARNING SYSTEMS;

EID: 0242456809     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/775047.775090     Document Type: Conference Paper

References (22)

1. E. Bauer and R. Kohavi. An empirical comparison of voting classification algorithms: Bagging, boosting, and variants. Machine Learning, 36:105-139, 1999.
2. K. P. Bennett and A. Demiriz. Semi-supervised support vector machines. In D. C. M. Kearns, S. Solla, editor, Advances in Neural Information Processing Systems 11, pages 368-374, Cambridge, MA, 1999. MIT Press.
3. C. L. Blake and C. J. Merz. UCI repository of machine learning databases, 1998. http://www.ics.uci.edu/~mlearn/MRLepository.html.
4. A. Blum and T. Mitchell. Combining labeled and unlabeled data with co-training. In COLT: Proceedings of the Workshop on Computational Learning Theory, Morgan Kaufmann Publishers, 1998.
5. R. Caruana, V. de Sa, M. Kearns, and A. McCallum. Integrating supervised and unsupervised learning, 1998. http://www.cs.cmu.edu/~mccallum/supunsup
6. F. de'Alché Buc, Y. Grandvalet, and C. Ambroise. Semi-supervised marginboost. In T. G. Dietterich, S. Becker, and Z. Ghahramani, editors, Advances in Neural Information Processing Systems 14. MIT Press, 2002.
7. A. Demiriz, K. P. Bennett, and M. J. Embrechts. A genetic algorithm approach for semi-supervised clustering. Journal of Smart Engineering System Design, 4:35-44, 2002. Taylor & Francis.
8. Y. Freund and R. E. Schapire. Experiments with a new boosting algorithm. In International Conference on Machine Learning, pages 148-156, 1996.
9. G. Fung and O. L. Mangasarian. Semi-supervised support vector machines for unlabeled data classification. Optimization Methods and Software, 15:29-44, 2001.
10. T. Graepel, R. Herbrich, and K. Obermayer. Using unlabeled data for supervised learning, 1999. http://stat.cs.tu-berlin.de/nips99
11. Y. Grandvalet, F. d'Alché Buc, and C. Ambroise. Boosting mixture models for semi-supervised learning. In G. Dorffner, H. Bischof, and K. Hornik, editors, ICANN 2001, pages 41-48. LNCS 2130, Springer-Verlag, 2001.
12. A. J. Grove and D. Schuurmans. Boosting in the limit: Maximizing the margin of learned ensembles. In AAAI/IAAI, pages 692-699, 1998.
13. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Springer-Verlag, New York, 2001.
14. S. C. Kremer and D. A. Stacey. Competition: Unlabeled data for supervised learning, 2001. http://q.cis.uoguelph.ca/~skremer/NIPS2001/.
15. S. C. Kremer, D. A. Stacey, and K. P. Bennett. Unlabeled data supervised learning competition, 2000. http://q.cis.uoguelph.ca/~skremer/NIPS2000/.
16. L. Mason, P. Bartlett, J. Baxter, and M. Frean. Functional gradient techniques for combining hypotheses. In B. Schölkopf, A. Smola, P. Bartlett, and D. Schuurmans, editors, Advances in Large Margin Classifiers. MIT Press, 2000.
17. K. Nigam, A. McCallum, S. Thrum, and T. Mitchell. Using EM to classify test from labeled and unlabeled documents. Machine Learning, 39:2:103-134, 2000.
18. D. Opitz and R. Maclin. Popular ensemble methods: An empirical study. Journal of Artificial Intelligence Research, 11:169-198, 1999.
19. G. Rätsch. Benchmark datasets, 1998. http://ida.first.gmd.de/~raetsch/data/benchmarks.htm.
20. W. N. Street and Y. Kim. An ensemble method for large-scale classification. In Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-01), 2001.
21. T. Therneau and B. Atkinson. Rpart: Recursive partitioning software, February 2000. Available at http://www.mayo.edu/hsr/Sfunc.html.
22. V. Vapnik. Statistical Learning Theory. Wiley, New York, 1998.