A PAC-style model for learning from labeled and unlabeled data

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3559 LNAI, Issue , 2005, Pages 111-126

  Balcan, Maria Florina ^a   Blum, Avrim ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; CONVERGENCE OF NUMERICAL METHODS; DATA REDUCTION; LEARNING ALGORITHMS; MATHEMATICAL MODELS;

COMPATIBILITY; PAC-STYLE MODEL; STANDARD THEORETICAL MODELS; UNLABELED DATA;

LEARNING SYSTEMS;

EID: 26944451289     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11503415_8     Document Type: Conference Paper

References (24)

1. M. F. Balcan, A. Blum, and K. Yang. Co-training and expansion: Towards bridging theory and practice. In NIPS, 2004.
2. G.M. Benedek and A. Itai. Learnability with respect to a fixed distribution. Theoretical Computer Science, 86:377-389, 1991.
3. A. Blum and S. Chawla. Learning from labeled and unlabeled data using graph mincuts. In Proc. ICML, pages 19-26, 2001.
4. A. Blum, A. Frieze, R. Kannan, and S. Vempala. A polynomial-time algorithm for learning noisy linear threshold functions. Algorithmica, 22:35-52, 1998.
5. A. Blum and T. M. Mitchell. Combining labeled and unlabeled data with co-training. In Proc. 11th Annual Conf. Computational Learning Theory, pages 92-100, 1998.
6. A. Blumer, A. Ehrenfeucht, D. Haussler, and M. K. Warmuth. Learnability and the Vapnik Chervonenkis dimension. Journal of the ACM, 36(4):929-965, 1989.
7. S. Boucheron, O. Bousquet, and G. Lugosi. Theory of classification: a survey of recent advances. Manuscript, 2004.
8. S. Boucheron, G. Lugosi, and P. Massart. A sharp concentration inequality with applications. Random Structures and Algorithms, 16:277-292, 2000.
9. V. Castelli and T.M. Cover. On the exponential value of labeled samples. Pattern Recognition Letters, 16:105-111, 1995.
10. V. Castelli and T.M. Cover. The relative value of labeled and unlabeled samples in pattern recognition with an unknown mixing parameter. IEEE Transactions on Information Theory, 42(6):2102-2117, 1996.
11. L. Devroye, L. Gyorfi, and G. Lugosi. A Probabilistic Theory of Pattern Recognition. Springer-Verlag, 1996.
12. J. Dunagan and S. Vempala. Optimal outlier removal in high-dimensional spaces. In Proceedings of the 33rd ACM Symposium on Theory of Computing, 2001.
13. A. Ehrenfeucht, D. Haussler, M. Kearns, and L. Valiant. A general lower bound on the number of examples needed for learning. Inf. and Comput, 82:246-261, 1989.
14. A. Flaxman. Personal communication, 2003.
15. R. Hwa, M. Osborne, A. Sarkar, and M. Steedman. Corrected co-training for statistical parsers. In ICML-03 Workshop on the Continuum from Labeled to Unlabeled Data in Machine Learning and Data Mining, Washington D.C., 2003.
16. T. Joachims. Transductive inference for text classification using support vector machines. In Proc. ICML, pages 200-209, 1999.
17. A. Levin, P. Viola, and Y. Freund. Unsupervised improvement of visual detectors using co-training. In Proc. 9th Int. Conf. Computer Vision, pages 626-633, 2003.
18. K. Nigam, A. McCallum, S. Thrun, and T.M. Mitchell. Text classification from labeled and unlabeled documents using EM. Mach. Learning, 39(2/3):103-134, 2000.
19. S.-B. Park and B.-T. Zhang. Co-trained support vector machines for large scale unstructured document classification using unlabeled data and syntactic information. Information Processing and Management, 40(3):421-439, 2004.
20. J. Shawe-Taylor, P. L. Bartlett, R. C. Williamson, and M. Anthony. Structural risk minimization over data-dependent hierarchies. IEEE Transactions on Information Theory, 44(5): 1926-1940, 1998.
21. L.G. Valiant. A theory of the learnable. Commun. ACM, 27(11):1134-1142, 1984.
22. V. N. Vapnik. Statistical Learning Theory. John Wiley and Sons Inc., 1998.
23. D. Yarowsky. Unsupervised word sense disambiguation rivaling supervised methods. In Meeting of the Association for Computational Linguistics, pages 189-196, 1995.
24. X. Zhu, Z. Ghahramani, and J. Lafferty. Semi-supervised learning using gaussian fields and harmonic functions. In Proc. ICML, pages 912-912, 2003.