PAC-bayes risk bounds for sample-compressed gibbs classifiers

ICML 2005 - Proceedings of the 22nd International Conference on Machine Learning

Volumn , Issue , 2005, Pages 481-488

  Laviolette, François ^a   Marchand, Mario ^a  

^a UNIVERSITÉ LAVAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DATA REDUCTION; INFORMATION USE; SET THEORY; THEOREM PROVING;

COMPRESSION SET; GIBBS CLASSIFIER; PAC-BAYES THEOREM;

LEARNING SYSTEMS;

EID: 31844447906     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1102351.1102412     Document Type: Conference Paper

References (13)

1. Cover, T. M., & Thomas, J. A. (1991). Elements of information theory, chapter 12. Wiley.
2. Floyd, S., & Warmuth, M. (1995). Sample compression, leainability, and the Vapnik-Chervonenkis dimension. Machine Learning, 21, 269-304.
3. Graepel, T., Herbrich, R., & Shawe-Taylor, J. (2000). Generalisation error bounds for sparse linear classifiers. Proceedings of the Thirteenth Annual Conference on Computational Learning Theory (pp. 298-303).
4. Graepel, T., Herbrich, R., & Williamson, R. C. (2001). From margin to sparsity. Advances in neural information processing systems (pp. 210-216).
5. Langford, J. (2005). Tutorial on practical prediction theory for classification. Journal of Machine Learning Reasearch, 6, 273-306.
6. Langford, J., & Shawe-Taylor, J. (2003). PAC-Bayes & margins. In S. T. S. Becker and K. Obermayer (Eds.), Advances in neural information processing systems 15, 423-430. Cambridge, MA: MIT Press.
7. Littlestone, N., & Warmuth, M. (1986). Relating data compression and learnability (Technical Report). University of California Santa Cruz, Santa Cruz, CA.
8. Marchand, M., & Shawe-Taylor, J. (2002). The set covering machine. Journal of Machine Learning Reasearch, 3, 723-746.
9. McAllester, D. (1999). Some PAC-Bayesian theorems. Machine Learning, 37, 355-363.
10. McAllester, D. (2003a). PAC-Bayesian stochastic model selection. Machine Learning, 51, 5-21.
11. A priliminary version appeared in proceedings of COLT'99.
12. McAllester, D. (2003b). Simplified PAC-Bayesian margin bounds. Proceedings of the 16th Annual Conference on Learning Theory, Lecture Notes in Artificial Intelligence, 2777, 203-215.
13. Seeger, M. (2002). PAC-Bayesian generalization bounds for gaussian processes. Journal of Machine Learning Research, 3, 233-269.