PAC-Bayes & Margins

NIPS 2002: Proceedings of the 15th International Conference on Neural Information Processing Systems

Volumn , Issue , 2002, Pages 423-430

  Langford, John ^a   Shawe Taylor, John ^b  

^a IBM RESEARCH   (United States)

^b UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ERRORS;

ERROR BOUND; ERROR RATES BOUND; LARGE MARGINS; MARGIN DISTRIBUTIONS; PAC-BAYES; SIMPLE++; STOCHASTICS; TRAINING ERROR RATE; TRUE ERROR; WEIGHTED SUM;

STOCHASTIC SYSTEMS;

EID: 85156230827     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. P. L. Bartlett, "The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network," IEEE Transactions on Information Theory, vol. 44, no. 2, pp. 525-536, 1998.
2. Thomas Cover and Joy Thomas, "Elements of Information Theory" Wiley, New York 1991.
3. Ralf Herbrich and Thore Graepel, A PAC-Bayesian Margin Bound for Linear Classifiers: Why SVMs work. In Advances in Neural Information Processing Systems 13, pages 224-230. 2001.
4. T. Jaakkola, M. Meila, T. Jebara, "Maximum Entropy D iscrimination\char" NIPS 1999.
5. John Langford and Rich Caruana, (Not) Bounding the True Error NIPS2001.
6. John Langford, Matthias Seeger, and Nimrod Megiddo, "An Improved Predictive Accuracy Bound for Averaging Classifiers" ICML2001.
7. John Langford and Matthias Seeger, "Bounds for Averaging Classifiers." CMU tech report, CMU-CS-01-102, 2001.
8. David McAllester, "PAC-Bayesian Model Averaging" COLT 1999.
9. Yoav Preund and Robert E. Schapire, "A Decision Theoretic Generalization of On-line Learning and an Application to Boosting" Eurocolt 1995.
10. Matthias Seeger, "PAC-Bayesian Generalization Error Bounds for Gaussian Processes", Tech Report, Division of Informatics report EDI-INF-RR-0094. http://www.dai.ed.ac.uk/homes/seeger/papers/gpmcall-tr.ps.gz
11. Robert E. Schapire, Yoav Preund, Peter Bartlett, and Wee Sun Lee, "Boosting the Margin: A new explanation for the effectiveness of voting methods" The Annals of Statistics, 26(5):1651-1686, 1998.
12. J. Shawe-Taylor, P. L. Bartlett, R. C. Williamson, and M. Anthony. Structural risk minimization over data-dependent hierarchies. IEEE Transactions on Information Theory, 44(5):1926-1940, 1998.