Some new bounds on the generalization error of combined classifiers

Advances in Neural Information Processing Systems

Volumn , Issue , 2001, Pages

  Koltchinskii, Vladimir ^a   Panchenko, Dmitriy ^a   Lozano, Fernando ^b  

^a UNIVERSITY OF NEW MEXICO   (United States)

^b University of New Mexico   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMBINED CLASSIFIERS; EMPIRICAL PROCESS; FUNCTIONAL CLASS; GAUSSIAN COMPLEXITY; GAUSSIANS; GENERALIZATION ERROR; MARGIN DISTRIBUTIONS;

EID: 0006505290     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. Bartlett, P. (1998) The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network. IEEE Transactions on Information Theory, 44, 525-536.
2. Breiman, L. (1996). Bagging Predictors. Machine Learning, 26(2), 123-140.
3. Freund Y. (1995) Boosting a weak learning algorithm by majority. Information and Computation, 121, 2, 256-285.
4. Freund Y. and Schapire, R.E. (1997) A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1), 119-139.
5. Koltchinskii, V. and Panchenko, D. (2000) Empirical margin distributions and bounding the generalization error of combined classifiers, preprint.
6. Mason, L., Bartlett, P. and Baxter, J. (1999) Improved Generalization through Explicit Optimization of Margins. Machine Learning, 0, 1-11.
7. Mason, L., Baxter, J., Bartlett, P. and Frean, M. (1999) Functional Gradient Techniques for Combining Hypotheses. In: Advances in Large Margin Classifiers. Smola, Bartlett, Scholkopf and Schnurmans (Eds), to appear.
8. Schapire, R., Freund, Y, Bartlett, P. and Lee, W. S. (1998) Boosting the Margin: A New Explanation of Effectiveness of Voting Methods. Ann. Statist., 26, 1651-1687.
9. Shawe-Taylor, J. and Cristianini, N. (1999) Margin Distribution Bounds on Generalization. In: Lecture Notes in Artificial Intelligence, 1572. Computational Learning Theory, 4th European Conference, EuroCOLT'99, 263-273.
10. Shawe-Taylor, J. and Cristianini, N. (1999) Further Results on the Margin Distribution. Proc. of COLT'99, 278-285.
11. van der Vaart, A. and Wellner, J. (1996) Weak convergence and Empirical Processes. With Applications to Statistics. Springer-Verlag, New York.