Improved generalization through explicit optimization of margins

Machine Learning

Volumn 38, Issue 3, 2000, Pages 243-255

  Mason, Llew ^a   Bartlett, Peter L ^a   Baxter, Jonathan ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

COSTS; DATA STRUCTURES; DATABASE SYSTEMS; DECISION THEORY; FUNCTIONS; LEARNING ALGORITHMS; NEURAL NETWORKS; OPTIMIZATION; THEOREM PROVING;

BOOSTING METHODS; MARGINS ANALYSIS; VOTING METHODS;

LEARNING SYSTEMS;

EID: 0033870982     PISSN: 08856125     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1007697429651     Document Type: Article

References (8)

1. Bartlett, P. L. (1998). The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Transactions on Information Theory, 44(2), 525-536.
2. Blake, C., Keogh, E., & Merz, C. J. (1998). UCI repository of machine learning databases. http://www.ics.uci.edu/~mlearn/MLRepository.html.
3. Breiman, L. (1997). Prediction games and arcing algorithms. Technical Report 504, Department of Statistics, University of California, Berkeley.
4. Frean, M. & Downs, T. (1998). A simple cost function for boosting. Technical Report, Department of Computer Science and Electrical Engineering, University of Queensland.
5. Freund, Y. & Schapire, R. E. (1997). A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1), 119-139.
6. Grove, A. & Schuurmans, D. (1998). Boosting in the limit: maximizing the margin of learned ensembles. Proceedings of the Fifteenth National Conference on Artificial Intelligence (pp. 692-699).
7. Mason, L., Baxter, J., Bartlett, P. L., & Frean, M. (to appear). Functional gradient techniques for combining hypotheses. In: A. J. Smola, P. Bartlett, B. Schölkopf, & C. Schuurmans (Eds.), Advances in large margin classifiers. Cambridge, MA: MIT Press.
8. Schapire, R. E., Freund, Y., Bartlett, P. L., & Lee, W. S. (1998). Boosting the margin : a new explanation for the effectiveness of voting methods. Annals of Statistics, 26(5), 1651-1686.