Unifying the error-correcting and output-code AdaBoost within the margin framework

ICML 2005 - Proceedings of the 22nd International Conference on Machine Learning

Volumn , Issue , 2005, Pages 873-880

  Sun, Yijun ^a,b   Todorovic, Sinisa ^b   Li, Jian ^b   Wu, Bapeng ^b  

^a UNIVERSITY OF FLORIDA   (United States)

^b University of Florida   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COSTS; DATABASE SYSTEMS; OPTIMIZATION;

COST FUNCTION; ERROR-CORRECTING; FUNCTIONAL GRADIENT;

ERROR ANALYSIS;

EID: 31844448666     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Allwein, E. L., Schapire, R. E., & Singer, Y. (2000). Reducing multiclass to binary: A unifying approach for margin classifiers. J. Machine Learning Research, 1, 113-141.
2. Blake, C., & Merz, C. (1998). UCI repository of machine learning databases.
3. Breiman, L. (1999). Prediction games and arcing algorithms. Neural Computation, 11, 1493-1517.
4. Crammer, K., & Singer, Y. (2000). On the learnability and design of output codes for multiclass problems. Computational Learing Theory (pp. 35-46).
5. Dietterich, T. G. (2000). An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization. Machine Learning, 40, 139-157.
6. Dietterich, T. G., & Bakiri, G. (1995). Solving multiclass learning problems via error-correcting output codes. J. Artificial Intelligence Research, 2, 263-286.
7. Friedman, J. (2001). Greedy function approximation: a gradient boosting machine. The Annals of Statistics, 29, 1189-1232.
8. Friedman, J., Hastie, T., & Tibshirani, R. (2000). Additive logistic regression: a statistical view of boosting. The Annals of Statistics, 28, 337-407.
9. Grove, A. J., & Schuurmans, D. (1998). Boosting in the limit: maximizing the margin of learned ensembles. Proc. 15th Nat'1 Conf. on Artificial Intelligence (pp. 692-699). Madison, WI.
10. Guruswami, V., & Sahai, A. (1999). Multiclass learning, boosting, and error-correcting codes. Proc. 12th Annual Conf. Computational Learning Theory (pp. 145-155). Santa Cruz, California.
11. Mason, L., Bartlett, J., Baxter, P., & Frean, M. (2000). Functional gradient techniques for combining hypotheses. In B. Scholkopf, A. Smola, P. Bartlett and D. Schuurmans (Eds.), Advances in Large Margin Classifiers, 221-247. MIT Press.
12. Quinlan, J. R. (1993). C4.5: Programs for Machine Learning. Morgan Kaufmann.
13. Rudin, C., Daubechies, I., & Schapire, R. E. (2004). The dynamics of adaboost: Cyclic behavior and convergence of margins. Journal of Machine Learning Research, 5, 1557-1595.
14. Schapire, R. E. (1997). Using output codes to boost multiclass learning problems. Proc. 14th Int'l Conf. Machine Learning (pp. 313-321). Nashville, TN, USA.
15. Schapire, R. E., Freund, Y., Bartlett, P., & Lee, W. S. (1998). Boosting the margin: a new explanation for the effectiveness of voting methods. The Annals of Statistics, 26, 1651-1686.