Robust boosting and its relation to bagging

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2005, Pages 249-255

  Rosset, Saharon ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Bagging; Boosting; Robust Fitting

Indexed keywords

BAGGING; BOOSTING; FUNCTION SPACE; ROBUST FITTING;

FUNCTIONS; ITERATIVE METHODS; LINEAR EQUATIONS;

KNOWLEDGE BASED SYSTEMS;

EID: 32344442047     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1081870.1081900     Document Type: Conference Paper

References (20)

1. E. Bauer and R. Kohavi. An empirical comparison of voting classification algorithms: bagging, boosting and variants. Machine Learning, 36(1/2):105-139, 1999.
2. C. Blake and C. Merz. Repository of machine learning databases. [http://www.ics.uci.edu/ mlearn/MLRepository.html]. Irvine, CA: University of California, Department of Information and Computer Science., 1998.
3. L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996.
4. L. Breiman. Arcing classifiers. Annals of Statistics, 26(3):801:849, 1998.
5. P. Buhlmann and B. Yu. Analyzing bagging. Annals of Statistics, 2003.
6. C. Domingo and O. Watanabe. Madaboost: A modification of adaboost. In 13th Annual Conference on Comp. Learning Theory, 2000.
7. N. Duffy and D. Helmbold. Potential boosters? In Advance in Neural Information Processing, 1999.
8. Y. Freund and R. Scahpire. Experiments with a new boosting algorithm. In International Conference on Machine Learning, 1996.
9. Y. Freund and R. Schapire. A decision-theoretic generalization of on-line learning and an application to boosting. In European Conference on Computational Learning Theory, pages 23-37, 1995.
10. J. Friedman. Greedy function approximation: A gradient boosting machine. Annals of Statistics, 29(5), 2001.
11. J. Friedman, T. Hastie, and R. Tibshirani. Additive logistic regression: a statistical view of boosting. Annals of Statistics, 28:337-407, 2000.
12. J. H. Friedman and P. Hall. On bagging and nonlinear estimation, preprint, 2000.
13. T. Hastie, T. Tibshirani, and J. Friedman. Elements of Statistical Learning. Springer-Verlag, New York, 2001.
14. P. Huber. Robust estimation of a location parameter. Annals of Mathematical Statistics, 35(1):73:101, 1964.
15. Y. LeCun, B. Boser, J. Denker, D. Henderson, R. Howard, W. Hubbard, and L. Jackel. Handwritten digit recognition with a back-propagation network. In Advances in Neural Information Processing Systems 2, 1990.
16. L. Mason, J. Baxter, P. Bartlett, and M. Frean. Boosting algorithms as gradient descent. In Neural Information Processing Systems, volume 12, 1999.
17. S. Rosset and E. Segal. Boosting density estimation. In Advances in Neural Information Processing Systems 15, 2003.
18. S. Rosset, J. Zhu, and T. Hastie. Boosting as a regularized path to a maximum margin classifier. Journal of Machine Learning Research, 5, 2004.
19. S. Rosset, J. Zhu, and T. Hastie. Margin maximizing loss functions. In Advances in Neural Information Processing Systems 16, 2004.
20. R. E. Schapire, Y. Freund, P. Bartlett, and W. Lee. Boosting the margin: a new explanation for the effectiveness of voting methods. Annals of Statistics, 26:1651-1686, 1998.