Monte Carlo theory as an explanation of bagging and boosting

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2003, Pages 499-504

  Esposito, Roberto ^a   Saitta, Lorenza ^b  

^a UNIVERSITY OF TURIN   (Italy)

^b UNIVERSITY OF EASTERN PIEDMONT   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ENSEMBLE LEARNING; MONTE CARLO ALGORITHMS; MONTE CARLO THEORY;

ARTIFICIAL INTELLIGENCE;

MONTE CARLO METHODS;

EID: 14344254249     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. E. Bauer and R. Kohavi. An empirical comparison of voting classification algorithms: Bagging, boosting, and variants. Machine Learning, 56:105-139.
2. G. Brassard and P. Bratley. Algorithmics: theory and practice. Prentice-Hall, Inc., 1988.
3. L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996. (Pubitemid 126724382)
4. L. Breiman. Arcing classifiers. The Annals of Statistics, 26(3):801-849, 1998. (Pubitemid 128450035)
5. M. Collins, R. Schapire, and Y. Singer. Logistic regression, adaboost and bregman distances. In Computational Learing Theory, pages 158-169,2000.
6. T. Diettcrich. Ensemble methods in machine learning. Lecture Notes in Computer Science, 1857:1-15,2000.
7. Drucker and Cortes, Boosting decision trees. In David S. Touretzky, Michael C. Mozer, and Michael E. Hasselmo (Eds.), Advances in Neural Information Processing Systems, Vol. 8, (pp. 479-485), The MIT Press, 1996.
8. B. Efron and R. Tibshirani. An introduction to the Bootstrap. Chapman and Hall, 1993.
9. R. Esposito. Analyzing Ensemble Learning in the Framework of Monte Carlo Theory. Ph.D. Thesis, University of Torino, Dept. of Informatica, Italy.
10. Y. Freund. Boosting a weak learning algorithm by majority. Information and Computation, 2(121):256-2%5, 1995.
11. Y. Freund and R. Schapire, A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1):119-139, 1997.*(Pubitemid 127433398)
12. Y. Freund and R. Schapire. Discussion of the paper "arcing classifiers" by Leo Breiman. The Annals of Statistics, 26(3):824-832, 1998.
13. J. Friedman, T. Hastic, and R. Tibshirani. Additive logistic regression: a statistical view of boosting. Technical report, Department of Statistics, Sequoia Hall, Stanford Univerity, July 1998.
14. R. Quinlan. Bagging, boosting, and C4.5. In Proceedings of the Thirteenth National Conference on Artificial Intelligence and the Eighth Innovative Applications of Artificial Intelligence Conference, pages 725-730, 1996. AAAI Press / MIT Press
15. G. Ratsch, M. Warmuth, S. Mika, T. Onoda, S. Lemm-and K. Muller. Barrier boosting. In 13th Conference on Computational Learning Theory, 2000.
16. R. Schapire. Drifting games. Machine Learning 43(3): 265-291,2001. (Pubitemid 32471835)
17. R. Schapire, Y. Freund, P. Bartlett, and W. Lee. Boosting the margin: A new explanation for the effectiveness of voting methods. Annals of Statistic, 26(5): 1651-1686, 1998. (Pubitemid 128376902)
18. D. Wolpert. Stacked Generalization, Neural Networks, 5, 241-259, 1992.