A study of AdaBoost with SVM based weak learners

Proceedings of the International Joint Conference on Neural Networks

Volumn 1, Issue , 2005, Pages 196-201

  Li, Xuchun ^a   Wang, Lei ^a   Sung, Eric ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

DATABASE SYSTEMS; LEARNING ALGORITHMS; MATHEMATICAL MODELS; PERFORMANCE; PROBLEM SOLVING;

DABOOSTSVM; GENERALIZATION PERFORMANCE; MODEL SELECTION; SVM BASED WEAK LEARNERS;

LEARNING SYSTEMS;

EID: 33745937896     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2005.1555829     Document Type: Conference Paper

References (20)

1. Robert E. schapire, "The boosting approach to machine learning: An overview," In MSRI Workshop on Nonlinear Estimation and Classification, 2002.
2. Leo Breiman, "Bagging predictors," Machine Learning, vol. 24, pp. 123-140, 1996.
3. Eric Bauer and Ron Kohavi, "An empirical comparison of voting classification algorithms: Bagging, boosting, and variants," Machine Learning, vol. 36, no. 1, pp. 105-139, Jul 1999.
4. Yoav Freund and Robert E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of Computer and System Sciences, vol. 55(1), pp. 119-139, August 1997.
5. R. E. Schapire, Y. Singer, P. Bartlett, and W. Lee, "Boosting the margin: A new explanation for the effectiveness of voting methods," The Annals of Statistics, vol. 26, no. 5, pp. 1651-1686, 1998.
6. Thomas G. Dietterich, "An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization," Machine Learning, vol. 40, no. 2, pp. 139-157, Aug 2000.
7. Holger Schwenk and Yoshua Bengio, "Boosting neural networks," Nueral Computation, vol. 12, pp. 1869-1887, 2000.
8. Gunnar Ratsch, "Soft margins for adaboost," Machine Learning, vol. 42, no. 3, pp. 287-320, Mar 2001.
9. Prem Melville and Raymond J. Mooney, "Creating diversity in ensembles using artificial data," Information Fusion, vol. 6, no. 1, pp. 99-111, Mar 2005.
10. Ludmila I. Kuncheva and Christopher J. Whitaker, "Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy," Machine Learning, vol. 51, no. 2, pp. 181-207, May 2003.
11. Wenxin Jiang. "Process consistency for adaboost," Annals of Statistics, vol. 32, no. 1, pp. 13-29, 2004.
12. Vladimir Vapnik, Statistical Learning Theory. John Wiley and Sons Inc., New York, 1998.
13. Bernhard Scholkopf, Kah-Kay Sung, Chris Burges, Federico Girosi, Partha Niyogi, Tomaso Poggio. and Vladimir Vapnik, "Comparing support vector machines with gaussian kernels to radial basis function classifiers," IEEE Transactions on Signal Processing, vol. 45, no. 11, pp. 2758-2765, 1997.
14. Giorgio Valentini and Thomas G. Dietterich, "Bias-variance analysis of support vector machines for the development of svm-based ensemble methods," Journal of Machine Learning Research, vol. 5, pp. 725-775, Jul 2004.
15. Robert E. Schapire and Yoram Singer, "Improved boosting algorithms using confidence-rated predictions," Machine Learning, vol. 37, no. 3, pp. 297-336, Dec 1999.
16. H.W.Shin and S.Y.Sohn, "Selected tree classifier combination based on both accuracy and error diversity," Pattern Recognition, vol. 38, pp. 191-197, 2005.
17. Sanjoy Dasgupta and Philip M. Long, "Boosting with diverse base classifiers," in Proceeding of the 16th Annual Conference on Learning Theory, Aug 2003, pp. 273-287.
18. http://mlg.anu.edu.au/~raetsch/data.
19. Rong Yan, Yan Liu, Rong Jin, and Alex Hauptmann, "On predicting rare class with svm ensemble in scene classification," in Proceeding of the IEEE International Conference on Acoustics. Speech, and Signal 2003, Apr 2003, pp. III - 21-4.
20. Hyun-Chul Kim, Shaoning Pang, Hong-Mo Je, Daijin Kim, and Sung Yang Bang, "Constructing support vector machine ensemble," Pattern Recognition, vol. 36, no. 12, pp. 2757-2767, Dec 2003.