Reducing overfitting of adaboost by clustering-based pruning of hard examples

Proceedings of the 7th International Conference on Ubiquitous Information Management and Communication, ICUIMC 2013

Volumn , Issue , 2013, Pages

  Kim, Dae Sun ^a   Baek, Yeul Min ^a   Kim, Whoi Yul ^a  

^a Hanyang University   (South Korea)

Author keywords

Adaboost; Clustering; Hard to learn samples; Overfitting

Indexed keywords

ADABOOST ALGORITHM; BASE CLASSIFIERS; CLUSTERING; HARD-TO-LEARN SAMPLES; K-MEANS CLUSTERING; OVER FITTING PROBLEM; OVERFITTING;

COMMUNICATION; INFORMATION MANAGEMENT;

ADAPTIVE BOOSTING;

EID: 84875846159     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2448556.2448646     Document Type: Conference Paper

References (13)

1. Freund, Y. and Schapire, R. E. 1997. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55, 1 (Mar. 1997), 119-139.
2. Schapire, R. E. 1999. Improved boosting algorithms using confidence-rated predictions. Journal of Machine Learning, 37, 3 (Dec. 1999), 297-336.
3. Drucker, H., Cortes, C., Jackel, L. D., LeCun, Y. and Vapnik, V. 1994. Boosting and other ensemble methods. Journal of Neural Computation, 6, 6 (Nov. 1994), 1289-1301.
4. Jiang, W. 2000. Does boosting overfit: views from an exact solution. Technical Report. Department of Statistics, Northwestern University.
5. Ratsch, G., Onoda, T. and Muller, K. R. 2001, Soft margins for AdaBoost. Journal of Machine Learning, 42, 3 (Mar. 2001), 287-320.
6. Dietterich, T. G. 2000. An experimental comparison of three methods for constructing ensembles of decision trees : bagging, boosting, and randomization. Journal of Machine Learning, 40, 2 (Aug. 2000), 139-157.
7. Martinez, G. Sanchez-Martinez, A. Hernandez-Lobato, D. and Suarez, A. 2008. Class-switching neural network ensembles. Journal of Neurocomputing. 71, (Aug. 2008), 2521-2528.
8. Gao, Y. and Gao, F. 2010. Edited adaBoost by weighted kNN. Neurocomputing, 73, 16-18 (October, 2010), 3079- 3088.
9. Cao, J., Kwong, S. and Wang, R. 2012. A noise-detection based AdaBoost algorithm for mislabeled data. Pattern Recognition, 45, 12 (December, 2012), 4451-4465.
10. Vezhnevets, A. and Barinova, O. 2007. Avoiding boosting overfitting by removing confusing samples. In Proceedings of the 18th European Conference on Machine Learning (The Warsaw, The Poland, September 17 - 21, 2007). 430-441.
11. MacQueen, J. B. 1967. Some methods for classification and analysis of multivariate observations. In Proceedings of the fifth Berkeley Symposium on Mathematical Statistics and Probability (The California, The USA, June 21-July 18, 1965 and December 27, 1965-January 7, 1966). 281-297.
12. Mahalanobis, P. C. 1936. On the generalized distance in statistics. In Proceedings of the National Institute of Sciences (The India, April 16, 1936). 49-55.
13. Blake, C. L. and Merz, C. J. 1998. UCI repository of machine learning databases.