Improved Boosting algorithm with adaptive filtration

Proceedings of the World Congress on Intelligent Control and Automation (WCICA)

Volumn , Issue , 2010, Pages 3173-3178

  Gao, Yunlong ^a   Gao, Feng ^a   Guan, Xiaohong ^a  

^a XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

AdaBoost; Filter; Overfitting; Variable loss function

Indexed keywords

ADABOOST; BASE CLASSIFIERS; BOOSTING ALGORITHM; CLASSIFICATION ACCURACY; DATA SETS; FILTER; FILTERING ALGORITHM; HOEFFDING INEQUALITY; LOSS FUNCTIONS; NOISE FREE CASE; OVERFITTING; VARIABLE LOSS FUNCTION;

ADAPTIVE ALGORITHMS; CLASSIFICATION (OF INFORMATION); INTELLIGENT CONTROL; SIGNAL FILTERING AND PREDICTION;

ADAPTIVE BOOSTING;

EID: 77958123748     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WCICA.2010.5553968     Document Type: Conference Paper

References (26)

1. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to Boosting," Journal of Computer and System Sciences, vol. 55, no. 1, pp. 119-139, December, 1997.
2. R. E. Schapire, "Theoretical views of Boosting," in: Proc. of 4th EuroCOLT'99, Nordkirchen, Germany, pp. 1-10, 1999.
3. R. E. Schapire and Y. Singer, "Improved Boosting algorithms using confidence-rated predictions," in: Proc. of 11th Annual Conference on Computational Learning Theory, Wisconsin, pp. 80-91, 1998.
4. H. Drucker, C. Cortes, L. C. Jackl, Y. LeCun and V. Vapnik, "Boosting and other ensemble methods," Neural Computation, vol. 6, pp. 1289-1301, November 1994.
5. R. E. Schapire, Y. Freund, P. L. Bartlett, W. S. Lee, "Boosting the margin: A new explanation for the effectiveness of voting methods," The Annals of Statistics, vol. 26, pp. 1651-1686, May 1998.
6. H. H. Bauschke and J. M. Borwein, "Legendre functions and the method of random Bregman projections," Journal of Convex Analysis. vol. 4, no. 1, pp. 27-67, 1997.
7. S. Abney, R. E. Schapire and Y. Singer, "Boosting applied to tagging and pp attachment," In Proc. of the joint SIGDAT conference on Empirical Mthods in Natural Language Processing and Very Large Corpora, University of Maryland, USA, pp. 38-45, June 1999.
8. J. R. Quinlan, "Boosting first-order learning," Lecture Notes in Computer Science, Vol. 1160, pp. 143-155, 1996.
9. G. Rätsch, "Ensemble learning methods for classification," Master's thesis, Dep. of Computer Science, University of Potsdam, German, 1998.
10. L. Breiman, "Prediction games and arcing algorithms," Neural Computation. vol. 11, pp. 1493-1518, October 1999.
11. G. Rätsch, T. Onoda and K. Muller, "Soft margins for AdaBoost," Machine learning, vol. 42, pp. 287-320, March 2001.
12. Y. Freund, "An adaptive version of the boost by majority algorithm," Machine Learning, vol. 43, pp. 293-318, June 2001.
13. R. A. Servedio, "Smooth Boosting and learning with malicious noise," The Journal of Machine Learning Research, vol 4, pp. 633-648 December 2003.
14. R. Meir and G. Rätsch, "An introduction to Boosting and leveraging," Advanced lectures on machine learning, pp. 118-183, 2003.
15. Rong Jin, Yan Liu, Luo Si, Jaime Carbonell and Alexander G. Hauptmann, "A New Boosting Algorithm Using Input-Dependent Regularizer," 20th International Conference on Machine Learning (ICML'03), Washington, DC, pp. 21-24, August 2003.
16. Masayuki Nakamura, Hiroki Nomiya and Kuniaki Uehara, "Improvement of Boosting algorithm by modifying the reweighting rule," Annals of Mathematics and Artificial Intelligence, vol. 41, pp. 95-109, May 2004.
17. Alexander Vezhnevets, Olga Barinova, "Avoiding Boosting Overfitting by Removing Confusing shamples," ECML2007, Poland, September, pp. 430-441, 2007.
18. Nades H. Bshouty and Dmitry Gavinsky, "On Boosting with Polynomially Bounded Distributions," Journal of Machine Learning Research, Volume 3, pp. 483-506, March 2003.
19. L. Breiman, "Arcing classifiers," Annals of Statistics, vol. 26, pp. 801-824, Junuary 1998.
20. Domingo, C., Watanabe, O. "MAdaBoost: A modication of AdaBoost," In: 13th Annual Conference on Comp. Learning Theory, California, USA, pp. 180-189, July 2000.
21. Nikunj C. Oza, "Boosting with Averaged Weight Vectors," Lecture Notes in Computer Science, Volume 2709, pp. 159-169, 2003.
22. Nikunj C. Oza, "AveBoost2: Boosting for Noisy Data," Lecture Notes in Computer Science, Volume 3077, pp. 31-40, 2004.
23. Mason, L., Baxter, J., Bartlett, P. and Frean, M. "Boosting algorithms as gradient descent," In: Neural Information Processing Systems Vol. 125, pp. 12-518, 2000.
24. Takafumi Kanamori, PTakashi Takenouchi, PShinto Eguchi, PNoboru, "Robust Loss Functions for Boosting," Neural Computation, vol. 19, pp. 2183-2244, August 2007.
25. Mason L, Bartlett P.L., Baxter J, "Improved Generalization Through Explicit Optimization of Margins," Machine Learning, vol 38, pp. 243-255, March 2000.
26. J. Friedman, T. Hastie, and R.J. Tibshirani, "Additive logistic regression: a sttistical view of Boosting," Annals of Statistics, vol 28, No. 2, pp. 337-407, 2000.