An efficient modified boosting method for solving classification problems

Journal of Computational and Applied Mathematics

Volumn 214, Issue 2, 2008, Pages 381-392

  Zhang, Chun Xia ^a   Zhang, Jiang She ^a   Zhang, Gai Ying ^a  

^a XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

Adaboost; Classification noise; Ensemble classifier; Kappa error diagram; Weak learner

Indexed keywords

ADA (PROGRAMMING LANGUAGE); ALGORITHMS; CLASSIFICATION (OF INFORMATION); ERROR ANALYSIS; PROBABILITY;

ADABOOST; CLASSIFICATION NOISE; ENSEMBLE CLASSIFIER; KAPPA-ERROR DIAGRAM; WEAK LEARNER;

PROBLEM SOLVING;

EID: 39049086240     PISSN: 03770427     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cam.2007.03.003     Document Type: Article

References (27)

1. C.L. Blake, C.J. Merz, UCI repository of machine learning databases, 1998, available from: 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉.
2. Breiman L. Bagging predictors. Mach. Learn. 24 (1996) 123-140
3. Breiman L. Arcing classifiers. Ann. Statist. 26 (1998) 801-849
4. Breiman L., Friedman J., Olshen R., and Stone C. Classification and Regression Trees (1984), Chapman & Hall, New York
5. Chandra A., and Yao X. Evolving hybrid ensembles of learning machines for better generalisation. Neurocomputing 69 (2006) 686-700
6. Dietterich T. An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting and randomization. Mach. Learn. 40 (2000) 139-157
7. Fleiss J.L., Levin B., and Paik M.C. Statistical Methods for Rates and Proportions (1981), Wiley, New York
8. Freund Y. Boosting a weak learning algorithm by majority. Inform. and Comput. 121 (1995) 256-285
9. Freund Y., and Schapire R. Experiment with a new boosting algorithm. Proceedings of the 13th International Conference on Machine Learning (1996), Bari, Italy 148-156
10. Freund Y., and Schapire R. A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. System Sci. 55 (1997) 119-139
11. Friedman J. Greedy function approximation: a gradient boosting machine. Ann. Statist. 29 (2001) 1189-1232
12. Friedman J. Stochastic gradient boosting. Comput. Statist. Data Anal. 38 (2002) 367-378
13. Friedman J., Hastie T., and Tibshirani R. Additive logistic regression: a statistical view of boosting. Ann. Statist. 28 (2000) 337-407
14. Hansen L.K., and Salamon P. Neural network ensembles. IEEE Trans. Pattern Anal. Mach. Intell. 12 (1990) 993-1001
15. Kearns M.J., and Vazirani U.V. An Introduction to Computational Learning Theory (1994), MIT Press, Cambridge, MA
16. Maclin R., and Optiz D. An empirical evaluation of bagging and boosting. Proceedings of the 14th National Conference on Artificial Intelligence (1997), AAAI Press, Rhode Island 546-551
17. Margineantu D., and Dietterich T. Pruning adaptive boosting. Proceedings of the 14th International Conference on Machine Learning (1997), Morgan, Kaufmann 211-218
18. R. Meir, G. Rätsch, An introduction to boosting and leveraging, in: Lecturer Notes in Computer Science, vol. 2600, 2003, pp. 118-183.
19. Optiz D., and Maclin R. Popular ensemble methods: an empirical study. J. Artificial Intell. Res. 11 (1999) 169-198
20. Opitz D.W., and Shavlik J.W. Generating accurate and diverse members of a neural-network ensemble. Neural Inform. Proc. Sys. 8 (1996) 535-541
21. Rätsch G., Onoda T., and Müller K.R. Soft margins for Adaboost. Mach. Learn. 42 (2001) 287-320
22. Rodríguez J.J., Kuncheva L.I., and Alonso C.J. Rotation forest: a new classifier ensemble method. IEEE Trans. Pattern Anal. Mach. Intell. 28 (2006) 1619-1630
23. Schapire R.E. The strength of weak learnability. Mach. Learn. 5 (1990) 197-227
24. Schapire R.E., Freund Y., Bartlett P., and Lee W.S. Boosting the margin: a new explanation for the effectiveness of voting methods. Ann. Statist. 26 (1998) 1651-1686
25. Teghem J., Pirlot M., and Antoniadis C. Embedding of linear programming in a simulated annealing algorithm for solving a mixed integer production planning problem. J. Comput. Appl. Math. 64 (1995) 92-101
26. Tresp V. Committee machines. In: Hu Y.H., and Hwang J.-N. (Eds). Handbook for Neural Network Signal Processing (2001), CRC Press, Boca Raton
27. Webb G.I. Multiboosting: a technique for combining boosting and bagging. Mach. Learn. 40 (2000) 159-196