A weight-adjusted voting algorithm for ensembles of classifiers

Journal of the Korean Statistical Society

Volumn 40, Issue 4, 2011, Pages 437-449

  Kim, Hyunjoong ^a   Kim, Hyeuk ^b   Moon, Hojin ^c   Ahn, Hongshik ^b  

^a Yonsei University   (South Korea)

^b Stony Brook University   (United States)

^c CALIFORNIA STATE UNIVERSITY   (United States)

Author keywords

Aggregation; Bagging; Boosting; Classification; Cross validation; Ensemble; Primary; Random Forest; Secondary; Voting

Indexed keywords

EID: 82855178868     PISSN: 12263192     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jkss.2011.03.002     Document Type: Article

References (35)

1. Asuncion, A., & Newman, D. J. (2007). UCI machine learning repository. University of California. Irvine. School of Information and Computer Science. http://www.ics.uci.edu/~mlearn/MLRepository.html.
2. Bauer E., Kohavi R. An empirical comparison of voting classification algorithms: bagging, boosting, and variants. Machine Learning 1999, 36:105-139.
3. Breiman L. Bagging predictors. Machine Learning 1996, 24:123-140.
4. Breiman L. Arcing classifiers. The Annals of Statistics 1998, 26:801-824.
5. Breiman L. Random forests. Machine Learning 2001, 45:5-32.
6. Breiman L., Friedman J.H., Olshen R.A., Stone C.J. Classification and regression trees 1984, Chapman & Hall, New York.
7. Chandra A., Yao X. Evolving hybrid ensembles of learning machines for better generalisation. Neurocomputing 2006, 69:686-700.
8. Dietterich T.G. Ensemble methods in machine learning 2000, Springer, Berlin.
9. Freund Y., Schapire R. Experiments with a new boosting algorithm. Proceedings of the thirteenth international conference on machine learning 1996, 148-156. Morgan Kaufmann.
10. Friedman J., Hastie T., Tibshirani R. Additive logistic regression: a statistical view of boosting. The Annals of Statistics 2000, 28:337-407.
11. Geman S., Bienenstock E., Doursat R. Neural networks and the bias/variance dilemma. Neural Computation 1992, 4:1-48.
12. Hansen L.K., Salamon P. Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence 1990, 12:993-1001.
13. Hastie T., Tibshirani R., Friedman J. The elements of statistical learning: data mining, inference, and prediction 2001, Springer-Verlag, New York.
14. Heinz G., Peterson L.J., Johnson R.W., Kerk C.J. Exploring relationships in body dimensions. Journal of Statistics Education 2003, 11. http://www.amstat.org/~publications/jse/v11n2/datasets.heinz.html.
15. Ho T.K. The random subspace method for constructingdecision forests. IEEE Transactions of Pattern Analysis and Machine Intelligence 1998, 20:832-844.
16. Hothorn T., Lausen B. Double-bagging: combining classifiers by bootstrap aggregation. Pattern Recognition 2003, 36:1303-1309.
17. Hothorn T., Lausen B. Bundling classifiers by bagging trees. Computational Statistics & Data Analysis 2005, 49:1068-1078.
18. Kim H., Loh W.-Y. Classification trees with unbiased multiway splits. Journal of the American Statistical Association 2001, 96:589-604.
19. Kim H., Loh W.-Y. Classification trees with bivariate linear discriminant node models. Journal of Computational and Graphical Statistics 2003, 12:512-530.
20. Kohavi R., Wolpert D.H. Bias plus variance decomposition for zero-one loss functions. Proceedings of the thirteenth international conference on machine learning 1996, 275-283. Morgan Kaufmann.
21. Kong E.B., Dietterich T.G. Error-correcting output coding corrects bias and variance. Proceedings of the twelfthth international conference on machine learning 1995, 313-321. Morgan Kaufmann.
22. Kuncheva L. Diversity in multiple classifier systems. Information Fusion 2005, 6:3-4.
23. Lam L., Suen C.Y. Application of majority voting to pattern recognition: an analysis of its behavior and performancee. IEEE Transactions on Pattern Analysis and Machine Intelligence 1997, 27:553-568.
24. Loh W.-Y. Improving the precision of classification trees. The Annals of Applied Statistics 2009, 3:1710-1737.
25. Maslov I.V., Gertner I. Multi-sensor fusion: an evolutionary algorithm approach. Information Fusion 2006, 7:304-330.
26. Masnadi-Shirazi H., Vasconcelos N. Cost-sensitive boosting. IEEE Transactions on Pattern Analysis and Machine Intelligence 2011, 33:294-309.
27. Rahman A.F.R., Alam H., Fairhurst M.C. Multiple classifier combination for character recognition: revisiting the majority voting system and its variations. Lecture notes in computer science 2002, Vol. 2423:167-178.
28. Rodriguez J.J., Kuncheva L.I., Alonso C.J. Rotation forest: a new classifier ensemble method. IEEE Transactions on Pattern Analysis and Machine Intelligence 2006, 28:1619-1630.
29. Rokach L. Taxonomy for characterizing ensemble methods in classification tasks: a review and annotated bibliography. Computational Statistics and Data Analysis 2009, 53:4046-4072.
30. Schapire R.E. The strength of weak learnability. Machine Learning 1990, 5:197-227.
31. Statlib. 2010. Datasets archive. Carnegie Mellon University. Department of Statistics. http://lib.stat.cmu.edu.
32. Terhune J.M. Geographical variation of harp seal underwater vocalisations. Canadian Journal of Zoology 1994, 72:892-897.
33. Webb G.I. Multiboosting: a technique for combining boosting and wagging. Machine Learning 2000, 40:159-196.
34. Zhang C.X., Zhang J.S. A local boosting algorithm for solving classification problems. Computational Statistics and Data Analysis 2008, 52:1928-1941.
35. Zhu J., Zou H., Rosset S., Hastie T. Multi-class adaboost. Statistics and its Interface 2009, 2:349-360.