The effectiveness of a new negative correlation learning algorithm for classification ensembles

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2010, Pages 1013-1020

  Wang, Shuo ^a   Yao, Xin ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Classification; Diversity; Ensemble learning; Negative correlation learning

Indexed keywords

ADABOOST; BASE LEARNERS; BENCHMARK DATA; CLASSIFICATION; CLASSIFICATION PERFORMANCE; COMPUTATION COSTS; DIVERSITY; ENSEMBLE LEARNING; ERROR CORRELATION; EXPERIMENTAL ASPECTS; NEGATIVE CORRELATION LEARNING; PROBLEM DOMAIN; REAL WORLD DATA; TEST ERRORS; TRAINING EPOCHS; TRAINING ERRORS;

ADAPTIVE BOOSTING; ALGORITHMS; CLASSIFICATION (OF INFORMATION); CORRELATION METHODS;

DATA MINING;

EID: 79951730881     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDMW.2010.196     Document Type: Conference Paper

References (20)

1. Y. Liu and X. Yao, "Ensemble learning via negative correlation," Neural Networks, vol. 12, no. 10, pp. 1399-1404, 1999.
2. G. Brown, "Ensemble learning," Encyclopedia of Machine Learning, pp. 1-24, 2010.
3. S. Wang, H. Chen, and X. Yao, "Negative correlation learning for classification ensembles," in International Joint Conference on Neural Networks, WCCI, 2010, pp. 2893-2900.
4. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," in Proc. of the 13th. Int. Conf. on Machine Learning, 1996, pp. 148-156.
5. A. Asuncion and D. Newman. (2007) UCI machine learning repository. [Online]. Available: http://www.ics.uci.edu/∼mlearn/MLRepository.html.
6. H. Chen, "Diversity and regularization in neural network ensembles (chapter 3)," Ph.D. dissertation, School of Computer Science, University of Birmingham, 2008, Url: http://www.comp.leeds.ac.uk/scshc/.
7. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation, and active learning," in Advances in Neural Information Processing Systems, vol. 7, 1995, pp. 231-238.
8. J. Quinlan, "Bagging, boosting, and c4.5," in The 1996 13th National Conference on Artificial Intelligence, AAAI 96, 1996, pp. 725-730.
9. D. Opitz and R. Maclin, "Popular ensemble methods: An empirical study," Journal of Artificial Intelligence Research, vol. 11, pp. 169-198, 1999. (Pubitemid 129628763)
10. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of Computer and System Sciences, vol. 55, pp. 119- 139, 1997. (Pubitemid 127433398)
11. C. A. Shipp and L. I. Kuncheva, "An investigation into how adaboost affects classier diversity," in IPMU, 2002, pp. 203- 208.
12. R. E. Schapire, Y. Freund, P. Bartlett, and W. S. Lee, "Boosting the margin: A new explanation for the effectiveness of voting methods," The Annals of Statistics, vol. 26, no. 5, pp. 1651-1686, 1998. (Pubitemid 128376902)
13. R. E. Schapire, "The boosting approach to machine learning: An overview," in MSRI Workshop on Nonlinear Estimation and Classification, 2002, pp. 1-23.
14. L. Breiman, "Prediction games and arcing algorithms," Neural Computation, vol. 11, no. 7, 1999.
15. A. Murua, "Upper bounds for error rates of linear combinations of classifiers," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 591-602, 2002. (Pubitemid 34550428)
16. R. E. Schapire and Y. Singer, "Improved boosting algorithms using confidence-rated predictions," Machine Learning, vol. 37, no. 3, pp. 297-336, 1999. (Pubitemid 32210620)
17. Y. Sun, M. S. Kamel, A. K. Wong, and Y. Wang, "Costsensitive boosting for classification of imbalanced data," Pattern Recognition, vol. 40, no. 12, pp. 3358-3378, 2007. (Pubitemid 47223287)
18. R. Kohavi and D. H. Wolpert, "Bias plus variance decomposition for zero-one loss functions," Machine Learning: Proceedings of the Thirteenth International Conference, pp. 275-283, 1996.
19. L. I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms. Wiley Press, 2004.
20. K. M. Ali and M. J. Pazzani, "On the link between error correlation and error reduction in decision tree ensembles," 1995.