Negative correlation learning for classification ensembles

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2010, Pages

  Wang, Shuo ^a   Chen, Huanhuan ^b   Yao, Xin ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b UNIVERSITY OF LEEDS   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

PROBLEM SOLVING;

AMBIGUITY DECOMPOSITION; BENCHMARK DATA; CLASSIFICATION ENSEMBLES; COMPUTATION TIME; DATA SET; ERROR-FUNCTION; MULTICLASS PROBLEM; NEGATIVE CORRELATION LEARNING; PERFORMANCE;

ADAPTIVE BOOSTING;

EID: 79959396934     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2010.5596702     Document Type: Conference Paper

References (34)

1. Y. Liu and X. Yao, "Simultaneous training of negatively correlated neural networks in an ensemble," IEEE Transactions on Systems, Man and Cybernetics, PartB: Cybernetics, vol. 29, no. 6, pp. 716-725, 1999.
2. Z. S. H. Chan and N. Kasabov, "A preliminary study on negative correlation learning via correlation-corrected data," Neural Processing Letters, vol. 21, no. 3, pp. 207-214, 2005.
3. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation, and active learning," in Advances in Neural Information Processing Systems, vol. 7, 1995, pp. 231-238.
4. M. P. Perrone and L. N. Cooper, "When networks disagree: Ensemble methods for hybrid neural networks," Artificial Neural Networks for Speech and Vision, pp. 126-142, 1993.
5. N. Ueda and R. Nakano, "Generalization error of ensemble estimators," IEEE International Conference on Neural Networks, vol. 1, pp. 90-95, 1996.
6. L. Breiman, "Bagging predictors," Machine Learning, vol. 24, no. 2, pp. 123-140, 1996.
7. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," in Proc. of the 13th. Int. Conf. on Machine Learning, 1996, pp. 148-156.
8. G. Brown, J. L. Wyatt, and P. Tino, "Managing diversity in regression ensembles," Journal of Machine Learning Research, vol. 6, pp. 1621-1650, 2005.
9. H. Chen, "Diversity and regularization in neural network ensembles (chapter 3)," Ph.D. dissertation, School of Computer Science, University of Birmingham, 2008.
10. J. Quinlan, "Bagging, boosting, and c4.5," in The 1996 13th National Conference on Artificial Intelligence, AAAI 96, 1996, pp. 725-730.
11. D. Opitz and R. Maclin, "Popular ensemble methods: An empirical study," Journal of Artificial Intelligence Research, vol. 11, pp. 169-198, 1999.
12. Z. Zheng, "Multistrategy ensemble learning: Reducing error by combining ensemble learning techniques," IEEE Trans. on Knowl. and Data Eng., vol. 16, no. 8, pp. 980-991, 2004.
13. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of Computer and System Sciences, vol. 55, pp. 119-139, 1997.
14. C. A. Shipp and L. I. Kuncheva, "An investigation into how adaboost affects classier diversity," in IPMU, 2002, pp. 203-208.
15. D. H. Wolpert, "Stacked generalization," Neural Networks, vol. 5, no. 2, pp. 241 - 259, 1992.
16. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, "Adaptive mixtures of local experts," Neural Computation, vol. 3, no. 1, pp. 79-87, 1991.
17. J. Zhu, S. Rosset, H. Zou, and T. Hastie, "Multi-class adaboost," 2006.
18. J. Huang, S. Ertekin, Y. Song, H. Zha, and C. L. Giles, "Efficient multiclass boosting classification with active learning," in The 7th SIAM International Conference on Data Mining, 2007.
19. R. Jin and J. Zhang, "Multi-class learning by smoothed boosting," Machine Learning, vol. 67, no. 3, pp. 207-227, 2007.
20. N. V. Chawla, A. Lazarevic, L. O. Hall, and K. W. Bowyer, "Smote-boost: Improving prediction of the minority class in boosting," in Knowledge Discovery in Databases: PKDD 2003, vol. 2838/2003, 2003, pp. 107-119.
21. X.-Y. Liu, J. Wu, and Z.-H. Zhou, "Exploratory undersampling for class imbalance learning," IEEE Transactions on Systems, Man and Cybernetics, vol. 39, no. 2, pp. 539-550, 2009.
22. L. I. Kuncheva and C. J. Whitaker, "Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy," Machine Learning, vol. 51, pp. 181-207, 2003.
23. E. K. Tang, P. N. Suganthan, and X.Yao, "An analysis of diversity measures," Machine Learning, vol. 65, pp. 247-271, 2006.
24. L. Kuncheva, C. Whitaker, C. Shipp, and R. Duin, "Limits on the majority vote accuracy in classifier fusion," Pattern Analysis and Applications, vol. 6, no. 1, pp. 22-31, 2003.
25. G. Brown, J. Wyatt, R. Harris, and X. Yao, "Diversity creation methods: a survey and categorisation," Information Fusion, vol. 6, no. 1, pp. 5-20, 2004.
26. H. Chen and X. Yao, "Regularized negative correlation learning for neural network ensembles," IEEE Transactions on Neural Networks, vol. 20, no. 12, pp. 1962-1979, 2009.
27. -, "Multi-objective neural network ensembles based on regularized negative correlation learning," IEEE Transactions on Knowledge and Data Engineering, 2010.
28. L. Kuncheva and C. Whitaker, "Ten measures of diversity in classifier ensembles: limits for two classifiers," in A DERA/IEE Workshop on Intelligent Sensor Processing (Ref. No. 2001/050), 2001, pp. 1-10.
29. L. I. Kuncheva, "That elusive diversity in classifier ensembles," Pattern Recognition and Image Analysis, vol. 2652, pp. 1126-1138, 2003.
30. Y. Sun, M. S. Kamel, A. K. Wong, and Y. Wang, "Cost-sensitive boosting for classification of imbalanced data," Pattern Recognition, vol. 40, no. 12, pp. 3358-3378, 2007.
31. J. Friedman, T. Hastie, and R. Tibshirani, The elements of statistical learning: data mining, inference and prediction. Springer Verlag, 2001.
32. A. Asuncion and D. Newman, "UCI machine learning repository," 2007.
33. A. P. Bradley, "The use of the area under the roc curve in the evaluation of machine learning algorithms," Pattern Recognition, vol. 30, no. 7, pp. 1145-1159, 1997.
34. C. X. Ling, J. Huang, and H. Zhang, "Auc: a statistically consistent and more discriminating measure than accuracy," in In Proceedings of 18th International Conference on Artificial Intelligence (IJCAI2003), 2003, pp. 329-341.