Neural network ensemble construction fusing multiple popular methods

IAENG International Journal of Computer Science

Volumn 37, Issue 4, 2010, Pages

  Akhand, M A H ^a   Murase, K ^b  

^a KHULNA UNIVERSITY OF ENGINEERING AND TECHNOLOGY   (Bangladesh)

^b UNIVERSITY OF FUKUI   (Japan)

Author keywords

Diversity; Generalization ability; Network selection; Neural network ensemble

Indexed keywords

EID: 78649970955     PISSN: 1819656X     EISSN: 18199224     Source Type: Journal    
DOI: None     Document Type: Article

References (19)

1. A. J. C. Sharkey, "On combining artificial neural nets," Connection Science, vol. 8-3/4, pp. 299-314, 1996.
2. A. J. C. Sharkey, and N. E. Sharkey, "Combining Diverse Neural Nets," Knowledge Engineering Review, vol. 12, no. 3, pp. 299-314, 1997.
3. D. W. Opitz and R. Maclin, "Popular ensemble methods: An empirical study," Journal of Artificial Intelligence Research, vol. 11, pp. 169-198, 1999.
4. M. A. H. Akhand, Md. Monirul Islam and K. Murase, "A Comparative Study of Data Sampling Techniques for Constructing Neural Network Ensembles," International Journal of Neural Systems, vol. 19, no 2, pp. 67-89, 2009.
5. G. Brown, J. Wyatt, R. Harris, and X. Yao, "Diversity Creation Methods: A Survey and Categorization," Information Fusion, vol. 6, pp. 99-111, 2005.
6. D. J. Newman, S. Hettich, C. L. Blake, and C. J. Merz, "UCI Repository of Machine Learning Databases," Dept. of Information and Computer Sciences, University of California, Irvine, 1998. Available: http://www.ics.uci.edu/~mlearn/
7. L. Breiman, "Bagging predictors," Machine Learning, vol. 24, pp. 123-140, 1996.
8. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," Proc. of the 13th International Conference on Machine Learning, Morgan kaufmann, pp. 148-156, 1996.
9. Y. Liu and X. Yao, "Ensemble learning via negative correlation," Neural Networks, vol. 12, pp. 1399-1404, 1999.
10. Y. Liu and X. Yao, "Simultaneous Training of Negatively Correlated Neural Networks in an Ensemble," IEEE Trans. on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 29, no. 6, pp. 716-725, 1999.
11. E. Bauter and R. Kohavi, "An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants," Machine Learning, vol. 36, pp. 105-142, 1999.
12. D. E. Goldberg, Genetic Algorithms, Addison-wesley, 1998.
13. L. Prechelt, "Proben1- A Set of Benchmarks and Benching ules for Neural Network Training Algorithms," Tech. Rep. 21/94, Fakultat fur Informatik, University of Karlsruhe, Germany, 1994.
14. Z. Zhou, J. Wu and W. Tang, "Ensembling Neural Networks: Many Could Be Better Than All," Artificial Intelligence, vol. 137, pp. 239-263, 2002.
15. Z. Zhou, J. Wu, W. Tang and Z. Chen, "Selectively Ensembling Neural Classifiers," Proc. of the 2002 International Joint Conference on Neural Networks (IJCNN2002), Honolulu, HI, USA, pp. 1411-1415, 2002.
16. A. Tsymbal, M. Pechenizkiy and P. Cunningham, "Diversity in search strategies for ensemble feature selection," Information Fusion, vol. 6, pp. 83-98, 2005.
17. S. Haykin, Neural Networks - A Comprehensive Foundation, Prentice Hall, 2nd edition, 1999.
18. R. E. Banfield, L. O. Hall, K. W. Bowyer and W. P. Kegelmeyer, "Ensemble diversity measures and their application to thinning," Information Fusion, vol. 6, pp. 49-62, 2005.
19. K. Tang, M. Lin, F. L. Minku and X. Yao, "Selective Negative Correlation Learning Approach to Incremental Learning," Neurocomputing, vol. 72, pp. 2796-2805, 2009.