A selective approach to neural network ensemble based on clustering technology

Proceedings of 2004 International Conference on Machine Learning and Cybernetics

Volumn 5, Issue , 2004, Pages 3229-3233

  Li, Kai ^a,b   Huang, Hou Kuan ^a   Ye, Xiu Chen ^b   Cui, Li Juan ^b  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b HEBEI UNIVERSITY   (China)

Author keywords

Clustering; Ensemble; Neural network; Selective ensemble; Similarity

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER SIMULATION; CORRELATION METHODS; DATA ACQUISITION; IMAGE PROCESSING; LEARNING ALGORITHMS; MATHEMATICAL MODELS; OPTIMIZATION; VECTORS;

CLUSTERING TECHNOLOGY; ENSEMBLES; NETWORK ARCHITECTURE; SQUARED EUCLIDEAN DISTANCES;

NEURAL NETWORKS;

EID: 6344292247     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. L.K. Hansen, P. Salamon, Neural network ensembles, IEEE Trans. Pattern Anal. Machine Intelligence12 (10), pp. 993-1001,Oct. 1990.
2. F.J. Huang, Z.-H. Zhou, H.-J. Zhang, T.H. Chen, Pose invariant face recognition, in: Proc. 4th IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, France, IEEE Computer Society Press, Los Alamitos, CA, pp. 245-250, 2000.
3. L.K. Hansen, L. Liisberg, P. Salamon, Ensemble methods for handwritten digit recognition, in: Proc. IEEE Workshop on Neural Networks for Signal Processing, Helsingoer, Denmark, IEEE Press, Piscataway, NJ, pp. 333-342, Aug. 1992.
4. Y. Shimshoni, N. Intrator, Classification of seismic signals by integrating ensembles of neural networks, IEEE Trans. Signal Process. 46 (5), pp. 1194-1201, 1998.
5. L. Breiman, Bagging predictors, Machine Learning 24 (2) pp. 123-140, 1996.
6. R.E. Schapire, The strength of weak learnability, Machine Learning 5 (2), pp. 197-227, 1990.
7. Y. Freund, Boosting a weak algorithm by majority, Inform. and Comput. 121 (2), pp. 256-285, 1995.
8. J. Hampshire, A. Waibel, A novel objective function for improved phoneme recognition using time-delay neural networks, IEEE Trans. Neural Networks 1 (2), pp.216-228, 1990.
9. A. Krogh, J. Vedelsby, Neural network ensembles, cross validation, and active learning, in: G. Tesauro,D. Touretzky, T. Leen (Eds.), Advances in Neural Information Processing Systems 7, Denver, CO, MIT Press, Cambridge, MA, pp. 231-238, 1995.
10. D.W. Opitz, J.W. Shavlik, Actively searching for an effective neural network ensemble, Connection Science 8 (3-4), pp. 337-353, 1996.
11. M.P. Perrone, L.N. Cooper, When networks disagree: Ensemble method for neural networks, in: R.J.Mammone (Ed.), Artificial Neural Networks for Speech and Vision, Chapman & Hall, New York, pp. 126-142, 1993.
12. N. Ueda, Optimal linear combination of neural networks for improving classification performance, IEEE Trans. Pattern Anal. Machine Intelligence 22 (2), pp. 207-215, 2000.
13. K. Tumer, J.Ghosh. Error correlation and error reduction in ensemble classifiers, Connection Science 8, pp. 385-404, 1996.
14. Zhi-Hua Zhou, Jianxin Wu, Wei Tang, Ensembling neural networks: Many could be better than all, Artificial Intelligence 137, pp. 239-263, 2002.
15. Ludmila I. Kuncheva, Christopher J.Whitaker. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machine learning, 51, pp. 181-207, 2003.
16. D. Partridge. Network generalization differalization difference quantified Neural networks 9, pp. 263-271, 1996.
17. C. Blake, E. Keogh, C.J. Merz, UCI repository of machine learning databases, Department of Information and Computer Science, University of California, Irvine, CA, 1998, http://www.ics.uci.edu/~mlearn/ MLRepository.htm.
18. Xuanli Lisa Xie and Gerardo Beni. A validity measure for fuzzy clustering, IEEE Trans. on pattern analysis and machine intelligence, Vol. 13, No. 8, pp.841-847, Aug. 1991.
19. Nikhil R. Pal and James C. Bezdek. On cluster validity for the fuzzy c-means model, IEEE Trans. on fuzzy systems, Vol. 3, No. 3, pp. 370-378, Aug. 1995.
20. YU jian & ChENG. The upper bound of the optimal number of clusters in fuzzy clustering, Science in china (series F), Vol. 44, No.2, pp. 119-125, Apr. 2001.