The build of n-Bits Binary Coding ICBP Ensemble System

Neurocomputing

Volumn 74, Issue 17, 2011, Pages 3509-3519

  Dai, Qun ^a   Liu, Ningzhong ^a  

^a NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

Author keywords

Accuracy; Classifier; Diversity; Handwritten digit recognition task; Improved circular back propagation neural network (ICBP); Machine learning; N bits binary coding ICBP ensemble system (nBBC ICBP ES); Neural network ensemble; Pattern recognition; t test

Indexed keywords

ACCURACY; BINARY CODING; DIVERSITY; HANDWRITTEN DIGIT RECOGNITION; IMPROVED CIRCULAR BACK PROPAGATION; MACHINE-LEARNING; NEURAL NETWORK ENSEMBLE; T-TEST;

ADAPTIVE BOOSTING; BACKPROPAGATION; BINARY CODES; CLASSIFICATION (OF INFORMATION); CLASSIFIERS; NETWORK ARCHITECTURE; OPTIMIZATION; PATTERN RECOGNITION;

NEURAL NETWORKS;

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION ALGORITHM; CLASSIFIER; COMPUTER SYSTEM; CONTROLLED STUDY; DISCRIMINATION LEARNING; HUMAN; IMPROVED CIRCULAR BACK PROPAGATION SYSTEM; INTERMETHOD COMPARISON; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; N BITS BINARY CODING ICBP ENSEMBLE SYSTEM; PATTERN RECOGNITION; PRIORITY JOURNAL; PROCESS OPTIMIZATION; QUALITY CONTROL; SIMULATION; SUPPORT VECTOR MACHINE; SYSTEM ANALYSIS; TASK PERFORMANCE;

EID: 80052931178     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.06.005     Document Type: Article

References (46)

1. Islam M.M., Yao X., Murase K. A constructive algorithm for training cooperative neural network ensembles. IEEE Transactions on Neural Networks 2003, 14(4):820-834.
2. Zhang Y., Burer S., Street W.N. Ensemble pruning via semi-definite programming. Journal of Machine Learning Research 2006, 7:1315-1338.
3. Breiman L. Bagging predictors. Machine Learning 1996, 24(2):123-140.
4. Freund Y., Schapire R.E. Experiments with a new boosting algorithm. in: Proceedings of ICML-96, Bari, Italy 1996, 148-156. Morgan Kaufmann, San Mateo, CA.
5. Breiman L. Arcing classifiers. Annals of Statistics 1998, 26:801-849.
6. Breiman L. Random forests. Machine Learning 2001, 45(1):5-32.
7. K. Li, H.K. Huang, C.X. Ye, L.J. Cui, A selective approach to neural network ensemble based on clustering technology, in: Proceedings of the Third International Conference on Machine Learning and Cybernetics, Shanghai, China, 2004.
8. Zhou Z.-H., Wu J., Tang W. Ensembling neural networks: many could be better than all. Artificial Intelligence 2002, 137:239-263.
9. F.J. Huang, Z.-H.Z. Hou, H.-J. Zhang, T.H. Che, Pose invariant face recognition, in: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, France, 2000.
10. L.K. Hansen, L. Liisberg, P. Salamon, Ensemble methods for handwritten digit recognition, IEEE Workshop on Neural Networks for Signal Processing, Helsingoer, Denmark, 1992.
11. Y. Zhao, J. Gao, X. Yang, A survey of neural network ensemble, International Conference on Neural Networks and Brain, Beijing, China, 2005.
12. K.J. Cherkauer, Human expert level performance on a scientific image analysis task by a system using combined artificial neural networks, in: Proceedings of the AAAI-96 Workshop on Integrating Multiple Learned Models for Improving and Scaling Machine Learning Algorithms, Portland, OR, 1996.
13. Cunningham P., Carney J., Jacob S. Stability problems with artificial neural networks and the ensemble solution. Artificial Intelligence in Medicine 2000, 20(3):217-225.
14. Zhou Z.-H., Jiang Y., Yang Y.-B., Chen S.-F. Lung cancer cell identification based on artificial neural network ensembles. Artificial Intelligence in Medicine 2002, 24(1):25-36.
15. R. Maclin, J. Shavlik, Combining the predictions of multiple classifiers: using competitive learning to initialize neural networks, in: Proceedings of the Eleventh International Conference on Artificial Intelligence, Detroit, MI, 1995.
16. Hsieh W.W. Nonlinear principle component analysis by neural networks. Tellus 2001, 53A:599-615.
17. Hashem S. Optimal linear combination of neural networks. Neural Networks 1997, 10:599-614.
18. Opitz D., Maclin R. Popular ensemble methods: an empirical study. Journal of Artificial Intelligence Research 1999, 11:169-198.
19. Hansen L.K., Salamon P. Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence 1990, 12:993-1001.
20. Krogh A., Vedelsby J. Neural Network Ensembles, Cross Validation, and Active Learning 1995, MIT Press, Cambridge, MA.
21. Opitz D.W., Shavlik J.W. Actively searching for an effective neural-network ensemble. Connection Science 1996, 8(3/4):337-353.
22. Dai Q. The build of a dynamic classifier selection ICBP system and its application to pattern recognition. Neural Computers and Applications 2010, 19:123-137.
23. Q. Dai, Research on Hybrid Neural Networks and Diversified Ensemble Methods Based on ICBP Model, Ph.D. Thesis, College of Information Science and Technology, Nanjing University of Aeronautics and Astronautics, 2009.
24. Efron B., Tibshirani R. An Introduction to the Bootstrap 1993, Chapman & Hall, New York.
25. Schapire R.E. The strength of weak learnability. Machine Learning 1990, 5(2):197-227.
26. Clemen R.T., Winkler R.L. Limits for the precision and value of information from dependent sources. Operation Research 1985, 33:427-442.
27. Perrone M., Cooper L.N. When Networks Disagree: Ensemble Methods for Hybrid Neural Networks 1993, Chapman & Hall, London, UK.
28. Liu Y., Yao X. Simultaneous training of negatively correlated neural networks in an ensemble. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics 1999, 29:716-725.
29. Dai Q., Chen S.C., Zhang B.Z. Improved CBP neural network model with applications in time series prediction. Neural Processing Letters 2003, 18:197-211.
30. Q. Dai, S.C. Chen, The Research on Multi-Step and Robust Time Series Prediction Techniques Based on ICBP Networks, Master's Thesis, Computer Science Department, Nanjing University of Aeronautics and Astronautics, 2003.
31. B.Z. Zhang, S.C. Chen, The Equivalence between ICBP and the Bayesian Classifier, Technical Report, No. 021, Department of Computer Science and Engineering, Nanjing University of Aeronautics and Astronautics, 2001.
32. Zhang B.Z., Chen S.C. Equivalence between vector quantization and ICBP networks. Journal of Data Acquisition and Processing 2001, 16(3):291-294. (in Chinese).
33. B.Z. Zhang, The Research on the Performance and Applications of Improved BP Neural Networks, Master's Thesis, Computer Science Department, Nanjing University of Aeronautics and Astronautics, 2001.
34. Chen L., Xue W., Tokuda N. Classification of 2-dimensional array patterns: assembling many small neural networks is better than using a large one. Neural Networks 2010, 23:770-781.
35. Liu Y., Yao X., Higuchi T. Evolutionary ensembles with negative correlation learning. IEEE Transactions on Evolutionary Computation 2000, 4:380-387.
36. Bollé D., Dominguez D.R.C., Amari S. Mutual information of sparsely coded associative memory with self-control and ternary neurons. Neural Networks 2000, 13:452-462.
37. Freund Y., Schapire R.E. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences 1997, 55:119-139.
38. Schapire R.E., Singer Y. Improved boosting algorithms using confidence-rated predictions. Machine Learning 1999, 37:297-336.
39. Ridella S., Rovetta S., Zunino R. Circular back-propagation networks for classification. IEEE Transactions on Neural Networks 1997, 8(1):84-97.
40. Ridella S., Rovetta S., Zunino R. Circular back-propagation networks embed vector quantization. IEEE Transactions and Neural Networks 1999, 10(4):972-975.
41. Ridella S., Rovetta S., Zunino R. CBP networks as a generalized neural model. International Conference on Neural Networks 1997.
42. S. Haykin, Neural Networks: A Comprehensive Foundation, second ed., Prentice-Hall Inc. Englewood Cliffs, NJ, 1999.
43. Weijters A. The BP-SOM architecture and learning rule. Neural Processing Letters 1995, 2(6):13-16.
44. Weijters A., Bosch V.D., Herik H.J. Intelligible neural networks with BP-SOM. Marcke and Daelemans 1997, 27-36.
45. J. Eggermont, Rule-Extraction and Learning in the BP-SOM Architecture, Master's Thesis, Computer Science Department, Leiden University, 1998.
46. UCI repository of machine learning databases, MLRepository.html or ftp.ics.uci.edu:pub/machine-learning-databases. http://www.ics.uci.edu/~mlearn/.