Classification of 2-dimensional array patterns: Assembling many small neural networks is better than using a large one

Neural Networks

Volumn 23, Issue 6, 2010, Pages 770-781

  Chen, Liang ^a   Xue, Wei ^b   Tokuda, Naoyuki ^c  

^a UNIVERSITY OF NORTHERN BRITISH COLUMBIA   (Canada)

^b WENZHOU UNIVERSITY   (China)

^c Shinjuku Hirose Bldg   (Japan)

Author keywords

Image and signal processing; Neural network; Noisy environment; Pattern classification; Robust; Task decomposition

Indexed keywords

IMAGE AND SIGNAL PROCESSING; NOISY ENVIRONMENT; PATTERN CLASSIFICATION; ROBUST; ROBUST TASK;

FACE RECOGNITION; LABELS; SIGNAL PROCESSING;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION; MATHEMATICAL ANALYSIS; MODEL; NOISE; PATTERN RECOGNITION; PRIORITY JOURNAL; SIGNAL PROCESSING;

ACTION POTENTIALS; ANIMALS; ARTIFICIAL INTELLIGENCE; FACE; FEMALE; HUMANS; MALE; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS; PATTERN RECOGNITION, AUTOMATED; PATTERN RECOGNITION, VISUAL; VISUAL CORTEX;

EID: 77953812029     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2010.03.006     Document Type: Article

References (23)

1. Cao J., Murata N., ichi Amari S., Cichocki A., Takeda T. A robust approach to independent component analysis of signals with high-level noise measurements. IEEE Transactions on Neural Networks 2003, 14(3):631-645.
2. Cao J., Murata N., ichi Amari S., Cichocki A., Takeda T. Independent component analysis for unaveraged single-trial meg data decomposition and single-dipole source localization. Neurocomputing 2002, 49(1-4):255-277.
3. Chen, L. (2005). Pattern classification by assembling small neural networks. In Proceedings of 2005 international joint conference on neural networks. (pp. 1947-1952).
4. Chen L., Tokuda N. A general stability analysis on regional and national voting schemes against noise. Artificial Intelligence 2005, 163(1):47-66.
5. Chen L., Tokuda N. Stability analysis of regional and national voting schemes by a continuous model. IEEE Transactions on Knowledge and Data Engineering 2003, 15(4):1037-1042.
6. Fukushima K. Neocognitron for handwritten digit recognition. Neurocomputing 2003, 51(April):161-180.
7. Fukushima K., Miyake S. Neocognitron: a new algorithm for pattern recognition tolerant of deformations and shifts in position. Pattern Recognition 1982, 15(6):455-469.
8. Garcia C., Delakis M. Convolutional face finder: a neural architecture for fast and robust face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 2004, 26(11):1408-1423.
9. Gordon L., Chervonenkis A.Y., Gammerman A.J., Shahmuradov I.A., Solovyev V.V. Sequence alignment kernel for recognition of promoter regions. Bioinformatics 2003, 19:1964-1971.
10. Haykin S. Neural networks C A comprehensive foundation 1999, Prentice Hall.
11. Ho T.K. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence 1998, 20(8):832-844.
12. Ikeda N., Watta P., Artiklar M., Hassoun M.H. A two-level Hamming network for high performance associative memory. Neural Networks 2001, 14(9):1189-1200.
13. Juang C.F., Lin C.T. A recurrent self-organizing neural fuzzy inference network. IEEE Transactions on Neural Networks 1999, 10(4):828-845.
14. Kittler J., Hatef M., Duin R.R.W., Matas J. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 1998, 20(3):226-239.
15. Lu B.-L., Ito M. Task decomposition and module combination based on class relations: a modular neural network for pattern classification. IEEE Transactions on Neural Networks 1999, 10(5):1244-1256.
16. Mäkinen E., Raisamo R. Evaluation of gender classification methods with automatically detected and aligned faces. IEEE Transactions on Pattern Analysis and Machine Intelligence 2008, 30(3):543-547.
17. Mu X., Artiklar M., Hassoun M.H., Watta P. An RCE-based associative memory with application to human face recognition. Proceedings of the international joint conference on neural networks 2003 2003, Vol. 4:2552-2557. IEEE Press, Portland, Oregon, July.
18. Riesenhuber M., Poggio T. Hierarchical models of object recognition in cortex. Nature Neuroscience 1999, 2:1019-1025.
19. Rowley H., Baluja S., Kanade T. Neural network-based face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 1998, 20(1):23-38.
20. Tan X., Chen S., Zhou Z.-H., Zhang F. Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft knn ensemble. IEEE Transactions on Neural Networks 2005, 16(4):875-886.
21. Turk M., Pentland A. Eigenfaces for recognition. Journal of Cognitive Neuroscience 1991, 3(1):71-86.
22. Wu G.D., Lin C.T. A recurrent neural fuzzy network for word boundary detection in variable noise-level environments. IEEE Transactions on Systems, Man, and Cybernetics Part B 2001, 31(1):84-97.
23. Zhou Z.-H., Wu J., Tang W. Ensembling neural networks: many could be better than all. Artificial Intelligence 2002, 137(1-2):239-263.