Artificial vision by multi-layered neural networks: Neocognitron and its advances

Neural Networks

Volumn 37, Issue , 2013, Pages 103-119

  Fukushima, Kunihiko ^a  

^a FUZZY LOGIC SYSTEMS INSTITUTE   (Japan)

Author keywords

Artificial vision; Bottom up and top down; Hierarchical network; Modeling neural networks; Neocognitron

Indexed keywords

BOTTOM-UP AND TOP-DOWN; HIERARCHICAL NETWORK; ITS ARCHITECTURE; LEARNING PROCESS; LEARNING RULES; MULTI-LAYERED; MULTILAYERED NEURAL NETWORKS; NEOCOGNITRON; NEURAL NETWORK MODEL; RECOGNITION RATES; SELECTIVE ATTENTION; TOPDOWN; VISUAL PATTERN; VISUAL SYSTEMS; FUKUSHIMA; MODELING NEURAL NETWORK; NEURAL-NETWORKS;

COMPUTER VISION; NETWORK LAYERS; VISION; NEURAL NETWORKS;

FEEDFORWARD NEURAL NETWORKS; NETWORK LAYERS;

ARTICLE; COGNITION; CONTROLLED STUDY; LEARNING; MENTAL PERFORMANCE; NERVE CELL NETWORK; NEUROCOGNITION; NEUROMODULATION; NEUROPHYSIOLOGY; PRIORITY JOURNAL; RECOGNITION; SELECTIVE ATTENTION; VISUAL DISCRIMINATION; ARTIFICIAL NEURAL NETWORK; INTERMETHOD COMPARISON; LEARNING ALGORITHM; NEOCOGNITRON; PATTERN RECOGNITION; VISUAL INFORMATION; VISUAL ORIENTATION; VISUAL SYSTEM; ANIMAL; ARTIFICIAL INTELLIGENCE; ATTENTION; HUMAN; MAMMAL; PHYSIOLOGY; VISION;

ANIMALS; ARTIFICIAL INTELLIGENCE; ATTENTION; COGNITION; HUMANS; LEARNING; MAMMALS; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, VISUAL; VISION, OCULAR; VISUAL PATHWAYS; VISUAL PERCEPTION;

EID: 84870443413     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2012.09.016     Document Type: Article

References (37)

1. Bruce C.J., Desimone R., Gross C.G. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. Journal of Neurophysiology 1981, 46:369-384.
2. Carpenter G.A., Grossberg S. ART 2: self-organization of stable category recognition codes for analog input patterns. Applied Optics 1987, 26:4919-4930.
3. Desimone R., Schein S.J. Visual properties of neurons in area V4 of the macaque: sensitivity to stimulus form. Journal of Neurophysiology 1987, 57(3):835-868.
4. Fujita I., Tanaka K., Ito M., Cheng K. Columns for visual features of objects in monkey inferotemporal cortex. Nature 1992, 360:343-346.
5. Fukushima K. Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics 1980, 36(4):193-202.
6. Fukushima K. Neural network model for selective attention in visual pattern recognition and associative recall. Applied Optics 1987, 26(23):4985-4992.
7. Fukushima K. A neural network for visual pattern recognition. IEEE Computer 1988, 21(3):65-75.
8. Fukushima K. Analysis of the process of visual pattern recognition by the neocognitron. Neural Networks 1989, 2(6):413-420.
9. Fukushima K. Recognition of partly occluded patterns: a neural network model. Biological Cybernetics 2001, 84(4):251-259.
10. Fukushima K. Neocognitron for handwritten digit recognition. Neurocomputing 2003, 51:161-180.
11. Fukushima K. Neocognitron capable of incremental learning. Neural Networks 2004, 17(1):37-46.
12. Fukushima K. Use of non-uniform spatial blur for image comparison: symmetry axis extraction. Neural Networks 2005, 18(1):23-32.
13. Fukushima K. Restoring partly occluded patterns: a neural network model. Neural Networks 2005, 18(1):33-43.
14. Fukushima K. Interpolating vectors for robust pattern recognition. Neural Networks 2007, 20(8):904-916.
15. Fukushima K. Neural network model for completing occluded contours. Neural Networks 2010, 23(4):465-582.
16. Fukushima K. Neocognitron trained with winner-kill-loser rule. Neural Networks 2010, 23(7):926-938.
17. Fukushima K. Increasing robustness against background noise: visual pattern recognition by a neocognitron. Neural Networks 2011, 24(7):767-778.
18. Fukushima, K. (2012). Training multi-layered neural network neocognitron. Neural Networks (submitted for publication).
19. Fukushima K., Hashimoto H. Recognition and segmentation of components of a face by a multi-resolution neural network. Lecture notes in computer science, LNCS 1997, vol. 1327:931-936. Springer-Verlag, Berlin, Heidelberg, New York. W. Gerstner, A. Germond, M. Hasler, J.-D. Nicoud (Eds.).
20. Fukushima K., Hayashi I., Léveillé J. Neocognitron trained by winner-kill-loser with triple threshold. Lecture notes in computer science, LNCS 2011, vol. 7063:628-637. Springer-Verlag, Berlin, Heidelberg. B.-L. Lu, L. Zhang, J. Kwok (Eds.).
21. Fukushima K., Imagawa T. Recognition and segmentation of connected characters with selective attention. Neural Networks 1993, 6(1):33-41.
22. Fukushima K., Tanigawa M. Use of different thresholds in learning and recognition. Neurocomputing 1996, 11(1):1-17.
23. Gray R.M. Vector quantization. IEEE ASSP Magazine 1984, 1(2):4-29.
24. Hebb D.O. Organization of behavior 1949, John Wiley & Sons, New York, London, Sydney.
25. Hubel D.H., Wiesel T.N. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. Journal of Physiology (London) 1962, 106(1):106-154.
26. Hubel D.H., Wiesel T.N. Receptive fields and functional architecture in two nonstriate visual areas (18 and 19) of the cat. Journal of Neurophysiology 1965, 28(2):229-289.
27. Ito M., Komatsu H. Representation of angles embedded within contour stimuli in area V2 of macaque monkeys. Journal of Neuroscience 2004, 24(13):3313-3324.
28. Kohonen T. The self-organizing map. Proceedings of the IEEE 1990, 78(9):1464-1480.
29. LeCun Y., Bottou L., Bengio Y., Haffner P. Gradient-based learning applied to document recognition. Proceedings of the IEEE 1998, 86(11):2278-2324.
30. Mutch J., Lowe D.G. Object class recognition and localization using sparse features with limited receptive fields. International Journal of Computer Vision 2008, 80(1):45-57.
31. Pasupathy A., Connor C.E. Responses to contour features in macaque area V4. Journal of Neurophysiology 1999, 82:2490-2502.
32. Riesenhuber M., Poggio T. Hierarchical models of object recognition in cortex. Nature Neuroscience 1999, 2(11):1019-1025.
33. Satoh S., Kuroiwa J., Aso H., Miyake S. Recognition of rotated patterns using a neocognitron. Knowledge based intelligent techniques in character recognition 1999, 49-64. CRC Press. L.C. Jain, B. Lazzerini (Eds.).
34. Serre T., Oliva A., Poggio T. A feedforward architecture accounts for rapid categorization. Proceedings of the National Academy of Sciences of the United States of America 2007, 104(15):6424-6429.
35. von der Hydt P., Peterhans E., Baumgartner G. Illusory contours and cortical neuron responses. Science 1984, 224(4654):1260-1262.
36. Walker G.A., Ohzawa I., Freeman R.D. Suppression outside the classical cortical receptive field. Visual Neuroscience 2000, 17:369-379.
37. Yamane S., Kaji S., Kawano K. What facial features activate face neurons in the inferotemporal cortex of the monkey?. Experimental Brain Research 1988, 73:209-214.