Visual recognition based on temporal cortex cells: Viewer-centred processing of pattern configuration

Zeitschrift fur Naturforschung - Section C Journal of Biosciences

Volumn 53, Issue 7-8, 1998, Pages 518-541

  Perrett, David I ^a   Oram, Mike W ^b  

^a UNIVERSITY OF ST ANDREWS   (United Kingdom)

^b NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

Author keywords

Pattern Configuration; Temporal Cortex Cells; Visual Recognition

Indexed keywords

NERVE CELL; PSYCHOLOGY; VISUAL SYSTEM;

PRIMATES;

EID: 0032123355     PISSN: 09395075     EISSN: None     Source Type: Journal    
DOI: 10.1515/znc-1998-7-807     Document Type: Conference Paper

References (108)

1. Allison T., Ginter H., McCarthy G., Nobre A. C., Puce A., Luby M. and Spencer D. D. (1994a), Face recognition in human extrastriate cortex. J. Neurophysiol. 71, 821-835.
2. Allison T., McCarthy G., Nobre A., Puce A. and Beiger A. (1994b), Human extrastriate visual-cortex and the perception of faces, words, numbers and colours. Cereb. Cortex 4, 544-554.
3. Allman J., Miezin F. and McGuinness E. (1985), Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. Ann. Rev. Neurosci. 8, 407-430.
4. Assal G., Favre C. and Anderes, J. P. (1984), Non-reconnaissance d'animaux familiers chez un paysan: zooagnosie ou prosopagnosie pour les animaux. Revue Neurologique 140, 580-584.
5. Barlow H. B. (1972), Single units and sensation: a neuron doctrine for perceptual psychology. Perception 1, 371-394.
6. Barlow H. B. (1985), The twelfth Bartlett Memorial Lecture: The role of single neurons in the psychology of perception. Quart. J. Exp.Psychol. 37, 121-145.
7. Barlow H. B. (1994), The Cognitive Neurosciences (M. Gazzaniga, ed.). Place Publishers, pp. 415-435.
8. Baylis C. G., Rolls E. T. and Leonard C. M. (1985), Selectivity between faces in the responses of a population of neurons in the cortex in the superior temporal sulcus of the monkey. Brain Res. 342, 91-102.
9. Benson P. J. and Perrett D. I. (1991), Perception and recognition of photographic quality caricatures: implications for natural image processing. Eur. J. Cognit. Psychol. 3, 105-135.
10. Benton A. L. and Van Allen M. W. (1968), Impairment in facial recognition in patients with cerebral disease. Cortex 4, 344-358.
11. Biederman I. (1987), Recognition by components: a theory of human image understanding. Psycholog. Rev. 94, 115-145.
12. Bruce C. J., Desimone R. and Gross C. G. (1981), Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J. Neurophysiol. 46, 369-384.
13. Bruce V., Doyle T., Dench N. and Burton M. (1991), Remembering facial configurations. Cognition 38, 109-144.
14. Bruce V. and Young A. (1986), Understanding face recognition. Brit. J. Psychol. 77, 103-327.
15. Carey S. (1992), Becoming a face expert. Phil. Trans. R. Soc. London B 335, 95-103.
16. Carey D. P., Perrett D. I. and Oram M. W. (1997), Recognizing, understanding and reproducing action. In: Handbook of Neuropsychology, Vol. 11 (F. Boller and J. Grafman, Series eds.). Elsevier Science, pp. 111-129.
17. De Renzi E., Faglioni P. and Spinnler H. (1968), The performance of patients with unilateral brain damage on face recognition tasks. Cortex 4, 17-34.
18. De Renzi E. (1986), Current issues on prosopagnosia. In: Aspects of Face Processing (H. D. Ellis, M. A. Jeeves, F. Newcombe and A. Young, eds.). NATO Advanced Science Institute. Series. Martinus Nijhoff Publishers, Dordrecht, pp. 243-252.
19. Desimone R., Albright T. D., Gross C. G. and Bruce C. (1984), Stimulus-selective properties of inferior temporal neurons in the macaque. J. Neurosci. 8, 2051-2062.
20. Dodd J. and Perrett D. I. (1997), The effect of caricaturing on learning and recognition of car shapes (in submission).
21. Farah M. J. (1996), Is face recognition special - evidence from neuropsychology. Behav.Brain Res. 76, 181-189.
22. Flin R. and Dziurawiec S. (1989), Development factors in face processing. In: Handbook of Research on Face Processing. North Holland, Amsterdam, pp. 335-350.
23. Foldiak P. (1991), Learning invariance from transformation sequences. Neural Computation 3, 194-200.
24. Foldiak P. and Young, M. P. (1995), Sparse coding in the primate cortex. In: The Handbook of Brain Theory and Neural Networks (M. A. Arbib, ed.). Massachusetts Institute of Technology Press, pp. 895-898.
25. Fujita I., Tanaka K., Ito, M. and Cheng K. (1992), Columns for visual features of objects in monkey inferotemporal cortex. Nature 36, 343-346.
26. Fukushima K. (1980), Neocognitron: a self-organising neural network model for a mechanism of pattern recognition unaffected by shift in position. Biolog. Cybern. 36, 193-202.
27. Gauthier I., Anderson A. W., Tarr M. J., Skudlarski P. and Gore J. C. (1997), Levels of categorization in visual recognition studied using functional magnetic resonance imaging. Curr. Biol. 7, 645-651.
28. Gauthier I. and Tarr M. J. (1997), Becoming a "greeble" expert: exploring mechanisms for face recognition. Vision Res. 37, 1673-1682.
29. Gochin P. M., Miller E. K., Gross C. G. and Gerstein G. L. (1991), Functional interactions among neurons in inferior temporal cortex of the awake macaque. Exp. Brain Res. 84, 505-516.
30. Gross C. G., (1992), Representation of visual stimuli in inferior temporal cortex. Phil. Trans. R. Soc. London B 335, 3-10.
31. Gross C. G., Rocha-Miranda C. E. and Bender D. B. (1972), Visual properties of neurons in inferotemporal cortex of the macaque. J. Neurophysiol. 35, 96-111.
32. Guzman A. (1968), Decomposition of a scene into three-dimensional bodies. AFIRS Fall Joint Conferences 33, 291-304.
33. Harries M. H. and Perrett D. I. (1991), Visual processing of faces in the temporal cortex: physiological evidence for a modular organization and possible anatomical correlates. J. Cognit. Neurosci. 3, 9-24.
34. Hasselmo M. E., Rolls E. T., Baylis G. C. and Nalwa V. (1989), Object centred encoding by face-selective neurons in the cortex of the superior temporal sulcus of the monkey. Exp. Brain Res. 75, 417-429.
35. Hietanen J. K., Perrett D. I., Oram M. W., Benson P. J. and Dittrich W. H. (1992), The effects of lighting conditions on responses of cells selective for face views in the temporal cortex. Exp. Brain Res. 89, 157-71.
36. Hubel D. H. and Livingstone M. S. (1990), Color and contrast sensitivity in the lateral geniculate body and primary visual cortex of the macaque monkey. J. Neurosci. 10, 2223-2237..
37. Ito M., Tamura H., Fujita I. and Tanaka K. (1995), Size and position invariance of neuronal responses in monkey inferotemporal cortex. J. Neurophysiol. 73, 218-226.
38. Jolicoeur P. (1992), Identification of Disoriented Objects: A Dual-System Theory. Blackwell, Cambridge, Mass.
39. Kendrick K. M. and Baldwin B. A. (1987), Cells in temporal cortex of conscious sheep can respond preferentially to the sight of faces. Science 236, 448-450.
40. Knierim J. J. and Van-Essen D. C. (1992), Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. J. Neurophysiol. 67, 961-980.
41. Kobatake E. and Tanaka K. (1994), Neural selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. J. Neurophysiol. 71, 856-867.
42. Koenderink J. J. and van Doom A. J. (1979), The internal representation of solid shape with respect to vision. Biolog. Cybern. 32, 211-216.
43. Komatsu H. and Ideura Y. (1993), Relationships between color, shape and pattern selectivities of neurons in the inferior temporal cortex of the Monkey. J. Neurophysiol. 70, 677-694.
44. Konorski J. (1967), Integrative Activity of the Brain. University of Chicago Press, Chicago Illinois.
45. Logothetis N. K., Pauls J., Bulthoff H. H. and Poggio T. (1994a), View-dependent object recognition by monkeys. Curr. Biol. 4, 401-414.
46. Logothetis N. K., Pauls J. and Poggio T. (1995), Shape representation in the inferior temporal cortex of monkeys. Curr. Biol. 5, 552-563.
47. Lowe D. G. (1987), Three-dimensional object recognition form single two-dimensional images. Artificial Intelligence 31, 355-395.
48. Marr D. and Nishihara H. K. (1978), Representation and recognition of the spatial organization of three dimensional shapes. Proc. R. Soc. London B 200, 269-294.
49. McClelland J. L. and Rummelhart and the PDP Research Group (1988), Parallel Distributed Processing Explorations in the Microstructure of Cognition, Vol. 2, Psychological and Biological Models. MIT Press, Massachusetts.
50. McNeil J. E. and Warrington E. (1994), Prosopagnosia: a face specific deficit? Exp. Psycholog. Soc., Sussex, 3-5 July 1991. Meeting Abstracts, 47.
51. Miyashita Y. and Chang H. S. (1988), Neuronal correlate of pictorial short-term memory in the primate temporal cortex. Nature 331, 68-70.
52. Miyashita Y., Date A. and Okuno H. (1993), Configurational encoding of complex visual forms by single neurons of monkey temporal cortex. Neuropsychologia 31, 1119-1131.
53. Moscovitch M., Winocur G. and Behrmann M. (1997), What is special about face recognition? Nineteen experiments on a person with visual object agnosia and dyslexia but normal face recognition. J. Cognit. Neurosci. 9, 555-604.
54. Nobre A. C., Allison T. and McCarthy G. (1994), Word recognition in the human inferior temporal lobe. Nature 372, 260-263.
55. Ono et al. (1992), Amygdala and learned aversive.
56. Oram M.W and Perrett D. I. (1992), The time course of responses of cells selective for faces in the temporal cortex. J. Neurophysiol. 68, 70-84.
57. Oram M. W., Perrett D. I. and Hietanen J. K. (1993), Directional tuning of motion-sensitive cells in the anterior superior temporal polysensory area of the macaque. Exp. Brain Res. 97, 274-294.
58. Oram M. W. and Perrett D. I. (1994), Modeling visual recognition from neurobiological constraints. Neural Networks 7, 945-972.
59. Oram M. W. and Foldiak P. (1996), Learning generalization and localization: competition for stimulus type and receptive field. NeuroComputing 11, 297-321.
60. Oram M. W. and Perrett D. I. (1996), Integration of form and motion in the anterior superior temporal polysensory area (STPa) of the macaque monkey. J. Neurophysiol. 76, 109-129.
61. Perrett D. I., Mistlin A. J. and Chitty A. J. (1987), Visual neurons responsive to faces. TINS 10, 358-364.
62. Perrett D. I., Harries M. H., Bevan R., Thomas S., Benson P. J., Mistlin A. J., Chitty A. J., Hietanen J. K. and Ortega J. E. (1989a), Frameworks of analysis for the neural representation of animate objects and actions. J. Exp. Biol. 146, 87-114.
63. Perrett D. I., Hietanen J. K., Oram M. W. and Benson P. J. (1992), Organization and functions of cells responsive to faces in the temporal cortex. Phil. Trans. R. Soc. London B 335, 23-30.
64. Perrett D. I., Mistlin A. J., Chitty A. J., Smith P. A. J., Potter D. D., Broennimann R. and Harries M. H. (1988), Specialised face processing and hemispheric asymmetry in man and monkey: evidence from single unit and reaction time studies. Behav. Brain Res. 29, 245-258.
65. Perrett D. I. and Oram M. W. (1993), The neurophysiology of shape processing. Image and Visual Computing 11, 317-333.
66. Perrett D. I. and Emery N. J. (1994), Understanding the intentions of others from visual signals: neurophysiological evidence. Curr. Psych. Cognit. 13, 683-694.
67. Perrett D. I., Oram M. W., Harries M. H., Bevan R., Hietanen J. K., Benson P. J. and Thomas S. (1991), Viewer-centred and object-centred coding of heads in the macaque temporal cortex. Exp. Brain Res. 86, 159-173.
68. Perrett D. I., Rolls E. T. and Caan W. (1982), Visual neurons responsive to faces in the monkey temporal cortex. Exp. Brain Res. 47, 329-342.
69. Perrett D. I., Smith P. A. J., Potter D. D., Mistlin A. J., Head A. S., Milner A. D. and Jeeves M. A. (1984), Neurons responsive to faces in the temporal cortex: Studies of functional organization, sensitivity to identity and relation to perception. Human Neurobiol. 3, 197-208.
70. Perrett D. I., Smith P. A. J., Potter D. D., Mistlin A. J., Head A. S., Milner A. D. and Jeeves M. A. (1985), Visual cells in the temporal cortex sensitive to face view and gaze direction. Proc. R. Soc. London B 223, 293-317.
71. Perrett D. I., Oram M. W., Wachsmuth E. and Emery N. J. (1995a), Understanding the behaviour and 'minds' of others from their facial and body signals: Studies of visual processing within the temporal cortex. In: Emotion, Memory and Behaviour: Studies on Human and Non-Human Primates (T. Nakajima and T. Ono, eds.). Taniguchi Symposia on Brain Sciences 18, Tokyo. Japan Scientific Societies Press, Japan, pp. 155-167.
72. Perrett D. I. Benson P. J. Hietanen J. K. Oram M. W. and Dittrich W. H. (1995b), When is a face not a face? Correlations between perception and single neurones. In: The Artful Eye (R. Gregory, J. Harris, P. Heard and D. Rose, eds.). Oxford University Press, Oxford.
73. Poggio T. and Edelman S. (1990), A network that learns to recognise three-dimensional objects. Nature 343, 263-266.
74. Porrill J., Pollard S. B., Pridmore T. P., Bowen J. B., Mayhew J. E. W. and Frisby J. P. (1988), TINA: a 3D vision system for pick and place. Image and Vision Computing 6, 91 -99.
75. Puce A. Allison T., Gore J. C. and McCarthy G. (1996a), Face-sensitive regions in human extrastriate cortex studied by functional MRI. J. Neurophysiol. 74, 1192-1199.
76. Puce A., Allison T., Asgari M., Gore J. C. and McCarthy G. (1996b), Differential sensitivity of human visual-cortex to faces letter strings and textures - a functional magnetic resonance imaging study. J. Neurosci. 16, 5205-5215.
77. Rhodes G., Brennan S. E. and Carey S. (1987), Identification and ratings of caricatures: implications for mental representations of faces. Cognit. Psych. 19, 473-497.
78. Rhodes G. and McLean I. (1990), Distinctiveness and expertise effects with homogeneous stimuli: towards a model of configurai coding. Perception 19, 773-794.
79. Richmond B. J. and Optican L. M. (1992), The structure and interpretation of neuronal codes in the visual system. In: Neural Networks for Perception (H. Wechsler, ed.). Academic Press Ltd., San Diego, CA, USA.
80. Rolls E. T. and Baylis G. C. (1986), Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey. Exp. Brain Res. 65, 38-48.
81. Rolls E. T. and Tovee M. J. (1995), Sparseness of neuronal represntation of stimuli in the primate temporal visual-cortex. J. Neurophysiol. 73, 713-726.
82. Rolls E. T., Treves A. and Tovee M. J. (1997), The representational capacity of the distributed encoding of information provided by populations of neurons in primate temporal visual cortex. Exp. Brain Res. 114, 149-162.
83. Sakai K. and Miyashita Y. (1991), Neural organization for the long-term memory of paired associates. Nature 354, 152-155.
84. Sakata H., Taira M., Murata A. and Mine S. (1995), Neural mechanisms of visual guidance of hand action in the parietal cortex of the monkey. Cereb. Cortex 5, 429-438.
85. Saund E. (1992), Putting knowledge into visual shape representation. Artificial Intelligence 54, 71-119.
86. Schwartz E. L., Desimone R., Albright T. D. and Gross C. G. (1983), Shape recognition and inferior temporal neurons. Proc. Natl. Acad. Sci. USA 80, 5776-5778.
87. Seibert M. and Waxman A. (1992a), Adaptive 3-D object recognition from multiple views. IEEE Transactions on Pattern Analysis and Machine Intelligence 14, 107-124.
88. Seibert M. and Waxman A. (1992b), Learning and recognizing 3D objects from multiple views in a neural system. In: Neural Networks for Perception. Academic Press, Inc., 426-444.
89. Sirovitch L. and Kirby M. (1987), Low-dimensional proceedure for the characterization of human faces. J. Opt. Soc. America A 4, 519-524.
90. Tanaka K., Saito H., Fukada Y. and Moriya M. (1991), Coding visual images of objects in the inferotemporal cortex of the macaque monkey. J. Neurophysiol. 66, 170-189.
91. Tovee M. J., Rolls E. T. and Azzopardi A. (1994), Translation invariance in the responses to faces of single neurones in the primate temporal cortical areas of the alert macaque. J. Neurophysiol. 72, 1049-1060.
92. Turk M. and Pentland A. (1991), Eigenfaces for recognition. J. Cognit. Neurosci. 3, 71-86.
93. Ullman S. (1989), Aligning pictorial descriptions: an approach to object recognition. Cognition 32, 193-254.
94. Ungerleider L. G. and Mishkin M. (1982), Two cortical visual systems. In: Analysis of Visual Behaviour. MIT Press, Cambridge Massachusetts, 549-585.
95. Verfaillie K. (1992), Variant points of view on viewpoint invariance. Can. J. Psychol. 46, 215-236.
96. Vetter T., Huribert A. and Poggio T. (1995), Models of 3D object recognition: invariance to image transformations. Cerebral Cortex 5, 261-269.
97. Wachsmuth E., Oram M. W. and Perrett D. I. (1994), Recognition of objects and their component parts: responses of single units in the temporal cortex of the macaque. Cereb. Cortex 4, 509-522.
98. Wachsmuth E. and Perrett D. I. (1995), Generalising across object orientation and size. In: Perceptual Constancies (V. Walsh and S. Butler, eds.). Oxford University Press, Oxford.
99. Wachsmuth E. and Perrett D. I. (1997), The physiology of shape generalisation (size and orientation). In: Perceptual Constancies: Why things Look as they do (V. Walsh and J. Kulikowski, eds.). Cambridge University Press, Cambridge, UK. (in press).
100. Warrington E. K. (1982), Neuropsychological studies of object recognition. Phil. Trans. R. Soc. London B 298, 15-33.
101. Warrington E. K. and James, M. (1986), Visual object recognition in patients with right hemisphere lesions: axes or features? Perception 15, 355-366.
102. Watt R. J. (1996), Critical operations in low-level human vision International. J. Image Systems Technol. 7, 65-77.
103. Weiskrantz L. and Saunders R. C. (1984), Impairments of visual object transforms in monkeys. Brain 107, 1033-1072.
104. Wicklegren W. A. (1969), Context-sensitive coding, associative memory and serial order in (speech) behaviour. Psycholog. Rev. 76, 1-15.
105. Yamane S., Kaji S. and Kawano K. (1988), What facial features activate face neurons in the inferotemporal cortex of the monkey. Exp. Brain Res. 73, 209-214.
106. Yin R. K. (1969), Looking at upside-down faces. J. Exp. Psychol. 81, 141-145.
107. Yin R. K. (1970), Face recognition by brain-injured patients, a dissociable ability? Neuropsychologia 8, 395-402.
108. Young M. P. and Yamane S. (1992), Sparse population coding of faces in the inferotemporal cortex. Science 256, 1327-1331.