Invariant face and object recognition in the visual system

Progress in Neurobiology

Volumn 51, Issue 2, 1997, Pages 167-194

  Wallis, Guy ^a,b   Rolls, Edmund T ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

FACE; HUMAN; LEARNING; PRIORITY JOURNAL; RECOGNITION; REVIEW; VISUAL DISCRIMINATION; VISUAL SYSTEM;

EID: 0031040957     PISSN: 03010082     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0301-0082(96)00054-8     Document Type: Article

References (113)

1. Abbott, L. A., Rolls, E. T. and Tovee, M. J. (1996) Representational capacity of face coding in monkeys. Cerebral Cortex 6, 498-505.
2. Baddeley, R. J., Wakeman, E., Booth, M., Rolls, E. T. and Abbott, L. F. (1997) The distribution of firing rates of primate temporal lobe visual neurons to "natural" scenes (in preparation).
3. Baizer, J. S., Ungerleider, L. G. and Desimone, R. (1991) Organization of visual inputs to the inferior temporal and posterior parietal cortex in macaques. J. Neurosci. 11, 168-190.
4. Ballard, D. H. (1990) Animate vision uses object-centred reference frames. In: Advanced Neural Computers, pp. 229-236. Ed. R. Eckmiller. North-Holland: Amsterdam.
5. Ballard, D. H. (1993) Subsymbolic modelling of hand-eye co-ordination. In: The Simulation of Human Intelligence, Ch. 3, pp. 71-102. Ed. D. E. Broadbent. Blackwell: Oxford.
6. Barlow, H. B. (1972) Single units and sensation: a neuron doctrine for perceptual psychology?. Perception 1, 371-394.
7. Barlow, H. B. (1985) Cerebral cortex as model builder. In: Models of the Visual Cortex, pp. 37-46. Eds D. Rose and V. G. Dobson. Wiley: Chichester.
8. Barlow, H. B., Kaushal, T. P. and Mitchison, G. J. (1989) Finding minimum entropy codes. Neural Computat. 1, 412-423.
9. Baylis, G. C., Rolls, E. T. and Leonard, C. M. (1985) Selectivity between faces in the responses of a population of neurons in the cortex in the superior temporal sulcus of the monkey. Brain Res. 342, 91-102.
10. Baylis, G. C., Rolls, E. T. and Leonard, C. M. (1987) Functional subdivisions of temporal lobe neocortex. J. Neurosci. 7, 330-342.
11. Baylis, G. C. and Rolls, E. T. (1987) Responses of neurons in the inferior temporal cortex in short term and serial recognition memory tasks. Expl Brain Res. 65, 614-622.
12. Bennett, A. (1990) Large competitive networks. Network 1, 449-462.
13. Boussaoud, D., Desimone, R. and Ungerleider, L. G. (1991) Visual topography of area TEO in the macaque. J. Comp. Neurol. 306, 554-575.
14. Breitmeyer, B. G. (1980) Unmasking visual masking: a look at the "why" behind the veil of the "how". Psychol. Rev. 87, 52-69.
15. Brown, T. H., Kariss, E. W. and Keenan, C. L. (1990) Hebbian synapses: biological mechanisms and algorithms. Ann. Rev. Neurosci. 13, 475-511.
16. Buhmann, J., Lades, M. and von der Malsburg, C. (1990) Size and distortion invariant object recognition by hierarchical graph matching. In: International Joint Conference on Neural Networks, pp. 411-416. IEEE: New York.
17. Buhmann, J., Lange, J., von der Malsburg, C., Vorbrüggen, J. C. and Würtz, R. P. (1991) Object recognition in the dynamic link architecture: parallel implementation of a transputer network. In: Neural Networks for Signal Processing, pp. 121-159. Ed. B. Kosko. Prentice Hall: Englewood Cliffs, New Jersey.
18. Bülthoff, H. and Edelman, S. (1992) Psychophysical support for a two-dimensional view interpolation theory of object recognition. Proc. natn. Acad. Sci. U.S.A. 92, 60-64.
19. Cavanagh, P. (1978) Size and location invariance in the visual system. Perception 7, 167-177.
20. Chakravarty, I. (1979) A generalized line and junction labelling scheme with applications to scene analysis. IEEE Transactions PAMI, April, pp. 202-205.
21. Engel, A. K., Konig, P., Kreiter, A. K., Schillen, T. B. and Singer, W. (1992) Temporal coding in the visual system: new vistas on integration in the nervous system. Trends Neurosci. 15, 218-226.
22. Feldman, J. A. (1985) Four frames suffice: a provisional model of vision and space [see p. 279]. Behar. Brain Sci. 8, 265-289.
23. Foldiak, P. (1991) Learning invariance from transformation sequences. Neural Comp. 3, 193-199.
24. Fukushima, K. (1980) Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybernet. 36, 193-202.
25. Gross, C. G. (1973) Visual functions of the inferotemporal cortex. In: Handbook of Sensory Physiology, pp. 451-482. Springer-Verlag: Berlin.
26. Gross, C. G., Desimone, R., Albright, T. D. and Schwartz, E. L. (1985) Inferior temporal cortex and pattern recognition. Expl Brain Res. Suppl. 11, 179-201.
27. Hasselmo, M. E., Rolls, E. T. and Baylis, G. C. (1989a) The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behav. Brain Res. 32, 203-218.
28. Hasselmo, M. E., Rolls, E. T., Baylis, G. C. and Nalwa, V. (1989b) Object-centered encoding by face-selective neurons in the cortex in the superior temporal sulcus of the monkey. Expl Brain Res. 75, 417-429.
29. Hawken, M. J. and Parker, A. J. (1987) Spatial properties of the monkey striate cortex. Proc. R. Soc. London [B] 231, 251-288.
30. Hertz, J., Krogh, A. and Palmer, R. G. (1991) Introduction to the Theory of Neural Computation. Addison-Wesley: Wokingham, U.K.
31. Hinton, G. E. (1981) A parallel computation that assigns canonical object based frames of reference. In: Proceedings of the 9th International Joint Conference on Artificial Intelligence. Reviewed in Rumelhart and McClelland (1986), Ch. 4.
32. Hornak, J., Rolls, E. T. and Wade, D. (1996) Face and voice expression identification and their association with emotional and behavioural changes in patients with frontal lobe damage. Neuropsychologia 34, 247-261.
33. Hummel, J. E. and Biederman, I. (1992) Dynamic binding in a neural network for shape recognition. Psychol. Rev. 99, 480-517.
34. Humphreys, G. W. and Bruce, V. (1989) Visual Cognition. Erlbaum: Hove, U.K.
35. Koenderink, J. J. and van Doom, A. J. (1979) The internal representation of solid shape with respect to vision. Biol. Cybernet. 32, 211-216.
36. Kovacs, G., Vogels, R. and Orban, G. A. (1995) Cortical correlate of pattern backward masking. Proc. Natn. Acad. Sci. 92, 5587-5591.
37. Leonard, C. M., Rolls, E. T., Wilson, F. A. W. and Baylis, G. C. (1985) Neurons in the amygdala of the monkey with responses selective for faces. Behav. Brain Res. 15, 159-176.
38. Linsker, E. (1986) From basic network principles to neural architecture. Proc. natn. Acad. Sci. U.S.A., 83, 7508-7512, 8390-8394, 8779-8783.
39. Logothetis, N. K., Pauls, J., Bülthoff, H. H. and Poggio, T. (1994) View-dependent object recognition by monkeys. Curr. Biol. 4, 401-414.
40. Marr, D. (1982) Vision. W. H. Freeman: San Francisco.
41. Maunsell, J. H. R. and Newsome, W. T. (1987) Visual processing in monkey extrastriate cortex. Ann. Rev. Neurosci. 10, 363-401.
42. Mel, B. W. (1996) SEEMORE: Combining color, shape, and texture histogramming in a neurally inspired approach to visual object recognition. (Unpublished manuscript.)
43. Miller, E. K. and Desimone, R. (1994) Parallel neuronal mechanisms for short-term memory. Science 263, 520-522.
44. Miyashita, Y. (1993) Inferior temporal cortex: where visual perception meets memory. Ann. Rev. Neurosci. 16, 245-263.
45. Miyashita, Y. and Chang, H. S. (1988) Neuronal correlate of pictorial short-term memory in the primate temporal cortex. Nature 331, 68-70.
46. Montague, R., Gally, J. and Edelman, G. (1991) Spatial signalling in the development and function of neural connections. Cerebr. Cort. 1, 199-220.
47. Nass, M. M. and Cooper, L. N. (1975) A theory for the development of feature detecting cells in visual cortex. Biol. Cybernet. 19, 1-18.
48. Oja, E. (1982) A simplified neuron model as a principal component analyzer. J. Math. Biol. 15, 267-273.
49. Olhausen, B. A., Anderson, C. H. and Van Essen, D. C. (1993) A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. J. Neurosci. 13, 4700-4719.
50. Perrett, D. I., Rolls, E. T. and Caan, W. (1982) Visual neurons responsive to faces in the monkey temporal cortex. Expl Brain Res. 47, 329-342.
51. Perrett, D. I., Smith, P. A. J., Mistlin, A. J., Chitty, A. J., Head, A. S., Potter, D. D., Broennimann, R., Milner, A. D. and Jeeves, M. A. (1985a) Visual analysis of body movements by neurons in the temporal cortex of the macaque monkey: a preliminary report. Behav. Brain Res. 16, 153-170.
52. Perrett, D. I., Smith, P. A. J., Potter, D. D., Mistlin, A. J., Head, A. S., Milner, D. and Jeeves, M. A. (1985b) Visual cells in temporal cortex sensitive to face view and gaze direction. Proc. R. Soc. 223B, 293-317.
53. Perrett, D. I., Mistlin, A. J. and Chitty, A. J. (1987) Visual neurons responsive to faces. Trends Neurosci. 10, 358-364.
54. Perrett, D. I., Hietanen, J. K., Oram, M. W. and Benson, P. J. (1992) Organisation and functions of cells responsive to faces in the temporal cortex. Phil. Trans. R. Soc. London [B] 335, 23-30.
55. Poggio, T. and Edelman, S. (1990) A network that learns to recognize three-dimensional objects. Nature 343, 263-266.
56. Poggio, T. and Girosi, F. (1990a) Regularization algorithms for learning that are equivalent to multilayer networks. Science 247, 978-982.
57. Poggio, T. and Girosi, F. (1990b) Networks for approximation and learning. Proc. IEEE 78, 1481-1497.
58. Rhodes, P. (1992) The open time of the NMDA channel facilitates the self-organisation of invariant object responses in cortex. Soc. Neurosci. Abstr. 18, 740.
59. Rolls, E. T. (1984) Neurons in the cortex of the temporal lobe and in the amygdala of the monkey with responses selective for faces. Human Neurobiol. 3, 209-222.
60. Rolls, E. T. (1989a) Functions of neuronal networks in the hippocampus and neocortex in memory. In: Neural Models of Plasticity: Experimental and Theoretical Approaches, Ch. 13, pp. 240-265. Eds J. H. Byrne and W. O. Berry. Academic Press: San Diego.
61. Rolls, E. T. (1989b) The representation and storage of information in neuronal networks in the primate cerebral cortex and hippocampus. In: The Computing Neuron, Ch. 8, pp. 125-159. Eds R. Durbin, C. Miall and G. Mitchison. Addison-Wesley: Wokingham, U.K.
62. Rolls, E. T. (1989c) Functions of neuronal networks in the hippocampus and cerebral cortex in memory. In: Models of Brain Function, pp. 15-33. Ed. R. M. J. Coterill. Cambridge University Press: Cambridge, U.K.
63. Rolls, E. T. (1990) A theory of emotion, and its application to understanding the neural basis of emotion. Cogn. Emotion 4, 161-190.
64. Rolls, E. T. (1991) Neural organisation of higher visual functions. Curr. Opin. Neurobiol. 1, 274-278.
65. Rolls, E. T. (1992a) Neurophysiology and functions of the primate amygdala. In: The Amygdala, Ch. 5, pp. 143-165. Ed. J. P. Aggleton. Wiley-Liss: New York.
66. Rolls, E. T. (1992b) Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. Phil. Trans. R. Soc. 335, 11-21.
67. Rolls, E. T. (1994) Brain mechanisms for invariant visual recognition and learning. Behav. Proc. 33, 113-138.
68. Rolls, E. T. (1995a) A theory of emotion and consciousness, and its application to understanding the neural basis of emotion. In: The Cognitive Neurosciences, Ch. 72, pp. 1091-1106. Ed. M. S. Gazzaniga. MIT Press: Cambridge, MA.
69. Rolls, E. T. (1995b) Learning mechanisms in the temporal lobe visual cortex. Behav. Brain Res. 66, 177-185.
70. Rolls, E. T. (1996a) Roles of long term potentiation and long term depression in neuronal network operations in the brain. In: Cortical Plasticity: LTP and LTD, Ch. 11, pp. 223-250. Eds M. S. Fazeli and G. L. Collingridge. Bios: Oxford, U.K.
71. Rolls, E. T. (1996b) A neurophysiological and computational approach to the functions of the temporal lobe cortical visual areas in invariant object recognition. In: Computational and Biological Mechanisms of Visual Coding, Eds L. Harris and M. Jenkin. Cambridge University Press: Cambridge, U.K.
72. Rolls, E. T., Baylis, G. C. and Leonard, C. M. (1985) Role of low and high spatial frequencies in the face-selective responses of neurons in the cortex in the superior temporal sulcus. Vision Res. 25, 1021-1035.
73. Rolls, E. T. and Baylis, G. C. (1986) Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey. Expl Brain Res. 65, 38-48.
74. Rolls, E. T., Baylis, G. C. and Hasselmo, M. E. (1987) The responses of neurons in the cortex in the superior temporal sulcus of the monkey to band-pass spatial frequency filtered faces. Vis. Res. 27, 311-326.
75. Rolls, E. T., Baylis, G. C., Hasselmo, M. E. and Nalwa, V. (1989) The effect of learning on the face-selective responses of neurons in the cortex in the superior temporal sulcus of the monkey. Expl Brain Res. 76, 153-164.
76. Rolls, E. T. and Treves, A. (1990) The relative advantages of sparse versus distributed encoding for associative neuronal networks in the brain. Network 1, 407-421.
77. Rolls, E. T., Tovee, M. J. and Ramachandran, V. S. (1993) Visual learning reflected in the responses of neurons in the temporal visual cortex of the macaque. Soc. Neurosci. Abstr. 19, 27.
78. Rolls, E. T. and Tovee, M. J. (1994) Processing speed in the cerebral cortex, and the neurophysiology of visual backward masking. Proc. R. Soc. B 257, 9-15.
79. Rolls, E. T., Tovee, M. J., Purcell, D. G., Stewart, A. L. and Azzopardi, P. (1994) The responses of neurons in the temporal cortex of primates, and face identification and detection. Expl Brain Res. 101, 474-484.
80. Rolls, E. T. and Tovee, M. J. (1995a) Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. J. Neurophysiol. 73, 713-726.
81. Rolls, E. T. and Tovee, M. J. (1995b) The responses of single neurons in the temporal visual cortical areas of the macaque when more than one stimulus is present in the visual field. Expl Brain Res. 103, 409-420.
82. Rolls, E. T., Treves, A. and Tovee, M. J. (1996a) The representational capacity of the distributed encoding of information provided by populations of neurons in the primate temporal visual cortex. Expl Brain Res. (in press).
83. Rolls, E. T., Booth, M. C. A. and Treves, A. (1996b) View-invariant representations of objects in the inferior temporal visual cortex. Soc. Neurosci. Abstr. 22.
84. Rolls, E. T., Tovee, M. and Treves, A. (1997) Information in the neuronal representation of individual stimuli in the primate temporal visual cortex. J. Comput. Neurosci. (in press).
85. Rolls, E. T. and Treves, A. (1997) Neural Networks and Brain Function. Oxford University Press: Oxford.
86. Seltzer, B. and Pandya, D. N. (1978) Afferent cortical connections and architectonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey. Brain Res. 149, 1-24.
87. Simmen, M. W., Rolls, E. T. and Treves, A. (1996) On the dynamics of a network of spiking neurons. In Computations and Neuronal Systems: Proceedings of CNS95, Eds F. H. Eekman and J. M. Bower. Kluwer: Boston.
88. Snedecor, G. W. and Cochran, W. G. (1989) Statistical Methods, 8th edn. Iowa State University Press: Ames, IA.
89. Sutton, R. S. and Barto, A. G. (1981) Towards a modern theory of adaptive networks: expectation and prediction. Psychol. Rev. 88, 135-170.
90. Tanaka, K., Saito, C., Fukada, Y. and Moriya, M. (1990) Integration of form, texture, and color information in the inferotemporal cortex of the macaque. In: Vision, Memory and the Temporal Lobe, Ch. 10, pp. 101-109. Eds E. Iwai and M. Mishkin. Elsevier: New York.
91. Tanaka, K., Saito, H., Fukada, Y. and Moriya, M. (1991) Coding visual images of objects in the inferotemporal cortex of the macaque monkey. J. Neurophysiol. 66, 170-189.
92. Tarr, M. J. and Pinker, S. (1989) Mental rotation and orientation-dependence in shape recognition. Cognit. Psychol. 21, 233-282.
93. Thorpe, S. J. and Imbert, M. (1989) Biological constraints on connectionist models. In: Connectionism in Perspective, pp. 63-92. Eds R. Pfeifer, Z. Schreter and F. Fogelman-Soulie. Elsevier: Amsterdam.
94. Tovee, M. J., Rolls, E. T., Treves, A. and Bellis, R. P. (1993) Information encoding and the responses of single neurons in the primate temporal visual cortex. J. Neurophysiol. 70, 640-654.
95. Tovee, M. J., Rolls, E. T. and Azzopardi, P. (1994) Translation invariance and the responses of neurons in the temporal visual cortical areas of primates. J. Neurophysiol. 72, 1049-1060.
96. Tovee, M. J. and Rolls, E. T. (1995) Information encoding in short firing rate epochs by single neurons in the primate temporal visual cortex. Vis. Cognit. 2, 35-58.
97. Tovee, M. J., Rolls, E. T. and Ramachandran, V. S. (1996) Visual learning in neurons of the primate temporal visual cortex. NeuroReport 7, 2757-2760.
98. Treves, A. (1993) Mean-field analysis of neuronal spike dynamics. Network 4, 259-284.
99. Treves, A. and Rolls, E. T. (1994) A computational analysis of the role of the hippocampus in memory. Hippocampus 4, 374-391.
100. Turvey, M. T. (1973) On the peripheral and central processes in vision: inferences from an information processing analysis of masking with patterned stimuli. Psychol. Rev. 80, 1-52.
101. Ungerleider, L. G. and Mishkin, M. (1982) Two cortical visual systems. In: Analysis of Visual Behaviour, pp. 549-586. Eds D. J. Ingle, M. A. Goodale and R. J. W. Mansfield. MIT Press: Cambridge, MA.
102. Ungerleider, L. G. and Haxby, J. V. (1994) "What" and "Where" in the human brain. Curr. Opin. Neurobiol. 4, 157-165.
103. Van Essen, D., Anderson, C. H. and Felleman, D. J. (1992) Information processing in the primate visual system: an integrated systems perspective. Science 255, 419-423.
104. von der Malsburg, C. (1973) Self-organization of orientation sensitive cells in the striate cortex [Reprinted in Anderson and Rosenfeld, 1988]. Kybernetik 14, 85-100.
105. von der Malsburg, C. (1981) The Correlation Theory of Brain Function. Technical report 81-2, Department of Neurobiology, Max-Planck-Institute for Biophysical Chemistry, Göttingen.
106. von der Malsburg, C. and Schneider, W. (1986) A neural cocktail-party processor. Biol. Cybernet. 54, 29-40.
107. von der Malsburg, C. (1990) A neural architecture for the representation of scenes. In: Brain Organization and Memory: Cells, Systems and Circuits, Ch. 18, pp. 356-372. Eds J. L. McGaugh, N. M. Weinberger and G. Lynch. Oxford University Press: New York.
108. Wallis, G. (1994) Neural Mechanisms Underlying Processing in the Visual Areas of the Occipital and Temporal Lobes. Doctoral thesis. Department of Experimental Psychology, Oxford University, U.K.
109. Wallis, G. (1996a) Optimal unsupervised learning in invariant object recognition Neural Computation (in press).
110. Wallis, G. (1996b) Using spatio-temporal correlations to learn invariant object recognition. Neural Networks (in press).
111. Wallis, G. (1996c) Temporal order in human object recognition. J. Biol. Syst. (in press).
112. Wallis, G., Rolls, E. T. and Foldiak, P. (1993) Learning invariant responses to the natural transformations of objects. Intl Joint Conf. Neural Networks 2, 1087-1090.
113. Yamane, S., Kaji, S. and Kawano, K. (1988) What facial features activate face neurons in the inferotemporal cortex of the monkey?. Expl Brain Res. 73, 209-214.