Invariant visual object recognition: A model, with lighting invariance

Journal of Physiology Paris

Volumn 100, Issue 1-3, 2006, Pages 43-62

  Rolls, Edmund T ^a   Stringer, Simon M ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Attention; Dorsal visual stream; Global motion recognition; Inferior temporal visual cortex; Trace learning; Ventral visual stream; View invariance

Indexed keywords

ARTICLE; ILLUMINATION; LEARNING; SHORT TERM MEMORY; STATISTICS; VISION; VISUAL MEMORY; VISUAL STIMULATION; VISUAL SYSTEM;

ANIMALS; COMPUTER SIMULATION; HUMANS; LIGHTING; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; SPACE PERCEPTION; VISUAL CORTEX; VISUAL PATHWAYS;

EID: 35848965229     PISSN: 09284257     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jphysparis.2006.09.004     Document Type: Article

References (117)

1. Abeles M. Corticonics: Neural Circuits of the Cerebral Cortex (1991), Cambridge University Press, Cambridge
2. Ackley D.H., Hinton G.E., and Sejnowski T.J. A learning algorithm for Boltzmann machines. Cognitive Science 9 (1985) 147-169
3. Aggelopoulos N.C., and Rolls E.T. Natural scene perception: inferior temporal cortex neurons encode the positions of different objects in the scene. European Journal of Neuroscience 22 (2005) 2903-2916
4. Aggelopoulos N.C., Franco L., and Rolls E.T. Object perception in natural scenes: encoding by inferior temporal cortex simultaneously recorded neurons. Journal of Neurophysiology 93 (2005) 1342-1357
5. Biederman I. Perceiving real-world scenes. Science 177 (1972) 77-80
6. Booth M.C.A., and Rolls E.T. View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. Cerebral Cortex 8 (1998) 510-523
7. Chelazzi L., Miller E., Duncan J., and Desimone R. A neural basis for visual search in inferior temporal cortex. Nature (London) 363 (1993) 345-347
8. Corchs S., and Deco G. Large-scale neural model for visual attention: integration of experimental single cell and fMRI data. Cerebral Cortex 12 (2002) 339-348
9. Corchs S., and Deco G. Feature-based attention in human visual cortex: simulation of fMRI data. Neuroimage 21 (2004) 36-45
10. Cowey A., and Rolls E.T. Human cortical magnification factor and its relation to visual acuity. Experimental Brain Research 21 (1975) 447-454
11. Deco G., and Lee T.S. A unified model of spatial and object attention based on inter-cortical biased competition. Neurocomputing 44-46 (2002) 775-781
12. Deco G., and Rolls E.T. Object-based visual neglect: a computational hypothesis. European Journal of Neuroscience 16 (2002) 1994-2000
13. Deco G., and Rolls E.T. Attention and working memory: a dynamical model of neuronal activity in the prefrontal cortex. European Journal of Neuroscience 18 (2003) 2374-2390
14. Deco G., and Rolls E.T. A neurodynamical cortical model of visual attention and invariant object recognition. Vision Research 44 (2004) 621-644
15. Deco G., and Rolls E.T. Attention, short term memory, and action selection: a unifying theory. Progress in Neurobiology 76 (2005) 236-256
16. Deco G., and Rolls E.T. Neurodynamics of biased competition and cooperation for attention: a model with spiking neurons. Journal of Neurophysiology 94 (2005) 295-313
17. Deco G., and Rolls E.T. Synaptic and spiking dynamics underlying reward reversal in the orbitofrontal cortex. Cerebral Cortex 15 (2005) 15-30
18. Deco G., and Rolls E.T. A neurophysiological model of decision-making and Weber's law. European Journal of Neuroscience 24 (2006) 901-916
19. Deco G., and Zihl J. Top-down selective visual attention: a neurodynamical approach. Visual Cognition 8 (2001) 119-140
20. Deco G., Pollatos O., and Zihl J. The time course of selective visual attention: theory and experiments. Vision Research 42 (2002) 2925-2945
21. Deco G., Rolls E.T., and Horwitz B. 'What' and 'where' in visual working memory: a computational neurodynamical perspective for integrating fMRI and single-neuron data. Journal of Cognitive Neuroscience 16 (2004) 683-701
22. Desimone R., and Duncan J. Neural mechanisms of selective visual attention. Annual Review of Neuroscience 18 (1995) 193-222
23. Duncan J. Cooperating brain systems in selective perception and action. In: Inui T., and McClelland J.L. (Eds). Attention and Performance XVI (1996), MIT Press, Cambridge, Mass 549-578
24. Elliffe M.C.M., Rolls E.T., and Stringer S.M. Invariant recognition of feature combinations in the visual system. Biological Cybernetics 86 (2002) 59-71
25. Feldman J.A. Four frames suffice: a provisional model of vision and space. Behavioural Brain Sciences 8 (1985) 265-289
26. Finkel L.H., and Edelman G.M. Population rules for synapses in networks. In: Edelman G.M., Gall W.E., and Cowan W.M. (Eds). Synaptic Function (1987), John Wiley & Sons, New York 711-757
27. Földiák P. Learning invariance from transformation sequences. Neural Computation 3 (1991) 193-199
28. Földiák, P., 1992. Models of sensory coding, Technical Report CUED/F-INFENG/TR 91, University of Cambridge, Department of Engineering.
29. Franco L., Rolls E.T., Aggelopoulos N.C., and Treves A. The use of decoding to analyze the contribution to the information of the correlations between the firing of simultaneously recorded neurons. Experimental Brain Research 155 (2004) 370-384
30. Franco, L., Rolls, E.T., Aggelopoulos, N.C., Jerez, J.M., 2007. Neuronal selectivity, population sparseness, and ergodicity in the inferior temporal visual cortex, Submitted for publication.
31. Fukushima K. Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics 36 (1980) 193-202
32. Geesaman B.J., and Andersen R.A. The analysis of complex motion patterns by form/cue invariant MSTd neurons. Journal of Neuroscience 16 (1996) 4716-4732
33. Graziano M.S.A., Andersen R.A., and Snowden R.J. Tuning of MST neurons to spiral motions. Journal of Neuroscience 14 (1994) 54-67
34. Hasselmo M.E., Rolls E.T., and Baylis G.C. The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behavioural Brain Research 32 (1989) 203-218
35. Hasselmo M.E., Rolls E.T., Baylis G.C., and Nalwa V. Object-centered encoding by face-selective neurons in the cortex in the superior temporal sulcus of the monkey. Experimental Brain Research 75 (1989) 417-429
36. Hawken M.J., and Parker A.J. Spatial properties of the monkey striate cortex. Proceedings of the Royal Society, London [B] 231 (1987) 251-288
37. Hertz J.A., Krogh A., and Palmer R.G. Introduction to the Theory of Neural Computation (1991), Addison-Wesley, Wokingham, UK
38. Hummel J.E., and Biederman I. Dynamic binding in a neural network for shape recognition. Psychological Review 99 (1992) 480-517
39. Koenderink J.J. Solid Shape (1990), MIT Press, Cambridge, MA
40. Koenderink J.J., and Van Doorn A.J. The internal representation of solid shape with respect to vision. Biological Cybernetics 32 (1979) 211-217
41. Logothetis N.K., Pauls J., Bulthoff H.H., and Poggio T. View-dependent object recognition by monkeys. Current Biology 4 (1994) 401-414
42. Logothetis N.K., Pauls J., and Poggio T. Shape representation in the inferior temporal cortex of monkeys. Current Biology 5 (1995) 552-563
43. Malsburg C.v.d. Self-organization of orientation-sensitive columns in the striate cortex. Kybernetik 14 (1973) 85-100
44. Malsburg C.v.d. A neural architecture for the representation of scenes. In: McGaugh J.L., Weinberger N.M., and Lynch G. (Eds). Brain Organization and Memory: Cells, Systems and Circuits (1990), Oxford University Press, New York 356-372 (Chapter 19)
45. Martinez-Trujillo J., and Treue S. Attentional modulation strength in cortical area MT depends on stimulus contrast. Neuron 35 (2002) 365-370
46. Mel B.W., and Fiser J. Minimizing binding errors using learned conjunctive features. Neural Computation 12 (2000) 731-762
47. Mel B.W., Ruderman D.L., and Archie K.A. Translation-invariant orientation tuning in visual "complex" cells could derive from intradendritic computations. Journal of Neuroscience 18 11 (1998) 4325-4334
48. Montague R., Gally J., and Edelman G. Spatial signalling in the development and function of neural connections. Cerebral Cortex 1 (1991) 199-220
49. Moran J., and Desimone R. Selective attention gates visual processing in the extrastriate cortex. Science 229 (1985) 782-784
50. Movshon J.A., Adelson E.H., Gizzi M.S., and Newsome W.T. The analysis of moving visual patterns. In: Chagas C., Gattass R., and Gross C. (Eds). Pattern Recognition Mechanisms (1985), Springer-Verlag, New York 117-151
51. Mozer M.C. The Perception of Multiple Objects: A Connectionist Approach (1991), MIT Press, Cambridge, Massachusetts
52. Newsome W.T., Britten K.H., and Movshon J.A. Neuronal correlates of a perceptual decision. Nature 341 (1989) 52-54
53. Oja E. A simplified neuron model as a principal component analyzer. Journal of Mathematical Biology 15 (1982) 267-273
54. Olshausen B.A., Anderson C.H., and Van Essen D.C. A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. Journal of Neuroscience 13 (1993) 4700-4719
55. Olshausen B.A., Anderson C.H., and Van Essen D.C. A multiscale dynamic routing circuit for forming size- and position-invariant object representations. Journal of Computational Neuroscience 2 (1995) 45-62
56. O'Reilly R., and Johnson M. Object recognition and sensitive periods: a computational analysis of visual imprinting. Neural Computation 6 (1994) 357-389
57. Perrett D., and Oram M. Neurophysiology of shape processing. Image and Vision Computing 11 6 (1993) 317-333
58. Perrett D.I., Rolls E.T., and Caan W. Visual neurons responsive to faces in the monkey temporal cortex. Experimental Brain Research 47 (1982) 329-342
59. Perrett D.I., Smith P.A.J., Potter D.D., Mistlin A.J., Head A.S., Milner D., and Jeeves M.A. Visual cells in temporal cortex sensitive to face view and gaze direction. Proceedings of the Royal Society of London, Series B 223 (1985) 293-317
60. Perry, G., Rolls, E.T., Stringer, S.M., 2006. Continuous transformation learning of translation invariant representations, submitted for publication.
61. Perry, G., Rolls, E.T., Stringer, S.M., in press. Spatial vs temporal continuity in view invariant visual object recognition learning. Vision Research.
62. Poggio T., and Edelman S. A network that learns to recognize three-dimensional objects. Nature 343 (1990) 263-266
63. Renart A., Parga N., and Rolls E.T. A recurrent model of the interaction between the prefrontal cortex and inferior temporal cortex in delay memory tasks. In: Solla S., Leen T., and Mueller K.-R. (Eds). Advances in Neural Information Processing Systems vol. 12 (2000), MIT Press, Cambridge, Mass 171-177
64. Reynolds J., and Desimone R. The role of neural mechanisms of attention in solving the binding problem. Neuron 24 (1999) 19-29
65. Reynolds J.H., Chelazzi L., and Desimone R. Competitive mechanisms subserve attention in macaque areas V2 and V4. Journal of Neuroscience 19 (1999) 1736-1753
66. Rhodes P. The open time of the NMDA channel facilitates the self-organisation of invariant object responses in cortex. Society for Neuroscience Abstracts 18 (1992) 740
67. Riesenhuber M., and Poggio T. Are cortical models really bound by the "binding problem"?. Neuron 24 (1999) 87-93
68. Riesenhuber M., and Poggio T. Hierarchical models of object recognition in cortex. Nature Neuroscience 2 (1999) 1019-1025
69. Riesenhuber M., and Poggio T. Models of object recognition. Nature Neuroscience Supplement 3 (2000) 1199-1204
70. Rolls E.T. Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. Philosophical Transactions of the Royal Society 335 (1992) 11-21
71. Rolls E.T. Brain mechanisms for invariant visual recognition and learning. Behavioural Processes 33 (1994) 113-138
72. Rolls E.T. Learning mechanisms in the temporal lobe visual cortex. Behavioural Brain Research 66 (1995) 177-185
73. Rolls E.T. Functions of the primate temporal lobe cortical visual areas in invariant visual object and face recognition. Neuron 27 (2000) 205-218
74. Rolls E.T. Consciousness absent and present: a neurophysiological exploration. Progress in Brain Research 144 (2003) 95-106
75. Rolls E.T. Emotion Explained (2005), Oxford University Press, Oxford
76. Rolls, E.T., 2006. The representation of information about faces in the temporal and frontal lobes of primates including humans. Neuropsychologia, in press.
77. Rolls E.T. Invariant representations of objects in natural scenes in the temporal cortex visual areas. In: Funahashi S. (Ed). Representation and the Brain (2007), Springer-Verlag, Berlin
78. Rolls E.T., and Baylis G.C. Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey. Experimental Brain Research 65 (1986) 38-48
79. Rolls E.T., and Cowey A. Topography of the retina and striate cortex and its relationship to visual acuity in rhesus monkeys and squirrel monkeys. Experimental Brain Research 10 (1970) 298-310
80. Rolls E.T., and Deco G. Computational Neuroscience of Vision (2002), Oxford University Press, Oxford
81. Rolls, E.T., Deco, G., 2006. Attention in natural scenes: neurophysiological and computational bases. Neural Networks, in press.
82. Rolls E.T., and Milward T. A model of invariant object recognition in the visual system: learning rules, activation functions, lateral inhibition, and information-based performance measures. Neural Computation 12 (2000) 2547-2572
83. Rolls E.T., and Stringer S.M. Invariant object recognition in the visual system with error correction and temporal difference learning. Network: Computation in Neural Systems 12 (2001) 111-129
84. Rolls, E.T., Stringer, S.M., 2006. Invariant global motion recognition in the dorsal visual system: a unifying theory. Neural Computation, in press.
85. Rolls E.T., and Tovee M.J. Processing speed in the cerebral cortex and the neurophysiology of visual masking. Proceedings of the Royal Society, B 257 (1994) 9-15
86. Rolls E.T., and Tovee M.J. Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. Journal of Neurophysiology 73 (1995) 713-726
87. Rolls E.T., and Treves A. Neural Networks and Brain Function (1998), Oxford University Press, Oxford
88. Rolls E.T., Tovee M.J., Purcell D.G., Stewart A.L., and Azzopardi P. The responses of neurons in the temporal cortex of primates, and face identification and detection. Experimental Brain Research 101 (1994) 474-484
89. Rolls E.T., Treves A., and Tovee M.J. The representational capacity of the distributed encoding of information provided by populations of neurons in the primate temporal visual cortex. Experimental Brain Research 114 (1997) 149-162
90. Rolls E.T., Treves A., Tovee M., and Panzeri S. Information in the neuronal representation of individual stimuli in the primate temporal visual cortex. Journal of Computational Neuroscience 4 (1997) 309-333
91. Rolls E.T., Tovee M.J., and Panzeri S. The neurophysiology of backward visual masking: information analysis. Journal of Cognitive Neuroscience 11 (1999) 335-346
92. Rolls E.T., Aggelopoulos N.C., and Zheng F. The receptive fields of inferior temporal cortex neurons in natural scenes. Journal of Neuroscience 23 (2003) 339-348
93. Rolls E.T., Aggelopoulos N.C., Franco L., and Treves A. Information encoding in the inferior temporal visual cortex: contributions of the firing rates and the correlations between the firing of neurons. Biological Cybernetics 90 (2004) 19-32
94. Rolls, E.T., Franco, L., Aggelopoulos, N.C., Jerez, J.M., 2006. Information in the first spike, the order of spikes, and the number of spikes provided by neurons in the inferior temporal visual cortex. Vision Research, in press.
95. Rosenblatt F. Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms (1961), Spartan, Washington, DC
96. Singer W. Neuronal synchrony: a versatile code for the definition of relations?. Neuron 24 (1999) 49-65
97. Singer W., and Gray C.M. Visual feature integration and the temporal correlation hypothesis. Annual Review of Neuroscience 18 (1995) 555-586
98. Singer W., Gray C., Engel A., Konig P., Artola A., and Brocher S. Formation of cortical cell assemblies. Cold Spring Harbor Symposium on Quantitative Biology 55 (1990) 939-952
99. Stringer S.M., and Rolls E.T. Position invariant recognition in the visual system with cluttered environments. Neural Networks 13 (2000) 305-315
100. Stringer S.M., and Rolls E.T. Invariant object recognition in the visual system with novel views of 3D objects. Neural Computation 14 (2002) 2585-2596
101. Stringer S.M., Perry G., Rolls E.T., and Proske J.H. Learning invariant object recognition in the visual system with continuous transformations. Biological Cybernetics 94 (2006) 128-142
102. Sutton R.S., and Barto A.G. Towards a modern theory of adaptive networks: expectation and prediction. Psychological Review 88 (1981) 135-170
103. Szabo M., Almeida R., Deco G., and Stetter M. Cooperation and biased competition model can explain attentional filtering in the prefrontal cortex. European Journal of Neuroscience 19 (2004) 1969-1977
104. Tanaka K. Inferotemporal cortex and object vision. Annual Review of Neuroscience 19 (1996) 109-139
105. Tanaka K., Saito C., Fukada Y., and Moriya M. Integration of form, texture, and color information in the inferotemporal cortex of the macaque. In: Iwai E., and Mishkin M. (Eds). Vision, Memory and the Temporal Lobe (1990), Elsevier, New York 101-109 (Chapter 10)
106. Tovee M.J., and Rolls E.T. Information encoding in short firing rate epochs by single neurons in the primate temporal visual cortex. Visual Cognition 2 (1995) 35-58
107. Tovee M.J., Rolls E.T., Treves A., and Bellis R.P. Information encoding and the responses of single neurons in the primate temporal visual cortex. Journal of Neurophysiology 70 (1993) 640-654
108. Tovee M.J., Rolls E.T., and Azzopardi P. Translation invariance and the responses of neurons in the temporal visual cortical areas of primates. Journal of Neurophysiology 72 (1994) 1049-1060
109. Trappenberg T.P., Rolls E.T., and Stringer S.M. Effective size of receptive fields of inferior temporal visual cortex neurons in natural scenes. In: Dietterich T.G., Becker S., and Gharamani Z. (Eds). Advances in Neural Information Processing Systems vol. 14 (2002), MIT Press, Cambridge, MA 293-300
110. Ullman S. High-level vision. Object Recognition and Visual Cognition (1996), Bradford/MIT Press, Cambridge, Mass
111. Usher M., and Niebur E. Modelling the temporal dynamics of IT neurons in visual search: a mechanism for top-down selective attention. Journal of Cognitive Neuroscience 8 (1996) 311-327
112. Van Essen D., Anderson C.H., and Felleman D.J. Information processing in the primate visual system: an integrated systems perspective. Science 255 (1992) 419-423
113. Vogels R., and Biederman I. Effects of illumination intensity and direction on object coding in macaque inferior temporal cortex. Cerebral Cortex 12 (2002) 756-766
114. Wallis G., and Baddeley R. Optimal unsupervised learning in invariant object recognition. Neural Computation 9 (1997) 883-894
115. Wallis G., and Rolls E.T. Invariant face and object recognition in the visual system. Progress in Neurobiology 51 (1997) 167-194
116. Wurtz R.H., and Kandel E.R. Perception of motion depth and form. In: Kandel E.R., Schwartz J.H., and Jessell T.M. (Eds). Principles of Neural Science. fourth ed. (2000), McGraw-Hill, New York 548-571
117. Yamane S., Kaji S., and Kawano K. What facial features activate face neurons in the inferotemporal cortex of the monkey?. Experimental Brain Research 73 (1988) 209-214