A quantitative theory of immediate visual recognition

Progress in Brain Research

Volumn 165, Issue , 2007, Pages 33-56

  Serre, Thomas ^a   Kreiman, Gabriel ^a   Kouh, Minjoon ^a   Cadieu, Charles ^a   Knoblich, Ulf ^a   Poggio, Tomaso ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

feedforward; hierarchical models; ventral stream; visual object recognition

Indexed keywords

BIOLOGY; CONCEPTUAL FRAMEWORK; FEEDBACK SYSTEM; HUMAN; IMAGE ANALYSIS; IMAGE PROCESSING; LEARNING; MATHEMATICAL MODEL; MOLECULAR MODEL; NERVE CELL; OBSERVATIONAL STUDY; PREDICTION; PRIORITY JOURNAL; PSYCHOPHYSICS; REVIEW; TEMPORAL LOBE; THEORY; VISUAL CORTEX; VISUAL MEMORY; VISUAL STIMULATION; VISUAL SYSTEM;

ANIMALS; COMPUTER SIMULATION; FIELD DEPENDENCE-INDEPENDENCE; HUMANS; MODELS, BIOLOGICAL; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PSYCHOPHYSICS; VISUAL CORTEX;

EID: 34948886211     PISSN: 00796123     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0079-6123(06)65004-8     Document Type: Review

References (78)

1. Abbott L.F., Rolls E.T., and Tovee M.T. Representational capacity of face coding in monkeys. Cereb. Cortex 6 (1996) 498-505
2. Amit Y., and Mascaro M. An integrated network for invariant visual detection and recognition. Vision Res. 43 19 (2003) 2073-2088
3. Bacon-Mace N., Mace M.J., Fabre-Thorpe M., and Thorpe S.J. The time course of visual processing: backward masking and natural scene categorisation. Vision Res. 45 (2005) 1459-1469
4. Barlow H.B. Possible principles underlying the transformation of sensory messages. In: Rosenblith W.A. (Ed). Sensory Communication (1961), MIT Press, Cambridge, MA 217-234
5. Biederman I. Recognition-by-components: a theory of human image understanding. Psychol. Rev. 94 (1987) 115-147
6. Booth M.C., and Rolls E.T. View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. Cereb. Cortex 8 (1998) 510-523
7. Breitmeyer B., and Ogmen H. Visual Masking: Time Slices through Conscious and Unconscious Vision (2006), Oxford University Press, UK
8. DeAngelis G.C., Robson J.G., Ohzawa I., and Freeman R.D. Organization of suppression in receptive fields of neurons in cat visual cortex. J. Neurophysiol. 68 1 (1992) 144-163
9. Delorme A., Richard G., and Fabre-Thorpe M. Ultra-rapid categorisation of natural images does not rely on colour: a study in monkeys and humans. Vision Res. 40 (2000) 2187-2200
10. Desimone R., Albright T.D., Gross C.G., and Bruce C. Stimulus-selective properties of inferior temporal neurons in the macaque. J. Neurosci. 4 8 (1984) 2051-2062
11. Elston G.N. Comparative studies of pyramidal neurons in visual cortex of monkeys. In: Kaas J.H., and Collins C. (Eds). The Primate Visual System (2003), CRC Press, Boca Raton, FL 365-385
12. Enns J.T., and Di Lollo V. What's new in masking?. Trends Cogn. Sci. 4 9 (2000) 345-351
13. Fei-Fei, L., Fergus, R. and Perona, P. (2004) Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. In: Proc. IEEE CVPR, Workshop on generative-model based vision, Washington, DC.
14. Felleman D.J., and van Essen D.C. Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1 (1991) 1-47
15. Földiák P. Learning invariance from transformation sequences. Neural Comput. 3 (1991) 194-200
16. Freedman D.J., Riesenhuber M., Poggio T., and Miller E.K. Visual categorization and the primate prefrontal cortex: neurophysiology and behavior. J. Neurophysiol. 88 (2002) 930-942
17. Freiwald W.A., Tsao D.Y., Tootell R.B.H., and Livingstone M.S. Complex and dynamic receptive field structure in macaque cortical area V4d. J. Vis. 4 8 (2005) 184a
18. Fukushima K. Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36 (1980) 193-202
19. Gallant J.L., Connor C.E., Rakshit S., Lewis J.W., and Van Essen D.C. Neural responses to polar, hyperbolic, and Cartesian gratings in area V4 of the macaque monkey. J. Neurophysiol. 76 (1996) 2718-2739
20. Gawne T.J., and Martin J.M. Responses of primate visual cortical V4 neurons to simultaneously presented stimuli. J. Neurophysiol. 88 (2002) 1128-1135
21. Giese M., and Poggio T. Neural mechanisms for the recognition of biological movements and action. Nat. Rev. Neurosci. 4 (2003) 179-192
22. Gross C.G. Brain Vision and Memory: Tales in the History of Neuroscience (1998), MIT Press, Cambridge, MA
23. Gross C.G., Rocha-Miranda C.E., and Bender D.B. Visual properties of neurons in inferotemporal cortex of the macaque. J. Neurophysiol. 35 (1972) 96-111
24. Hegdé J., and van Essen D.C. A comparative study of shape representation in macaque visual areas V2 and V4. Cereb. Cortex. 17 (2007) 1100-1116
25. Hietanen J.K., Perrett D.I., Oram M.W., Benson P.J., and Dittrich W.H. The effects of lighting conditions on responses of cells selective for face views in the macaque temporal cortex. Exp. Brain Res. 89 (1992) 157-171
26. Hubel D.H., and Wiesel T.N. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J. Physiol. 160 (1962) 106-154
27. Hung C., Kreiman G., Poggio T., and DiCarlo J. Fast read-out of object identity from macaque inferior temporal cortex. Science 310 (2005) 863-866
28. Keysers C., Xiao D.K., Földiák P., and Perrett D.I. The speed of sight. J. Cogn. Neurosci. 13 (2001) 90-101
29. Kobatake E., and Tanaka K. Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. J. Neurophysiol. 71 (1994) 856-867
30. Kreiman G., Hung C., Poggio T., and DiCarlo J. Object selectivity of local field potentials and spikes in the inferior temporal cortex of macaque monkeys. Neuron 49 (2006) 433-445
31. Lamme V.A.F., and Roelfsema P.R. The disctinct modes of vision offered by feedforward and recurrent processing. Trends Neurosci. 23 (2000) 571-579
32. Lampl I., Ferster D., Poggio T., and Riesenhuber M. Intracellular measurements of spatial integration and the MAX operation in complex cells of the cat primary visual cortex. J. Neurophysiol. 92 (2004) 2704-2713
33. LeCun Y., Bottou L., Bengio Y., and Haffner P. Gradient-based learning applied to document recognition. Proc. IEEE 86 11 (1998) 2278-2324
34. Li F.F., VanRullen R., Koch C., and Perona P. Rapid natural scene categorization in the near absence of attention. Proc. Natl. Acad. Sci. U.S.A. 99 (2002) 9596-9601
35. Logothetis N.K., Pauls J., Augath M., Trinath T., and Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature 412 (2001) 150-157
36. Logothetis N.K., Pauls J., and Poggio T. Shape representation in the inferior temporal cortex of monkeys. Curr. Biol. 5 (1995) 552-563
37. Logothetis N.K., and Sheinberg D.L. Visual object recognition. Ann. Rev. Neurosci. 19 (1996) 577-621
38. Mahon L.E., and DeValois R.L. Cartesian and non-Cartesian responses in LGN, V1, and V2 cells. Vis. Neurosci. 18 (2001) 973-981
39. Mel B.W. SEEMORE: combining color, shape, and texture histogramming in a neurally inspired approach to visual object recognition. Neural Comput. 9 (1997) 777-804
40. Miller E.K. The prefrontal cortex and cognitive control. Nat. Rev. Neurosci. 1 (2000) 59-65
41. Mitzdorf U. Current source-density method and application in cat cerebral cortex: investigation of evoked potentials and EEG phenomena. Physiol. Rev. 65 (1985) 37-99
42. Mutch, J. and Lowe, D. (2006) Multiclass object recognition with sparse, localized features. In: Proc. IEEE Conf. Comput. Vis. Pattern Recognit., New York, NY.
43. Nakamura H., Gattass R., Desimone R., and Ungerleider L.G. The modular organization of projections from areas V1 and V2 to areas V4 and TEO in macaques. J. Neurosci. 13 9 (1993) 3681-3691
44. Olshausen B.A., Anderson C.H., and Van Essen D.C. A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. J. Neurosci. 13 11 (1993) 4700-4719
45. Pasupathy A., and Connor C.E. Shape representation in area V4: position-specific tuning for boundary conformation. J. Neurophysiol. 86 5 (2001) 2505-2519
46. Perrett D.I., Hietanen J.K., Oram M.W., and Benson P.J. Organization and functions of cells responsive to faces in the temporal cortex. Philos. Trans. R. Soc. B 335 (1992) 23-30
47. Perrett D.I., and Oram M. Neurophysiology of shape processing. Image Vis. Comput. 11 (1993) 317-333
48. Poggio T., and Bizzi E. Generalization in vision and motor control. Nature 431 (2004) 768-774
49. Poggio T., and Edelman S. A network that learns to recognize 3D objects. Nature 343 (1990) 263-266
50. Potter M.C. Meaning in visual search. Science 187 (1975) 565-566
51. Reynolds J.H., Chelazzi L., and Desimone R. Competitive mechanisms subserve attention in macaque areas V2 and V4. J. Neurosci. 19 (1999) 1736-1753
52. Riesenhuber M., and Poggio T. Hierarchical models of object recognition in cortex. Nat. Neurosci. 2 (1999) 1019-1025
53. Rolls E.T., Tovee M.J., and Panzeri S. The neurophysiology of backward visual masking: information analysis. J. Comp. Neurol. 11 (1999) 300-311
54. Rousselet G.A., Mace M.J., and Fabre-Thorpe M. Is it an animal? Is it a human face? Fast processing in upright and inverted natural scenes. J. Vis. 3 (2003) 440-455
55. Sato T. Interactions of visual stimuli in the receptive fields of inferior temporal neurons in awake macaques. Exp. Brain Res. 74 2 (1989) 263-271
56. Schwartz E.L., Desimone R., Albright T.D., and Gross C.G. Shape recognition and inferior temporal neurons. Proc. Natl. Acad. Sci. U.S.A. 80 18 (1983) 5776-5778
57. Serre, T. (2006) Learning a dictionary of shape-components in visual cortex: comparison with neurons, humans and machines. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA, April 2006.
58. Serre, T., Kouh, M., Cadieu, C., Knoblich, U., Kreiman, G. and Poggio, T. (2005) A theory of object recognition: computations and circuits in the feedforward path of the ventral stream in primate visual cortex. AI Memo 2005-036/CBCL Memo 259, MIT, Cambridge, MA.
59. Serre T., Oliva A., and Poggio T. A feedforward architecture accounts for rapid categorization. Proc. Natl. Acad. Sci. 104 15 (2007) 6424-6429
60. Serre, T. and Riesenhuber, M. (2004) Realistic modeling of simple and complex cell tuning in the HMAX model, and implications for invariant object recognition in cortex. AI Memo 2004-017/CBCL Memo 239, MIT, Cambridge, MA.
61. Serre T., Wolf L., Bileschi S., Riesenhuber M., and Poggio T. Robust object recognition with cortex-like mechanisms. IEEE Trans. Pattern Anal. Machine Intell. 29 3 (2007) 411-426
62. Sigala, R., Serre, T., Poggio, T. and Giese, M. (2005) Learning features of intermediate complexity for the recognition of biological motion. In: Proc. Int. Conf. Artif. Neural Netw., Warsaw, Poland.
63. Simons D.J., and Rensink R.A. Change blindness: past, present and future. Trends Cogn. Sci. 9 1 (2005) 16-20
64. Tanaka K. Inferotemporal cortex and object vision. Ann. Rev. Neurosci. 19 (1996) 109-139
65. Thorpe, S.J. (2002) Ultra-rapid scene categorisation with a wave of spikes. In: Proc. Biologically Motivated Comput. Vis., Tubingen, Germany.
66. Thorpe S.J., and Fabre-Thorpe M. Seeking categories in the brain. Science 291 (2001) 260-263
67. Thorpe S.J., Fize D., and Marlot C. Speed of processing in the human visual system. Nature 381 (1996) 520-522
68. Torralba A., and Oliva A. Statistics of natural image categories. Netw Comput. Neural Syst. 14 (2003) 391-412
69. Tovee M.J., Rolls E.T., Treves A., and Bellis R.P. Information encoding and the response of single neurons in the primate temporal visual cortex. J. Neurophysiol. 70 (1993) 640-654
70. Treisman A.M., and Gelade G. A feature-integration theory of attention. Cogn. Psychol. 12 (1980) 97-136
71. Ullman S., Vidal-Naquet M., and Sali E. Visual features of intermdediate complexity and their use in classification. Nat. Neurosci. 5 7 (2002) 682-687
72. Ungerleider L.G., and Haxby J.V. "What" and "where" in the human brain. Curr. Opin. Neurobiol. 4 (1994) 157-165
73. Valiant L.G. Memorization and association on a realistic neural model. Neural Comput. 17 (2005) 527-555
74. VanRullen R., and Koch C. Visual selective behavior can be triggered by a feed-forward process. J. Comp. Neurol. 15 (2003) 209-217
75. Victor J.D., Mechler F., Repucci M.A., Purpura K.P., and Sharpee T. Responses of V1 neurons to two-dimensional hermite functions. J. Neurophysiol. 95 (2006) 379-400
76. Wallis G., and Rolls E.T. A model of invariant object recognition in the visual system. Prog. Neurobiol. 51 (1997) 167-194
77. Wersing H., and Koerner E. Learning optimized features for hierarchical models of invariant recognition. Neural Comput. 15 7 (2003) 1559-1588
78. Wolfe J.M., and Bennett S.C. Preattentive object files: shapeless bundles of basic features. Vision Res. 37 (1997) 25-44