Computational models of visual object recognition

Principles of Neural Coding

Volumn , Issue , 2013, Pages 565-579

  Kreiman, Gabriel ^a  

^a HARVARD MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84917688880     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1201/b14756     Document Type: Chapter

References (100)

1. Abbott LF, Rolls ET, Tovee MJ. 1996. Representational capacity of face coding in monkeys. Cerebral Cortex 6:498-505.
2. Amit Y, Mascaro M. 2002. An integrated network for invariant visual detection and recognition. Vision Research 43:14.
3. Amit Y, Mascaro M. 2003. An integrated network for invariant visual detection and recognition. Vision Research 43:2073-2088.
4. Bengio Y, Lamblin P, Popovici D, Larochelle H. 2007. Greedy Layer-Wise Training of Deep Networks. In Advances in Neural Information Processing Systems (B. Schölkopf, J. Platt, T. Hofmann, eds.). Vancouver: MIT Press.
5. Biederman I. 1987. Recognition-by-components: A theory of human image understanding. Psychological Review 24:115-147.
6. Blumberg J, Kreiman G. 2010. How cortical neurons help us see: Visual recognition in the human brain. Journal of Clinical Investigation 120:3054-3063.
7. Borenstein E, Sharon E, Ullman S. 2004. Combining top-down and bottom-up segmentation. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Washington, DC.
8. Brady TF, Konkle T, Alvarez GA, Oliva A. 2008. Visual long-term memory has a massive storage capacity for object details. Proceedings of the National Academy of Science of the United States of America 105:14325-14329.
9. Brincat SL, Connor CE. 2004. Underlying principles of visual shape selectivity in posterior inferotemporal cortex. Nature Neuroscience 7:880-886.
10. Bulthoff HH, Edelman SY, Tarr MJ. 1995. How are three-dimensional objects represented in the brain? Cerebral Cortex 5:247-260.
11. Cadieu C, Kouh M, Pasupathy A, Connor C, Riesenhuber M, Poggio T. 2007. A model of V4 shape selectivity and invariance. Journal of Neurophysiology 98:1733-1750.
12. Callaway EM. 1998. Local circuits in primary visual cortex of the macaque monkey. Annual Review of Neuroscience 21:47-74.
13. Callaway EM. 2004. Feedforward, feedback and inhibitory connections in primate visual cortex. Neural Network 17:625-632.
14. Carandini M, Demb JB, Mante V, Tolhurst DJ, Dan Y, Olshausen BA, Gallant JL, Rust NC. 2005. Do we know what the early visual system does? Journal of Neuroscience 25:10577-10597.
15. Carandini M, Heeger DJ, Movshon JA. 1997. Linearity and normalization in simple cells of the macaque primary visual cortex. Journal of Neuroscience 17:8621-8644.
16. Chikkerur S, Serre T, Tan C, Poggio, T. 2010. What and where: A Bayesian inference theory of attention. Vision Research 50:2233-2247.
17. Compte A, Wang XJ. 2006. Tuning curve shift by attention modulation in cortical neurons: A computational study of its mechanisms. Cerebral Cortex 16:761-778.
18. Connor CE, Brincat SL, Pasupathy A. 2007. Transformation of shape information in the ventral pathway. Current Opinion in Neurobiology 17:140-147.
19. Dayan P, Abbott L. 2001. Theoretical Neuroscience. Cambridge: MIT Press.
20. Deco G, Rolls ET. 2004. A neurodynamical cortical model of visual attention and invariant object recognition. Vision Research 44:621-642.
21. Deco G, Rolls ET. 2005. Attention, short-term memory, and action selection: A unifying theory. Progress in Neurobiology 76:236-256.
22. DiCarlo JJ, Cox DD. 2007. Untangling invariant object recognition. Trends in Cognitive Science 11:333-341.
23. DiCarlo JJ, Zoccolan D, Rust NC. 2012. How does the brain solve visual object recognition? Neuron 73:415-434.
24. Douglas RJ, Martin KA. 2004. Neuronal circuits of the neocortex. Annual Review in Neuroscience 27:419-451.
25. Dowling, J. 2012. The retina. An approachable part of the brain. Cambridge, MA: Harvard University Press.
26. Edelman S, Duvdevani-Bar S. 1997. A model of visual recognition and categorization. Philosophy of Transaction Royal Society of London B: Biological Science 352:1191-1202.
27. Felleman DJ, Van Essen DC. 1991. Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex 1:1-47.
28. Fukushima K. 1980. Neocognitron: A self organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics 36:193-202.
29. Haxby J, Grady C, Horwitz B, Ungerleider L, Mishkin M, Carson R, Herscovitch P, Schapiro M, Rapoport S. 1991. Dissociation of object and spatial visual processing pathways in human extrastriate cortex. Proceedings of the National Academy of Sciences 88:1621-1625.
30. Heeger DJ, Simoncelli EP, Movshon JA. 1996. Computational models of cortical visual processing. Proceedings of the National Academy of Sciences of the United States of America 93:623-627.
31. Hegde J, Van Essen DC. 2007. A comparative study of shape representation in macaque visual areas v2 and v4. Cerebral Cortex 17:1100-1116.
32. Hertz J, Krogh A, Palmer R. 1991. Introduction to the Theory of Neural Computation. Santa Fe: Santa Fe Institute Studies in the Sciences of Complexity.
33. Hinton G. 1992. How neural networks learn from experience. Scientific American 267:145-151.
34. Hinton GE, Salakhutdinov RR. 2006. Reducing the dimensionality of data with neural networks. Science 313:504-507.
35. Hopfield JJ. 1982. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences 79:2554-2558.
36. Horn B. 1986. Robot Vision. Cambridge: MIT Press.
37. Hubel DH, Wiesel TN. 1962. Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. Journal of Physiology 160:106-154.
38. Hummel JE, Biederman I. 1992. Dynamic binding in a neural network for shape recognition. Psychological Review 99:480-517.
39. Hung C, Kreiman G, Poggio T, DiCarlo J. 2005. Fast read-out of object identity from macaque inferior temporal cortex. Science 310:863-866.
40. Itti L, Koch C. 2001. Computational modeling of visual attention. National Review of Neuroscience 2:194-203.
41. Keat J, Reinagel P, Reid RC, Meister M. 2001. Predicting every spike: A model for the responses of visual neurons. Neuron 30:803-817.
42. Kersten D, Yuille A. 2003. Bayesian models of object perception. Current Opinion in Neurobiology 13:150-158.
43. Keysers C, Xiao DK, Foldiak P, Perret DI. 2001. The speed of sight. Journal of Cognitive Neuroscience 13:90-101.
44. Kirchner H, Thorpe SJ. 2006. Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited. Vision Research 46:1762-1776.
45. Kohn A. 2007. Visual adaptation: Physiology, mechanisms, and functional benefits. Journal of Neurophysiology 97:3155-3164.
46. Kouh M, Poggio T. 2008. A canonical neural circuit for cortical nonlinear operations. Neural Computation 20: 1427-1451.
47. Kriegeskorte N, Mur M, Ruff DA, Kiani R, Bodurka J, Esteky H, Tanaka K, Bandettini PA. 2008. Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 60:1126-1141.
48. Lampl I, Ferster D, Poggio T, Riesenhuber M. 2004. Intracellular measurements of spatial integration and the MAX operation in complex cells of the cat primary visual cortex. Journal of Neurophysiology 92:2704-2713.
49. LeCun Y, Bottou L, Bengio Y, Haffner P. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE 86:2278-2324.
50. Lee TS, Mumford D. 2003. Hierarchical Bayesian inference in the visual cortex. Journal of the Optical Society of America A, Optics of Image Science Vision 20:1434-1448.
51. Lennie P, Movshon JA. 2005. Coding of color and form in the geniculostriate visual pathway (invited review). Journal of the Optical Society of America A, Optics of Image Science Vision 22:2013-2033.
52. Liu H, Agam Y, Madsen JR, Kreiman G. 2009. Timing, timing, timing: Fast decoding of object information from intracranial field potentials in human visual cortex. Neuron 62:281-290.
53. Logothetis NK, Sheinberg DL. 1996. Visual object recognition. Annual Review of Neuroscience 19:577-621.
54. Logothetis NK, Pauls J, Poggio T. 1995. Shape representation in the inferior temporal cortex of monkeys. Current Biology 5:552-563.
55. Marr D. 1982. Vision. San Francisco: Freeman Publishers.
56. Marr D, Nishihara HK. 1978. Representation and recognition of the spatial organization of three-dimensional shapes. Proceedings of the Royal Society of London B: Biological Science 200:269-294.
57. Maunsell JHR. 1995. The brain’s visual world: Representatioin of visual targets in cerebral cortex. Science 270:764-769.
58. Mel B. 1997. SEEMORE: Combining color, shape and texture histogramming in a neurally inspired approach to visual object recognition. Neural Computation 9:777.
59. Miyashita Y, Chang HS. 1988. Neuronal correlate of pictorial short-term memory in the primate temporal cortex. Nature 331:68-71.
60. Mumford D. 1992. On the computational architecture of the neocortex. II. The role of cortico-cortical loops. Biology of Cybernetics 66:241-251.
61. Mutch J, Lowe D. 2006. Multiclass object recognition with sparse, localized features. In: CVPR, pp 11-18. New York.
62. Myerson J, Miezin F, Allman J. 1981. Binocular rivalry in macaque monkeys and humans: A comparative study in perception. Behavioral Analysis Letters 1:149-159.
63. Nielsen KJ, Logothetis NK, Rainer G. 2006. Discrimination strategies of humans and rhesus monkeys for complex visual displays. Current Biology 16:814-820.
64. Olshausen BA, Anderson CH, Van Essen DC. 1993. A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. Journal of Neuroscience 13:4700-4719.
65. Orban GA, Van Essen, D., Vanduffel, W. 2004. Comparative mapping of higher visual areas in monkeys and humans. Trends in Cognitive Sciences 8:315-324.
66. Pinto N, Doukhan D, DiCarlo JJ, Cox DD. 2009. A high-throughput screening approach to discovering good forms of biologically inspired visual representation. PLoS Compution in Biology 5:e1000579.
67. Poggio T. 2012. The computational magic of the ventral stream. Available from Nature Precedings, doi:10.1038/npre.2012.6117.3
68. Poggio T, Smale S. 2003. The mathematics of learning: Dealing with data. Notices of the American Mathematical Society 50:537-544.
69. Potter M, Levy E. 1969. Recognition memory for a rapid sequence of pictures. Journal of Experimental Psychology 81:10-15.
70. Rao RP. 2004. Bayesian computation in recurrent neural circuits. Neural Computation 16:1-38.
71. Rao RP. 2005. Bayesian inference and attentional modulation in the visual cortex. Neuroreport 16:1843-1848.
72. Rao RP, Ballard DH. 1999. Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience 2:79-87.
73. Rao RPN, Olshausen BA, Lewicki MS, eds. 2002. Probabilistic Models of the Brain: Perception and Neural Function. Cambridge: MIT Press.
74. Richmond B, Wurtz R, Sato T. 1983. Visual responses in inferior temporal neurons in awake Rhesus monkey. Journal of Neurophysiology 50:1415-1432.
75. Riesenhuber M, Poggio T. 1999. Hierarchical models of object recognition in cortex. Nature Neuroscience 2:1019-1025.
76. Riesenhuber M, Poggio T. 2002. Neural mechanisms of object recognition. Current Opinion in Neurobiology 12:162-168.
77. Rolls E. 1991. Neural organization of higher visual functions. Current Opinion in Neurobiology 1:274-278.
78. Rust NC, Mante V, Simoncelli EP, Movshon JA. 2006. How MT cells analyze the motion of visual patterns. Nature Neuroscience 9:1421-1431.
79. Schmolesky M, Wang Y, Hanes D, Thompson K, Leutgeb S, Schall J, Leventhal A. 1998. Signal timing across the macaque visual system. Journal of Neurophysiology 79:3272-3278.
80. Serre T, Wolf L, Poggio T. 2005a. Object recognition with features inspired by visual cortex. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). San Diego: IEEE Computer Society Press.
81. Serre T, Oliva A, Poggio T. 2007a. Feedforward theories of visual cortex account for human performance in rapid categorization. Proceedings of the National Academy of Science 104:6424-6429.
82. Serre T, Kouh M, Cadieu C, Knoblich U, Kreiman G, Poggio T. 2005b. A theory of object recognition: Computations and circuits in the feedforward path of the ventral stream in primate visual cortex. In: pp CBCL Paper #259/AI Memo #2005-2036. Boston: MIT.
83. Serre T, Kreiman G, Kouh M, Cadieu C, Knoblich U, Poggio T. 2007b. A quantitative theory of immediate visual recognition. Progress in Brain Research 165C:33-56.
84. Sharon E, Galun M, Sharon D, Basri R, Brandt A. 2006. Hierarchy and adaptivity in segmenting visual scenes. Nature 442:810-813.
85. Smirnakis SM, Berry MJ, Warland DK, Bialek W, Meister M. 1997. Adaptation of retinal processing to image contrast and spatial scale. Nature 386:69-73.
86. Standing L. 1973. Learning 10,000 pictures. Quarterly Journal of Experimental Psychology 25:207-222.
87. Sutherland NS. 1968. Outlines of a theory of visual pattern recognition in animals and man. Proceedings of the Royal Society of London B: Biological Science 171:297-317.
88. Tanaka K. 1996. Inferotemporal cortex and object vision. Annual Review of Neuroscience 19:109-139.
89. Thorpe S, Fize D, Marlot C. 1996. Speed of processing in the human visual system. Nature 381:520-522.
90. Tsao DY, Livingstone MS. 2008. Mechanisms of face perception. The Annual Review of Neuroscience 31:26.
91. Tsotsos J. 1990. Analyzing vision at the complexity level. Behavioral and Brain Sciences 13-30:423-445.
92. Ullman S. 1996. High-Level Vision. Cambridge, MA: The MIT Press.
93. Ungerleider L, Mishkin M. 1982. Two cortical visual systems. In: Analysis of Visual Behavior (Ingle D, Goodale M, Mansfield R, eds). Cambridge: MIT Press.
94. Virga A, Rockland, KS. 1989. Terminal arbors of individual “feedback” axons projecting from area V2 to V1 in the macaque monkey: A study using immunohistochemistry of anterogradely transported phaseolus vulgaris-leucoagglutinin. The Journal of Comparative Neurology 285:54-72.
95. Vogels R, Biederman I, Bar M, Lorincz A. 2001. Inferior temporal neurons show greater sensitivity to nonaccidental than to metric shape differences. Journal of Cognitive Neuroscience 13:444-453.
96. Wallis G, Rolls ET. 1997. Invariant face and object recognition in the visual system. Progress in Neurobiology 51:167-194.
97. Wandell BA. 1995. Foundations of Vision. Sunderland: Sinauer Associates Inc.
98. Winston P. 1975. Learning structural descriptions from examples. In The psychology of computer vision, (P. Winston, ed.). London: McGraw-Hill, pp. 157-209.
99. Yamane Y, Carlson ET, Bowman KC, Wang Z, Connor CE. 2008. A neural code for three-dimensional object shape in macaque inferotemporal cortex. Nature Neuroscience 11:1352-1360.
100. Yuille A, Kersten D. 2006. Vision as Bayesian inference: Analysis by synthesis? Trends in Cognitive Science 10:301-308.