Deep hierarchies in the primate visual cortex: What can we learn for computer vision?

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 35, Issue 8, 2013, Pages 1847-1871

  Kruger, Norbert ^a   Janssen, Peter ^b   Kalkan, Sinan ^c   Lappe, Markus ^d   Leonardis, Ales ^e,f   Piater, Justus ^g   Rodriguez Sanchez, Antonio J ^g   Wiskott, Laurenz ^h  

^a UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^b KU LEUVEN UNIVERSITY OF LEUVEN   (Belgium)

^c MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

^d UNIVERSITY OF MÜNSTER   (Germany)

^e UNIVERSITY OF LJUBLJANA   (Slovenia)

^f UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^g UNIVERSITY OF INNSBRUCK   (Austria)

^h RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

biological modeling; Computer vision; deep hierarchies

Indexed keywords

ACTIVITY RECOGNITION; BIOLOGICAL MODELING; BIOLOGICAL PRINCIPLES; COMPUTATIONAL MODELING; COMPUTER VISION ALGORITHMS; DEEP HIERARCHIES; HIERARCHICAL PROCESSING; VISION BASED NAVIGATION;

BIOLOGY; OBJECT RECOGNITION;

COMPUTER VISION;

ANIMAL; ARTIFICIAL INTELLIGENCE; HUMAN; PATTERN RECOGNITION; PHYSIOLOGY; PRIMATE; REVIEW; VISION; VISUAL CORTEX;

ANIMALS; ARTIFICIAL INTELLIGENCE; HUMANS; PATTERN RECOGNITION, VISUAL; PRIMATES; VISION, OCULAR; VISUAL CORTEX;

EID: 84879847917     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2012.272     Document Type: Article

References (207)

1. Y. Amit, 2D Object Detection and Recognition: Models, Algorithms and Networks. MIT Press, 2002.
2. Y. Amit and D. Geman, "A Computational Model for Visual Selection," Neural Computation, vol. 11, no. 7, pp. 1691-1715, 1999.
3. R. Andersen, A. Batista, L. Snyder, C. Buneo, and Y. Cohen, "Programming to Look and Reach in the Posterior Parietal Cortex," The New Cognitive Neurosciences, M. Gazzaniga, ed., chapter 36, second ed., pp. 515-524, MIT Press, 2000.
4. R. Andersen and V.B. Mountcastle, "The Influence of the Angle of Gaze upon the Excitability of the Light-Sensitive Neurons of the Posterior Parietal Cortex," J. Neuroscience, vol. 3, no. 3, pp. 532-548, 1983. (Pubitemid 13132718)
5. A. Anzai, S. Chowdhury, and G. DeAngelis, "Coding of Stereoscopic Depth Information in Visual Areas V3 and V3a," J. Neuroscience, vol. 31, no. 28, pp. 10270-10282, 2011.
6. L. Bazzani, N. Freitas, H. Larochelle, V. Murino, and J.-A. Ting, "Learning Attentional Policies for Tracking and Recognition in Video with Deep Networks," Proc. 28th Int'l Conf. Machine Learning, pp. 937-944, L. Getoor and T. Scheffer, eds., June 2011.
7. S. Becker and G.E. Hinton, "A Self-Organizing Neural Network that Discovers Surfaces in Random-Dot Stereograms," Nature, vol. 355, no. 6356, pp. 161-163, 1992.
8. A.J. Bell and T.J. Sejnowski, "The 'Independent Components' of Natural Scenes Are Edge Filters," Vision Research, vol. 37, no. 23, pp. 3327-3338, 1997. (Pubitemid 27493806)
9. Y. Bengio, "Learning Deep Architectures for AI," Foundations and Trends in Machine Learning, vol. 2, no. 1, pp. 1-127, 2009.
10. P. Berkes and L. Wiskott, "Slow Feature Analysis Yields a Rich Repertoire of Complex Cell Properties," J. Vision, vol. 5, no. 6, pp. 579-602, http://journalofvision.org/5/6/9/, 2005, doi:10.1167/5.6.9. (Pubitemid 41519241)
11. J.W. Bisley and M.E. Goldberg, "Attention, Intention, and Priority in the Parietal Lobe," Ann. Rev. Neuroscience, vol. 33, pp. 1-21, 2010.
12. E. Borra, A. Belmalih, R. Calzavara, M. Gerbella, A. Murata, S. Rozzi, and G. Luppino, "Cortical Connections of the Macaque Anterior Intraparietal (AIP) Area," Cerebral Cortex, vol. 18, no. 5 pp. 1094-1111, 2008.
13. J. Bowmaker and H. Dartnall, "Visual Pigments of Rods and Cones in a Human Retina," J. Physiology, vol. 298, pp. 501-511, 1980. (Pubitemid 10111750)
14. D.C. Bradley, G.C. Chang, and R.A. Andersen, "Encoding of Three-Dimensional Structure-from-Motion by Primate Area MT Neurons," Nature, vol. 392, pp. 714-717, 1998. (Pubitemid 28207791)
15. F. Bremmer, M. Kubischik, M. Pekel, M. Lappe, and K.-P. Hoffmann, "Linear Vestibular Self-Motion Signals in Monkey Medial Superior Temporal Area," Ann. New York Academy of Sciences, vol. 871, pp. 272-281, 1999. (Pubitemid 29306520)
16. M. Brown, D. Burschka, and G. Hager, "Advances in Computational Stereo," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 8, pp. 993-1008, Aug. 2003.
17. E. Brunswik and J. Kamiya, "Ecological Cue-Validity of 'Proximity' and of Other Gestalt Factors," Am. J. Psychologie, vol. 66, pp. 20-32, 1953.
18. D. Calow, N. Krü ger, F. Wörgö tter, and M. Lappe, "Biologically Motivated Space-Variant Filtering for Robust Optic Flow Processing," Network, vol. 16, no. 4, pp. 323-340, 2005. (Pubitemid 43656061)
19. M. Carandini and D.J. Heeger, "Normalization as a Canonical Neural Computation," Nature Neuroscience, vol. 13, pp. 51-62, 2012.
20. M.S. Caywood, B. Willmore, and D.J. Tolhurst, "Independent Components of Color Natural Scenes Resemble V1 Neurons in Their Spatial and Color Tuning," J. Neurophysiology, vol. 91, no. 6, pp. 2859-2873, June 2004. (Pubitemid 38649789)
21. C. Colby and M. Goldberg, "Space and Attention in Parietal Cortex," Ann. Rev. Neuroscience, vol. 22, no. 1, pp. 319-349, 1999. (Pubitemid 29144891)
22. B. Conway, "Spatial Structure of Cone Inputs to Color Cells in Alert Macaque Primary Visual cortex (V-1)," The J. Neuroscience, vol. 21, no. 8, pp. 2768-2783, 2001. (Pubitemid 32298218)
23. B.R. Conway, "Color Vision, Cones, and Color-Coding in the Cortex," Neuroscientist, vol. 15, pp. 274-290, June 2009.
24. B.R. Conway, S. Moeller, and D.Y. Tsao, "Specialized Color Modules in Macaque Extrastriate Cortex," Neuron, vol. 56, pp. 560-573, Nov. 2007. (Pubitemid 350026271)
25. H. Cui and R. Andersen, "Posterior Parietal Cortex Encodes Autonomously Selected Motor Plans," Neuron, vol. 56, no. 3, pp. 552-559, 2007. (Pubitemid 350026270)
26. B. Cumming and A. Parker, "Responses of Primary Visual Cortical Neurons to Binocular Disparity without Depth Perception," Nature, vol. 389, no. 6648, pp. 280-283, 1997. (Pubitemid 27406640)
27. B. Cumming and A. Parker, "Binocular Neurons in V1 of Awake Monkeys Are Selective for Absolute, Not Relative, Disparity," J. Neuroscience, vol. 19, no. 13, pp. 5602-5618, 1999. (Pubitemid 29300223)
28. C. Curcio and K. Allen, "Topography of Ganglion Cells in Human Retina," J. Comparative Neurology, vol. 300, no. 1 pp. 5-25, 1990. (Pubitemid 20349476)
29. J. Daugman, "Complete Discrete 2-D Gabor Transforms by Neural Networks for Image Analysis and Compression," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 36, no. 7 pp. 1169-1179, July 1988.
30. G.C. De Angelis, B.G. Cumming, and W.T. Newsome, "Cortical Area MT and the Perception of Stereoscopic Depth," Nature, vol. 394, pp. 677-680, 1998. (Pubitemid 28389793)
31. J.J. DiCarlo and D.D. Cox, "Untangling Invariant Object Recognition," Trends in Cognitive Sciences, vol. 11, no. 8, pp. 333-341, 2007. (Pubitemid 47077917)
32. S. Dickinson, "The Evolution of Object Categorization and the Challenge of Image Abstraction," Object Categorization: Computer and Human Vision Perspectives, S. Dickinson, A. Leonardis, B. Schiele, and M.J. Tarr, eds., pp. 1-37, Cambridge Univ. Press, 2009.
33. Y. Dong, S. Mihalas, F. Qiu, R. von der Heydt, and E. Niebur, "Synchrony and the Binding Problem in Macaque Visual Cortex," J. Vision, vol. 8, no. 7, article 30, 2008.
34. C.J. Duffy and R.H. Wurtz, "Sensitivity of MST Neurons to Optic Flow Stimuli. II. Mechanisms of Response Selectivity Revealed by Small-Field Stimuli," J. Neurophysiology, vol. 65, pp. 1346-1359, 1991.
35. J. Duhamel, F. Bremmer, S. BenHamed, and W. Graf, "Spatial Invariance of Visual Receptive Fields in Parietal Cortex Neurons," Nature, vol. 389, no. 6653, pp. 845-848, 1997. (Pubitemid 27462977)
36. J. Duhamel, C. Colby, and M. Goldberg, "The Updating of the Representation of Visual Space in Parietal Cortex by Intended Eye Movements," Science, vol. 255, no. 5040 pp. 90-92, 1992.
37. M.R. Dürsteler and R.H. Wurtz, "Pursuit and Optokinetic Deficits Following Chemical Lesions of Cortical Areas MT and MST," J. Neurophysiology, vol. 60, pp. 940-965, 1988.
38. W. Einhäuser, C. Kayser, P. König, and K.P. Körding, "Learning the Invariance Properties of Complex Cells from Their Responses to Natural Stimuli," Euro J. Neuroscience, pp. 475-486, Feb. 2002. (Pubitemid 35463666)
39. J.H. Elder, "Are Edges Incomplete?" Int'l J. Computer Vision, vol. 34, pp. 97-122, 1999. (Pubitemid 30526153)
40. A. Engel, P. Roelfsema, P. Fries, M. Brecht, and W. Singer, "Role of the Temporal Domain for Response Selection and Perceptual Binding," Cerebral Cortex, vol. 7, no. 6, pp. 571-582, 1997. (Pubitemid 27353641)
41. R.G. Erickson and P. Thier, "A Neuronal Correlate of Spatial Stability during Periods of Self-Induced Visual Motion," Experimental Brain Research, vol. 86, pp. 608-616, 1991.
42. G.J. Ettinger, "Hierarchical Object Recognition Using Libraries of Parameterized Model Sub-Parts," technical report, MIT, 1987.
43. F. Fang, H. Boyaci, and D. Kersten, "Border Ownership Selectivity in Human Early Visual Cortex and Its Modulation by Attention," J. Neuroscience, vol. 29, no. 2, pp. 460-465, 2009.
44. D. Felleman and D.V. Essen, "Distributed Hierarchical Processing in Primate Cerebral Cortex," Cerebral Cortex, vol. 1, pp. 1-47, 1991.
45. S. Fidler, M. Boben, and A. Leonardis, "Similarity-Based Cross-Layered Hierarchical Representation for Object Categorization," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2008.
46. S. Fidler, M. Boben, and A. Leonardis, "Learning Hierarchical Compositional Representations of Object Structure," Object Categorization: Computer and Human Vision Perspectives, S. Dickinson, A. Leonardis, B. Schiele, and M.J. Tarr, eds., pp. 196-215, Cambridge Univ. Press, 2009.
47. G. Finlayson and S. Hordley, "Color Constancy at a Pixel," J. Optical Soc. Am. A, vol. 18, pp. 253-264, 2001.
48. I.M. Finn and D. Ferster, "Computational Diversity in Complex Cells of Cat Primary Visual Cortex," J. Neuroscience, vol. 27, no. 36, pp. 9638-9648, 2007.
49. D.J. Fleet, A.D. Jepson, and M.R. Jenkin, "Phase-Based Disparity Measurement," CVGIP: Image Understanding, vol. 53, no. 2, pp. 10, 1991.
50. D.J. Fleet, H. Wagner, and D.J. Heeger, "Neural Encoding of Binocular Disparity: Energy Models, Position Shifts and Phase Shifts," Vision Research, vol. 36, no. 12, pp. 1839-1857, June 1996. (Pubitemid 26166010)
51. M. Franzius, N. Wilbert, and L. Wiskott, "Invariant Object Recognition and Pose Estimation with Slow Feature Analysis," Neural Computation, vol. 23, no. 9, pp. 2289-2323, 2011.
52. D. Freedman and J. Assad, "Experience-Dependent Representation of Visual Categories in Parietal Cortex," Nature, vol. 443, no. 5502, pp. 85-88, 2006. (Pubitemid 44344052)
53. D. Freedman, M. Riesenhuber, T. Poggio, and E. Miller, "Categorical Representation of Visual Stimuli in the Primate Prefrontal Cortex," Science, vol. 291, no. 5502, pp. 312-316, 2001. (Pubitemid 32096318)
54. K. Fukushima, S. Miyake, and T. Ito, "Neocognitron: A Neural Network Model for a Mechanism of Visual Pattern Recognition," IEEE Systems, Man, and Cybernetics, vol. 13, no. 3, pp. 826-834, Sept./Oct. 1983.
55. A. Gail and R. Andersen, "Neural Dynamics in Monkey Parietal Reach Region Reflect Context-Specific Sensorimotor Transformations," J. Neuroscience, vol. 26, no. 37, pp. 9376-9384, 2006. (Pubitemid 44396850)
56. V. Gallese, A. Murata, M. Kaseda, N. Niki, and H. Sakata, "Deficit of Hand Preshaping after Muscimol Injection in Monkey Parietal Cortex," Neuroreport, vol. 5, no. 12, pp. 1525-1529, 1994. (Pubitemid 24251888)
57. C. Galletti, P.P. Battaglini, and P. Fattori, "'Real-Motion' Cells in Area V3a of Macaque Visual Cortex," Experimental Brain Research, vol. 82, pp. 67-76, 1990. (Pubitemid 20321359)
58. I. Gauthier, P. Skudlarski, J.C. Gore, and A.W. Anderson, "Expertise for Cars and Birds Recruits Brain Areas Involved in Face Recognition," Nature Neuroscience, vol. 3, no. 2, pp. 191-197, 2000. (Pubitemid 30126336)
59. S. Geman, "Hierarchy in Machine and Natural Vision," Proc. 11th Scandinavian Conf. Image Analysis, 1999.
60. S. Geman, D. Potter, and Z. Chi, "Composition Systems," Quarterly of Applied Math., vol. 60, no. 4, pp. 707-736, 2002. (Pubitemid 35468515)
61. J. Gibson, "The Perception of Visual Surfaces," Am. J. Psychology, vol. 63, pp. 367-384, 1950.
62. C. Gilbert and W. Li, "Adult Visual Cortical Plasticity," Neuron, vol. 75, no. 2, pp. 250-264, 2012.
63. I. Gödecke and T. Bonhoeffer, "Development of Identical Orientation Maps for Two Eyes without Common Visual Experience," Nature, vol. 379, pp. 251-255, 1996.
64. M.A. Goodale and A.D. Milner, "Separate Visual Pathways for Perception and Action," Trends Neuroscience, vol. 15, no. 1, pp. 20-25, 1992.
65. J.P. Gottlieb, M. Kusunoki, and M.E. Goldberg, "The Representation of Visual Salience in Monkey Parietal Cortex," Nature, vol. 391, pp. 481-484, 1998. (Pubitemid 28086547)
66. E. Gould, A. Reeves, M. Graziano, and C. Gross, "Neurogenesis in the Neocortex of Adult Primates," Science, vol. 286, no. 5439, pp. 548-552, 1999.
67. Y. Gu, P. Watkins, D. Angelaki, and G. DeAngelis, "Visual and Nonvisual Contributions to Three-Dimensional Heading Selectivity in the Medial Superior Temporal Area," J. Neuroscience, vol. 26, no. 1, pp. 73-85, 2006. (Pubitemid 43089521)
68. M. Hawken and A. Parker, "Spatial Properties of Neurons in the Monkey Striate Cortex," Proc. Royal Soc. London, Series B, Biological Sciences, vol. 231, pp. 251-288, 1987. (Pubitemid 17106475)
69. J. Hawkins and S. Blakeslee, On Intelligence. Times Books, 2004.
70. D. Hinkle et al., "Three-Dimensional Orientation Tuning in Macaque Area v4," Nature Neuroscience, vol. 5, no. 7, pp. 665-670, 2002. (Pubitemid 34742982)
71. I. Howard and B.J. Rogers, Seeing in Depth, Vol. 1: Basic Mechanisms. Univ. of Toronto Press, 2002.
72. D. Hubel and T. Wiesel, "Receptive Fields, Binocular Interaction and Functional Architecture in the Cat's Visual Cortex," J. Phyiology, vol. 160, pp. 106-154, 1962.
73. D. Hubel and T. Wiesel, "Receptive Fields and Functional Architecture of Monkey Striate Cortex," J. Physiology, vol. 195, no. 1, pp. 215-243, 1968.
74. C. Hung, G. Kreiman, T. Poggio, and J. DiCarlo, "Fast Readout of Object Identity from Macaque Inferior Temporal Cortex," Science, vol. 310, no. 5749, pp. 863-866, 2005. (Pubitemid 41567346)
75. M. Ito, H. Tamura, I. Fujita, and K. Tanaka, "Size and Position Invariance of Neuronal Responses in Monkey Inferotemporal Cortex," J. Neurophysiology, vol. 73, no. 1, pp. 218-226, Jan. 1995.
76. P. Janssen and M. Shadlen, "A Representation of the Hazard Rate of Elapsed Time in Macaque Area Lip," Nature Neuroscience, vol. 8, no. 2, pp. 234-241, 2005. (Pubitemid 40194055)
77. P. Janssen, R. Vogels, Y. Liu, and G. Orban, "Macaque Inferior Temporal Neurons Are Selective for Three-Dimensional Boundaries and Surfaces," J. Neuroscience, vol. 21, no. 23, pp. 9419-9429, 2001. (Pubitemid 33096885)
78. P. Janssen, R. Vogels, Y. Liu, and G. Orban, "At Least at the Level of Inferior Temporal Cortex, the Stereo Correspondence Problem Is Solved," Neuron, vol. 37, no. 4, pp. 693-701, 2003. (Pubitemid 36262989)
79. P. Janssen, R. Vogels, and G. Orban, "Macaque Inferior Temporal Neurons Are Selective for Disparity-Defined Three-Dimensional Shapes," Proc. Nat'l Academy of Sciences, vol. 96, no. 14 p. 8217, 1999.
80. P. Janssen, R. Vogels, and G. Orban, "Selectivity for 3D Shape that Reveals Distinct Areas within Macaque Inferior Temporal Cortex," Science, vol. 288, no. 5473, pp. 2054-2056, 2000. (Pubitemid 30397688)
81. P. Janssen, R. Vogels, and G. Orban, "Three-Dimensional Shape Coding in Inferior Temporal Cortex," Neuron, vol. 27, no. 2, pp. 385-397, 2000.
82. J. Jones and L. Palmer, "An Evaluation of the Two Dimensional Gabor Filter Model of Simple Receptive Fields in Striate Cortex," J. Neurophysiology, vol. 58, no. 6, pp. 1223-1258, 1987.
83. B. Julesz, Foundations of Cyclopean Perception. Univ. Chicago Press, 1971.
84. Principles of Neural Science, E.R. Kandel, J.H. Schwartz, and T.M. Jessel eds., fourth ed. McGraw-Hill, 2000.
85. N. Kanwisher, J. McDermott, and M.M. Chun, "The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception," J. Neuroscience, vol. 17, no. 11, pp. 4302-4311, 1997. (Pubitemid 27220621)
86. N. Katsuyama, A. Yamashita, K. Sawada, T. Naganuma, H. Sakata, and M. Taira, "Functional and Histological Properties of Caudal Intraparietal Area of Macaque Monkey," Neuroscience, vol. 167, no. 1, pp. 1-10, 2010.
87. P. Kellman and M. Arterberry, The Cradle of Knowledge. MIT Press, 1998.
88. R. Kiani, H. Esteky, K. Mirpour, and K. Tanaka, "Object Category Structure in Response Patterns of Neuronal Population in Monkey Inferior Temporal Cortex," J. Neurophysiology, vol. 97, no. 6, pp. 4296-4309, 2007. (Pubitemid 47080657)
89. C. Koch, Biophysics of Computation: Information Processing in Single Neurons. Oxford Univ. Press, 1999.
90. K. Koffka, Principles of Gestalt Psychology. Routledge, 1955.
91. P. König and N. Krü ger, "Perspectives: Symbols as Self-Emergent Entities in an Optimization Process of Feature Extraction and Predictions," Biological Cybernetics, vol. 94, no. 4, pp. 325-334, 2006.
92. K. Köteles, P. De Maziere, M. Van Hulle, G. Orban, and R. Vogels, "Coding of Images of Materials by Macaque Inferior Temporal Cortical Neurons," European J. Neuroscience, vol. 27, no. 2, pp. 466-482, 2008.
93. Z. Kourtzi and J.J. DiCarlo, "Learning and Neural Plasticity in Object Recognition," Current Opinion Neurobiology, vol. 16, pp. 152-158, Apr. 2006.
94. R.J. Krauzlis and S.G. Lisberger, "A Model of Visually-Guided Smooth Pursuit Eye Movements Based on Behavioral Observations," J. Computational Neuroscience, vol. 1, no. 4, pp. 265-283, 1994.
95. J. Kremers, The Primate Visual System: A Comparative Approach. Wiley, 2005.
96. K. Krug, B. Cumming, and A. Parker, "Comparing Perceptual Signals of Single V5/MT Neurons in Two Binocular Depth Tasks," J. Neurophysiology, vol. 92, no. 3, pp. 1586-1596, 2004. (Pubitemid 39100657)
97. K. Krug and A. Parker, "Neurons in Dorsal Visual Area V5/MT Signal Relative Disparity," J. Neuroscience, vol. 31, no. 49, pp. 17892-17904, 2011.
98. V. Lamme et al., "Neuronal Synchrony Does Not Represent Texture Segregation," Nature, vol. 396, no. 6709, pp. 362-366, 1998.
99. M. Lappe, "Functional Consequences of an Integration of Motion and Stereopsis in Area MT of Monkey Extrastriate Visual Cortex," Neural Computation, vol. 8, no. 7, pp. 1449-1461, 1996. (Pubitemid 126449977)
100. M. Lappe, F. Bremmer, M. Pekel, A. Thiele, and K.P. Hoffmann, "Optic Flow Processing in Monkey STS: A Theoretical and Experimental Approach," J. Neuroscience, vol. 16, no. 19, pp. 6265-6285, 1996. (Pubitemid 26314000)
101. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-Based Learning Applied to Document Recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
102. T. Lee and D. Mumford, "Hierarchical Bayesian Inference in the Visual Cortex," J. Optical Soc. Am., vol. 20, no. 7, pp. 1434-1448, 2003.
103. J. Lewis and D. Van Essen, "Corticocortical Connections of Visual, Sensorimotor, and Multimodal Processing Areas in the Parietal Lobe of the Macaque Monkey," J. Comparative Neurology, vol. 428, no. 1, pp. 112-137, 2000.
104. N. Li and J. DiCarlo, "Unsupervised Natural Visual Experience Rapidly Reshapes Size-Invariant Object Representation in Inferior Temporal Cortex," Neuron, vol. 67, no. 6, pp. 1062-1075, 2010.
105. S. Li, S.D. Mayhew, and Z. Kourtzi, "Learning Shapes Spatiotemporal Brain Patterns for Flexible Categorical Decisions," Cerebral Cortex, to be published, 2011.
106. M.S. Livingstone, C.C. Pack, and R.T. Born, "Two-Dimensional Substructure of MT Receptive Fields," Neuron, vol. 30, no. 3, pp. 781-793, 2001. (Pubitemid 32607342)
107. D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 2, no. 60, pp. 91-110, 2004.
108. B. Manjunath and W. Ma, "Texture Features for Browsing and Retrieval of Image Data," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 837-842, Aug. 1996. (Pubitemid 126772825)
109. D. Marr, Vision: A Computational Investigation into the Human Representation and Processing of Visual information. Freeman, 1977.
110. G. Masson, C. Busettini, and F. Miles, "Vergence Eye Movements in Response to Binocular Disparity without Depth Perception," Nature, vol. 389, no. 6648, pp. 283-286, 1997. (Pubitemid 27406641)
111. T. Matsumora, K. Koida, and H. Komatsu, "Relationship between Color Discrimination and Neural Responses in the Inferior Temporal Cortex of the Monkey," J. Neurophysiology, vol. 100, no. 6, pp. 3361-3374, 2008.
112. J.H.R. Maunsell and D.C. van Essen, "Functional Properties of Neurons in Middle Temporal Visual Area of the Macaque Monkey. I. Selectivity for Stimulus Direction, Speed, and Orientation," J. Neurophysiology, vol. 49, no. 5, pp. 1127-1147, 1983. (Pubitemid 13083978)
113. S.D. Mayhew, S. Li, and Z. Kourtzi, "Learning Acts on Distinct Processes for Visual Form Perception in the Human Brain," J. Neuroscience, vol. 32, no. 3, pp. 775-786, 2012.
114. B.W. Mel and J. Fiser, "Minimizing Binding Errors Using Learned Conjunctive Features," Neural Computation, vol. 12, no. 4, pp. 731-762, 2000.
115. B.W. Mel, D.L. Ruderman, and K.A. Archie, "Translation-Invariant Orientation Tuning in Visual 'Complex' Cells Could Derive from Intradendritic Computations," J. Neuroscience, vol. 18, no. 11, pp. 4325-4334, 1998. (Pubitemid 28243825)
116. K. Mikolajczyk and C. Schmid, "A Performance Evaluation of Local Descriptors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1615-1630, Oct. 2005. (Pubitemid 41555406)
117. J.A. Movshon, E.H. Adelson, M.S. Gizzi, and W.T. Newsome, "The Analysis of Moving Visual Patterns," Pattern Recognition Mechanisms, C. Chagas, R. Gattass, and C. Gross, eds., pp. 117-151, Springer, 1985.
118. J.A. Movshon and W.T. Newsome, "Visual Response Properties of Striate Cortical Neurons Projecting to Area MT in Macaque Monkeys," J. Neuroscience, vol. 16, no. 23, pp. 7733-7741, 1996. (Pubitemid 26389712)
119. R. Mruczek and D. Sheinberg, "Activity of Inferior Temporal Cortical Neurons Predicts Recognition Choice Behavior and Recognition Time during Visual Search," J. Neuroscience, vol. 27, no. 11, pp. 2825-2836, 2007. (Pubitemid 46438977)
120. A. Murata, V. Gallese, G. Luppino, M. Kaseda, and H. Sakata, "Selectivity for the Shape, Size, and Orientation of Objects for Grasping in Neurons of Monkey Parietal Area AIP," J. Neurophysiology, vol. 83, no. 5, pp. 2580-2601, 2000. (Pubitemid 30321452)
121. H. Nakamura, T. Kuroda, M. Wakita, M. Kusunoki, A. Kato, A. Mikami, H. Sakata, and K. Itoh, "From Three-Dimensional Space Vision to Prehensile Hand Movements: The Lateral Intraparietal Area Links the Area V3a and the Anterior Intraparietal Area in Macaques," J. Neuroscience, vol. 21, no. 20, pp. 8174-8187, 2001. (Pubitemid 32952773)
122. W.T. Newsome, R.H. Wurtz, and H. Komatsu, "Relation of Cortical Areas MT and MST to Pursuit Eye Movements. II. Differentiation of Retinal from Extraretinal Inputs," J. Neurophysiology, vol. 60, no. 2, pp. 604-620, 1988.
123. J. Nguyenkim and G. DeAngelis, "Disparity-Based Coding of Three-Dimensional Surface Orientation by Macaque Middle Temporal Neurons," J. Neuroscience, vol. 23, no. 18, pp. 7117-7128, 2003. (Pubitemid 36975876)
124. A. Oliva and A. Torralba, "The Role of Context in Object Recognition," Trends Cognitive Sciences, vol. 11, pp. 520-527, 2007. (Pubitemid 350181571)
125. B.A. Olshausen and D.J. Field, "Emergence of Simple-Cell Receptive Field Properties by Learning a Sparse Code for Natural Images," Nature, vol. 381, no. 6583, pp. 607-609, June 1996. (Pubitemid 26177476)
126. B. Ommer and J.M. Buhmann, "Learning the Compositional Nature of Visual Objects," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
127. G.A. Orban, "Higher Order Visual Processing in Macaque Extrastriate Cortex," Physiological Rev., vol. 88, pp. 59-89, Jan. 2008.
128. C. Pack, M.S. Livingstone, K. Duffy, and R. Born, "End-Stopping and the Aperture Problem: Two-Dimensional Motion Signals in Macaque V1," Neuron, vol. 39, pp. 671-680, 2003. (Pubitemid 36993583)
129. C.C. Pack and R.T. Born, "Temporal Dynamics of a Neural Solution to the Aperture Problem in Visual Area MT of Macaque Brain," Nature, vol. 409, no. 6823, pp. 1040-1042, 2001. (Pubitemid 32204055)
130. A. Parker, "Binocular Depth Perception and the Cerebral Cortex," Nature Rev. Neuroscience, vol. 8, no. 5, pp. 379-391, 2007. (Pubitemid 46652468)
131. A. Pasupathy and C. Connor, "Responses to Contour Features in Macaque Area V4," J. Neurophysiology, vol. 82, no. 5 pp. 2490-2502, 1999.
132. M. Pekel, M. Lappe, F. Bremmer, A. Thiele, and K.-P. Hoffmann, "Neuronal Responses in the Motion Pathway of the Macaque Monkey to Natural Optic Flow Stimuli," NeuroReport, vol. 7, no. 4, pp. 884-888, 1996. (Pubitemid 26167970)
133. J.A. Perrone and A. Thiele, "Speed Skills: Measuring the Visual Speed Analyzing Properties of Primate MT Neurons," Nature Neuroscience, vol. 4, no. 5, pp. 526-532, 2001. (Pubitemid 32397191)
134. B. Pesaran, M. Nelson, and R. Andersen, "Free Choice Activates a Decision Circuit between Frontal and Parietal Cortex," Nature, vol. 453, no. 7193, pp. 406-409, 2008. (Pubitemid 351693121)
135. R. Peters, A. Iyer, L. Itti, and C. Koch, "Components of Bottom-Up Gaze Allocation in Natural Images," Int'l J. Neural Systems, vol. 45, no. 18, pp. 2397-2416, 2005. (Pubitemid 40848284)
136. M. Platt and P. Glimcher, "Neural Correlates of Decision Variables in Parietal Cortex," Nature, vol. 400, no. 6741, pp. 233-238, 1999. (Pubitemid 29334132)
137. A. Pouget and T.J. Sejnowski, "Spatial Transformations in the Parietal Cortex Using Basis Functions," J. Coginitive Neuroscience, vol. 9, no. 2, pp. 222-237, 1997. (Pubitemid 27192694)
138. R.Q. Quiroga, L. Reddy, C. Koch, and I. Fried, "Decoding Visual Inputs from Multiple Neurons in the Human Temporal Lobe," J Neurophysiology, vol. 98, no. 4, pp. 1997-2007, 2007. (Pubitemid 47584389)
139. S. Raiguel, R. Vogels, S. Mysore, and G. Orban, "Learning to See the Difference Specifically Alters the Most Informative V4 Neurons," J. Neuroscience, vol. 26, no. 24, pp. 6589-6602, 2006. (Pubitemid 44318340)
140. M. Riesenhuber and T. Poggio, "Hierarchical Models of Object Recognition in Cortex," Nature Neuroscience, vol. 11, no. 2, pp. 1019-1025, 1999. (Pubitemid 30599567)
141. K. Rockland, J. Kaas, and A. Peters, Cerebral Cortex: Extrastriate Cortex in Primates, vol. 12. Springer, 1997.
142. A. Rodríguez-Sánchez, E. Simine, and J. Tsotsos, "Attention and Visual Search," Int'l J. Neural Systems, vol. 17, no. 4, pp. 275-288, 2007. (Pubitemid 47258349)
143. A.J. Rodriguez-Sanchez and J.K. Tsotsos, "The Importance of Intermediate Representations for the Modeling of 2D Shape Detection: Endstopping and Curvature Tuned Computations," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 4321-4326, 2011.
144. A.J. Rodriguez-Sanchez and J.K. Tsotsos, "The Roles of Endstopped and Curvature Tuned Computations in a Hierarchical Representation of 2D Shape," PLoS ONE, vol. 7, no. 8, pp. 1-13, 2012.
145. P. Roelfsema, "Solutions for the Binding Problem," Zeitschrift für Naturforschung. C, J. Biosciences, vol. 53, no. 7/8, pp. 691-715, 1998. (Pubitemid 28417958)
146. E. Rolls, B. Webb, and M.C.A. Booth, "Responses of Inferior Temporal Cortex Neurons to Objects in Natural Scenes," Soc. Neuroscience Abstracts, vol. 26, p. 1331, 2000.
147. J.-P. Roy and R.H. Wurtz, "Disparity Sensitivity of Neurons in Monkey Extrastriate Area MST," J. Neuroscience, vol. 12, no. 7, pp. 2478-2492, 1992.
148. N. Rust, O. Schwartz, J. Movshon, and E. Simoncelli, "Spike- Triggered Characterization of Excitatory and Suppressive Stimulus Dimensions in Monkey V1," Neurocomputing, vol. 58, pp. 793-799, 2004. (Pubitemid 38684336)
149. U. Rutishauser, R.J. Douglas, and J.J. Slotine, "Collective Stability of Networks of Winner-Take-All Circuits," Neural Computation, vol. 23, no. 3, pp. 735-773, 2011.
150. H. Sakata, M. Taira, M. Kusunoki, A. Murata, and Y. Tanaka, "The Parietal Association Cortex in Depth Perception and Visual Control of Hand Action," Trends in Neurosciences, vol. 20, no. 8, pp. 350-357, 1997. (Pubitemid 27319847)
151. C.D. Salzman, K.H. Britten, and W.T. Newsome, "Cortical Microstimulation Influences Perceptual Judgements of Motion Direction," Nature, vol. 346, no. 12, pp. 174-177, 1990.
152. F. Scalzo and J.H. Piater, "Statistical Learning of Visual Feature Hierarchies," Proc. IEEE Workshop Learning Computer Vision and Pattern Recognition, 2005.
153. C.E. Stern and H.E. Schendan, "Mental Rotation and Object Categorization Share a Common Network of Prefrontal and Dorsal and Ventral Regions of Posterior Cortex," Neuroimage, vol. 35, pp. 1264-1277, 2007. (Pubitemid 46507829)
154. A. Schoups, R. Vogels, N. Qian, and G. Orban, "Practising Orientation Identification Improves Orientation Coding in V1 Neurons," Nature, vol. 412, no. 6846, pp. 549-53, 2001. (Pubitemid 32743834)
155. A. Sereno and J. Maunsell, "Shape Selectivity in Primate Lateral Intraparietal Cortex," Nature, vol. 395, no. 6701, pp. 500-503, 1998. (Pubitemid 28462444)
156. T. Serre and A.T. Poggio, "Neuromorphic Approach to Computer Vision," Comm. ACM, vol. 53, pp. 54-61, 2010.
157. T. Serre, L. Wolf, S. Bileschi, M. Riesenhuber, and T. Poggio, "Object Recognition with Cortex-Like Mechanisms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 3, pp. 411-426, Mar. 2007.
158. M. Shadlen and J. Movshon, "Synchrony Unbound: Review a Critical Evaluation of the Temporal Binding Hypothesis," Neuron, vol. 24, pp. 67-77, 1999. (Pubitemid 29466148)
159. M. Shadlen and W. Newsome, "Motion Perception: Seeing and Deciding," Proc. Nat'l Academy of Sciences, vol. 93, no. 2 pp. 628-633, 1996. (Pubitemid 26041139)
160. R. Shapley and M.J. Hawken, "Color in the Cortex: Single-and Double-Opponent Cells," Vision Research, vol. 51, no. 7, pp. 701-717, Apr. 2011.
161. X. Shi, N. Bruce, and J.K. Tsotsos, "Fast, Recurrent, Attentional Modulation Improves Saliency Representation and Scene Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshop Biologically- Consistent Vision, pp. 1-8, 2011.
162. E. Shikata et al., "Selectivity of the Parietal Visual Neurones in 3D Orientation of Surface of Stereoscopic Stimuli," Neuroreport, vol. 7, no. 14, pp. 2389-2394, 1996. (Pubitemid 26377802)
163. E. Simoncelli, "Vision and the Statistics of the Visual Environment," Current Opinion in Neurobiology, vol. 13, no. 2, pp. 144-149, 2003. (Pubitemid 36556270)
164. E.P. Simoncelli and D.J. Heeger, "A Model of Neuronal Responses in Visual Area MT," Vision Research, vol. 38, no. 5, pp. 743-761, 1998. (Pubitemid 28081676)
165. W. Singer, "Consciousness and the Binding Problem," Ann. New York Academy of Sciences, vol. 929, no. 1, pp. 123-146, 2001. (Pubitemid 32386055)
166. H. Spitzer and S. Hochstein, "A Complex-Cell Receptive-Field Model," J. Neurophysiology, vol. 53, no. 5, pp. 1266-1286, 1985. (Pubitemid 15033045)
167. S. Srivastava, G. Orban, P. De Mazière, and P. Janssen, "A Distinct Representation of Three-Dimensional Shape in Macaque Anterior Intraparietal Area: Fast, Metric, and Coarse," J. Neuroscience, vol. 29, no. 34, pp. 10613-10626, 2009.
168. S. Swaminathan and D. Freedman, "Preferential Encoding of Visual Categories in Parietal Cortex Compared with Prefrontal Cortex," Nature Neuroscience, vol. 15, pp. 315-320, 2012.
169. M. Taira, K. Tsutsui, M. Jiang, K. Yara, and H. Sakata, "Parietal Neurons Represent Surface Orientation from the Gradient of Binocular Disparity," J. Neurophysiology, vol. 83, no. 5 pp. 3140-3146, 2000. (Pubitemid 30321501)
170. A. Takemura, Y. Inoue, K. Kawano, C. Quaia, and F. Miles, "Single-Unit Activity in Cortical Area MST Associated with Disparity-Vergence Eye Movements: Evidence for Population Coding," J. Neurophysiology, vol. 85, no. 5, pp. 2245-2266, 2001. (Pubitemid 32440701)
171. S. Tanabe, K. Umeda, and I. Fujita, "Rejection of False Matches for Binocular Correspondence in Macaque Visual Cortical Area V4," J. Neuroscience, vol. 24, no. 37, pp. 8170-8180, 2004. (Pubitemid 39280837)
172. K. Tanaka, "Neuronal Mechanisms of Object Recognition," Science, vol. 262, pp. 685-688, 1993. (Pubitemid 23350686)
173. K. Tanaka, "Inferotemporal Cortex and Object Vision," Ann. Rev. of Neuroscience, vol. 19, no. 1, pp. 109-139, 1996. (Pubitemid 26080824)
174. K. Tanaka, H. Saito, Y. Fukada, and M. Moriya, "Coding Visual Images of Objects in the Inferotemporal Cortex of the Macaque Monkey," J. Neurophysiology, vol. 66, no. 1, pp. 170-189, 1991.
175. K. Tanaka and H.-A. Saito, "Analysis of Motion of the Visual Field by Direction, Expansion/Contraction, and Rotation Cells Clustered in the Dorsal Part of the Medial Superior Temporal Area of the Macaque Monkey," J. Neurophysiology, vol. 62, no. 3, pp. 626-641, 1989. (Pubitemid 19236118)
176. H. Tanigawa, H.D. Lu, and A.W. Roe, "Functional Organization for Color and Orientation in Macaque V4," Nature Neuroscience, vol. 13, pp. 1542-1548, Dec. 2010.
177. J.B. Tenenbaum, C. Kemp, T.L. Griffiths, and N.D. Goodman, "How to Grow a Mind: Statistics, Structure, and Abstraction," Science, vol. 331, pp. 1279-1285, 2011.
178. F.E. Theunissen, S.V. David, N.C. Singh, A. Hsu, W.E. Vinje, and J.L. Gallant, "Estimating Spatio-Temporal Receptive Fields of Auditory and Visual Neurons from Their Responses to Natural Stimuli," Network: Computation in Neural Systems, vol. 12, no. 3, pp. 289-316, 2001. (Pubitemid 33626948)
179. T. Theys, S. Srivastava, J. van Loon, J. Goffin, and P. Janssen, "Selectivity for Three-Dimensional Contours and Surfaces in the Anterior Intraparietal Area," J. Neurophysiology, vol. 107, no. 3, pp. 995-1008, 2012.
180. P. Thier and R. Andersen, "Electrical Microstimulation Suggest Two Different Kinds of Representation of Head-Centered Space in the Intraparietal Sulcus of Rhesus Monkeys," Proc. Nat'l Academy of Sciences USA, vol. 93, pp. 4962-4967, 1996. (Pubitemid 26162853)
181. O. Thomas, B. Cumming, and A. Parker, "A Specialization for Relative Disparity in V2," Nature Neuroscience, vol. 5, no. 5, pp. 472-478, 2002. (Pubitemid 34454254)
182. T. Tompa and G. Sáry, "A Review on the Inferior Temporal Cortex of the Macaque," Brain Research Rev., vol. 62, no. 2, pp. 165-182, 2010.
183. R. Tootell, K. Nelissen, W. Vanduffel, and G. Orban, "Search for Color Center(s) in Macaque Visual Cortex," Cerebral Cortex, vol. 14, no. 4, pp. 353-363, 2004. (Pubitemid 38506967)
184. M.J. Tovée, E.T. Rolls, and P. Azzopardi, "Translation Invariance in the Responses to Faces of Single Neurons in the Temporal Visual Cortical Areas of the Alert Macaque," J. Neurophysiology, vol. 72, no. 3, pp. 1049-1060, Sept. 1994. (Pubitemid 24294825)
185. A. Treisman, "The Binding Problem," Current Opinion in Neurobiology, vol. 6, no. 2, pp. 171-178, 1996. (Pubitemid 26168475)
186. A. Treisman and H. Schmidt, "Illusory Conjunctions in the Perception of Objects," Cognitive Psychology, vol. 14, no. 1, pp. 107-141, 1982.
187. D. Tsao et al., "Stereopsis Activates V3a and Caudal Intraparietal Areas in Macaques and Humans," Neuron, vol. 39, no. 3, pp. 555-568, 2003. (Pubitemid 36937054)
188. J.K. Tsotsos, "Analyzing Vision at the Complexity Level," Behavioral and Brain Sciences, vol. 13, no. 3, pp. 423-469, 1990.
189. K. Tsutsui, H. Sakata, T. Naganuma, and M. Taira, "Neural Correlates for Perception of 3D Surface Orientation from Texture Gradient," Science, vol. 298, no. 5592, pp. 409-412, 2002. (Pubitemid 35176348)
190. T. Uka and G. DeAngelis, "Linking Neural Representation to Function in Stereoscopic Depth Perception: Roles of the Middle Temporal Area in Coarse versus Fine Disparity Discrimination," J. Neuroscience, vol. 26, no. 25, pp. 6791-6802, 2006. (Pubitemid 44315240)
191. S. Ullman and B. Epshtein, "Visual Classification by a Hierarchy of Extended Features," Towards Category-Level Object Recognition. Springer-Verlag, 2006.
192. L.G. Ungerleider and M. Mishkin, "Two Cortical Visual Systems," Analysis of Visual Behavior, D.J. Ingle, M.A. Goodale, and R.J.W. Mansfield, eds., pp. 549-586, MIT Press, 1982.
193. C. van den Boomen, M.J. van der Smagt, and C. Kemner, "Keep Your Eyes on Development: The Behavioral and Neurophysiological Development of Visual Mechanisms Underlying Form Processing," Front Psychiatry, vol. 16, no. 3, 2012.
194. J.H. van Hateren and D.L. Ruderman, "Independent Component Analysis of Natural Image Sequences Yields Spatio-Temporal Filters Similar to Simple Cells in Primary Visual Cortex," Proc. Biological Sciences, vol. 265, no. 1412, pp. 2315-2320, 1998. (Pubitemid 28561175)
195. B. Verhoef, R. Vogels, and P. Janssen, "Contribution of Inferior Temporal and Posterior Parietal Activity to Three-Dimensional Shape Perception," Current Biology, vol. 20, no. 10, pp. 909-913, 2010.
196. B. Verhoef, R. Vogels, and P. Janssen, "Inferotemporal Cortex Subserves Three-Dimensional Structure Categorization," Neuron, vol. 73, pp. 171-182, 2012.
197. R. Vogels, "Categorization of Complex Visual Images by Rhesus Monkeys. Part 2: Single-Cell Study," European J. Neuroscience, vol. 11, no. 4, pp. 1239-1255, 1999. (Pubitemid 29142183)
198. Handbuch der Physiologischen Optic, H. von Helmholtz, ed. Hamburg and Leipzig, 1866.
199. J. Wagemans, J. Elder, M. Kubovy, S. Palmer, M. Peterson, M. Singh, and R. von der Heydt, "A Century of Gestalt Psychology in Visual Perception: I. Perceptual Grouping and Figure-Ground Organization," Psychological Bull., to be Published.
200. L. Wiskott, "How Does Our Visual System Achieve Shift and Size Invariance?" 23 Problems in Systems Neuroscience, chapter 16, J.L. van Hemmen and T.J. Sejnowski, ed., pp. 322-340, Oxford Univ. Press, 2006.
201. L. Wiskott, J.-M. Fellous, N. Krü ger, and C. von der Malsburg, "Face Recognition by Elastic Bunch Graph Matching," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 775-779, July 1997. (Pubitemid 127762270)
202. J.M. Wolfe, "Visual Search," Attention, H. Pashler, ed., Univ. College London Press, 1998.
203. F. Xu and S. Carey, "Infants' Metaphysics: The Case of Numerical Identity," Cognitive Psychology, vol. 30, no. 2, pp. 111-153, Apr. 1996. (Pubitemid 126375449)
204. S. Zeki, S. Aglioti, D. McKeefry, and G. Berlucchi, "The Neurobiological Basis of Conscious Color Perception in a Blind Patient," Proc. Nat'l Academy of Sciences, vol. 96, pp. 14124-14129, 1999.
205. H. Zhou, H. Friedman, and R. Von Der Heydt, "Coding of Border Ownership in Monkey Visual Cortex," J. Neuroscience, vol. 20, no. 17, pp. 6594-6611, 2000.
206. D. Zipser and R.A. Andersen, "A Back-Propagation Programmed Network That Simulates Response Properties of a Subset of Posterior Parietal Neurons," Nature, vol. 331, no. 6158, pp. 679-684, 1988. (Pubitemid 18062235)
207. N. Pugeault, F. Wörgötte, and N. Krüger, "Visual Primitives: Local, Condensed, and Semantically Rich Visual Descriptors and Their Applications in Robotics," Int'l J. Humanoid Robotics, special issue on cognitive humanoid vision, vol. 7, no. 3, pp. 379-405, 2010.