Coding of visual objects in the ventral stream

Current Opinion in Neurobiology

Volumn 16, Issue 4, 2006, Pages 408-414

  Reddy, Leila ^a   Kanwisher, Nancy ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN CORTEX; CELL POPULATION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HIPPOCAMPUS; HUMAN; NERVE CELL; NEUROPHYSIOLOGY; NONHUMAN; PRIORITY JOURNAL; REVIEW; VISION;

ACTION POTENTIALS; ANIMALS; HUMANS; MAGNETIC RESONANCE IMAGING; NERVE NET; NEURONS; PATTERN RECOGNITION, VISUAL; SYNAPTIC TRANSMISSION; TEMPORAL LOBE; VISUAL CORTEX; VISUAL PATHWAYS;

EID: 33746578476     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conb.2006.06.004     Document Type: Review

References (77)

1. Kreiman G., Koch C., and Fried I. Category-specific visual responses of single neurons in the human medial temporal lobe. Nat Neurosci 3 (2000) 946-953
2. Quiroga R.Q., Reddy L., Kreiman G., Koch C., and Fried I. Invariant visual representation by single neurons in the human brain. Nature 435 (2005) 1102-1107. This study provides strong evidence for a sparse, explicit code in single neurons in the human medial temporal lobe. Some neurons respond in an invariant manner to strikingly different pictures of particular landmarks, famous individuals, or other objects.
3. Barlow H.B. Single units and sensation: a neuron doctrine for perceptual psychology?. Perception 1 (1972) 371-394
4. Konorksi J. Integrative Activity of the Brain: An Interdisciplinary Approach (1967), University of Chicago Press
5. Margoliash D. Acoustic parameters underlying the responses of song-specific neurons in the white-crowned sparrow. J Neurosci 3 (1983) 1039-1057
6. Perez-Orive J., Mazor O., Turner G.C., Cassenaer S., Wilson R.I., and Laurent G. Oscillations and sparsening of odor representations in the mushroom body. Science 297 (2002) 359-365
7. Olshausen B.A., and Field D.J. Sparse coding of sensory inputs. Curr Opin Neurobiol 14 (2004) 481-487
8. Thorpe S. Localized versus distributed representations. In: Arbib M.A. (Ed). The handbook of brain theory and neural networks (1998), MIT Press 549-552
9. Georgopoulos A.P., Schwartz A.B., and Kettner R.E. Neuronal population coding of movement direction. Science 233 (1986) 1416-1419
10. Georgopoulos A.P., Kalaska J.F., Caminiti R., and Massey J.T. On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. J Neurosci 2 (1982) 1527-1537
11. Pouget A., Dayan P., and Zemel R. Information processing with population codes. Nat Rev Neurosci 1 (2000) 125-132
12. Vogels R. Population coding of stimulus orientation by striate cortical cells. Biol Cybern 64 (1990) 25-31
13. Treisman A. The binding problem. Curr Opin Neurobiol 6 (1996) 171-178
14. Gross C.G., Bender D.B., and Rocha-Miranda C.E. Visual receptive fields of neurons in inferotemporal cortex of the monkey. Science 166 (1969) 1303-1306
15. Gross C.G., Rocha-Miranda C.E., and Bender D.B. Visual properties of neurons in inferotemporal cortex of the macaque. J Neurophysiol 35 (1972) 96-111
16. Logothetis N.K., Pauls J., and Poggio T. Shape representation in the inferior temporal cortex of monkeys. Curr Biol 5 (1995) 552-563
17. Logothetis N.K., and Sheinberg D.L. Visual object recognition. Annu Rev Neurosci 19 (1996) 577-621
18. Tanaka K. Inferotemporal cortex and object vision. Annu Rev Neurosci 19 (1996) 109-139
19. Freedman D.J., Riesenhuber M., Poggio T., and Miller E.K. Categorical representation of visual stimuli in the primate prefrontal cortex. Science 291 (2001) 312-316
20. Freedman D.J., Riesenhuber M., Poggio T., and Miller E.K. A comparison of primate prefrontal and inferior temporal cortices during visual categorization. J Neurosci 23 (2003) 5235-5246
21. Foldiak P., Xiao D., Keysers C., Edwards R., and Perrett D.I. Rapid serial visual presentation for the determination of neural selectivity in area STSa. Prog Brain Res 144 (2004) 107-116. Using rapid serial presentation, the authors measure the response of individual neurons to more than a thousand natural images. Some neurons respond selectively to faces: in one case, the 70 stimuli producing the strongest responses all contained faces, and the next 'best' stimuli produced less than 1/5 of the maximal response.
22. Connor C.E. Neuroscience: friends and grandmothers. Nature 435 (2005) 1036-1037
23. Kiani R, Esteky H, Tanaka K: Hierarchical representation of object categories in monkey inferotemporal cortex [abstract]. Soc Neurosci 2005: 620.4.
24. Pasupathy A., and Connor C.E. Population coding of shape in area V4. Nat Neurosci 5 (2002) 1332-1338
25. Brincat S.L., and Connor C.E. Underlying principles of visual shape selectivity in posterior inferotemporal cortex. Nat Neurosci 7 (2004) 880-886
26. Kayaert G., Biederman I., and Vogels R. Representation of regular and irregular shapes in macaque inferotemporal cortex. Cereb Cortex 15 (2005) 1308-1321
27. Hung C.P., Kreiman G., Poggio T., and DiCarlo J.J. Fast readout of object identity from macaque inferior temporal cortex. Science 310 (2005) 863-866. The authors show that a small population of neurons in monkey inferior temporal cortex provides accurate information about object category and identity within 12.5 ms of image presentation. The responses of these neurons support a population based coding scheme.
28. Abbott L.F., Rolls E.T., and Tovee M.J. Representational capacity of face coding in monkeys. Cereb Cortex 6 (1996) 498-505
29. Quian Quiroga R, Reddy L, Koch C, Fried I: Decoding visual responses from single neurons in the human brain [abstract]. Soc Neurosci 2005:856.1.
30. Freiwald WA, Tsao DY, Tootell RBH, Livingstone MS: Single-unit recording in an FMRI-identified macaque face patch. II. Coding along multiple feature axes [abstract]. Soc Neurosci 2005:362.6.
31. Tsunoda K., Yamane Y., Nishizaki M., and Tanifuji M. Complex objects are represented in macaque inferotemporal cortex by the combination of feature columns. Nat Neurosci 4 (2001) 832-838
32. Hirabayashi T., and Miyashita Y. Dynamically modulated spike correlation in monkey inferior temporal cortex depending on the feature configuration within a whole object. J Neurosci 25 (2005) 10299-10307
33. Chklovskii D.B., and Koulakov A.A. Maps in the brain: what can we learn from them?. Annu Rev Neurosci 27 (2004) 369-392. The authors argue that the minimization of wiring costs constitutes a major constraint that has shaped the organization of cortical maps.
34. Sompolinsky H., and Shapley R. New perspectives on the mechanisms for orientation selectivity. Curr Opin Neurobiol 7 (1997) 514-522
35. Wang Y., Fujita I., and Murayama Y. Neuronal mechanisms of selectivity for object features revealed by blocking inhibition in inferotemporal cortex. Nat Neurosci 3 (2000) 807-813
36. Horton J.C., and Adams D.L. The cortical column: a structure without a function. Philos Trans R Soc Lond B Biol Sci 360 (2005) 837-862
37. Fujita I., Tanaka K., Ito M., and Cheng K. Columns for visual features of objects in monkey inferotemporal cortex. Nature 360 (1992) 343-346
38. Kreiman G., Hung C.P., Kraskov A., Quiroga R.Q., Poggio T., and DiCarlo J.J. Object selectivity of local field potentials and spikes in the macaque inferior temporal cortex. Neuron 49 (2006) 433-445
39. Kanwisher N., McDermott J., and Chun M.M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci 17 (1997) 4302-4311
40. Grill-Spector K., Knouf N., and Kanwisher N. The fusiform face area subserves face perception, not generic within-category identification. Nat Neurosci 7 (2004) 555-562
41. Yovel G., and Kanwisher N. The neural basis of the behavioral face-inversion effect. Curr Biol 15 (2005) 2256-2262
42. Yovel G., and Kanwisher N. Face perception: domain specific, not process specific. Neuron 44 (2004) 889-898
43. Andrews T.J., and Schluppeck D. Neural responses to mooney images reveal a modular representation of faces in human visual cortex. Neuroimage 21 (2004) 91-98
44. Epstein R., and Kanwisher N. A cortical representation of the local visual environment. Nature 392 (1998) 598-601
45. Epstein R., Harris A., Stanley D., and Kanwisher N. The parahippocampal place area: recognition, navigation, or encoding?. Neuron 23 (1999) 115-125
46. Downing P.E., Jiang Y., Shuman M., and Kanwisher N. A cortical area selective for visual processing of the human body. Science 293 (2001) 2470-2473
47. Downing PE, Chan AW, Peelen MV, Dodds CM, Kanwisher N: Domain specificity in visual cortex. Cereb Cortex 2005, in press; DOI:10.1093/cercor/bhj086.
48. Schwarzlose R.F., Baker C.I., and Kanwisher N. Separate face and body selectivity on the fusiform gyrus. J Neurosci 25 (2005) 11055-11059
49. McCandliss B.D., Cohen L., and Dehaene S. The visual word form area: expertise for reading in the fusiform gyrus. Trends Cogn Sci 7 (2003) 293-299
50. Baker CI, Liu J, Wald L, Benner T, Kanwisher N: Experience-dependent selectivity for visual letter strings in English and Hebrew readers [abstract]. Soc Neurosci 2005:620.17.
51. Spiridon M., Fischl B., and Kanwisher N. Location and spatial profile of category-specific regions in human extrastriate cortex. Hum Brain Mapp 27 (2006) 77-89
52. Tsao D.Y., Freiwald W.A., Knutsen T.A., Mandeville J.B., and Tootell R.B. Faces and objects in macaque cerebral cortex. Nat Neurosci 6 (2003) 989-995
53. Pinsk M.A., DeSimone K., Moore T., Gross C.G., and Kastner S. Representations of faces and body parts in macaque temporal cortex: a functional MRI study. Proc Natl Acad Sci USA 102 (2005) 6996-7001
54. Zangenehpour S., and Chaudhuri A. Patchy organization and asymmetric distribution of the neural correlates of face processing in monkey inferotemporal cortex. Curr Biol 15 (2005) 993-1005. In this remarkable study the authors use a novel dual label method to image face and object responses with single-cell resolution in IT cortex in marmosets. Multiple large patches of cortex are shown to contain only neurons responsive to faces and not objects. These patches are found disproportionately in the right hemisphere.
55. Haxby J.V., Gobbini M.I., Furey M.L., Ishai A., Schouten J.L., and Pietrini P. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293 (2001) 2425-2430
56. Ewbank M.P., Schluppeck D., and Andrews T.J. fMR-adaptation reveals a distributed representation of inanimate objects and places in human visual cortex. Neuroimage 28 (2005) 268-279
57. Ernst M.O., and Banks M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415 (2002) 429-433
58. Hanson S.J., Matsuka T., and Haxby J.V. Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: is there a "face" area?. Neuroimage 23 (2004) 156-166
59. Sayres R., and Grill-Spector K. Identifying distributed object representations in human extrastriate cortex. In: Weiss Y., Scholkopf B., and Platt J. (Eds). Advances in Neural Information Processing Systems 18 (2006), MIT Press
60. Spiridon M., and Kanwisher N. How distributed is visual category information in human occipito-temporal cortex? An fMRI study. Neuron 35 (2002) 1157-1165
61. O'Toole A.J., Jiang F., Abdi H., and Haxby J.V. Partially distributed representations of objects and faces in ventral temporal cortex. J Cogn Neurosci 17 (2005) 580-590. The authors use the methods of Haxby et al. [55] to show that object categories with shared image-based attributes have shared neural structure. They also demonstrate that the FFA and PPA are not well suited to perform classifications not involving faces and places, respectively.
62. Baker CI, Knouf N, Wald LL, Fischl B, Kanwisher N: Functional and spatial selectivity in human extrastriate visual cortex at high resolution [abstract]. Soc Neurosci 2003:69.3.
63. Grill-Spector K, Sayres RA, Ress D: Fine-scale functional organisation of face-selective regions in humans revealed by high resolution FMRI [abstract]. Soc Neurosci 2005:362.4.
64. Grill-Spector K, Sayres RA, Ress D: Fine-scale functional organisation of face-selective regions in humans revealed by high-resolution FMRI [abstract]. Soc Neurosci 2005:362.4.
65. Tsao D.Y., Freiwald W.A., Tootell R.B., and Livingstone M.S. A cortical region consisting entirely of face-selective cells. Science 311 (2006) 670-674. Single-unit recordings targeted to face-selective patches identified with fMRI in macaques show that 97% of the neurons in face-selective patches respond nearly exclusively to faces.
66. Afraz S, Kiani R, Esteky H: Microstimulation of inferotemporal cortex influences face categorization. Nature 2006, in press. The authors reveal the causal role in face perception of face-selective patches of cortex in monkeys, by demonstrating that microstimulation of these regions biases the monkeys toward a percept of a face.
67. Wada Y., and Yamamoto T. Selective impairment of facial recognition due to a haematoma restricted to the right fusiform and lateral occipital region. J Neurol Neurosurg Psychiatry 71 (2001) 254-257
68. Puce A., Allison T., and McCarthy G. Electrophysiological studies of human face perception. III: effects of top-down processing on face-specific potentials. Cereb Cortex 9 (1999) 445-458
69. Mundel T., Milton J.G., Dimitrov A., Wilson H.W., Pelizzari C., Uftring S., Torres I., Erickson R.K., Spire J.P., and Towle V.L. Transient inability to distinguish between faces: electrophysiologic studies. J Clin Neurophysiol 20 (2003) 102-110
70. Urgesi C., Berlucchi G., and Aglioti S.M. Magnetic stimulation of extrastriate body area impairs visual processing of nonfacial body parts. Curr Biol 14 (2004) 2130-2134. This study used TMS to demonstrate that the extrastriate body area (EBA) is not only correlated with but also causally involved in the perception of body parts: stimulation of this region selectively disrupted performance on successive matching of body parts, not faces or objects.
71. Gaillard R., Naccache L., Pinel P., Clemenceau S., Volle E., Hasboun D., Dupont P., Baulac M., Dehaene S., Adam C., et al. Direct intracranial, fMRI and lesion evidence for the causal role of left inferotemporal cortex in reading. Neuron 50 (2006) 191-204. The authors report the results of surgical removal of a cortical region adjacent to a word-preferring region in the left fusiform gyrus in an epilepsy patient. This surgery eliminated word-preferring activation and left the patient with a severe reading deficit, but no deficit in recognition of other categories, demonstrating the necessity of this region for reading but not object recognition.
72. Op de Beeck H.P., Baker C.I., Rindler S., and Kanwisher N. An increased bold response for trained objects in object-selective regions of human visual cortex. J Vis 5 (2005) 1056a
73. Polk T.A., Stallcup M., Aguirre G.K., Alsop D.C., D'Esposito M., Detre J.A., and Farah M.J. Neural specialization for letter recognition. J Cogn Neurosci 14 (2002) 145-159
74. Baker C.I., Behrmann M., and Olson C.R. Impact of learning on representation of parts and wholes in monkey inferotemporal cortex. Nat Neurosci 5 (2002) 1210-1216
75. Logothetis N.K., and Pauls J. Psychophysical and physiological evidence for viewer-centered object representations in the primate. Cereb Cortex 5 (1995) 270-288
76. Freedman DJ, Riesenhuber M, Poggio T, Miller EK: Experience-dependent sharpening of visual shape selectivity in inferior temporal cortex. Cereb Cortex 2005, in press; DOI:10.1093/cercor/bhj100. The authors provide evidence for a sharpening of neuronal selectivities in monkey inferior temporal cortex that were specific to objects that monkeys were familiar with or extensively trained on.
77. Erickson C.A., Jagadeesh B., and Desimone R. Clustering of perirhinal neurons with similar properties following visual experience in adult monkeys. Nat Neurosci 3 (2000) 1143-1148