What fMRI has taught us about human vision

Current Opinion in Neurobiology

Volumn 7, Issue 4, 1997, Pages 554-561

  Courtney, Susan M ^a   Ungerleider, Leslie G ^a  

^a Laboratory of Brain and Cognition   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ATTENTION; COLOR; HUMAN; MEMORY; MONKEY; MOVEMENT PERCEPTION; NEUROANATOMY; NONHUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; PRIORITY JOURNAL; REVIEW; VISUAL CORTEX; VISUAL DISCRIMINATION; VISUAL STIMULATION; VISUAL SYSTEM;

EID: 0031408826     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0959-4388(97)80036-0     Document Type: Article

References (90)

1. Ungerleider LG, Haxby JV. What and where in the human brain. Curr Opin Neurobiol. 4:1994;157-165.
2. Fox PT, Raichle ME. Focal physiological uncoupling of cerebral blood flow and oxidative metabolism during somatosensory stimulation in human subjects. Proc Natl Acad Sci USA. 83:1986;1140-1144.
3. Bandettini PA, Wong EC, Hinks RS, Tikofsky RS, Hyde JS. Time course of EPI of human brain function during task activation. Magn Reson Med. 25:1992;390-397.
4. Kwong KK, Belliveau JW, Chesler DA, Goldberg IE, Weisskoff RM, Poncelet BP, Kennedy DN, Hoppel BE, Cohen MS, Turner R, et al. Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. Proc Natl Acad Sci USA. 89:1992;5675-5679.
5. Ogawa S, Tank DW, Menon R, Ellermann JM, Kim SG, Merkle H, Ugurbil K. Intrinsic signal changes accompanying sensory stimulation: functional brain mapping with magnetic resonance imaging. Proc Natl Acad Sci USA. 89:1992;5951-5955.
6. Boynton GM, Engel SA, Glover GH, Heeger DJ. Linear systems analysis of functional magnetic resonance imaging in human V1. of special interest J Neurosci. 16:1996;4207-4221 The authors describe a linear systems analysis of fMRI responses in V1 and demonstrate that the response is a separable function of stimulus duration and stimulus contrast. Their analysis demonstrates that the fMRI signal, at least in V1, increases monotonically with stimulus contrast and that the response to a long, periodic stimulus is slightly overestimated by a linear model based on the response to a brief pulse. These findings help us begin to understand the quantitative relationship between neural activity and the fMRI signal.
7. Felleman DJ, Van Essen DC. Distributed heirarchical processing in the primate cerebral cortex. Cereb Cortex. 1:1991;1-47.
8. Ungerleider LG, Mishkin M. Two cortical visual systems. Ingle DJ, Goodale MA, Mansfield RJW. Analysis of Visual Behavior. 1982;549-586 MIT Press, Cambridge, Massachusetts.
9. Desimone R, Ungerleider LG. Neural mechanisms of visual processing in monkeys. Goodglass H, Damasio AR. Handbook of Neuropsychology. 1989;267-300 Elsevier, Amsterdam.
10. Desimone R. Face-selective cells in the temporal cortex of monkeys. J Cogn Neurosci. 3:1991;1-8.
11. Tanaka K. Neuronal mechanisms of object recognition. Science. 262:1993;685-688.
12. Barbas H, Mesulam M-M. Cortical afferent input to the principalis region of the rhesus monkey. Neuroscience. 15:1985;619-637.
13. Cavada C, Goldman-Rakic PS. Posterior parietal cortex in rhesus monkey. II. Evidence for segregated corticocortical networks linking sensory and limbic areas with the frontal lobe. J Comp Neurol. 287:1989;422-445.
14. Webster MJ, Bachevalier J, Ungerleider LG. Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. Cereb Cortex. 5:1994;470-483.
15. Desimone R, Duncan J. Neural mechanisms of selective visual attention. Annu Rev Neurosci. 18:1995;193-222.
16. Schneider W, Noli DC, Cohen JD. Functional topographic mapping of the cortical ribbon in human vision with conventional MRI scanners. Nature. 365:1993;150-153.
17. Engel SA, Rumelhart DE, Wandell BA, Lee AT, Glover GH, Chichilnisky E-J, Shadlen MN. fMRI of human visual cortex. Nature. 369:1994;525.
18. Sereno MI, Dale AM, Reppas JB, Kwong KK, Belliveau JW, Brady TJ, Rosen BR, Tootell RBH. Borders of multiple visual areas in human revealed by functional magnetic resonance imaging. Science. 268:1995;889-893.
19. DeYoe EA, Carman GJ, Bandettini P, Glickman S, Wieser J, Cox R, Miller D, Neitz J. Mapping striate and extrastriate visual areas in human cerebral cortex. of outstanding interest Proc Natl Acad Sci USA. 93:1996;2382-2386 The authors used the same method as the one presented in [17] and a cortical unfolding algorithm, different from [18], to map the locations, spatial extents, and borders of several retinotopic visual areas in human cortex. Their findings agree well with those presented in [18].
20. Engel SA, Glover GH, Wandell BA. Retinotopic organization in human visual cortex and the spatial precision of functional MRI. Cereb Cortex. 7:1997;181-192.
21. Tootell RBH, Dale AM, Sereno MI, Malach R. New images from human visual cortex. of special interest Trends Neurosci. 19:1996;481-489 This review summarizes much of the imaging, histological, and physiological data regarding the organization of early visual areas in human cortex. It also includes additional data that clarify or support previously published fMRI results on retinotopic mapping, contrast sensitivity in MT, and object selectivity in LO.
22. Zeki SM. Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey. J Physiol (Lond). 236:1974;549-573.
23. Maunsell JHR, Van Essen DC. Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction speed, and orientation. J Neurophysiol. 49:1983;1127-1147.
24. Treue S, Maunsell JHR. Attentional modulation of visual motion processing in cortical areas MT and MST. Nature. 382:1996;539-541.
25. Corbetta M, Miezin FM, Dobmeyer S, Shulman GL, Petersen SE. Selective and divided attention during visual discriminations of shape, color, and speed: functional anatomy by positron emission tomography. J Neurosci. 11:1991;2383-2402.
26. Zeki S, Watson JPG, Lueck CJ, Friston K, Kennard C, Frackowiak RSJ. A direct demonstration of functional specialization in human visual cortex. J Neurosci. 11:1991;641-649.
27. Watson JD, Myers R, Frackowiak RSJ, Hajnal JV, Woods RP, Mazziotta JC, Shipp S, Zeki S. Area V5 of the human brain: evidence from a combined study using positron emission tomography and magnetic resonance imaging. Cereb Cortex. 3:1993;79-94.
28. Tootell RBH, Reppas JB, Kwong KK, Malach R, Born RT, Brady TJ, Rosen BR, Belliveau JW. Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging. J Neurosci. 15:1995;3215-3230.
29. Howard RJ, Brammer M, Wright I, Woodruff PW, Bullmore ET, Zeki S. A direct demonstration of functional specialization within motion-related visual and auditory cortex of the human brain. of outstanding interest Curr Biol. 6:1996;1015-1019 This paper reports that moving stimuli activate, in addition to MT, a presumably multimodal area in the superior temporal gyrus. The area appears to overlap with regions activated when the same subjects were listening to speech. This study, along with those presented in [35,36], provides evidence for a link between motion processing and language of special interest.
30. Beauchamp MS, Cox RW, DeYoe EA. Graded effects of spatial and featural attention on human area MT and associated motion processing areas. of special interest J Neurophysiol. 1997; In this study, subjects viewed a peripherally presented annulus containing colored, moving dots while maintaining central fixation. The results showed that activation in MT was greatest when spatial attention was directed toward the annulus and featural attention was directed toward the speed of the dots. This activation was reduced when featural attention was directed toward the color of the dots, and further reduced when spatial attention was directed toward the central fixation point. These results demonstrate that top-down influences, such as spatial and featural attention, have a powerful effect on motion processing in MT.
31. O'Craven KM, Rosen BR, Kwong KK, Treisman A, Savoy RL. Voluntary attention modulates fMRI activity in human MT-MST. Neuron. 18:1997;591-598.
32. Lund JS, Lund RD, Hendrickson A, Bunt AH, Fuchs AF. The origin of efferent pathways from the primary visual cortex, area 17 of the macaque monkey as shown by retrograde transport of horseradish peroxidase. J Comp Neurol. 164:1976;287-304.
33. Lovegrove WJ, Bowling A, Badock D, Blackwood M. Specific reading disability: differences in contrast sensitivity as a function of spatial frequency. Science. 210:1980;439-440.
34. Livingstone M, Rosen GD, Drislane FW, Galaburda A. Physiological and anatomical evidence for a magnocellular defect in develomental dyslexia. Proc Natl Acad Sci USA. 88:1991;7943-7947.
35. Eden GF, VanMeter JW, Rumsey JM, Maisog JM, Woods RP, Zeffiro TA. Abnormal processing of visual motion in dyslexia revealed by functional brain imaging. of outstanding interest Nature. 382:1996;66-69 This paper presents an fMRI study demonstrating an almost complete lack of activation in MT during motion perception in dyslexics, unlike in normal controls. Dyslexics, however, showed normal activation to textured patterns in early visual areas. These results support the idea that disorders in reading may reflect a general deficit in the visual processing of the temporal properties of stimuli, an example of which is motion.
36. Martin A, Haxby J, Lalonde F, Wiggs C, Ungerleider LG. Discrete cortical regions associated with knowledge of color and knowledge of action. Science. 270:1995;102-105.
37. Sakai K, Watanabe E, Onodera Y, Uchida I, Kato H, Yamamoto E, Koizumi H, Miyashita Y. Functional mapping of the human colour centre with echo-planar magnetic resonance imaging. Proc R Soc Lond [Biol]. 261:1995;89-98.
38. Kleinschmidt A, Lee BB, Requardt M, Frahm J. Functional mapping of color processing by magnetic resonance imaging of responses to selective P- and M-pathway stimulation. Exp Brain Res. 110:1996;279-288.
39. Clark VP, Parasuraman R, Keil K, Kulanski R, Fannon S, Maisog JM, Ungerleider LG, Haxby JV. Selective attention to face identity and color studied with fMRI. of special interest Hum Brain Mapping. 1997; This paper reports results from selective attention tasks to either color or face identity, using identical stimuli (color-washed greyscale images of faces). The results showed that selective attention to either faces or color activates a region along the fusiform gyrus, whereas only selective attention to color activates an additional area in the collateral sulcus. This latter area corresponds to the color-selective area found by previous fMRI and PET studies comparing passive viewing of colored and greyscale stimuli [25,26,37,38,40].
40. Lueck CJ, Zeki S, Friston KJ, Deiber MP, Cope P, Cunningham VG, Lammertsma AA, Kennard C, Frackowiak RSJ. The color center in the cerebral cortex of man. Nature. 340:1989;386-389.
41. Damasio A, Yamada T, Damasio H, Corbett J, McKee J. Central achromatopsia: behavioral, anatomical and physiologic aspects. Neurology. 30:1980;1064-1071.
42. Zeki SM. Functional specialization in the visual cortex of the rhesus monkey. Nature. 274:1978;423-428.
43. Schein SJ, Desimone R. Spectral properties of v4 neurons in the macaque. J Neurosci. 10:1990;3369-3389.
44. Desimone R, Schein SJ. Visual properties of neurons in area v4 of the macaque: sensitivity to stimulus form. J Neurophysiol. 57:1987;835-868.
45. Gallant J, Braun J, Van Essen DC. Selectivity for polar, hyperbolic, and Cartesian gratings in macaque visual cortex. Science. 259:1993;100-103.
46. Heywood CA, Gadotti A, Cowey A. Cortical area V4 and its role in the perception of color. J Neurosci. 12:1992;4056-4065.
47. Merigan WH. Human V4? Curr Biol. 3:1993;226-229.
48. Puce A, Allison T, Gore JC, McCarthy G. Face-sensitive regions in human extrastriate cortex studied by functional MRI. J Neurophysiol. 74:1995;1192-1199.
49. Puce A, Allison T, Asgari M, Gore JC, McCarthy G. Differential sensitivity of human visual cortex to faces, letterstrings, and textures: a functional magnetic resonance imaging study. of special interest J Neurosci. 16:1996;5205-5215 The authors measured the differential sensitivity of human visual cortex to textures, faces, and letterstrings. The locations of the texture and face activations agree with the results of other studies [50,51,52,53]. The 'letterstring area' seems to be just posterior to an area associated previously with recognition of visually presented words [57]. If the 'letterstring area' proves to be specific to letters, it would provide further evidence for a remodeling of cortex with experience of outstanding interest.
50. Clark VP, Keil K, Maisog JM, Courtney SM, Ungerleider LG, Haxby JV. Functional magnetic resonance imaging (fMRI) of human visual cortex during face matching: a comparison with positron emission tomography (PET). Neuroimage. 4:1996;1-15.
51. Courtney SM, Ungerleider LG, Keil K, Haxby JV. Transient and sustained activity in a distributed neural system for human working memory. of outstanding interest Nature. 386:1997;608-611 This study of working memory for faces used multiple regression analysis in order to distinguish activity related to transient perceptual processing during stimulus presentation and sustained activity during working memory delays. The results show a gradual decrease in the amount of perception-related activity and a corresponding increase in the amount of memory-related activity in six different cortical regions, from posterior extrastriate through to anterior prefrontal cortices.
52. Kanwisher N, McDermott J, Chun MM. The fusiform face area: a module in human extrastriate cortex specialized for the perception of faces. of special interest J Neurosci. 17:1997;4302-4311 This paper presents the results of several fMRI experiments demonstrating the face selectivity of the middle fusiform gyrus.
53. McCarthy G, Puce A, Gore JC, Allison T. Face-specific processing in the human fusiforms gyrus. of outstanding interest J Cogn Neurosci. 1997; This fMRI study shows a separate region of activation for faces over other objects in a rapid presentation, passive viewing paradigm. The area showing face selectivity seems to be the same as that found with very different paradigms in other studies [48,49,50,51,52] of special interest.
54. Damasio AR, Damasio H, Van Hoesen GW. Prosopagnosia: anatomic basis and behavioral mechanisms. Neurology. 32:1982;331-341.
55. Damasio AR, Tranel D, Damasio H. Face agnosia and the neural substrates of memory. Annu Rev Neurosci. 13:1990;89-109.
56. Fodor J. The Modularity of Mind. 1983;MIT Press, Cambridge, Massachusetts.
57. Petersen SE, Fox PT, Snyder AZ, Raichle ME. Activation of extrastriate and frontal cortical areas by visual words and word-like stimuli. Science. 249:1990;1041-1044.
58. Polk TA, Farah MJ. Late experience alters vision. Nature. 376:1995;648-649.
59. Farah MJ. Visual Agnosia. 1990;MIT Press, Cambridge, Massachusetts.
60. Malach R, Reppas JB, Benson RR, Kwong KK, Jiang H, Kennedy WA, Ledden PJ, Brady TJ, Rosen BR, Tootell RBH. Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc Natl Acad Sci USA. 92:1995;8135-8139.
61. Martin A, Wiggs C, Ungerleider LG, Haxby JV. Neural correlates of category-specific knowledge. Nature. 379:1996;649-652.
62. Kanwisher N, Woods RP, Iacoboni M, Mazziotta JC. A locus in human extrastriate cortex of visual shape analysis. J Cogn Neurosci. 9:1997;133-142.
63. Von der Heydt R, Peterhans E, Baumgartner G. Illusory contours and cortical neuron responses. Science. 224:1984;1260-1262.
64. Grosof DH, Shapley RM, Hawken MJ. Macaque V1 neurons can signal illusory contours. Nature. 365:1993;550-552.
65. Sheth BR, Sharma J, Rao SC, Sur M. Orientation maps of subjective contours in visual cortex. Science. 274:1996;2110-2115.
66. DeWeerd P, Gattass R, Desimone R, Ungerleider LG. Responses of cells in monkey visual cortex during perceptual filling-in of an artificial scotoma. Nature. 377:1995;731-734.
67. Newsome WT, Britten KH, Movshon JA. Neuronal correlates of a perceptual decision. Nature. 341:1989;52-54.
68. Britten KH, Newsome WT, Shadlen MN, Celebrini S, Movshon JA. A relationship between behavioral choice and the visual responses of neurons in macaque MT. Vis Neurosci. 13:1996;87-100.
69. Zeki SM. Colour coding in the cerebral cortex: the reaction of cells in monkey visual cortex to wavelengths and colours. Neuroscience. 9:1983;741-765.
70. Hirsch J, DeLaPaz RL, Relkin NR, Victor J, Kim K, Li T, Borden P, Rubin N, Shapley R. Illusory contours activate specific regions in human visual cortex: evidence from functional magnetic resonance imaging. Proc Natl Acad Sci USA. 92:1995;6469-6473.
71. Ffytche DH, Zeki S. Brain activity related to the perception of illusory contours. Neuroimage. 3:1996;104-108.
72. Tootell RBH, Reppas JB, Dale AM, Look RB, Sereno MI, Malach R, Brady TJ, Rosen BR. Visual motion aftereffect in human cortical area MT revealed by functional magnetic resonance imaging. Nature. 375:1995;139-141.
73. Moran J, Desimone R. Selective attention gates visual processing in the extrastriate cortex. Science. 229:1985;782-784.
74. Desimone R. Neural mechanisms for visual memory and their role in attention. Proc Natl Acad Sci USA. 93:1996;13494-13499.
75. Cohen JD, Perlstein WM, Braver TS, Nystrom LE, Noll DC, Jonides J, Smith EE. Temporal dynamics of brain activation during a working memory task. Nature. 386:1997;604-608.
76. Miyashita Y, Chang HS. Neuronal correlate of pictorial short-term memory in the primate temporal cortex. Nature. 331:1988;68-70.
77. Miller EK, Li L, Desimone R. Activity of neurons in anterior inferior temporal cortex during a short-term memory task. J Neurosci. 13:1993;1460-1478.
78. Fuster JM. Memory in the Cerebral Cortex: An Empirical Approach to Neural Networks in the Human and Nonhuman Primate. 1995;MIT Press, Cambridge, Massachusetts.
79. Wilson FA, Scalaidhe SP, Goldman-Rakic PS. Dissociation of object and spatial processing domains in primate prefrontal cortex. Science. 260:1993;1955-1958.
80. Miller EK, Li L, Desimone R. Neural mechanisms of visual working memory in prefrontal cortex of the macaque. J Neurosci. 16:1996;5154-5167.
81. D'Esposito M, Detre JA, Aguirre GK, Stallcup M, Alsop DC, Tippet LJ, Farah MJ. A functional MRI study of mental image generation. of outstanding interest Neuropsychologia. 35:1997;725-730 This experiment demonstrates the activation of extrastriate visual areas during imagery of the referents of auditorily presented concrete nouns. By showing that visual areas are activated in the complete absence of visual input, the study provides evidence both for top-down processing and for an interaction between the auditory and visual modalities through language.
82. LeBihan D, Tumer R, Zeffiro TA, Cuenod CA, Jezzard P, Bonnerot V. Activation of human primary visual cortex during visual recall: a magnetic resonance imaging study. Proc Natl Acad Sci USA. 90:1993;11802-11805.
83. Cohen MS, Kosslyn SM, Breiter HC, DiGirolamo GJ, Thompson WL, Anderson AK, Bookheimer SY, Rosen BR, Belliveau JW. Changes in cortical activity during mental rotation: a mapping study using functional MRI. of outstanding interest Brain. 119:1996;89-100 In this study, subjects made same/different responses to pictures of three-dimensional block figures that were shown at different orientations. Activations during this task were compared to those during a control condition in which the pairs of pictures were either identical or mirror images of each other. Activations for the task requiring mental rotation included Brodmann areas 7 and 19, and presumed human MT, providing evidence for top-down processing specific to parts of the dorsal spatial vision pathway.
84. Aguirre GK, D'Esposito M. Environmental knowledge is subserved by separable dorsal/ventral neural areas. of special interest J Neurosci. 17:1997;2512-2518 In this study, subjects made judgments regarding the appearance and position of familiar locations within a virtual reality environment. The fMRI data revealed a double dissociation of regional activation, with dorsal activation for the position of environmental landmarks and ventral activation for their appearance. The study lends further support for the dichotomy between dorsal and ventral visual streams.
85. Kosslyn SM, Alpert NM, Thompson WL, Maljkovic V, Weise S, Chabris CE, Hamilton S, Rauch SL, Buonanno FS. Visual mental imagery activates topographically organized visual cortex: PET investigations. J Cogn Neurosci. 5:1993;263-287.
86. Roland PE, Gulyas B. Visual memory, visual imagery, and visual recognition of large field patterns by the human brain: functional anatomy by positron emission tomography. Cereb Cortex. 5:1995;79-93.
87. Mellet E, Tzourio N, Crivello F, Joliot M, Denis M, Mazoyer B. Functional anatomy of spatial mental imagery generated from verbal instructions. J Neurosci. 16:1996;6504-6512.
88. Alivisatos B, Petrides M. Functional activation of the human brain during mental rotation. Neuropsychologia. 35:1997;111-118.
89. Courtney SM, Ungerleider LG, Keil K, Haxby JV. Object and spatial visual working memory activate separate neural systems in human cortex. Cereb Cortex. 6:1996;39-49.
90. Buckner RL, Bandettini PA, O'Craven KM, Savoy RL, Petersen SE, Raichle ME, Rosen BR. Detection of cortical activation during averaged single trials of a cognitive task using functional magnetic resonance imaging. of outstanding interest Proc Natl Acad Sci USA. 93:1996;14302-14303 This paper provides evidence that is possible to obtain reliable fMRI signals from single-trial paradigms, paving the way for greater flexibility in task designs that could take advantage of the high temporal resolution afforded by fMRI.