Linking visual perception with human brain activity

Current Opinion in Neurobiology

Volumn 9, Issue 4, 1999, Pages 474-479

  Heeger, David J ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ATTENTION; HUMAN; MONKEY; NERVE CONDUCTION; NONHUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; PRIORITY JOURNAL; PSYCHOPHYSIOLOGY; REVIEW; VISION; VISUAL CORTEX;

EID: 0033178545     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0959-4388(99)80071-3     Document Type: Article

References (68)

1. 1. Wandell BA: Computational neuroimaging of human visual cortex. Annu Rev Neurosci 1999, 22:145-173. This review details the fMRI methods for localizing human cortical visual areas. The author critically evaluates the conventional subtraction methodology that underlies the design and interpretation of the majority of neuroimaging experiments. He recommends a different approach, that he calls computational neuroimaging, using fMRI to test computational theories of vision.
2. 2. Parker AJ, Newsome WT: Sense and the single neuron: probing the physiology of perception. Annu Rev Neurosci 1998, 21:227-277. This paper provides a thorough review of the electrophysiological methods, results, and computational theories linking neuronal activity with psychophysical performance, emphasizing work on awake behaving monkeys.
3. 3. Dale AM, Buckner RL: Selective averaging of rapidly presented individual trials using fMRI. Hum Brain Mapp 1997, 5:329-340.
4. 4. Burock MA, Buckner RL, Woldorff MG, Rosen BR, Dale AM: Randomized event-related experimental designs allow for extremely rapid presentation rates using functional MRI. Neuroreport 1998, 9:3735-3739. This paper presents an event-related fMRI method that allows for very brief (e.g. 500 ms) inter-trial intervals, thereby expanding the potential applicability of fMRI to a much wider range of empirical questions and paradigms.
5. 5. Boynton GM, Engel SA, Glover GH, Heeger DJ: Linear systems analysis of fMRI in human V1. J Neurosci 1996, 16:4207-4221.
6. 6. Glover GH: Deconvolution of impulse response in event-related BOLD fMRI. Neuroimage 1999, 9:416-419. This study reports that fMRI signals in auditory and motor cortex are not proportional to average neuronal activity. These results imply that caution must be taken when analyzing and interpreting fMRI data, particularly for event-related experimental designs with brief inter-trial intervals. This paper also demonstrates that a variant of the Buxton balloon model [63•] can explain the apparent nonlinearities in the fMRI signal.
7. 7. Liu AK, Dale AM, Cavanagh P, Tootell RBH, Hadjikhani N: Retinotopy and color sensitivity in human visual cortical area V8. Nat Neurosci 1998, 1:235-241.
8. 8. Zeki S, McKeefry DJ, Bartels A, Frakowiak RSJ: Has a new color area been discovered? Nat Neurosci 1998, 1:335-336.
9. 9. Puce A, Allison T, Gore JC, McCarthy G: Face-sensitive regions in human extrastriate cortex studied by functional MRI. J Neurophysiol 1995, 74:1192-1199.
10. 10. Kanwisher N, McDermott J, Chun MM: The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci 1997, 17:4302-4311.
11. 11. Kanwisher N, Tong F, Nakayama K: The effect of face inversion on the human fusiform face area. Cognition 1998, 68:1-11.
12. 12. Haxby JV, Ungerleider LG, Clark VP, Schouten JL, Hoffman EA, Martin A: The effect of face inversion on activity in human neural systems for face and object perception. Neuron 1999, 22:189-199.
13. 13. Halgren E, Dale AM, Sereno MI, Tootell RBH, Marinkovic K, Rosen BR: Location of human face-selective cortex with respect to retinotopic areas. Hum Brain Mapp 1999, 7:29-37.
14. 14. Gauthier I, Anderson AW, Tarr MJ, Skudlarski P, Gore JC: Levels of categorization in visual recognition studied with functional MRI. Curr Biol 1997, 7:645-651.
15. 15. Gauthier I, Anderson AW, Tarr MJ, Skudlarski P, Gore JC: Activation of the middle fusiform face area increases with expertise in recognizing novel objects. Nat Neurosci 1999, 2:568-573. This study reports that the putative 'face area' responds to a set of novel objects once subjects have practiced and gained expertise in discriminating non-face objects. Together with [14], these results suggest that activity in this brain area is not specific to face recognition. These results also demonstrate changes in brain activity correlated with changes in perceptual performance after practice.
16. 16. Engel S, Zhang X, Wandell B: Colour tuning in human visual cortex measured with functional magnetic resonance imaging. Nature 1997, 388:68-71. This study reports that neuronal signals in human V1 and V2 are correlated with perceptual measurements of color sensitivity. Previous single-unit electrophysiology experiments had failed to reveal this result.
17. 17. Eden GF, vanMeter JW, Rumsey JM, Maisog JM, Woods RP, Zeffiro TA: Abnormal processing of visual motion in dyslexia revealed by functional brain imaging. Nature 1996, 382:66-69.
18. 18. Demb JB, Boynton GM, Heeger DJ: Brain activity in visual cortex predicts individual differences in reading performance. Proc Natl Acad Sci USA 1997, 94:13363-13366.
19. 19. Demb JB, Boynton GM, Heeger DJ: fMR imaging of early visual pathways in dyslexia. J Neurosci 1998, 18:6939-6951. This study reports a three-way correlation between brain activity, motion discrimination thresholds, and reading speed. Together with [17,18], these results support the hypothesis that dyslexia may involve a deficit in the magnocellular pathway of the visual system.
20. 20. Cornette L, Dupont P, Rosier A, Sunaert S, Van Hecke P, Michiels J, Mortelmans L, Orban GA: Human brain regions involved in direction discrimination. J Neurophysiol 1998, 79:2749-2765.
21. 21. Orban GA, Dupont P, De Bruyn B, Vandenberghe R, Rosier A, Mortelmans L: Human brain activity related to speed discrimination tasks. Exp Brain Res 1998, 122:9-22.
22. 22. Heeger DJ, Boynton GM, Demb JB, Seidemann E, Newsome WT: Motion opponency in visual cortex. J Neurosci 1999, 19:7162-7174. Previous perceptual studies suggested that visual motion perception is mediated by opponent mechanisms that correspond to mutually suppressive populations of neurons sensitive to motions in opposite directions. Using a combination of fMRI in human subjects and multi-unit electrophysiological recording in monkeys, this study found evidence for motion opponency in monkey MT/MST and in human MT+. These results provide further evidence that direction-selective signals underlie human MT+ responses, neuronal signals in human MT+ support visual motion perception, human MT+ may be homologous to monkey MT (along with adjacent motion-sensitive brain areas), and fMRI measurements are correlated with average spiking activity.
23. 23. Schiltz C, Bodart JM, Dubois S, Dejardin S, Michel C, Roucoux A, Crommelinck M, Orban GA: Neuronal mechanisms of perceptual learning: changes in human brain activity with training in orientation discrimination. Neuroimage 1999, 9:46-62.
24. 24. Boynton GM, Demb JB, Glover GH, Heeger DJ: Neural basis of contrast discrimination. Vis Res 1999, 39:257-269. This study used a combination of fMRI and psychophysics to demonstrate that neuronal signals appropriate for limiting contrast discrimination performance appear to be present as early as V1 (see Figure 3 above).
25. 25. Graham N: Visual Pattern Analyzers. Oxford: Oxford University Press; 1989.
26. 26. Pashler HE: The Psychology of Attention. Cambridge, Massachusetts: MIT Press; 1998.
27. 27. Desimone R, Duncan J: Neural mechanisms of selective visual attention. Annu Rev Neurosci 1995, 18:193-222.
28. 28. Maunsell JHR: The brain's visual world: representation of visual targets in cerebral cortex. Science 1995, 270:764-769.
29. 29. Treue S, Maunsell JHR: Attentional modulation of visual motion processing in cortical areas MT and MST. Nature 1996, 382:539-541.
30. 30. Luck SJ, Chelazzi L, Hillyard SA, Desimone R: Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. J Neurophysiol 1997, 7:24-42.
31. 31. McAdams CJ, Maunsell JHR: Effects of attention on orientation-tuning functions of single neurons in macaque cortical area V4. J Neurosci 1999, 19:431-441.
32. 32. Ito M, Gilbert CD: Attention modulates contextual influences in the primary visual cortex of alert monkeys. Neuron 1999, 22:593-604.
33. 33. Mangun GR, Hopfinger JB, Kussmaul CL, Fletcher EM, Heinze HJ: Covariations in ERP and PET measures of spatial selective attention in human extrastriate visual cortex. Hum Brain Mapp 1997, 5:273-279.
34. 34. O'Craven KM, Rosen BR, Kwong KK, Treisman A, Savoy RL: Voluntary attention modulates fMRI activity in human MT-MST. Neuron 1997, 18:591-598.
35. 35. Beauchamp MS, Cox RW, DeYoe EA: Graded effects of spatial and featural attention on human area MT and associated motion processing areas. J Neurophysiol 1997, 78:516-520.
36. 36. Buchel C, Josephs O, Rees G, Turner R, Frith CD, Friston KJ: The functional anatomy of attention to visual motion. Brain 1998, 121:1281-1294.
37. 37. Culham JC, Brandt SA, Cavanagh P, Kanwisher NG, Dale AM, Tootell RBH: Cortical fMRI activation produced by attentive tracking of moving targets. J Neurophysiol 1998, 80:2657-2670.
38. 38. Watanabe T, Harner AM, Miyauchi S, Sasaki Y, Nielsen M, Palomo D, Mukai I: Task-dependent influences of attention on the activation of human primary visual cortex. Proc Natl Acad Sci USA 1998, 95:11489-11492.
39. 39. Watanabe T, Sasaki Y, Mitauchi S, Putz B, Fulimaki N, Nielsen M, Takino R, Miyakawa S: Attention-regulated activity in human primary visual cortex. J Neurophysiol 1998, 79:2218-2221.
40. 40. Tootell RBH, Hadjikhani N, Hall EK, Marrett S, Vanduffel W, Vaughan JT, Dale AM: The retinotopy of visual spatial attention. Neuron 1998, 21:1409-1422.
41. 41. Kastner S, De Weerd P, Desimone R, Ungerleider LG: Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. Science 1998, 282:108-111.
42. 42. Somers DC, Dale AM, Seiffert AE, Tootell RBH: Functional MRI reveals spatially specific attentional modulation in human primary visual cortex. Proc Natl Acad Sci USA 1998, 16:1663-1668.
43. 43. Brefczynski JA, DeYoe EA: A physiological correlate of the 'spotlight' of visual attention. Nat Neurosci 1999, 2:370-374. In this study, fMRI was used to visualize the neuronal correlate of the 'spotlight' of attention. Subjects performed a task that required systematic shifts of visual attention (while maintaining fixation) from one location to the next in a stimulus array. This evoked a traveling wave of cortical activity. The topography of the attention-driven activity (attend-o-topy) matched the topography of activity evoked by moving a stimulus through the visual field (retinotopy).
44. 44. Gandhi SP, Heeger DJ, Boynton GM: Spatial attention affects brain activity in human primary visual cortex. Proc Natl Acad Sci USA 1999, 96:3314-3319. This fMRI study, together with [39-42,43•], reports that instructing subjects to attend to one or another location in a visual scene causes a consistent and systematic change in V1 activity. However, in two of the studies [39,42], subjects were instructed not only to alternate their attention between two spatial locations but also to alternate between two tasks. Hence, the effects of selective spatial attention were confounded in those two studies with the effects of switching tasks.
45. 45. Kastner S, Pinsk MA, De Weerd P, Desimone R, Ungerleider LG: Increased activity in human visual cortex during directed attention in the absence of visual stimulation. Neuron 1999, 22:751-761. This fMRI study reports increased activity in visual cortex, even in the absence of visual stimulation, when subjects covertly directed attention to a peripheral location expecting the onset of a stimulus. The data in Figure 2 (above) demonstrate a similar effect of attention in the absence of visual stimulation.
46. 46. Zeki S, Watson JDG, Frackowiak RSJ: Going beyond the information given: the relation of illusory visual motion to brain activity. Proc R Soc Lond [Biol] 1993, 252:215-222.
47. 47. Tootell RBH, Reppas JB, Dale AM, Look RB, Sereno MI, Malach R, Brady TJ, Rosen BR: Visual motion aftereffect in human cortical area MT revealed by functional magnetic resonance imaging. Nature 1995, 375:139-141.
48. 48. He S, Cohen ER, Hu XP: Close correlation between activity in brain area MT/V5 and the perception of a visual-motion aftereffect. Curr Biol 1998, 8:1215-1218.
49. 49. Culham JC, Dukelow SP, Vilis T, Hassard FA, Gati JS, Menon RS, Goodale MA: Recovery of fMRI activation in motion area MT following storage of the motion aftereffect. J Neurophysiol 1999, 81:388-393.
50. 50. Ffytche DH, Zeki S: Brain activity related to the perception of illusory contours. Neuroimage 1996, 3:104-108.
51. 51. Mendola JD, Dale AM, Fischl B, Liu AK, Tootell RBH: The representation of illusory and real contours in human cortical visual areas revealed by fMRI. J Neurosci 1999, in press.
52. 52. Tong F, Nakayama K, Vaughan JT, Kanwisher N: Binocular-rivalry and visual awareness in human extrastriate cortex. Neuron 1998, 21:761-773. When the two eyes view dissimilar images, we experience a phenomenon called binocular rivalry, in which one eye's view dominates for several seconds and is then replaced by that of the other eye. The physical stimulus does not change, yet the conscious percept changes radically over time. This fMRI study, together with [53,54], measured neuronal correlates of the perceptual alternations during binocular rivalry.
53. 53. Lumer ED, Friston KJ, Rees G: Neural correlates of perceptual rivalry in the human brain. Science 1998, 280:1930-1934.
54. 54. Lumer ED, Rees G: Covariation of activity in visual and prefrontal cortex associated with subjective visual perception. Proc Natl Acad Sci USA 1999, 96:1669-1673.
55. 55. Kleinschmidt A, Buchel C, Zeki S, Frakowiak RSJ: Human brain activity during spontaneously reversing perception of ambiguous figures. Proc R Soc Lond [Biol] 1998, 265:2427-2433.
56. 56. Kosslyn SM, Thompson WL, Kim IJ, Alpert NM: Topographic representations of mental images in primary visual cortex. Nature 1995, 378:496-498.
57. 57. Kosslyn SM, Thompson WL, Kim IJ, Rauch SL, Alpert NM: Individual differences in cerebral blood flow in area 17 predict time to evaluate visualized letters. J Cogn Neurosci 1996, 8:78-82.
58. 58. Kosslyn SM, Pascual-Leone A, Felician O, Camposano S, Keenan JP, Thompson WL, Ganis G, Sukel KE, Alpert NM: The role of area 17 in visual imagery: convergent evidence from PET and rTMS. Science 1999, 284:167-170.
59. 59. Howard RJ, Ffytche DH, Barnes J, McKeefry D, Ha Y, Woodruff PW, Bullmore ET, Simmons A, Williams SC, David AS, Brammer M: The functional anatomy of imagining and perceiving colour. Neuroreport 1998, 20:1019-1023.
60. 60. Goebel R, Khorram-Sefat D, Muckli L, Hacker H, Singer W: The constructive natures of vision: direct evidence from functional magnetic resonance imaging studies of apparent motion and motion imagery. Eur J Neurosci 1998, 10:1563-1573. This fMRI study reports selective activity in the visual motion pathway (including area MT+) when subjects imagine visual motion. These results, along with ([59]; N Kanwisher, KM O'Craven, Soc Neurosci Abstr 1998, 24:530), suggest that imagining different attributes of visual stimuli (e.g. color, motion, and faces) selectively activates the specific brain pathways involved in the perceptual processing of the stimulus attributes.
61. 60. Goebel R, Khorram-Sefat D, Muckli L, Hacker H, Singer W: The constructive natures of vision: direct evidence from functional magnetic resonance imaging studies of apparent motion and motion imagery. Eur J Neurosci 1998, 10:1563-1573. This fMRI study reports selective activity in the visual motion pathway (including area MT+) when subjects imagine visual motion. These results, along with ([59]; N Kanwisher, KM O'Craven, Soc Neurosci Abstr 1998, 24:530), suggest that imagining different attributes of visual stimuli (e.g. color, motion, and faces) selectively activates the specific brain pathways involved in the perceptual processing of the stimulus attributes.
62. 61. Malonek D, Grinvald A: Interactions between electrical activity and cortical microcirculation revealed by imaging spectroscopy: implications for functional brain mapping. Nature 1996, 272:551-554.
63. 62. Malonek D, Dirnagl U, Lindauer U, Yamada K, Kanno I, Grinvald A: Vascular imprints of neuronal-activity: relationships between the dynamics of cortical blood-flow, oxygenation, and volume changes following sensory stimulation. Proc Natl Acad Sci USA 1997, 94:14826-14831.
64. 63. Buxton RB, Wong EC, Frank LR: Dynamics of blood flow and oxygenation changes during brain activation: the balloon model. Magn Res Med 1998, 39:855-864. This paper provides a theoretical analysis of the relationship between blood flow, blood volume, oxy-/deoxy-hemoglobin concentration, and the fMRI signal.
65. 64. Stefanacci L, Reber P, Costanza J, Wong E, Buxton R, Zola S, Squire L, Albright T: fMRI of monkey visual cortex. Neuron 1998, 20:1051-1057.
66. 65. Dubowitz DJ, Chen DY, Atkinson DJ, Grieve KL, Gillikin B, Bradley WG, Andersen RA: Functional magnetic resonance imaging in macaque cortex. Neuroreport 1998, 9:2213-2218.
67. 66. Logothetis NK, Guggenberger H, Peled S, Pauls J: Functional imaging of the monkey brain. Nat Neurosci 1999, 2:555-562. This study, together with ([64,65]; W Vanduffel et al., Soc Neurosci Abstr 1998, 24:11), demonstrates the feasibility of performing fMRI measurements on monkeys.
68. 66. Logothetis NK, Guggenberger H, Peled S, Pauls J: Functional imaging of the monkey brain. Nat Neurosci 1999, 2:555-562. This study, together with ([64,65]; W Vanduffel et al., Soc Neurosci Abstr 1998, 24:11), demonstrates the feasibility of performing fMRI measurements on monkeys.