Neural representation of visual objects: Encoding and top-down activation

Current Opinion in Neurobiology

Volumn 10, Issue 2, 2000, Pages 187-194

  Miyashita, Yasushi ^a,b   Hayashi, Toshihiro ^a  

^a UNIVERSITY OF TOKYO   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; BRAIN FUNCTION; FEEDBACK SYSTEM; MACACA; MEMORY; MONKEY; NONHUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; PREFRONTAL CORTEX; PRIORITY JOURNAL; RECALL; REVIEW; TEMPORAL CORTEX; VISION; VISUAL CORTEX;

EID: 0034081511     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0959-4388(00)00071-4     Document Type: Review

References (77)

1. Milner B. Right temporal-lobe contribution to visual perception and visual memory. Iwai E., Mishkin M. Vision, Memory and the Temporal Lobe. 1990;43-53 Elsevier, New York.
2. Squire L.R. Memory and Brain. 1987;Oxford University Press, New York.
3. Penfield W., Perot P. The brain's record of auditory and visual experience. Brain. 86:1963;595-696.
4. Mishkin M. A memory system in the monkey. Philos Trans R Soc Lond B Biol Sci. 298:1982;83-95.
5. Miyashita Y. Inferior temporal cortex: where visual perception meets memory. Annu Rev Neurosci. 16:1993;245-263.
6. Brown M.W., Wilson F.A.W., Riches I.P. Neuronal evidence that inferomedial temporal cortex is more important than hippocampus in certain processes underlying recognition memory. Brain Res. 409:1987;158-162.
7. Miyashita Y. Neuronal correlate of visual associative long-term memory in the primate temporal cortex. Nature. 335:1988;817-820.
8. Sakai K., Miyashita Y. Neural organization for the long-term memory of paired associates. Nature. 354:1991;152-155.
9. Higuchi S., Miyashita Y. Formation of mnemonic neuronal responses to visual paired associates in inferotemporal cortex is impaired by perirhinal and entorhinal lesions. Proc Natl Acad Sci USA. 93:1996;739-743.
10. Tootell R.B., Hadjikhani N.K., Mendola J.D., Marrett S., Dale A.M. From retinotopy to recognition: fMRI in human visual cortex. Trends Cogn Sci. 2:1999;174-183.
11. Grill-Spector K., Kushnir T., Edelman S., Avidan G., Itzchak Y., Malach R. Differential processing of objects under various viewing conditions in the human lateral occipital complex. Neuron. 24:1999;187-203. Higher-order human visual areas have a reduced magnetic resonance signal when presented repetitively with the same visual stimulus, which is probably correlated with visual priming. The authors use this correlation to circumvent the limitation in the spatial resolution of magnetic resonance signals, and to investigate stimulus-invariant properties of individual neurons in lateral occiptal (LO) complex regions. They found that the anterior-ventral part of the object-selective LO region (LOa) exhibits strong adaptation to changes in stimulus size and position. The stimulus-invariant properties of LO-complex would provide useful clues in discussing the homologies between monkey temporal areas, such as TEO or TE, and human LO-complex regions.
12. Sheinberg D.L., Logothetis N.K. The role of temporal cortical areas in perceptual organization. Proc Natl Acad Sci USA. 94:1997;3408-3413.
13. Lumer E.D., Friston K.J., Rees G. Neural correlates of perceptual rivalry in the human brain. Science. 280:1998;1930-1934.
14. Kleinschmidt A., Büchel C., Zeki S., Frackowiak R.S.J. Human brain activity during spontaneously reversing perception of ambiguous figures. Proc R Soc Lond B Biol Sci. 265:1998;2427-2433. In this event-related fMRI experiment, subjects looked at an ambiguous figure, such as the 'vase-profile' illusion by Rubin or the 'my wife and mother-in-law' illusion by Leeper and Boring. Inter-reversal time-spans for these bi-stable percepts were confirmed to follow gamma distributions. The authors reported that activation occurred in ventral occipital and intraparietal visual areas, while deactivation occurred in the primary visual cortex and the pulvinar. These findings are discussed in relation to cognitive models of visual perception that propose widespread cooperation between functionally distinct and spatially segregated cortical areas.
15. Tong F., Nakayama K., Vaughan J.T., Kanwisher N. Binocular rivalry and visual awareness in human extrastriate cortex. Neuron. 21:1998;753-759. Magnetic resonance signals were measured during binocular rivalry, in which a house and a face were presented to different eyes. When the human subjects noted a change in the perceived visual input from the house to the face, magnetic resonance signals in the fusiform face area increased and those in the parahippocampal place area decreased. When human subjects perceived changes from the house to the face, the opposite pattern of magnetic resonance signal was observed. The authors report that these magnetic resonance responses during rivalry are equal in magnitude to those evoked by nonrivalrous stimulus alternation, although, in monkey IT cortex, neural response changes corresponding to perceptual transition are about half the magnitude of those evoked by nonrivalrous stimulus changes [13].
16. Sergent J., Ohta S., MacDonald B. Functional neuroanatomy of face and object processing: a positron emission tomography study. Brain. 115:1992;15-36.
17. Puce A., Allison T., Gore J.C., McCarthy G. Face-sensitive regions in human extrastriate cortex studied by functional MRI. J Neurophysiol. 74:1995;1192-1199.
18. Aguirre G.K., D'Esposito M. Environmental knowledge is subserved by separable dorsal/ventral neural areas. J Neurosci. 17:1997;2512-2518.
19. Epstein R., Kanwisher N. A cortical representation of the local visual environment. Nature. 392:1998;598-601.
20. O'Craven K.M., Downing P.E., Kanwisher N. fMRI evidence for objects as the units of attentional selection. Nature. 401:1999;84-87.
21. Roskies A.L. Reviews, on the binding problem. Neuron. 24:1999;7-125. This issue of Neuron contains a series of reviews on the binding problem. Some of the reviews contain convincing psychophysical data showing that the normal brain has difficulty binding perceptual stimuli and that this leads to errors, such as illusory conjunctions. Several other reviews address possible mechanisms for binding, agreeing or disagreeing with the 'temporal synchrony hypothesis'. Finally, other reviews argue that there is really no binding problem, in the sense that the classical hierarchical scheme of neural coding can encode the combinatorial information required for perception without leading to a combinatorial explosion.
22. Janssen P., Vogels R., Orban G.A. Macaque inferior temporal neurons are selective for disparity-defined three-dimensional shapes. Proc Natl Acad Sci USA. 96:1999;8217-8222.
23. Booth M.C., Rolls E.T. View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. Cereb Cortex. 8:1998;510-523.
24. Sugase Y., Yamane S., Ueno S., Kawano K. Global and fine information coded by single neurons in the temporal visual cortex. Nature. 400:1999;869-873. It has been generally assumed that if a neuron fires in response to a face, this activity continues to signal the same information at the beginning, middle and end of the response period. The authors recorded single neuron responses in the inferior temporal cortex and demonstrated that global information for shapes is conveyed in the earlier part of the responses, whereas detailed information about identity or expression is conveyed later.
25. Oram M.W., Richmond B.J. I see a face - a happy face. Nat Neurosci. 2:1999;856-858.
26. Logothetis N.K., Pauls J., Poggio T. Shape representation in the inferior temporal cortex of monkeys. Curr Biol. 5:1995;552-563.
27. Kobatake E., Wang G., Tanaka K. Effects of shape-discrimination training on the selectivity of inferotemporal cells in adult monkeys. J Neurophysiol. 80:1998;324-330. The authors trained adult monkeys to discriminate 28 moderately complex shapes, and then examined the stimulus selectivity of cells in area TE in anaesthetized conditions. The proportion of TE cells maximally responsive to some member of the trained stimuli was significantly greater in the trained monkeys than that in the control untrained monkeys. The results are consistent with previous reports [5,7] that IT cells develop differential responses to the images of relevant objects through training.
28. Stryker M.P. Temporal associations. Nature. 354:1991;108-109.
29. Sobotka S., Ringo J.L. Investigation of long-term recognition and association memory in unit responses from inferotemporal cortex. Exp Brain Res. 96:1993;28-38.
30. Gochin P.M., Colombo M., Dorfman G.A., Gerstein G.L., Gross C.G. Neural ensemble coding in inferior temporal cortex. J Neurophysiol. 71:1994;2325-2337.
31. Erickson C.A., Desimone R. Responses of macaque perirhinal neurons during and after visual stimulus association learning. J Neurosci. 19:1999;10404-10416. The authors recorded from perirhinal neurons in monkeys performing a visual task in which a predictor stimulus was followed, after a delay, by either a 'Go' or a 'No-Go' choice stimulus. Responses to frequently paired stimuli were more similar to one another than was the case with infrequently paired stimuli. The magnitude of the activity during the delay was correlated with the magnitude of responses to both the predictor and choice stimuli. These results supported those found by Sakai and Miyashita [8] in a forced-choice paired associate task. Furthermore, the authors reported that the learning effect was observed only for stimulus pairs that had been associated together for at least two days of training.
32. Yakovlev V., Fusi S., Berman E., Zohary E. Inter-trial neuronal activity in inferior temporal cortex: a putative vehicle to generate long-term visual associations. Nat Neurosci. 1:1998;310-317.
33. Miyashita Y., Chang H.S. Neuronal correlate of pictorial short-term memory in the primate temporal cortex. Nature. 331:1988;68-70.
34. Murray E.A., Bussey T.J. Perceptual-mnemonic functions of the perirhinal cortex. Trends Cogn Sci. 3:1999;142-151.
35. Brown M.W. Neuronal responses and recognition memory. Semin Neurosci. 8:1996;23-32.
36. Buckley M.J., Gaffan D. Perirhinal cortex ablation impairs visual object identification. J Neurosci. 18:1998;2268-2275.
37. Buckley M.J., Gaffan D. Perirhinal cortex ablation impairs configural learning and paired-associate learning equally. Neuropsychologia. 36:1998;535-546.
38. Buffalo E.A., Reber P.J., Squire L.R. The human perirhinal cortex and recognition memory. Hippocampus. 8:1998;330-339.
39. Eichenbaum H. Is the rodent hippocampus just for 'place'? Curr Opin Neurobiol. 6:1996;187-195.
40. Morris R.G.M., Frey U. Hippocampal synaptic plasticity: role in spatial learning or the automatic recording of attended experience? Philos Trans R Soc Lond B Biol Sci. 352:1997;1489-1503.
41. Buffalo E.A., Stefanacci L., Squire L.R., Zola S.M. A reexamination of the concurrent discrimination learning task: the importance of anterior inferotemporal cortex, area TE. Behav Neurosci. 112:1998;3-14.
42. Buckley M.J., Gaffan D., Murray E.A. Functional double dissociation between two inferior temporal cortical areas: perirhinal cortex versus middle temporal gyrus. J Neurophysiol. 77:1997;587-598.
43. Naya Y., Sakai K., Miyashita Y. Activity of primate inferotemporal neurons related to a sought target in pair-association task. Proc Natl Acad Sci USA. 93:1996;2664-2669.
44. Stuss D.T., Benson D.F. The Frontal Lobes. 1986;Raven Press, New York.
45. Incisa della Rocchetta A., Milner B. Strategic search and retrieval inhibition: the role of the frontal lobes. Neuropsychologia. 31:1993;503-524.
46. Moscovitch M., Melo B. Strategic retrieval and the frontal lobes: evidence from confabulation and amnesia. Neuropsychologia. 35:1997;1017-1034.
47. Gazzaniga M.S. Principles of human brain organization derived from split-brain studies. Neuron. 14:1995;217-228.
48. Hasegawa I., Fukushima T., Ihara T., Miyashita Y. Callosal window between prefrontal cortices: cognitive interaction to retrieve long-term memory. Science. 281:1998;814-818. This study introduced a posterior-split-brain monkey paradigm to assess the behavioural significance of the fronto-temporal top-down neuronal projections. When the splenium of the corpus callosum and the anterior commissure were selectively split, visual long-term memory acquired through stimulus-stimulus association learning did not transfer to the other hemisphere. However, following presentation of a visual cue to one hemisphere, the prefrontal cortex could instruct the contralateral hemisphere to retrieve the correct stimulus specified by the cue. These findings implicated the prefrontal cortex in regulation of memory recall in the absence of bottom-up sensory input.
49. Fuster J.M., Bauer R.H., Jervey J.P. Functional interactions between inferotemporal and prefrontal cortex in a cognitive task. Brain Res. 330:1985;299-307.
50. Tomita H., Ohbayashi M., Nakahara K., Hasegawa I., Miyashita Y. Top down signal from prefrontal cortex in executive control of memory retrieval. Nature. 401:1999;699-703. By conducting single-unit recording in posterior-split-brain monkeys, these authors demonstrated the first direct evidence of top-down signalling from the prefrontal cortex to IT cortex. In the absence of bottom-up visual inputs, IT neurons were robustly activated by the top-down signal, which conveyed information on the semantic category of the cue stimuli and information for the prospective target to be retrieved from the cue. Behavioural performance was severely impaired concomitantly with a loss of the top-down signal. The machinery of the prefrontal cortex, therefore, is suggested as an origin of executive top-down signalling.
51. Wilson F.A.W., O Scalaidhe S.P., Goldman-Rakic P.S. Dissociation of object and spatial processing domains in primate prefrontal cortex. Science. 260:1993;1955-1958.
52. O Scalaidhe S.P., Wilson F.A.W., Goldman-Rakic P.S. Areal segregation of face-processing neurons in prefrontal cortex. Science. 278:1997;1135-1138.
53. O Scalaidhe S.P., Wilson F.A.W., Goldman-Rakic P.S. Face-selective neurons during passive viewing and working memory performance of rhesus monkeys: evidence for intrinsic specialization of neuronal coding. Cereb Cortex. 9:1999;459-475. The authors recorded neurons from the prefrontal cortex of monkeys performing a fixation task while viewing visual stimuli such as faces, or a working memory task. Neurons selective for face stimuli during cue or delay periods were localised in the inferior convexity of the prefrontal cortex within the projection region of the IT cortex.
54. ••].
55. Fletcher P.C., Frith C.D., Rugg M.D. The functional neuroanatomy of episodic memory. Trends Neurosci. 20:1997;213-218.
56. Wagner A.D. Working memory contributions to human learning and remembering. Neuron. 22:1999;19-22.
57. Fletcher P.C., Shallice T., Frith C.D., Frackowiak R.S.J., Dolan R.J. The functional roles of prefrontal cortex in episodic memory. II: Retrieval. Brain. 121:1998;1249-1256.
58. Wagner A.D., Desmond J.E., Glover G.H., Gabrieli J.D. Prefrontal cortex and recognition memory. Functional-MRI evidence for context-dependent retrieval processes. Brain. 121:1998;1985-2002.
59. Buckner R.L., Koutstaal W., Schacter D.L., Dale A.M., Rotte M., Rosen B.R. Functional-anatomic study of episodic retrieval. II: Selective averaging of event-related fMRI trials to test the retrieval success hypothesis. Neuroimage. 7:1998;163-175.
60. Maguire E.A., Frith C.D., Morris R.G.M. The functional neuroanatomy of comprehension and memory: the importance of prior knowledge. Brain. 122:1999;1839-1850.
61. Goldman-Rakic P.S. The prefrontal landscape: implications of functional architecture for understanding human mentation and the central executive. Philos Trans R Soc Lond B Biol Sci. 351:1996;1445-1453.
62. Petrides M. Specialized systems for the processing of mnemonic information within the primate frontal cortex. Philos Trans R Soc Lond B Biol Sci. 351:1996;1455-1461.
63. Funahashi S., Chafee M.V., Goldman-Rakic P.S. Prefrontal neuronal activity in rhesus monkeys performing a delayed anti-saccade task. Nature. 365:1993;753-756.
64. Bichot N.P., Schall J.D. Effects of similarity and history on neural mechanisms of visual selection. Nat Neurosci. 2:1999;549-554. The authors trained monkeys to perform a visual conjunction search task; the target was specified as one combination of colour and shape at the beginning of daily session. Neurons in the frontal eye field during target selection responded greatest to the target. In addition, neurons responded greater to distracters sharing a feature in common with the target, and to a distracter that had been the target during the previous session, than to the distracter sharing no feature with the target. This suggests that frontal eye field represents locations of behaviourally relevant objects based on visual saliency and experience.
65. Rainer G., Asaad W.F., Miller E.K. Selective representation of relevant information by neurons in the primate prefrontal cortex. Nature. 393:1998;577-579.
66. Kim J.N., Shadlen M.N. Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nat Neurosci. 2:1999;176-185. By training monkeys to discriminate the direction of motion of dynamic random dots and to judge direction by making appropriate eye movements after a delay, the authors demonstrated that some neurons in the prefrontal cortex represent not simply the final outcome of sensory processing but the conversion of an analogue motion representation to a binary decision variable. This observation may reflect the processes by which prefrontal neurons extract relevant visual information and make decisions.
67. Swick D., Knight R.T. Is prefrontal cortex involved in cued recall? A neuropsychological test of PET findings. Neuropsychologia. 34:1996;1019-1028.
68. Kroll N.E., Markowitsch H.J., Knight R.T., von Cramon D.Y. Retrieval of old memories: the temporofrontal hypothesis. Brain. 120:1997;1377-1399.
69. Thompson-Schill S.L., Swick D., Farah M.J., D'Esposito M., Kan I.P., Knight R.T. Verb generation in patients with focal frontal lesions: a neuropsychological test of neuroimaging findings. Proc Natl Acad Sci USA. 95:1998;15855-15860.
70. Kosslyn S.M., Pascual-Leone A., Felician O., Camposano S., Keenan J.P., Thompson W.L., Ganis G., Sukel K.E., Alpert N.M. The role of area 17 in visual imagery: convergent evidence from PET and rTMS. Science. 284:1999;167-170. [Published erratum appears in Science 1999, 284:197.] By combining PET and a repetitive transcranial magnetic stimulation (rTMS), this report showed the contribution of area 17 in visual imagery. The authors showed activation of area 17 during an imagery task. When compared with a sham control condition, performance of the task was impaired when rTMS was applied to the medial occipital cortex before presentation of the task. This suggests that activation of area 17 during imagery tasks actually underlies information processing.
71. •].
72. •] have reported the first images of BOLD fMRI of awake macaque monkeys. The authors, by devising magnetic-safe primate chairs and handling apparatus and accustomising monkeys to sitting still whilst in the magnet, cleared up many difficulties in performing fMRI in awake monkeys. These two papers also include a useful discussion on the various technical issues.
73. Hayashi T., Konishi S., Hasegawa I., Miyashita Y. Mapping of somatosensory cortices with functional magnetic resonance imaging in anaesthetized macaque monkeys. Eur J Neurosci. 11:1999;4451-4456. The authors, using fMRI, examined the topographical organization of the somatosensory cortices in macaque monkeys. Topographically differential focal activation in somatosensory areas I (SI) and II (SII) were elicited by tactile stimulation to two body regions, the hand and the face. This study showed the feasibility of monkey fMRI for distinguishing between adjacent functionally distinct regions.
74. Disbrow E., Roberts T.P.L., Slutsky D., Krubitzer L. The use of fMRI for determining the topographic organization of cortical fields in human and nonhuman primates. Brain Res. 829:1999;167-173.
75. Logothetis N.K., Guggenberger H., Peled S., Pauls J. Functional imaging of the monkey brain. Nat Neurosci. 2:1999;555-562. The authors have designed a custom magnetic resonance machine with a vertical 4.7 Tesla magnet for imaging studies in monkeys, and they report far improved fMRI images with spatial resolution at the submillimetre level. They demonstrated distinct retinotopic activation patterns in the primary visual area, and also showed activation of the superior temporal sulcus, frontal cortex, amygdala and caudate in response to images of monkey faces. This report clearly shows the great potential of macaque fMRI studies.
76. Paradiso M.A. Monkey business builds a bridge to the human brain. Nat Neurosci. 2:1999;491-492.
77. Kim D-S., Duong T.G., Kim S-G. High-resolution mapping of iso-orientation columns by fMRI. Nat Neurosci. 3:2000;164-169. A biphasic BOLD response to visual stimuli has been observed in cat visual cortex area 18 using fMRI at 4.7 and 9.4 Tesla. The functional specificity of BOLD response at the columnar scale depends on the temporal dynamics of the underlying signals. The initial negative phase of BOLD gives functional maps at columnar resolution, whereas the delayed positive BOLD indicates overall activation in the visual cortex. This study has shown that fMRI using initial negative phase of BOLD can be performed at the spatial resolution of the columnar level.