Long- and short-range reward expectancy in the primate orbitofrontal cortex

European Journal of Neuroscience

Volumn 19, Issue 4, 2004, Pages 1046-1054

  Hikosaka, Kazuo ^a   Watanabe, Masataka ^a  

^a TOKYO METROPOLITAN INSTITUTE OF MEDICAL SCIENCE   (Japan)

Author keywords

Delay activity; Pre instruction activity; Progress over trials; Reward preference

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; BRAIN CELL; CONTROLLED STUDY; DELAYED HYPERSENSITIVITY; EXPECTANCY; MONKEY; MOTIVATION; NONHUMAN; ORBITAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; REWARD; TASK PERFORMANCE;

ANIMALS; FOOD; FRONTAL LOBE; MACACA; MOTIVATION; REACTION TIME; REINFORCEMENT SCHEDULE; REWARD;

EID: 1542329657     PISSN: 0953816X     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.0953-816X.2004.03120.x     Document Type: Article

References (45)

1. Aggleton, J.P. (2000) The Amygdala: a Functional Analysis, 2nd Edn. Oxford University Press, Oxford.
2. Apicella, P., Scarnati, E., Ljungberg, T. & Schultz, W. (1992) Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J. Neurophysiol., 68, 945-960.
3. Asaad, W.F., Rainer, G. & Miller, E.K. (2000) Task-specific neural activity in the primate prefrontal cortex. J. Neurophysiol., 84, 451-459.
4. Barbas, H. (1995) Anatomic basis of cognitive-emotional interactions in the primate prefrontal cortex. Neurosci. Biobehav. Rev., 19, 499-510.
5. Bechara, A., Tranel, D. & Damasio, H. (2000) Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. Brain, 123, 2189-2202.
6. Butter, C.M. (1969) Perseveration in extinction and in discrimination reversal tasks following selective frontal ablations in Macaca mulatto. Physiol. Behav., 4, 163-171.
7. Butter, C.M., Snyder, D.R. & McDonald, J.A. (1970) Effects of orbital frontal lesions on aversive and aggressive behaviors in rhesus monkeys. J. Comp. Physiol. Psychol., 72, 132-144.
8. Carmichael, S.T. & Price, J.-L. (1995) Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol., 363, 615-641.
9. Damasio, A.R. (1994) Descartes' Error. Grosset/Putnam, New York.
10. DeCoteau, W.E., Kesner, R.P. & Williams, J.M. (1997) Short-term memory for food reward magnitude: The role of the prefrontal cortex. Behav. Brain Res., 88, 239-249.
11. Fiorillo, C.D., Tobler, P.N. & Schultz, W. (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science, 299, 1898-1902.
12. Fuster, J.M. (1997) The Prefrontal Cortex. Anatomy, Physiology and Neuropsychology of the Frontal Lobe, 3rd Edn. Lippincott-Raven, New York.
13. Haber, S.N., Kunishio, K., Mizouchi, M. & Lynd-Balta, E. (1995) The orbital and medial prefrontal circuit through the primate basal ganglia. J. Neurosci., 15, 4851-4867.
14. Hasegawa, R.P., Blitz, A.M., Geller, N.L. & Goldberg, M.E. (2000) Neurons in monkey prefrontal cortex that track past or predict future performance. Science, 290, 1786-1789.
15. Hassani, O.K., Cromwell, H.C. & Schultz, W. (2001) Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. J. Neurophysiol., 85, 2477-2489.
16. Hikosaka, K. (1999) Tolerances of responses to visual patterns in neurons of the posterior inferotemporal cortex in the macaque against changing stimulus size and orientation, and deleting patterns. Behav. Brain Res., 100, 67-76.
17. Hikosaka, K. & Watanabe, M. (2000) Delay activity of orbital and lateral prefrontal neurons in the monkey varying with different rewards. Cerebral Cortex, 10, 263-271.
18. Hikosaka, O., Sakamoto, M. & Usui, S. (1989) Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J. Neurophysiol., 61, 814-832.
19. Hollerman, J.R., Tremblay, L. & Schultz, W. (1998) Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol., 80, 947-963.
20. Hornak, J., Rolls, E.T. & Wada, D. (1996) Face and voice expression identification in patients with emotional and behavioural changes following ventral frontal lobe damage. Neuropsychologia, 34, 247-261.
21. Kawagoe, R., Takikawa, Y. & Hikosaka, O. (1998) Expectation of reward modulates cognitive signals in the basal ganglia. Nature Neurosci., 1, 411-416.
22. Kobayashi, S., Lauwereyns, J., Koizumi, M., Sakagami, M. & Hikosaka, O. (2002) Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. J. Neurophysiol., 87, 1488-1498.
23. Lauwereyns, J., Takikawa, Y., Kawagoe, R., Kobayashi, S., Koizumi, M., Coe, B., Sakagami, M. & Hikosaka, O. (2002a) Feature-based anticipation of cues that predict reward in monkey caudate nucleus. Neuron, 33, 463-473.
24. Lauwereyns, J., Watanabe, K., Coe, B. & Hikosaka, O. (2002b) A neural correlate of response bias in monkey caudate nucleus. Nature, 418, 413-417.
25. Leon, M.I. & Shadlen, M.N. (1999) Effect on expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron, 24, 415-425.
26. McEnaney, K.W. & Butter, C.M. (1969) Perseveration of responding and nonresponding in monkeys with orbital frontal ablations. J. Comp. Physiol. Psychol., 68, 558-561.
27. Mobini, S., Body, S., Ho, M.Y., Bradshaw, C.M., Szabadi, E., Deakin, J.F. & Anderson, I.M. (2002) Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology, 160, 290-298.
28. Otto, T. & Eichenbaum, H. (1992) Complementary roles of the orbital prefrontal cortex and the perirhinal-entorhinal cortices in an odor-guided delayed non-matching-to-sample task. Behav. Neurosci., 106, 762-765.
29. Rolls, E.T. (1999) The Brain and Emotion. Oxford University Press, Oxford.
30. Sakagami, M. & Niki, H. (1994) Encoding of behavioral significance of visual stimuli by primate prefrontal neurons: relation to relevant task conditions. Exp. Brain Res., 97, 423-436.
31. Sakai, K. & Passingham, R.E. (2003) Prefrontal interactions reflect future task operations. Nature Neurosci., 6, 75-81.
32. Schoenbaum, G., Chiba, A.A. & Gallagher, M. (1998) Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nature Neurosci., 1, 155-159.
33. Schultz, W. (2000) Multiple reward signals in the brain. Nature Rev. Neurosci., 1, 199-207.
34. Shidara, M., Aigner, T.G. & Richmond, B.J. (1998) Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials. J. Neurosci., 18, 2613-2625.
35. Shidara, M. & Richmond, B.J. (2002) Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science, 296, 1709-1711.
36. Stuss, D.T. & Benson, D.F. (1986) The Frontal Lobes. Raven Press, New York.
37. Suzuki, H. & Azuma, M. (1976) A glass-insulated 'Elgiloy' microelectrode for recording unit activities in chronic monkey experiments. Electroencephalogr. Clin. Neurophysiol., 41, 93-95.
38. Takikawa, Y., Kawagoe, R. & Hikosaka, O. (2002) Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons. J. Neurophysiol., 87, 508-515.
39. Thorpe, S.J., Rolls, E.T. & Maddison, S. (1983) The orbitofrontal cortex: Neuronal activity in the behaving monkey. Exp. Brain Res., 49, 93-115.
40. Tremblay, L. & Schultz, W. (1999) Relative reward preference in primate orbitofrontal cortex. Nature, 398, 704-708.
41. Tremblay, L. & Schultz, W. (2000) Reward-related neuronal activity during gonogo task performance in primate orbitofrontal cortex. J. Neurophysiol., 83, 1864-1876.
42. Vogt, B.A. & Pandya, D.N. (1987) Cingulate cortex of the rhesus monkey, II. Cortical afferents. J. Comp. Neurol., 262, 271-289.
43. Watanabe, M. (1990) Prefrontal unit activities during associative learning in the monkey. Exp. Brain Res., 80, 296-309.
44. Watanabe, M. (1996) Reward expectancy in primate prefrontal neurons. Nature, 382, 629-632.
45. Watanabe, M., Hikosaka, K., Sakagami, M. & Shirakawa, S. (2002) Coding and monitoring of motivational context in the primate prefrontal cortex. J. Neurosci., 22, 2391-2400.