Reward processing in primate orbitofrontal cortex and basal ganglia

Cerebral Cortex

Volumn 10, Issue 3, 2000, Pages 272-283

  Schultz, Wolfram ^a   Tremblay, Léon ^a,b   Hollerman, Jeffrey R ^a,c  

^a UNIVERSITY OF FRIBOURG   (Switzerland)

^b PITIÉ SALPÊTRIÈRE HOSPITAL   (France)

^c ALLEGHENY COLLEGE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BASAL GANGLION; BEHAVIOR; BRAIN FUNCTION; LEARNING; NEUROPHYSIOLOGY; NONHUMAN; ORBITAL CORTEX; PRIMATE; PRIORITY JOURNAL; REWARD; TASK PERFORMANCE;

EID: 0034061495     PISSN: 10473211     EISSN: None     Source Type: Journal    
DOI: 10.1093/cercor/10.3.272     Document Type: Article

References (82)

1. Aldridge JW, Anderson RJ, Murphy JT (1980) The role of the basal ganglia in controlling a movement initiated by a visually presented cue. Brain Res 192:3-16.
2. Alexander GE, Crutcher MD (1990) Preparation for movement: neural representations of intended direction in three motor areas of the monkey. J Neurophysiol 64:133-150.
3. Apicella P, Ljungberg T, Scarnati E, Schultz W (1991) Responses to reward in monkey dorsal and ventral striatum. Exp Brain Res 85:491-500.
4. Apicella P, Scarnati E, Ljungberg T, Schultz W (1992) Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J Neurophysiol 68:945-960.
5. Barbas H (1988) Anatomic organization of basoventral and mediodorsal visual recipient prefrontal regions in the rhesus monkey. J Comp Neurol 276:313-342.
6. Baylis LL, Gaffan D (1991) Amygdalectomy and ventromedial prefrontal ablation produce similar deficits in food choice and in simple object discrimination learning for an unseen reward. Exp Brain Res 86: 617-622.
7. Bechara A, Damasio H, Tranel D, Anderson SW (1998) Dissociation of working memory from decision making within the human prefrontal cortex. J Neurosci 18:428-437.
8. Carmichael ST, Price JL (1995) Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J Comp Neurol 363:615-641.
9. Cavada C, Compañy T, Tejedor J, Cruz-Rizzolo RJ, Reinoso-Suárez F (2000) The anatomical connections of the macaque monkey orbitofrontal cortex: a review. Cereb Cortex 10:220-242.
10. Critchley HG, Rolls ET (1996) Olfactory neuronal responses in the primate the orbitofrontal cortex: analysis in an olfactory discrimination task. J Neurophysiol 75:1659-1672.
11. Cromwell HC, Hassani OK, Schultz W (1998) Reward discrimination in primate striatum. Soc Neurosci Abstr 24:1652.
12. Crutcher MD, Alexander GE (1990) Movement-related neuronal activity selectively coding either direction or muscle pattern in three motor areas of the monkey. J Neurophysiol 64:151-163.
13. Crutcher MD, DeLong MR (1984) Single cell studies of the primate putamen. II. Relations to direction of movement and pattern of muscular activity. Exp Brain Res 53:244-258.
14. Damasio AR (1994) Descartes' error. New York: Putnam.
15. Dias R, Robbins TW, Roberts AC (1996) Dissociation in prefrontal cortex of affective and attentional shifts. Nature 380:69-72.
16. Dickinson A, Balleine B (1994) Motivational control of goal-directed action. Anim Learn Behav 22:1-18.
17. Divac I, Rosvold HE, Szwarcbart MK (1967) Behavioral effects of selective ablation of the caudate nucleus. J Comp Physiol Psychol 63:184-190.
18. Eblen F, Graybiel AM (1995) Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey. J Neurosci 15:5999-6013.
19. Fibiger HC, Phillips AG (1986) Reward, motivation, cognition: psychobiology of mesotelencephalic dopamine systems. In: Handbook of physiology. Vol IV. The nervous system (Bloom FE, ed), pp 647-675. Baltimore, MD: Williams & Wilkins.
20. Fujita K (1987) Species recognition by five macaque monkeys. Primates 28:353-366.
21. Funahashi S, Bruce CJ, Goldman-Rakic PS (1990) Visuospatial coding in primate prefrontal neurons revealed by oculomotor paradigms. J Neurophysiol 63:814-831.
22. Funahashi S, Chafee MV, Goldman-Rakic PS (1993) Prefrontal neuronal activity in rhesus monkeys performing a delayed anti-saccade task. Nature 365:753-756.
23. Fuster JM (1973) Unit activity of prefrontal cortex during delayed-response performance: neuronal correlates of transient memory. J Neurophysiol 36:61-78.
24. Fuster JM, Alexander GE (1971) Neuron activity related to short-term memory. Science 173:652-654.
25. Gardiner TW, Nelson RJ (1992) Striatal neuronal activity during the initiation and execution of hand movements made in response to visual and vibratory cues. Exp Brain Res 92:15-26.
26. Haber SN, Lynd E, Klein C, Groenewegen HJ (1990) Topographic organization of the ventral striatal efferent projections in the rhesus monkey: an autoradiographic tracing study. J Comp Neurol 293: 282-298.
27. Haber S, Kunishio K, Mizobuchi M, Lynd-Balta E (1995) The orbital and medial prefrontal circuit through the primate basal ganglia. J Neurosci 15:4851-4867.
28. Hikosaka K, Watanabe M (2000) Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. Cereb Cortex 10:263-271.
29. Hikosaka O, Sakamoto M, Usui S (1989a) Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. J Neurophysiol 61:780-798.
30. Hikosaka O, Sakamoto M, Usui S (1989b) Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J Neurophysiol 61:814-832.
31. Hollerman JR, Schultz W (1998) Dopamine neurons report an error in the temporal prediction of reward during learning. Nature Neurosci 1:304-309.
32. Hollerman JR, Tremblay L, Schultz W (1998) Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80:947-963.
33. Iversen SD, Mishkin M (1970) Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Exp Brain Res 11:376-386.
34. Jacobsen CF, Nissen HW (1937) Studies of cerebral function in primates. IV. The effects of frontal lobe lesions on the delayed alternation habit in monkeys. J Comp Physiol Psychol 23:101-112.
35. Johnstone S, Rolls ET (1990) Delay, discriminatory, and modality specific neurons in the striatum and pallidum during short-term memory tasks. Brain Res 522:147-151.
36. Kawagoe R, Takikawa Y, Hikosaka O (1998) Expectation of reward modulates cognitive signals in the basal ganglia. Nature Neurosci 1:411-416.
37. Kubota K, Niki H (1971) Prefrontal cortical unit activity and delayed alternation performance in monkeys. J Neurophysiol 34:337-347.
38. Kubota K, Iwamoto T, Suzuki H (1974) Visuokinetic activities of primate prefrontal neurons during delayed-response performance. J Neurophysiol 37:1197-1212.
39. Ljungberg T, Apicella P, Schultz W (1992) Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67:145-163.
40. Mirenowicz J, Schultz W (1994) Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 72: 1024-1027.
41. Mirenowicz J, Schultz W (1996) Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379:449-451.
42. Montgomery EBJr, Buchholz SR (1991) The striatum and motor cortex in motor initiation and execution. Brain Res 549:222-229.
43. Nader MA, Woolverton WL (1991) Effects of increasing the magnitude of an alternative reinforcer on drug choice in a discrete trials choice procedure. Psychopharmacology 105:169-174.
44. Nishijo H, Ono T, Nishino H (1988) Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance. J Neurosci 8:3570-3583.
45. Olson CR, Gettner SN (1995) Object-centered direction selectivity in the macaque supplementary eye field. Science 269:985-988.
46. Öngür D, Price JL (2000) The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb Cortex 10:206-219.
47. Owen AM, Stern CE, Look RB, Tracey I, Rosen BR, Petrides M (1998) Functional organization of spatial and nonspatial working memory processing within the human lateral prefrontal cortex. Proc Natl Acad Sci USA 95:7721-7726.
48. Pandya DN, Yeterian EH (1996) Comparison of prefrontal architectures and connections. Phil Trans R Soc Lond B 351:1423-1432.
49. Petrides M, Pandya DN (1988) Association fiber pathways to the frontal cortex from the superior temporal region in the rhesus monkey. J Comp Neurol 273:52-66.
50. Rao SC, Rainer G, Miller EK (1997) Integration of what and where in the primate prefrontal cortex. Science 276:821-824.
51. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical conditioning. Vol II. Current research and theory (Black AH, Prokasy WF eds), pp 64-99 New York: Appleton Century Crofts.
52. Robbins TW, Everitt BJ (1996) Neurobehavioural mechanisms of reward and motivation. Curr Opin Neurobiol 6:228-236.
53. Rolls ET (1996) The orbitofrontal cortex. Phil Trans R Soc Lond B 351: 1433-1444.
54. Rolls ET (2000) The orbitofrontal cortex and reward. Cereb Cortex 10: 284-294.
55. Rolls ET, Yaxley S, Sienkiewicz ZJ (1990) Gustatory responses of single neurons in the caudolateral the orbitofrontal cortex of the macaque monkey. J Neurophysiol 64:1055-1066.
56. Romo R, Schultz W (1990) Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements. J Neurophysiol 63:592-606.
57. Romo R, Schultz W (1992) Role of primate basal ganglia and frontal cortex in the internal generation of movements. III. Neuronal activity in the supplementary motor area. Exp Brain Res 91:396-407.
58. Rosenkilde CE, Bauer RH, Fuster JM (1981) Single cell activity in ventral prefrontal cortex of behaving monkeys. Brain Res 209:375-394.
59. Schoenbaum G, Chiba AA, Gallagher M (1998) Orbitofrontal cortex and basolateral amygdala encode expected outcome during learning. Nature Neurosci 1:155-159.
60. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1-27.
61. Schultz W, Romo R (1992) Role of primate basal ganglia and frontal cortex in the internal generation of movements. I. Preparatory activity in the anterior striatum. Exp Brain Res 91:363-384.
62. Schultz W, Apicella P, Scarnati E, Ljungberg T (1992) Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12:4595-4610.
63. Schultz W, Apicella P, Ljungberg T (1993) Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13:900-913.
64. Schultz,W, Apicella P, Romo R, Scarnati E (1995) Context-dependent activity in primate striatum reflecting past and future behavioral events. In: Models of information processing in the basal ganglia (Houk JC, Davis JL, Beiser DG, eds), pp 11-28. Cambridge, MA: MIT Press.
65. Schultz W, Dayan P, Montague RR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
66. Selemon LD, Goldman-Rakic PS (1985) Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J Neurosci 5:776-794.
67. Shidara M, Aigner TG, Richmond BJ (1998) Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials. J Neurosci 18:2613-2625.
68. Shima K, Tanji J (1998) Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282:1335-1338.
69. Sutton RS, Barto AG (1981) Toward a modern theory of adaptive networks: expectation and prediction. Psychol Rev 88:135-170.
70. Thorpe SJ, Rolls ET, Maddison S (1983) The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp Brain Res 49:93-115.
71. Tremblay L, Schultz W (1999) Relative reward preference in primate the orbitofrontal cortex. Nature 398:704-708.
72. Tremblay L, Schultz W (2000a) Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J Neurophysiol (in press).
73. Tremblay L, Schultz W (2000b) Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. J Neurophysiol (in press).
74. Tremblay L, Hollerman JR, Schultz W (1998) Modifications of reward expectation-related neuronal activity during learning in primate striatum. J Neurophysiol 80:964-977.
75. Ungerleider LG, Courtney SM, Haxby JV (1998) A neural system for human visual working memory. Proc Natl Acad Sci USA 95:883-890.
76. Washburn DA, Hopkins WD, Rumbaugh DM (1991) Perceived control in rhesus monkeys (Macaca mulattta): enhanced video-task performance. J Exp Psychol: Anim Behav Proc 17:123-129.
77. Watanabe M (1992a) Frontal units coding the associative significance of visual and auditory stimuli. Exp Brain Res 89:233-247.
78. Watanabe M (1992b) Prefrontal unit activity during associative learning in the monkey. Exp Brain Res 80:296-309.
79. Watanabe M (1996) Reward expectancy in primate prefrontal neurons. Nature 382:629-632.
80. Wilson FAW, O'Scalaidhe SP, Goldman-Rakic PS (1993) Dissociation of object and spatial processing domains in primate prefrontal cortex. Science 260:1955-1958.
81. Wise RA (1996) Neurobiology of addiction. Curr Opin Neurobiol 6:243-251.
82. Wise RA, Rompre PP (1989) Brain dopamine and reward. Annu Rev Psychol 40:191-225.