The role of the dorsal striatum in reward and decision-making

Journal of Neuroscience

Volumn 27, Issue 31, 2007, Pages 8161-8165

  Balleine, Bernard W ^a,d   Delgado, Mauricio R ^b   Hikosaka, Okihide ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b RUTGERS UNIVERSITY   (United States)

^c NATIONAL EYE INSTITUTE   (United States)

^d Box 951563 ^*  (United States)

Author keywords

Choice; Executive; Frontal cortex; Reward; Striatum; Utility

Indexed keywords

COGNITION; CORPUS STRIATUM; DECISION MAKING; EMOTION; HUMAN; MOTIVATION; MOTOR PERFORMANCE; NEUROPHYSIOLOGY; NEUROSCIENCE; NONHUMAN; PRIMATE; PRIORITY JOURNAL; REWARD; RODENT; SENSORIMOTOR FUNCTION; SHORT SURVEY;

ANIMALS; CORPUS STRIATUM; DECISION MAKING; HUMANS; NERVE NET; REWARD;

EID: 34547670815     PISSN: 02706474     EISSN: 02706474     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.1554-07.2007     Document Type: Short Survey

References (78)

1. Alexander GE, Crutcher MD (1990) Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci 13:266-271.
2. Antonini A, Moresco RM, Gobbo C, De Notaris R, Panzacchi A, Barone P, Calzetti S, Negrotti A, Pezzoli G, Fazio F (2001) The status of dopamine nerve terminals in Parkinson's disease and essential tremor: a PET study with the tracer [11-C]FE-CIT. Neurol Sci 22:47-48.
3. Aosaki T, Tsubokawa H, Ishida A, Watanabe K, Graybiel AM, Kimura M (1994) Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning. J Neurosci 14:3969-3984.
4. Balleine BW (2005) Neural bases of food seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol Behav 86:717-730.
5. Balleine BW, Dickinson A (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37:407-419.
6. Balleine BW, Killcross S (2006) Parallel incentive processing: an integrated view of amygdala function. Trends Neurosci 29:272-279.
7. Barnes TD, Kubota Y, Hu D, Jin DZ, Graybiel AM (2005) Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437:1158-1161.
8. Blazquez PM, Fujii N, Kojima J, Graybiel AM (2002) A network representation of response probability in the striatum. Neuron 33:973-982.
9. Bloch MH, Leckman JF, Zhu H, Peterson BS (2005) Caudate volumes in childhood predict symptom severity in adults with Tourette syndrome. Neurology 65:1253-1258.
10. Brasted PJ, Wise SP (2004) Comparison of learning-related neuronal activity in the dorsal premotor cortex and striatum. Eur J Neurosci 19:721-740.
11. Chang JY, Chen L, Luo F, Shi LH, Woodward DJ (2002) Neuronal responses in the frontal cortico-basal ganglia system during delayed matching-tosample task: ensemble recording in freely moving rats. Exp Brain Res 142:67-80.
12. Corbit LH, Balleine BW (2003) The role of prelimbic cortex in instrumental conditioning. Behav Brain Res 146:145-157.
13. Corbit LH, Muir JL, Balleine BW (2001) The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell. J Neurosci 21:3251-3260.
14. Costa RM, Cohen D, Nicolelis MA (2004) Differential corticostriatal plasticity during fast and slow motor skill learning in mice. Curr Biol 14:1124-1134.
15. Costa RM, Lin SC, Sotnikova TD, Cyr M, Gainetdinov RR, Caron MG, Nicolelis MA (2006) Rapid alterations in corticostriatal ensemble coordination during acute dopamine-dependent motor dysfunction. Neuron 52:359-369.
16. Cromwell HC, Schultz W (2003) Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol 89:2823-2838.
17. Davidson MC, Horvitz JC, Tottenham N, Fossella JA, Watts R, Ulug AM, Casey BJ (2004) Differential cingulate and caudate activation following unexpected nonrewarding stimuli. NeuroImage 23:1039-1045.
18. Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8:1704-1711.
19. Dayan P, Balleine BW (2002) Reward, motivation, and reinforcement learning. Neuron 36:285-298.
20. Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA (2000) Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol 84:3072-3077.
21. Delgado MR, Miller MM, Inati S, Phelps EA (2005a) An fMRI study of reward-related probability learning. NeuroImage 24:862-873.
22. Delgado MR, Frank RH, Phelps EA (2005b) Perceptions of moral character modulate the neural systems of reward during the trust game. Nat Neurosci 8:1611-1618.
23. de Quervain DJ, Fischbacher U, Treyer V, Schellhammer M, Schnyder U, Buck A, Fehr E (2004) The neural basis of altruistic punishment. Science 305:1254-1258.
24. Dickinson A (1994) Instrumental conditioning. In: Animal cognition and learning (Mackintosh NJ, ed), pp 4-79. London: Academic.
25. Dickinson A, Balleine BW (1994) Motivational control of goal-directed action. Anim Learn Behav 22:1-18.
26. Dickinson A, Balleine BW, Watt A, Gonzales F, Boakes RA (1995) Overtraining and the motivational control of instrumental action. Anim Learn Behav 22:197-206.
27. Fuster JM (2000) Executive frontal functions. Exp Brain Res 133:66-70.
28. Gabbott PL, Warner TA, Jays PR, Salway P, Busby SJ (2005) Prefrontal cortex in the rat: projections to subcortical autonomic, motor, and limbic centers. J Comp Neurol 492:145-177.
29. Goldman-Rakic PS (1995) Architecture of the prefrontal cortex and the central executive. Ann NY Acad Sci 769:71-83.
30. Hadj-Bouziane F, Boussaoud D (2003) Neuronal activity in the monkey striatum during conditional visuomotor learning. Exp Brain Res 153:190-196.
31. Haruno M, Kawato M (2006) Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. J Neurophysiol 95:948-959.
32. Haruno M, Kuroda T, Doya K, Toyama K, Kimura M, Samejima K, Imamizu H, Kawato M (2004) A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task. J Neurosci 24:1660-1665.
33. Hernandez PJ, Schiltz CA, Kelley AE (2006) Dynamic shifts in corticostriatal expression patterns of the immediate early genes Homer 1a and Zif268 during early and late phases of instrumental training. Learn Mem 13:599-608.
34. Hikosaka O, Sakamoto M, Usui S (1989) Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J Neurophysiol 61:814-832.
35. Hikosaka O, Nakamura K, Nakahara H (2006) Basal ganglia orient eyes to reward. J Neurophysiol 95:567-584.
36. Hodges A, Strand AD, Aragaki AK, Kuhn A, Sengstag T, Hughes G, Elliston LA, Hartog C, Goldstein DR, Thu D, Hollingsworth ZR, Collin F, Synek B, Holmans PA, Young AB, Wexler NS, Delorenzi M, Kooperberg C, Augood SJ, Faull RL, et al. (2006) Regional and cellular gene expression changes in human Huntington's disease brain. Hum Mol Genet 15:965-977.
37. Hollerman J, Tremblay L, Schultz W (1998) Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80:947-963.
38. Houk JC, Adams JL, Barto A (1995) A model of how the basal ganglia generate and use neural signals that predict reinforcement. In: Models of information processing in the basal ganglia (Houk JC, Davis JL, Beiser DG, eds), pp 249-270. Cambridge, MA: MIT.
39. Ito R, Dalley JW, Robbins TW, Everitt BJ (2002) Dopamine release in the dorsal striatum during cocaine-seeking behavior under the control of a drug-associated cue. J Neurosci 22:6247-6253.
40. Jog MS, Kubota Y, Connolly CI, Hillegaart V, Graybiel AM (1999) Building neural representations of habits. Science 286:1745-1749.
41. Kawagoe R, Takikawa Y, Hikosaka O (1998) Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1:411-416.
42. Killcross S, Coutureau E (2003) Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb Cortex 13:400-408.
43. King-Casas B, Tomlin D, Anen C, Camerer CF, Quartz SR, Montague PR (2005) Getting to know you: reputation and trust in a two-person economic exchange. Science 308:78-83.
44. Knutson B, Adams CM, Fong GW, Hommer D (2001) Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21:RC159(1-5).
45. Koepp MJ, Gunn RN, Lawrence AD, Cunningham VJ, Dagher A, Jones T, Brooks DJ, Bench CJ, Grasby PM (1998) Evidence for striatal dopamine release during a video game. Nature 393:266-268.
46. Lauwereyns J, Watanabe K, Coe B, Hikosaka O (2002) A neural correlate of response bias in monkey caudate nucleus. Nature 418:413-417.
47. Levy R, Dubois B (2006) Apathy and the functional anatomy of the prefrontal cortex-basal ganglia circuits. Cereb Cortex 16:916-928.
48. Miyachi S, Hikosaka O, Miyashita K, Karádi Z, Rand MK (1997) Differential roles of monkey striatum in learning of sequential hand movement. Exp Brain Res 115:1-5.
49. Miyachi S, Hikosaka O, Lu X (2002) Differential activation of monkey striatal neurons in the early and late stages of procedural learning. Exp Brain Res 146:122-126.
50. Nakamura K, Hikosaka O (2006a) Role of dopamine in the primate caudate nucleus in reward modulation of saccades. J Neurosci 26:5360-5369.
51. Nakamura K, Hikosaka O (2006b) Facilitation of saccadic eye movements by postsaccadic electrical stimulation in the primate caudate. J Neurosci 26:12885-12895.
52. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454.
53. O'Doherty JP (2004) Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr Opin Neurobiol 14:769-776.
54. O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ (2002) Neural responses during anticipation of a primary taste reward. Neuron 33:815-826.
55. Ostlund SB, Balleine BW (2005) Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. J Neurosci 25:7763-7770.
56. Partridge JG, Tang KC, Lovinger DM (2000) Regional and postnatal heterogeneity of activity-dependent long-term changes in synaptic efficacy in the dorsal striatum. J Neurophysiol 84:1422-1429.
57. Pasupathy A, Miller EK (2005) Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433:873-876.
58. Poldrack RA, Clark J, Pare-Blagoev EJ, Shohamy D, Creso Moyano J, Myers C, Gluck MA (2001) Interactive memory systems in the human brain. Nature 414:546-550.
59. Reynolds JN, Wickens JR (2002) Dopamine-dependent plasticity of corticostriatal synapses. Neural Netw 15:507-521.
60. Rilling J, Gutman D, Zeh T, Pagnoni G, Berns G, Kilts C (2002) A neural basis for social cooperation. Neuron 35:395-405.
61. Robinson D, Wu H, Munne RA, Ashtari M, Alvir JM, Lerner G, Koreen A, Cole K, Bogerts B (1995) Reduced caudate nucleus volume in obsessivecompulsive disorder. Arch Gen Psychiatry 52:393-398.
62. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1-27.
63. Seppi K, Schocke MF, Prennschuetz-Schuetzenau K, Mair KJ, Esterhammer R, Kremser C, Muigg A, Scherfler C, Jaschke W, Wenning GK, Poewe W (2006) Topography of putaminal degeneration in multiple system atrophy: a diffusion magnetic resonance study. Mov Disord 21:847-852.
64. Seymour B, O'Doherty JP, Koltzenburg M, Wiech K, Frackowiak R, Friston K, Dolan R (2005) Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat Neurosci 8:1234-1240.
65. Shidara M, Aigner TG, Richmond BJ (1998) Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials. J Neurosci 18:2613-2625.
66. Shohamy D, Myers CE, Grossman S, Sage J, Gluck MA, Poldrack RA (2004) Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. Brain 127:851-859.
67. Smith R, Musleh W, Akopian G, Buckwalter G, Walsh JP (2001) Regional differences in the expression of corticostriatal synaptic plasticity. Neuroscience 106:95-101.
68. Tanaka SC, Samejima K, Okada G, Ueda K, Okamoto Y, Yamawaki S, Doya K (2006) Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics. Neural Netw 19:1233-1241.
69. Tang C, Pawlak AP, Prokopenko V, West MO (2007) Changes in activity of the striatum during formation of a motor habit. Eur J Neurosci 25:1212-1227.
70. Tremblay L, Hollerman JR, Schultz W (1998) Modifications of reward expectation-related neuronal activity during learning in primate striatum. J Neurophysiol 80:964-977.
71. Tricomi EM, Delgado MR, Fiez JA (2004) Modulation of caudate activity by action contingency. Neuron 41:281-292.
72. Volkow ND, Wang GJ, Fowler JS, Logan J, Jayne M, Franceschi D, Wong C, Gatley SJ, Gifford AN, Ding YS, Pappas N (2002) "Nonhedonic" food motivation in humans involves dopamine in the dorsal striatum and methylphenidate amplifies this effect. Synapse 44:175-180.
73. Williams ZM, Eskandar EN (2006) Selective enhancement of associative learning by microstimulation of the anterior caudate. Nat Neurosci 9:562-568.
74. Yin HH, Knowlton BJ, Balleine BW (2004) Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci 19:181-189.
75. Yin HH, Knowlton BJ, Balleine BW (2005a) Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behav Brain Res 166:189-196.
76. Yin HH, Knowlton BJ, Balleine BW (2005b) Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. Eur J Neurosci 22:505-512.
77. Yin HH, Ostlund SB, Knowlton BJ, Balleine BW (2005c) The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci 22:513-523.
78. Zald DH, Boileau I, El-Dearedy W, Gunn R, McGlone F, Dichter GS, Dagher A (2004) Dopamine transmission in the human striatum during monetary reward tasks. J Neurosci 24:4105-4112.