Inactivation of the putamen selectively impairs reward history-based action selection

Experimental Brain Research

Volumn 209, Issue 2, 2011, Pages 235-246

  Muranishi, Manabu ^a   Inokawa, Hitoshi ^a   Yamada, Hiroshi ^a,b   Ueda, Yasumasa ^a   Matsumoto, Naoyuki ^a   Nakagawa, Masanori ^a   Kimura, Minoru ^a,c  

^a KYOTO PREFECTURAL UNIVERSITY OF MEDICINE   (Japan)

^b NEW YORK UNIVERSITY   (United States)

^c Institute of Physical and Chemical Research   (Japan)

Author keywords

Decision making; Muscimol; Putamen; Reinforcement learning; Reward

Indexed keywords

MUSCIMOL;

ANIMAL EXPERIMENT; ARTICLE; BASAL GANGLION; BEHAVIOR; BRAIN CORTEX; DECISION MAKING; DOPAMINERGIC SYSTEM; FEMALE; MACACA; MESENCEPHALON; MESOLIMBIC DOPAMINERGIC SYSTEM; NONHUMAN; PRIORITY JOURNAL; PUTAMEN; REINFORCEMENT; REWARD; TASK PERFORMANCE;

ANIMALS; DECISION MAKING; FEMALE; GOALS; MACACA; MUSCIMOL; NEURONS; PUTAMEN; REWARD;

EID: 79952449389     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00221-011-2545-y     Document Type: Article

References (67)

1. GE Alexander MR DeLong PL Strick 1986 Parallel organization of functionally segregated circuits linking basal ganglia and cortex Annu Rev Neurosci 9 357 381 1:STN:280:DyaL283htlKksw%3D%3D 10.1146/annurev.ne.09.030186. 002041 3085570 (Pubitemid 16055790)
2. FG Ashby BO Turner JC Horvitz 2010 Cortical and basal ganglia contributions to habit learning and automaticity Trends Cogn Sci 14 208 215 10.1016/j.tics.2010.02.001 20207189
3. Baddeley AD, Hitch GJL (1974) Working Memory. In: Bower GA (ed) The psychology of learning and motivation: advances in research and theory vol 8. Academic Press, New York, pp 47-89
4. BW Balleine JP O'Doherty 2010 Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action Neuropsychopharmacology 35 48 69 10.1038/npp.2009.131 19776734
5. DJ Barraclough ML Conroy D Lee 2004 Prefrontal cortex and decision making in a mixed-strategy game Nat Neurosci 7 404 410 1:CAS:528:DC%2BD2cXisFCis7c%3D 10.1038/nn1209 15004564 (Pubitemid 38429181)
6. SM Beck HS Locke AC Savine K Jimura TS Braver 2010 Primary and secondary rewards differentially modulate neural activity dynamics during working memory PLoS One 5 e9251 10.1371/journal.pone.0009251 20169080
7. RN Cardinal NJ Howes 2005 Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats BMC Neurosci 6 37 10.1186/1471-2202-6-37 15921529 (Pubitemid 41418238)
8. LH Corbit PH Janak 2010 Posterior dorsomedial striatum is critical for both selective instrumental and Pavlovian reward learning Eur J Neurosci 31 1312 1321 10.1111/j.1460-9568.2010.07153.x 20345912
9. JT Coull B Nazarian F Vidal 2008 Timing, storage, and comparison of stimulus duration engage discrete anatomical components of a perceptual timing network J Cogn Neurosci 20 2185 2197 10.1162/jocn.2008.20153 18457512
10. ND Daw JP O'Doherty P Dayan B Seymour RJ Dolan 2006 Cortical substrates for exploratory decisions in humans Nature 441 876 879 1:CAS:528: DC%2BD28XlvVGltrw%3D 10.1038/nature04766 16778890
11. MR DeLong GE Alexander SJ Mitchell RT Richardson 1986 The contribution of basal ganglia to limb control Prog Brain Res 64 161 174 1:STN:280: DyaL283mtVKktg%3D%3D 10.1016/S0079-6123(08)63411-1 3088671
12. M Desmurget RS Turner 2008 Testing basal ganglia motor functions through reversible inactivations in the posterior internal globus pallidus J Neurophysiol 99 1057 1076 1:STN:280:DC%2BD1c7nslaksA%3D%3D 10.1152/jn.01010.2007 18077663 (Pubitemid 351413693)
13. M Desmurget RS Turner 2010 Motor sequences and the basal ganglia: kinematics, not habits J Neurosci 30 7685 7690 1:CAS:528:DC%2BC3cXovVOitLg%3D 10.1523/JNEUROSCI.0163-10.2010 20519543
14. K Doya 2000 Complementary roles of basal ganglia and cerebellum in learning and motor control Curr Opin Neurobiol 10 732 739 1:CAS:528: DC%2BD3MXkvVegsQ%3D%3D 10.1016/S0959-4388(00)00153-7 11240282 (Pubitemid 32052539)
15. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902 (Pubitemid 36356659)
16. AW Flaherty AM Graybiel 1995 Motor and somatosensory corticostriatal projection magnifications in the squirrel monkey J Neurophysiol 74 2638 2648 1:STN:280:DyaK28zlvFGruw%3D%3D 8747221 (Pubitemid 26012321)
17. JM Fuster 1991 The prefrontal cortex and its relation to behavior Prog Brain Res 87 201 211 1:STN:280:DyaK3Mzis1yguw%3D%3D 10.1016/S0079-6123(08)63053- 8 1907745
18. PS Goldman-Rakic 1996 The prefrontal landscape: implications of functional architecture for understanding human mentation and the central executive Philos Trans R Soc Lond B Biol Sci 351 1445 1453 1:STN:280: DyaK2s%2FpslWrsw%3D%3D 10.1098/rstb.1996.0129 8941956 (Pubitemid 27005371)
19. AM Graybiel 2008 Habits, rituals, and the evaluative brain Annu Rev Neurosci 31 359 387 1:CAS:528:DC%2BD1cXptlejtr0%3D 10.1146/annurev.neuro.29. 051605.112851 18558860
20. SN Haber B Knutson 2010 The reward circuit: linking primate anatomy and human imaging Neuropsychopharmacology 35 4 26 10.1038/npp.2009.129 19812543
21. SN Haber KS Kim P Mailly R Calzavara 2006 Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning J Neurosci 26 8368 8376 1:CAS:528:DC%2BD28Xos1Kju78%3D 10.1523/JNEUROSCI.0271-06. 2006 16899732 (Pubitemid 44309851)
22. O Hikosaka Y Takikawa R Kawagoe 2000 Role of the basal ganglia in the control of purposive saccadic eye movements Physiol Rev 80 953 978 1:STN:280:DC%2BD3czpvVKisA%3D%3D 10893428 (Pubitemid 30452008)
23. O Hikosaka K Nakamura H Nakahara 2006 Basal ganglia orient eyes to reward J Neurophysiol 95 567 584 10.1152/jn.00458.2005 16424448 (Pubitemid 44699062)
24. Hollerman JR, Schultz W (1998) Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1:304-309
25. Y Hori T Minamimoto M Kimura 2009 Neuronal encoding of reward value and direction of actions in the primate putamen J Neurophysiol 102 3530 3543 10.1152/jn.00104.2009 19812294
26. Houk JC, Adams JL, Barto AG (1995) A model of how the basal ganglia generate and use neural signals that predict reinforcement. In: Houk JC, Davis JL, Beiser DG (eds) Models of information processing in the basal ganglia. The MIT Press, Cambridge, pp 249-270
27. H Inokawa H Yamada N Matsumoto M Muranishi M Kimura 2010 Juxtacellular labeling of tonically active neurons and phasically active neurons in the rat striatum Neuroscience 168 395 404 1:CAS:528:DC%2BC3cXmtFCitbg%3D 10.1016/j.neuroscience.2010.03.062 20371269
28. M Ito K Doya 2009 Validation of decision-making models and analysis of decision variables in the rat basal ganglia J Neurosci 29 9861 9874 1:CAS:528:DC%2BD1MXpvFOmurY%3D 10.1523/JNEUROSCI.6157-08.2009 19657038
29. M Kato M Kimura 1992 Effects of reversible blockade of basal ganglia on a voluntary arm movement J Neurophysiol 68 1516 1534 1:STN:280: DyaK3s7isVWmsQ%3D%3D 1479428
30. R Kawagoe Y Takikawa O Hikosaka 1998 Expectation of reward modulates cognitive signals in the basal ganglia Nat Neurosci 1 411 416 1:CAS:528:DyaK1MXitVCgtLc%3D 10.1038/1625 10196532
31. SW Kennerley ME Walton TE Behrens MJ Buckley MF Rushworth 2006 Optimal decision making and the anterior cingulate cortex Nat Neurosci 9 940 947 1:CAS:528:DC%2BD28XmtFCmtr8%3D 10.1038/nn1724 16783368 (Pubitemid 43980509)
32. M Kimura T Minamimoto N Matsumoto Y Hori 2004 Monitoring and switching of cortico-basal ganglia loop functions by the thalamo-striatal system Neurosci Res 48 355 360 10.1016/j.neures.2003.12.002 15041188 (Pubitemid 38369332)
33. T Kojima H Onoe K Hikosaka K Tsutsui H Tsukada M Watanabe 2009 Default mode of brain activity demonstrated by positron emission tomography imaging in awake monkeys: higher rest-related than working memory-related activity in medial cortical areas J Neurosci 29 14463 14471 1:CAS:528:DC%2BD1MXhsVOhsLnL 10.1523/JNEUROSCI.1786-09.2009 19923280
34. B Lau PW Glimcher 2008 Value representations in the primate caudate nucleus during matching behavior Neuron 58 451 463 1:CAS:528: DC%2BD1cXmt1Snu7s%3D 10.1016/j.neuron.2008.02.021 18466754 (Pubitemid 351615183)
35. J Lauwereyns K Watanabe B Coe O Hikosaka 2002 A neural correlate of response bias in monkey caudate nucleus Nature 418 413 417 1:CAS:528: DC%2BD38XlsFajtr0%3D 10.1038/nature00892 12140557 (Pubitemid 34830386)
36. M Matsumoto O Hikosaka 2009 Two types of dopamine neuron distinctly convey positive and negative motivational signals Nature 459 837 841 1:CAS:528:DC%2BD1MXmtVOqsr0%3D 10.1038/nature08028 19448610
37. K Matsumoto W Suzuki K Tanaka 2003 Neuronal correlates of goal-based motor selection in the prefrontal cortex Science 301 229 232 1:CAS:528:DC%2BD3sXlsF2ntLg%3D 10.1126/science.1084204 12855813 (Pubitemid 36858478)
38. AN McCoy ML Platt 2005 Expectations and outcomes: decision-making in the primate brain J Comp Physiol A Neuroethol Sens Neural Behav Physiol 191 201 211 10.1007/s00359-004-0565-9 15759141 (Pubitemid 40473767)
39. NR McFarland SN Haber 2000 Convergent inputs from thalamic motor nuclei and frontal cortical areas to the dorsal striatum in the primate J Neurosci 20 3798 3813 1:CAS:528:DC%2BD3cXjtlKqsbw%3D 10804220 (Pubitemid 30266241)
40. FA Middleton PL Strick 2000 Basal ganglia and cerebellar loops: motor and cognitive circuits Brain Res Brain Res Rev 31 236 250 1:STN:280: DC%2BD3c7osFCqug%3D%3D 10.1016/S0165-0173(99)00040-5 10719151 (Pubitemid 30136179)
41. S Miyachi O Hikosaka K Miyashita Z Karadi MK Rand 1997 Differential roles of monkey striatum in learning of sequential hand movement Exp Brain Res 115 1 5 1:STN:280:DyaK2szmvVSlsw%3D%3D 10.1007/PL00005669 9224828 (Pubitemid 27259603)
42. O Monchi M Petrides V Petre K Worsley A Dagher 2001 Wisconsin card sorting revisited: distinct neural circuits participating in different stages of the task identified by event-related functional magnetic resonance imaging J Neurosci 21 7733 7741 1:STN:280:DC%2BD3MritVShtw%3D%3D 11567063 (Pubitemid 32904972)
43. G Morris D Arkadir A Nevet E Vaadia H Bergman 2004 Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons Neuron 43 133 143 1:CAS:528:DC%2BD2cXmtVyjsbs%3D 10.1016/j.neuron.2004.06.012 15233923 (Pubitemid 38952825)
44. G Morris A Nevet D Arkadir E Vaadia H Bergman 2006 Midbrain dopamine neurons encode decisions for future action Nat Neurosci 9 1057 1063 1:CAS:528:DC%2BD28Xnt12js7c%3D 10.1038/nn1743 16862149 (Pubitemid 44264919)
45. A Nambu 2008 Seven problems on the basal ganglia Curr Opin Neurobiol 18 595 604 1:CAS:528:DC%2BD1MXmtVKks7c%3D 10.1016/j.conb.2008.11.001 19081243
46. A Nambu K Kaneda H Tokuno M Takada 2002 Organization of corticostriatal motor inputs in monkey putamen J Neurophysiol 88 1830 1842 12364509 (Pubitemid 35191184)
47. SM Nicola 2007 The nucleus accumbens as part of a basal ganglia action selection circuit Psychopharmacology (Berl) 191 521 550 1:CAS:528: DC%2BD2sXitlCqtLc%3D 10.1007/s00213-006-0510-4 (Pubitemid 46355879)
48. J O'Doherty P Dayan J Schultz R Deichmann K Friston RJ Dolan 2004 Dissociable roles of ventral and dorsal striatum in instrumental conditioning Science 304 452 454 10.1126/science.1094285 15087550 (Pubitemid 38495943)
49. B Pasquereau A Nadjar D Arkadir E Bezard M Goillandeau B Bioulac CE Gross T Boraud 2007 Shaping of motor responses by incentive values through the basal ganglia J Neurosci 27 1176 1183 1:CAS:528:DC%2BD2sXhvVOjtLY%3D 10.1523/JNEUROSCI.3745-06.2007 17267573 (Pubitemid 46203326)
50. ML Platt PW Glimcher 1999 Neural correlates of decision variables in parietal cortex Nature 400 233 238 1:CAS:528:DyaK1MXkvFWlsb0%3D 10.1038/22268 10421364 (Pubitemid 29334132)
51. P Redgrave TJ Prescott K Gurney 1999 Is the short-latency dopamine response too short to signal reward error? Trends Neurosci 22 146 151 1:CAS:528:DyaK1MXitlClu7g%3D 10.1016/S0166-2236(98)01373-3 10203849 (Pubitemid 29166781)
52. PH Rudebeck TE Behrens SW Kennerley MG Baxter MJ Buckley ME Walton MF Rushworth 2008 Frontal cortex subregions play distinct roles in choices between actions and stimuli J Neurosci 28 13775 13785 1:CAS:528:DC%2BD1cXhsFCqtrnP 10.1523/JNEUROSCI.3541-08.2008 19091968
53. K Samejima Y Ueda K Doya M Kimura 2005 Representation of action-specific reward values in the striatum Science 310 1337 1340 1:CAS:528:DC%2BD2MXht1GqsrrP 10.1126/science.1115270 16311337 (Pubitemid 41698867)
54. T Satoh S Nakai T Sato M Kimura 2003 Correlated coding of motivation and outcome of decision by dopamine neurons J Neurosci 23 9913 9923 1:CAS:528:DC%2BD3sXovVKisLg%3D 14586021 (Pubitemid 37371606)
55. T Sawaguchi M Iba 2001 Prefrontal cortical representation of visuospatial working memory in monkeys examined by local inactivation with muscimol J Neurophysiol 86 2041 2053 1:STN:280:DC%2BD3MrltleisA%3D%3D 11600660 (Pubitemid 32953248)
56. W Schultz P Dayan PR Montague 1997 A neural substrate of prediction and reward Science 275 1593 1599 1:CAS:528:DyaK2sXhvFSntro%3D 10.1126/science.275. 5306.1593 9054347 (Pubitemid 27120526)
57. H Seo D Lee 2007 Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game J Neurosci 27 8366 8377 1:CAS:528:DC%2BD2sXpsVGnt74%3D 10.1523/JNEUROSCI.2369-07.2007 17670983 (Pubitemid 47219624)
58. M Shidara BJ Richmond 2002 Anterior cingulate: single neuronal signals related to degree of reward expectancy Science 296 1709 1711 10.1126/science.1069504 12040201 (Pubitemid 34579174)
59. M Shidara TG Aigner BJ Richmond 1998 Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials J Neurosci 18 2613 2625 1:CAS:528:DyaK1cXitFCjs7Y%3D 9502820 (Pubitemid 28141808)
60. K Shima J Tanji 1998 Both supplementary and pre supplementary motor areas are crucial for the temporal organization of multiple movements J Neurophysiol 80 3247 3260 1:STN:280:DyaK1M%2FotF2ktg%3D%3D 9862919 (Pubitemid 29029247)
61. LP Sugrue GS Corrado WT Newsome 2004 Matching behavior and the representation of value in the parietal cortex Science 304 1782 1787 1:CAS:528:DC%2BD2cXkvVersbk%3D 10.1126/science.1094765 15205529 (Pubitemid 38787891)
62. Sutton RS, Barto AG (1998) Reinforcement learning. The MIT press, Cambridge
63. M Takada H Tokuno I Hamada M Inase Y Ito M Imanishi N Hasegawa T Akazawa N Hatanaka A Nambu 2001 Organization of inputs from cingulate motor areas to basal ganglia in macaque monkey Eur J Neurosci 14 1633 1650 1:STN:280: DC%2BD387jvVSitw%3D%3D 10.1046/j.0953-816x.2001.01789.x 11860458 (Pubitemid 35478032)
64. E Tricomi BW Balleine JP O'Doherty 2009 A specific role for posterior dorsolateral striatum in human habit learning Eur J Neurosci 29 2225 2232 10.1111/j.1460-9568.2009.06796.x 19490086
65. M Watanabe HC Cromwell L Tremblay JR Hollerman K Hikosaka W Schultz 2001 Behavioral reactions reflecting differential reward expectations in monkeys Exp Brain Res 140 511 518 1:STN:280:DC%2BD3MnhtVantA%3D%3D 10.1007/s002210100856 11685405 (Pubitemid 32938334)
66. H Yamada N Matsumoto M Kimura 2004 Tonically active neurons in the primate caudate nucleus and putamen differentially encode instructed motivational outcomes of action J Neurosci 24 3500 3510 1:CAS:528: DC%2BD2cXjsFels70%3D 10.1523/JNEUROSCI.0068-04.2004 15071097 (Pubitemid 38481106)
67. RJ Yun JH Krystal DH Mathalon 2010 Working memory overload: fronto-limbic interactions and effects on subsequent working memory function Brain Imaging Behav 4 96 108 10.1007/s11682-010-9089-9 20503117