Neuronal basis for evaluating selected action in the primate striatum

European Journal of Neuroscience

Volumn 34, Issue 3, 2011, Pages 489-506

  Yamada, Hiroshi ^a   Inokawa, Hitoshi ^a   Matsumoto, Naoyuki ^a,b   Ueda, Yasumasa ^a   Kimura, Minoru ^a,c  

^a KYOTO PREFECTURAL UNIVERSITY OF MEDICINE   (Japan)

^b PREFECTURAL UNIVERSITY OF KUMAMOTO   (Japan)

^c TAMAGAWA UNIVERSITY   (Japan)

Author keywords

Basal ganglia; Caudate nucleus; Feedback; Putamen; Reward

Indexed keywords

ANIMAL CELL; ANIMAL TISSUE; ARTICLE; BEHAVIOR; BRAIN FUNCTION; CELL POPULATION; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; FEEDBACK SYSTEM; MENTAL TASK; NERVE CELL; NONHUMAN; OUTCOME ASSESSMENT; PRIORITY JOURNAL;

ANIMALS; BEHAVIOR, ANIMAL; CHOICE BEHAVIOR; CORPUS STRIATUM; DECISION MAKING; ELECTROMYOGRAPHY; FEMALE; HUMANS; LEARNING; MACACA; MALE; NEURONS; NEUROPSYCHOLOGICAL TESTS; REINFORCEMENT (PSYCHOLOGY); REWARD;

EID: 79960952317     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2011.07771.x     Document Type: Article

References (77)

1. Alexander, G.E., DeLong, M.R. & Strick, P.L. (1986) Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci., 9, 357-381.
2. Amiez, C., Joseph, J.P. & Procyk, E. (2006) Reward encoding in the monkey anterior cingulate cortex. Cereb. Cortex, 16, 1040-1055.
3. Apicella, P., Ljungberg, T., Scarnati, E. & Schultz, W. (1991) Responses to reward in monkey dorsal and ventral striatum. Exp. Brain Res., 85, 491-500.
4. Asaad, W.F., Rainer, G. & Miller, E.K. (2000) Task-specific neural activity in the primate prefrontal cortex. J. Neurophysiol., 84, 451-459.
5. Barraclough, D.J., Conroy, M.L. & Lee, D. (2004) Prefrontal cortex and decision making in a mixed-strategy game. Nat. Neurosci., 7, 404-410.
6. Bayer, H.M. & Glimcher, P.W. (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129-141.
7. Beck, S.M., Locke, H.S., Savine, A.C., Jimura, K. & Braver, T.S. (2010) Primary and secondary rewards differentially modulate neural activity dynamics during working memory. PLoS ONE, 5, e9251.
8. Berke, J.D., Breck, J.T. & Eichenbaum, H. (2009) Striatal versus hippocampal representations during win-stay maze performance. J. Neurophysiol., 101, 1575-1587.
9. Boussaoud, D. & Kermadi, I. (1997) The primate striatum: neuronal activity in relation to spatial attention versus motor preparation. Eur. J. Neurosci., 9, 2152-2168.
10. Brown, J.W. & Braver, T.S. (2007) Risk prediction and aversion by anterior cingulate cortex. Cogn. Affect Behav. Neurosci., 7, 266-277.
11. Coull, J.T., Nazarian, B. & Vidal, F. (2008) Timing, storage, and comparison of stimulus duration engage discrete anatomical components of a perceptual timing network. J. Cogn. Neurosci., 20, 2185-2197.
12. Crutcher, M.D. & DeLong, M.R. (1984) Single cell studies of the primate putamen. II. Relations to direction of movement and pattern of muscular activity. Exp. Brain Res., 53, 244-258.
13. Daw, N.D., Niv, Y. & Dayan, P. (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci., 8, 1704-1711.
14. Dayan, P., Kakade, S. & Montague, P.R. (2000) Learning and selective attention. Nat. Neurosci., 3(Suppl), 1218-1223.
15. Dickinson, A. (1980) Contemporaly Animal Learning Theory. Cambridge University Press, Cambridge.
16. Doya, K. (2000) Complementary roles of basal ganglia and cerebellum in learning and motor control. Curr. Opin. Neurobiol., 10, 732-739.
17. Funahashi, S., Chafee, M.V. & Goldman-Rakic, P.S. (1993) Prefrontal neuronal activity in rhesus monkeys performing a delayed anti-saccade task. Nature, 365, 753-756.
18. Fuster, J.M. (1991) The prefrontal cortex and its relation to behavior. Prog. Brain Res., 87, 201-211.
19. Genovesio, A., Brasted, P.J., Mitz, A.R. & Wise, S.P. (2005) Prefrontal cortex activity related to abstract response strategies. Neuron, 47, 307-320.
20. Genovesio, A., Tsujimoto, S. & Wise, S.P. (2008) Encoding problem-solving strategies in prefrontal cortex: activity during strategic errors. Eur. J. Neurosci., 27, 984-990.
21. Goldman-Rakic, P.S. (1996) The prefrontal landscape: implications of functional architecture for understanding human mentation and the central executive. Philos. Trans. R. Soc. Lond., B, Biol. Sci., 351, 1445-1453.
22. Haber, S.N., Kim, K.S., Mailly, P. & Calzavara, R. (2006) Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning. J. Neurosci., 26, 8368-8376.
23. Hikosaka, O., Sakamoto, M. & Usui, S. (1989) Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J. Neurophysiol., 61, 814-832.
24. Histed, M.H., Pasupathy, A. & Miller, E.K. (2009) Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions. Neuron, 63, 244-253.
25. Hori, Y., Minamimoto, T. & Kimura, M. (2009) Neuronal encoding of reward value and direction of actions in the primate putamen. J. Neurophysiol., 102, 3530-3543.
26. Hoshi, E. & Tanji, J. (2000) Integration of target and body-part information in the premotor cortex when planning action. Nature, 408, 466-470.
27. Houk, J.C., Adams, J.L. & Barto, A.G. (1995) A model of how the basal ganglia generate and use neural signals that predict reinforcement. In Houk, J.C., Davis, J.L. & Beiser, D.G. (eds), Models of Information Processing in the Basal Ganglia. The MIT Press, Cambridge, pp. 249-270.
28. Inokawa, H., Yamada, H., Matsumoto, N., Muranishi, M. & Kimura, M. (2010) Juxtacellular labeling of tonically active neurons and phasically active neurons in the rat striatum. Neuroscience, 168, 395-404.
29. Ito, M. & Doya, K. (2009) Validation of decision-making models and analysis of decision variables in the rat basal ganglia. J. Neurosci., 29, 9861-9874.
30. Johnston, K., Levin, H.M., Koval, M.J. & Everling, S. (2007) Top-down control-signal dynamics in anterior cingulate and prefrontal cortex neurons following task switching. Neuron, 53, 453-462.
31. Kakei, S., Hoffman, D.S. & Strick, P.L. (2001) Direction of action is represented in the ventral premotor cortex. Nat. Neurosci., 4, 1020-1025.
32. Kawagoe, R., Takikawa, Y. & Hikosaka, O. (1998) Expectation of reward modulates cognitive signals in the basal ganglia. Nat. Neurosci., 1, 411-416.
33. Kennerley, S.W., Walton, M.E., Behrens, T.E., Buckley, M.J. & Rushworth, M.F. (2006) Optimal decision making and the anterior cingulate cortex. Nat. Neurosci., 9, 940-947.
34. Kim, H., Sul, J.H., Huh, N., Lee, D. & Jung, M.W. (2009) Role of striatum in updating values of chosen actions. J. Neurosci., 29, 14701-14712.
35. Kimura, M., Rajkowski, J. & Evarts, E. (1984) Tonically discharging putamen neurons exhibit set-dependent responses. Proc. Natl. Acad. Sci. U S A, 81, 4998-5001.
36. Kimura, M., Kato, M. & Shimazaki, H. (1990) Physiological properties of projection neurons in the monkey striatum to the globus pallidus. Exp. Brain Res., 82, 672-676.
37. Kojima, T., Onoe, H., Hikosaka, K., Tsutsui, K., Tsukada, H. & Watanabe, M. (2009) Default mode of brain activity demonstrated by positron emission tomography imaging in awake monkeys: higher rest-related than working memory-related activity in medial cortical areas. J. Neurosci., 29, 14463-14471.
38. Kurata, K. (2010) Conditional selection of contra- and ipsilateral forelimb movements by the dorsal premotor cortex in monkeys. J. Neurophysiol., 103, 262-277.
39. Kusama, T. & Mabuchi, M. (1970) Stereotaxic Atlas of the Brain of Macaca Fuscata. University of Tokyo Press and University Park Press, Tokyo, Baltimore and Manchester.
40. Lau, B. & Glimcher, P.W. (2007) Action and outcome encoding in the primate caudate nucleus. J. Neurosci., 27, 14502-14514.
41. Lau, B. & Glimcher, P.W. (2008) Value representations in the primate caudate nucleus during matching behavior. Neuron, 58, 451-463.
42. Lauwereyns, J., Watanabe, K., Coe, B. & Hikosaka, O. (2002) A neural correlate of response bias in monkey caudate nucleus. Nature, 418, 413-417.
43. Matsumoto, M. & Hikosaka, O. (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature, 459, 837-841.
44. Matsumoto, M., Matsumoto, K., Abe, H. & Tanaka, K. (2007) Medial prefrontal cell activity signaling prediction errors of action values. Nat. Neurosci., 10, 647-656.
45. McDonald, R.J. & White, N.M. (1993) A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. Behav. Neurosci., 107, 3-22.
46. Middleton, F.A. & Strick, P.L. (2002) Basal-ganglia 'projections' to the prefrontal cortex of the primate. Cereb. Cortex, 12, 926-935.
47. Monchi, O., Petrides, M., Petre, V., Worsley, K. & Dagher, A. (2001) Wisconsin Card Sorting revisited: distinct neural circuits participating in different stages of the task identified by event-related functional magnetic resonance imaging. J. Neurosci., 21, 7733-7741.
48. Montague, P.R., Dayan, P. & Sejnowski, T.J. (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci., 16, 1936-1947.
49. Morris, G., Arkadir, D., Nevet, A., Vaadia, E. & Bergman, H. (2004) Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron, 43, 133-143.
50. Morris, G., Nevet, A., Arkadir, D., Vaadia, E. & Bergman, H. (2006) Midbrain dopamine neurons encode decisions for future action. Nat. Neurosci., 9, 1057-1063.
51. Muranishi, M., Inokawa, H., Yamada, H., Ueda, Y., Matsumoto, N., Nakagawa, M. & Kimura, M. (2011) Inactivation of the putamen selectively impairs reward history-based action selection. Exp. Brain Res., 209, 235-246.
52. Mushiake, H., Saito, N., Sakamoto, K., Itoyama, Y. & Tanji, J. (2006) Activity in the lateral prefrontal cortex reflects multiple steps of future events in action plans. Neuron, 50, 631-641.
53. Nakamura, K. & Hikosaka, O. (2006a) Facilitation of saccadic eye movements by postsaccadic electrical stimulation in the primate caudate. J. Neurosci., 26, 12885-12895.
54. Nakamura, K. & Hikosaka, O. (2006b) Role of dopamine in the primate caudate nucleus in reward modulation of saccades. J. Neurosci., 26, 5360-5369.
55. Padoa-Schioppa, C. & Assad, J.A. (2006) Neurons in the orbitofrontal cortex encode economic value. Nature, 441, 223-226.
56. Pasquereau, B., Nadjar, A., Arkadir, D., Bezard, E., Goillandeau, M., Bioulac, B., Gross, C.E. & Boraud, T. (2007) Shaping of motor responses by incentive values through the basal ganglia. J. Neurosci., 27, 1176-1183.
57. Pasupathy, A. & Miller, E.K. (2005) Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature, 433, 873-876.
58. Pearce, J.M. & Hall, G. (1980) A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev., 87, 532-552.
59. Platt, M.L. & Glimcher, P.W. (1999) Neural correlates of decision variables in parietal cortex. Nature, 400, 233-238.
60. Procyk, E. & Goldman-Rakic, P.S. (2006) Modulation of dorsolateral prefrontal delay activity during self-organized behavior. J. Neurosci., 26, 11313-11323.
61. Quilodran, R., Rothe, M. & Procyk, E. (2008) Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron, 57, 314-325.
62. Rescorla, R.A. & Wagner, A.R. (1972) Current research and theory. In Black, A.H. & Prokasy, W.F. (eds), Classical Conditioning II. Appleton Century Crofts, New York, pp. 64-99.
63. Reynolds, J.N., Hyland, B.I. & Wickens, J.R. (2001) A cellular mechanism of reward-related learning. Nature, 413, 67-70.
64. Samejima, K., Ueda, Y., Doya, K. & Kimura, M. (2005) Representation of action-specific reward values in the striatum. Science, 310, 1337-1340.
65. Satoh, T., Nakai, S., Sato, T. & Kimura, M. (2003) Correlated coding of motivation and outcome of decision by dopamine neurons. J. Neurosci., 23, 9913-9923.
66. Schultz, W. (1998) Predictive reward signal of dopamine neurons. J. Neurophysiol., 80, 1-27.
67. Schultz, W., Dayan, P. & Montague, P.R. (1997) A neural substrate of prediction and reward. Science, 275, 1593-1599.
68. Seo, H. & Lee, D. (2007) Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J. Neurosci., 27, 8366-8377.
69. Shen, W., Flajolet, M., Greengard, P. & Surmeier, D.J. (2008) Dichotomous dopaminergic control of striatal synaptic plasticity. Science, 321, 848-851.
70. Spraker, M.B., Yu, H., Corcos, D.M. & Vaillancourt, D.E. (2007) Role of individual Basal Ganglia nuclei in force amplitude generation. J. Neurophysiol., 98, 821-834.
71. Sugrue, L.P., Corrado, G.S. & Newsome, W.T. (2004) Matching behavior and the representation of value in the parietal cortex. Science, 304, 1782-1787.
72. Sutton, R.S. & Barto, A.G. (1998) Reinforcement Learning. The MIT press, Cambridge.
73. Thorndike, E. (1898) Some experiments on animal intelligence. Science, 7, 818-824.
74. Tsujimoto, S., Genovesio, A. & Wise, S.P. (2010) Evaluating self-generated decisions in frontal pole cortex of monkeys. Nat. Neurosci., 13, 120-126.
75. Wallis, J.D., Anderson, K.C. & Miller, E.K. (2001) Single neurons in prefrontal cortex encode abstract rules. Nature, 411, 953-956.
76. Williams, Z.M. & Eskandar, E.N. (2006) Selective enhancement of associative learning by microstimulation of the anterior caudate. Nat. Neurosci., 9, 562-568.
77. Wise, S.P. (1985) The primate premotor cortex: past, present, and preparatory. Annu. Rev. Neurosci., 8, 1-19.