Distinct Basal Ganglia Circuits Controlling Behaviors Guided by Flexible and Stable Values

Neuron

Volumn 79, Issue 5, 2013, Pages 1001-1010

  Kim, HyoungF ^a   Hikosaka, Okihide ^a  

^a NATIONAL EYE INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION; ADULT ANIMAL; ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; BASAL GANGLION; BEHAVIOR CONTROL; BRAIN NERVE CELL; CAUDATE NUCLEUS; CONTROLLED STUDY; EXPERIENCE; EYE FIXATION; GAZE; LEARNING; MALE; NERVE CELL NETWORK; NONHUMAN; PRIMATE; PRIORITY JOURNAL; RHESUS MONKEY; VISION;

ACTION POTENTIALS; ANIMALS; BEHAVIOR, ANIMAL; CAUDATE NUCLEUS; DISCRIMINATION (PSYCHOLOGY); MACACA MULATTA; MALE; NEURONS; REWARD; SACCADES;

EID: 84884204069     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2013.06.044     Document Type: Article

References (54)

1. Abraham W.C., Robins A. Memory retention-the synaptic stability versus plasticity dilemma. Trends Neurosci. 2005, 28:73-78.
2. Alexander G.E., DeLong M.R., Strick P.L. Parallel organization offunctionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 1986, 9:357-381.
3. Anderson P. Flexibility and stability in the innovating economy. Adm. Sci. Q. 2007, 52:333-335.
4. Ashby F.G., Maddox W.T. Human category learning. Annu. Rev. Psychol. 2005, 56:149-178.
5. Ashby F.G., Turner B.O., Horvitz J.C. Cortical and basal ganglia contributions to habit learning and automaticity. Trends Cogn. Sci. 2010, 14:208-215.
6. Awh E., Belopolsky A.V., Theeuwes J. Top-down versus bottom-up attentional control: a failed theoretical dichotomy. Trends Cogn. Sci. 2012, 16:437-443.
7. Balleine B.W., Dickinson A. Goal-directed instrumental action:contingency and incentive learning and their cortical substrates. Neuropharmacology 1998, 37:407-419.
8. Balleine B.W., O'Doherty J.P. Human and rodent homologies inaction control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 2010, 35:48-69.
9. Barto A.G. Reinforcement learning control. Curr. Opin. Neurobiol. 1994, 4:888-893.
10. Brown R.G., Marsden C.D. Cognitive function in Parkinson's disease: from description to theory. Trends Neurosci. 1990, 13:21-29.
11. Brown V.J., Desimone R., Mishkin M. Responses of cells in thetail of the caudate nucleus during visual discrimination learning. J.Neurophysiol. 1995, 74:1083-1094.
12. Caan W., Perrett D.I., Rolls E.T. Responses of striatal neurons in the behaving monkey. 2. Visual processing in the caudal neostriatum. Brain Res. 1984, 290:53-65.
13. Chelazzi L., Perlato A., Santandrea E., Della Libera C. Rewards teach visual selective attention. Vision Res. 2013, 85:58-72.
14. Cools A.R., van den Bercken J.H., Horstink M.W., van Spaendonck K.P., Berger H.J. Cognitive and motor shifting aptitude disorder in Parkinson's disease. J.Neurol. Neurosurg. Psychiatry 1984, 47:443-453.
15. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 2006, 441:876-879.
16. Dayan P., Balleine B.W. Reward, motivation, and reinforcement learning. Neuron 2002, 36:285-298.
17. Evans J.S. Dual-processing accounts of reasoning, judgment, and social cognition. Annu. Rev. Psychol. 2008, 59:255-278.
18. Fernandez-Ruiz J., Wang J., Aigner T.G., Mishkin M. Visual habit formation in monkeys with neurotoxic lesions of the ventrocaudal neostriatum. Proc. Natl. Acad. Sci. USA 2001, 98:4196-4201.
19. Gottlieb J. Attention, learning, and the value of information. Neuron 2012, 76:281-295.
20. Graybiel A.M. Habits, rituals, and the evaluative brain. Annu. Rev. Neurosci. 2008, 31:359-387.
21. Hikosaka O., Wurtz R.H. Modification of saccadic eye movements by GABA-related substances. I. Effect of muscimol and bicuculline in monkey superior colliculus. J.Neurophysiol. 1985, 53:266-291.
22. Hikosaka O., Nakahara H., Rand M.K., Sakai K., Lu X., Nakamura K., Miyachi S., Doya K. Parallel neural networks for learning sequential procedures. Trends Neurosci. 1999, 22:464-471.
23. Hikosaka O., Takikawa Y., Kawagoe R. Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol. Rev. 2000, 80:953-978.
24. Kehagia A.A., Murray G.K., Robbins T.W. Learning and cognitive flexibility: frontostriatal function and monoaminergic modulation. Curr. Opin. Neurobiol. 2010, 20:199-204.
25. Kemp J.M., Powell T.P. The cortico-striate projection in the monkey. Brain 1970, 93:525-546.
26. Kim S., Hwang J., Lee D. Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 2008, 59:161-172.
27. Kim S., Cai X., Hwang J., Lee D. Prefrontal and striatal activity related to values of objects and locations. Front Neurosci 2012, 6:108.
28. Knowlton B.J., Mangels J.A., Squire L.R. A neostriatal habit learning system in humans. Science 1996, 273:1399-1402.
29. Lawrence A.D., Sahakian B.J., Robbins T.W. Cognitive functions and corticostriatal circuits: insights from Huntington's disease. Trends Cogn. Sci. 1998, 2:379-388.
30. Lees A.J., Smith E. Cognitive deficits in the early stages of Parkinson's disease. Brain 1983, 106:257-270.
31. Liljenström H. Neural stability and flexibility: a computational approach. Neuropsychopharmacology 2003, 28(Suppl 1):S64-S73.
32. Mishkin M., Malamut B., Bachevalier J. Memories and habits: two neural systems. Neurobiology of Learning and Memory 1984, 65-77. The Guilford Press, New York.
33. Padoa-Schioppa C. Neurobiology of economic choice: a good-based model. Annu. Rev. Neurosci. 2011, 34:333-359.
34. Redgrave P., Rodriguez M., Smith Y., Rodriguez-Oroz M.C., Lehericy S., Bergman H., Agid Y., DeLong M.R., Obeso J.A. Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease. Nat. Rev. Neurosci. 2010, 11:760-772.
35. Rolls E.T. The orbitofrontal cortex and reward. Cereb. Cortex 2000, 10:284-294.
36. Rolls E.T., Thorpe S.J., Maddison S.P. Responses of striatal neurons in the behaving monkey. 1. Head of the caudate nucleus. Behav. Brain Res. 1983, 7:179-210.
37. Saint-Cyr J.A., Ungerleider L.G., Desimone R. Organization of visual cortical inputs to the striatum and subsequent outputs to the pallido-nigral complex in the monkey. J.Comp. Neurol. 1990, 298:129-156.
38. Schneider W., Shiffrin R.M. Controlled and automatic human information processing: I. Detection, search, and attention. Psychol. Rev. 1977, 84:1-66.
39. Seger C.A. How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback. Neurosci. Biobehav. Rev. 2008, 32:265-278.
40. Selemon L.D., Goldman-Rakic P.S. Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J.Neurosci. 1985, 5:776-794.
41. Shiffrin R.M., Schneider W. Controlled and automatic human information processing: II. Perceptual learning, automatic attending, and a general theory. Psychol. Rev. 1977, 84:127-189.
42. Shohamy D., Myers C.E., Onlaor S., Gluck M.A. Role of the basal ganglia in category learning: how do patients with Parkinson's disease learn?. Behav. Neurosci. 2004, 118:676-686.
43. Szabo J. Projections from the body of the caudate nucleus in the rhesus monkey. Exp. Neurol. 1970, 27:1-15.
44. Szabo J. The course and distribution of efferents from the tail of the caudate nucleus in the monkey. Exp. Neurol. 1972, 37:562-572.
45. Thorpe S.J., Rolls E.T., Maddison S. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 1983, 49:93-115.
46. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 1999, 398:704-708.
47. Vonsattel J.P., Myers R.H., Stevens T.J., Ferrante R.J., Bird E.D., Richardson E.P. Neuropathological classification of Huntington's disease. J.Neuropathol. Exp. Neurol. 1985, 44:559-577.
48. Wood W., Neal D.T. A new look at habits and the habit-goal interface. Psychol. Rev. 2007, 114:843-863.
49. Wunderlich K., Dayan P., Dolan R.J. Mapping value based planning and extensively trained choice in the human brain. Nat. Neurosci. 2012, 15:786-791.
50. Yamamoto S., Monosov I.E., Yasuda M., Hikosaka O. What and where information in the caudate tail guides saccades to visual objects. J.Neurosci. 2012, 32:11005-11016.
51. Yamamoto S., Kim H.F., Hikosaka O. Reward value-contingent changes of visual responses in the primate caudate tail associated with a visuomotor skill. J. Neurosci. 2013, 33:11227-11238.
52. Yasuda M., Yamamoto S., Hikosaka O. Robust representation ofstable object values in the oculomotor Basal Ganglia. J.Neurosci. 2012, 32:16917-16932.
53. Yeterian E.H., Van Hoesen G.W. Cortico-striate projections in the rhesus monkey: the organization of certain cortico-caudate connections. Brain Res. 1978, 139:43-63.
54. Yin H.H., Knowlton B.J. The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 2006, 7:464-476.