Signals for previous goal choice persist in the dorsomedial, but not dorsolateral striatum of rats

Journal of Neuroscience

Volumn 33, Issue 1, 2013, Pages 52-63

  Kim, Hoseok ^a   Lee, Daeyeol ^b   Jung, Min Whan ^a  

^a Ajou University School of Medicine   (South Korea)

^b YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION CORTEX; BEHAVIOR; DECISION MAKING; GOAL ATTAINMENT; LATENT PERIOD; LEARNING; MALE; NONHUMAN; PRIORITY JOURNAL; RAT; REINFORCEMENT; SENSORIMOTOR CORTEX; SINGLE UNIT ACTIVITY; SPIKE WAVE; TASK PERFORMANCE;

EID: 84871808197     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2422-12.2013     Document Type: Article

References (47)

1. Alexander GE, Crutcher MD (1990) Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci 13:266-271. CrossRef Medline
2. Alexander GE, DeLong MR, Strick PL (1986) Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9:357-381. CrossRef Medline
3. Alexander GE, Crutcher MD, DeLong MR (1990) Basal gangliathalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. Prog Brain Res 85:119-146. Medline
4. Baeg EH, Kim YB, Jang J, Kim HT, Mook-Jung I, Jung MW (2001) Fast spiking and regular spiking neural correlates of fear conditioning in the medial prefrontal cortex of the rat. Cereb Cortex 11:441-451. CrossRef Medline
5. Baeg EH, Kim YB, Huh K, Mook-Jung I, Kim HT, Jung MW (2003) Dynamics of population code for working memory in the prefrontal cortex. Neuron 40:177-188. CrossRef Medline
6. Baeg EH, Kim YB, Kim J, Ghim JW, Kim JJ, Jung MW (2007) Learninginduced enduring changes in functional connectivity among prefrontal cortical neurons. J Neurosci 27:909-918. CrossRef Medline
7. Balleine BW, Delgado MR, Hikosaka O (2007) The role of the dorsal striatum in reward and decision-making. J Neurosci 27:8161-8165. CrossRef Medline
8. Balleine BW, Liljeholm M, Ostlund SB (2009) The integrative function of the basal ganglia in instrumental conditioning. Behav Brain Res 199:43-52. CrossRef Medline
9. Barraclough DJ, Conroy ML, Lee D (2004) Prefrontal cortex and decision making in a mixed-strategy game. Nat Neurosci 7:404-410. CrossRef Medline
10. Bornstein AM, Daw ND (2011) Multiplicity of control in the basal ganglia: computational roles of striatal subregions. Curr Opin Neurobiol 21:374-380. CrossRef Medline
11. Burnham KP, Anderson DR (2002) Model selection and multimodel inference: a practical information-theoretic approach, Ed 2. New York: Springer.
12. Carr MF, Jadhav SP, Frank LM (2011) Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval. Nat Neurosci 14:147-153. CrossRef Medline
13. Cassenaer S, Laurent G (2012) Conditional modulation of spike-timingdependent plasticity for olfactory learning. Nature 482:47-52. CrossRef Medline
14. Curtis CE, Lee D (2010) Beyond working memory: the role of persistent activity in decision making. Trends Cogn Sci 14:216-222. CrossRef Medline
15. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ (2011) Model-based influences on humans' choices and striatal prediction errors. Neuron 69:1204-1215. CrossRef Medline
16. Devan BD, Hong NS, McDonald RJ (2011) Parallel associative processing in the dorsal striatum: segregation of stimulus-response and cognitive control subregions. Neurobiol Learn Mem 96:95-120. CrossRef Medline
17. Genovesio A, Brasted PJ, Wise SP (2006) Representation of future and previous spatial goals by separate neural populations in prefrontal cortex. J Neurosci 26:7305-7316. CrossRef Medline
18. Haber SN, Knutson B (2010) The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35:4-26. CrossRef Medline
19. Harvey CD, Coen P, Tank DW (2012) Choice-specific sequences in parietal cortex during a virtual-navigation decision task. Nature 484:62-68. CrossRef Medline
20. Huh N, Jo S, Kim H, Sul JH, Jung MW (2009) Model-based reinforcement learning under concurrent schedules of reinforcement in rodents. Learn Mem 16:315-323. CrossRef Medline
21. Ito M, Doya K (2011) Multiple representations and algorithms for reinforcement learning in the cortico-basal ganglia circuit. Curr Opin Neurobiol 21:368-373. CrossRef Medline
22. Kim H, Sul JH, Huh N, Lee D, Jung MW (2009) Role of striatum in updating values of chosen actions. J Neurosci 29:14701-14712. CrossRef Medline
23. Kim YB, Huh N, Lee H, Baeg EH, Lee D, Jung MW (2007) Encoding of action history in the rat ventral striatum. J Neurophysiol 98:3548-3556. CrossRef Medline
24. Kimchi EY, Torregrossa MM, Taylor JR, Laubach M (2009) Neuronal correlates of instrumental learning in the dorsal striatum. J Neurophysiol 102:475-489. CrossRef Medline
25. Lau B, Glimcher PW (2005) Dynamic response-by-response models of matching behavior in rhesus monkeys. J Exp Anal Behav 84:555-579. CrossRef Medline
26. Lee D, Seo H, Jung MW (2012) Neural basis of reinforcement learning and decision making. Annu Rev Neurosci 35:287-308. CrossRef Medline
27. Miyachi S, Hikosaka O, Miyashita K, Kárádi Z, Rand MK (1997) Differential roles of monkey striatum in learning of sequential hand movement. Exp Brain Res 115:1-5. CrossRef Medline
28. Miyachi S, Hikosaka O, Lu X (2002) Differential activation of monkey striatal neurons in the early and late stages of procedural learning. Exp Brain Res 146:122-126. CrossRef Medline
29. Pawlak V, Wickens JR, Kirkwood A, Kerr JN (2010) Timing is not everything: neuromodulation opens the STDP gate. Front Synaptic Neurosci 2:146. Medline
30. Paxinos G, Watson C (1998) The rat brain in stereotaxic coordinates, Ed 4. San Diego: Academic.
31. Redgrave P, Rodriguez M, Smith Y, Rodriguez-Oroz MC, Lehericy S, Bergman H, Agid Y, DeLong MR, Obeso JA (2010) Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease. Nat Rev Neurosci 11:760-772. CrossRef Medline
32. Schmitzer-Torbert N, Jackson J, Henze D, Harris K, Redish AD (2005) Quantitative measures of cluster quality for use in extracellular recordings. Neuroscience 131:1-11. CrossRef Medline
33. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599. CrossRef Medline
34. Seo H, Lee D (2009) Behavioral and neural changes after gains and losses of conditioned reinforcers. J Neurosci 29:3627-3641. CrossRef Medline
35. Seo H, Barraclough DJ, Lee D (2009) Lateral intraparietal cortex and reinforcement learning during a mixed-strategy game. J Neurosci 29: 7278-7289. CrossRef Medline
36. Simon DA, Daw ND (2011) Neural correlates of forward planning in a spatial decision task in humans. J Neurosci 31:5526-5539. CrossRef Medline
37. Stalnaker TA, Calhoon GG, Ogawa M, Roesch MR, Schoenbaum G (2010) Neural correlates of stimulus-response and response-outcome associations in dorsolateral versus dorsomedial striatum. Front Integr Neurosci 4:12. Medline
38. Sul JH, Kim H, Huh N, Lee D, Jung MW (2010) Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 66:449-460. CrossRef Medline
39. Sul JH, Jo S, Lee D, Jung MW (2011) Role of rodent secondary motor cortex in value-based action selection. Nat Neurosci 14:1202-1208. CrossRef Medline
40. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. Cambridge MA: MIT.
41. Thorn CA, Atallah H, Howe M, Graybiel AM (2010) Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron 66:781-795. CrossRef Medline
42. Thorndike EL (1933) A proof of the law of effect. Science 77:173-175. CrossRef Medline
43. Voorn P, Vanderschuren LJ, Groenewegen HJ, Robbins TW, Pennartz CM (2004) Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci 27:468-474. CrossRef Medline
44. Walton ME, Behrens TE, Buckley MJ, Rudebeck PH, Rushworth MF (2010) Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65:927-939. CrossRef Medline
45. White NM (2009) Some highlights of research on the effects of caudate nucleus lesions over the past 200 years. Behav Brain Res 199:3-23. CrossRef Medline
46. Yin HH, Knowlton BJ (2006) The role of the basal ganglia in habit formation. Nat Rev Neurosci 7:464-476. CrossRef Medline
47. Yin HH, Mulcare SP, Hilário MR, Clouse E, Holloway T, Davis MI, Hansson AC, Lovinger DM, Costa RM (2009) Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat Neurosci 12:333-341. CrossRef Medline