Learning Substrates in the Primate Prefrontal Cortex and Striatum: Sustained Activity Related to Successful Actions

Neuron

Volumn 63, Issue 2, 2009, Pages 244-253

  Histed, Mark H ^a   Pasupathy, Anitha ^a   Miller, Earl K ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

SYSNEURO

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; BRAIN NERVE CELL; CONTROLLED STUDY; CORPUS STRIATUM; NONHUMAN; PREFRONTAL CORTEX; PRIMATE; PRIORITY JOURNAL; REWARD; STATE DEPENDENT LEARNING; STIMULUS RESPONSE; VISUAL STIMULATION;

ANALYSIS OF VARIANCE; ANIMALS; CHOICE BEHAVIOR; CUES; DISCRIMINATION LEARNING; NEOSTRIATUM; NEURONS; PREFRONTAL CORTEX; PRIMATES; PSYCHOMOTOR PERFORMANCE; REACTION TIME;

EID: 67650881941     PISSN: 08966273     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuron.2009.06.019     Document Type: Article

References (67)

1. Alexander G.E., DeLong M.R., and Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 9 (1986) 357-381
2. Alexander G.E., Crutcher M.D., and DeLong M.R. Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. Prog. Brain Res. 85 (1990) 119-146
3. Anden N.E., Hfuxe K., Hamberger B., and Hokfelt T. A quantitative study on the nigro-neostriatal dopamine neuron system in the rat. Acta Physiol. Scand. 67 (1966) 306-312
4. Apicella P., Ljungberg T., Scarnati E., and Schultz W. Responses to reward in monkey dorsal and ventral striatum. Exp. Brain Res. 85 (1991) 491-500
5. Asaad W.F., Rainer G., and Miller E.K. Neural activity in the primate prefrontal cortex during associative learning. Neuron 21 (1998) 1399-1407
6. Barnes T.D., Kubota Y., Hu D., Jin D.Z., and Graybiel A.M. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437 (2005) 1158-1161
7. Barraclough D.J., Conroy M.L., and Lee D. Prefrontal cortex and decision making in a mixed-strategy game. Nat. Neurosci. 7 (2004) 404-410
8. Berger B., Trottier S., Verney C., Gaspar P., and Alvarez C. Regional and laminar distribution of the dopamine and serotonin innervation in the macaque cerebral cortex: a radioautographic study. J. Comp. Neurol. 273 (1988) 99-119
9. Bruce C.J., and Goldberg M.E. Primate frontal eye fields. I. Single neurons discharging before saccades. J. Neurophysiol. 53 (1985) 603-635
10. Chen L.L., and Wise S.P. Supplementary eye field contrasted with the frontal eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73 (1995) 1122-1134
11. Dayan P., and Abbott L.F. Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems (2001), MIT Press, Cambridge, MA
12. Doya K. Modulators of decision making. Nat. Neurosci. 11 (2008) 410-416
13. Drew P.J., and Abbott L.F. Extending the effects of spike-timing-dependent plasticity to behavioral timescales. Proc. Natl. Acad. Sci. USA 103 (2006) 8876-8881
14. Fellows L.K., and Farah M.J. Different underlying impairments in decision-making following ventromedial and dorsolateral frontal lobe damage in humans. Cereb. Cortex 15 (2005) 58-63
15. Frey U., Frey S., Schollmeier F., and Krug M. Influence of actinomycin D, a RNA synthesis inhibitor, on long-term potentiation in rat hippocampal neurons in vivo and in vitro. J. Physiol. 490 (1996) 703-711
16. Fujii N., and Graybiel A.M. Representation of action sequence boundaries by macaque prefrontal cortical neurons. Science 301 (2003) 1246-1249
17. Funahashi S., Bruce C.J., and Goldman-Rakic P.S. Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J. Neurophysiol. 61 (1989) 331-349
18. Fusi S., Asaad W.F., Miller E.K., and Wang X.J. A neural circuit model of flexible sensorimotor mapping: learning and forgetting on multiple timescales. Neuron 54 (2007) 319-333
19. Fuster J.M. The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe. Second edition (1997), Lippincott, Williams, and Wilkens, Philadelphia, PA
20. Fuster J.M., and Alexander G.E. Neuron activity related to short-term memory. Science 173 (1971) 652-654
21. Fuster J.M., Bodner M., and Kroger J.K. Cross-modal and cross-temporal association in neurons of frontal cortex. Nature 405 (2000) 347-351
22. Gaffan D., and Harrison S. A comparison of the effects of fornix transection and sulcus principalis ablation upon spatial learning by monkeys. Behav. Brain Res. 31 (1989) 207-220
23. Ganguli S., Huh D., and Sompolinsky H. Memory traces in dynamical systems. Proc. Natl. Acad. Sci. USA 105 (2008) 18970-18975
24. Green D.M., and Swets J.A. Signal Detection Theory and Psychophysics (1966), Wiley, New York
25. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA 79 (1982) 2554-2558
26. Houk J.C., and Wise S.P. Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. Cereb. Cortex 5 (1995) 95-110
27. Ichihara-Takeda S., and Funahashi S. Reward-period activity in primate dorsolateral prefrontal and orbitofrontal neurons is affected by reward schedules. J. Cogn. Neurosci. 18 (2006) 212-226
28. Jackson A., Mavoori J., and Fetz E.E. Long-term motor cortex plasticity induced by an electronic neural implant. Nature 444 (2006) 56-60
29. Lau B., and Glimcher P.W. Action and outcome encoding in the primate caudate nucleus. J. Neurosci. 27 (2007) 14502-14514
30. Lau B., and Glimcher P.W. Value representations in the primate striatum during matching behavior. Neuron 58 (2008) 451-463
31. Ljungberg T., Apicella P., and Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. J. Neurophysiol. 67 (1992) 145-163
32. Maass W., Natschläger T., and Markram H. Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput. 14 (2002) 2531-2560
33. Middleton F.A., and Strick P.L. Basal ganglia and cerebellar loops: motor and cognitive circuits. Brain Res. Brain Res. Rev. 31 (2000) 236-250
34. Miyachi S., Hikosaka O., Miyashita K., Karadi Z., and Rand M.K. Differential roles of monkey striatum in learning of sequential hand movement. Exp. Brain Res. 115 (1997) 1-5
35. Montague P.R., and Berns G.S. Neural economics and the biological substrates of valuation. Neuron 36 (2002) 265-284
36. Murray E.A., Bussey T.J., and Wise S.P. Role of prefrontal cortex in a network for arbitrary visuomotor mapping. Exp. Brain Res. 133 (2000) 114-129
37. Nakamura K., and Hikosaka O. Facilitation of saccadic eye movements by postsaccadic electrical stimulation in the primate caudate. J. Neurosci. 26 (2006) 12885-12895
38. Nakamura K., and Hikosaka O. Role of dopamine in the primate caudate nucleus in reward modulation of saccades. J. Neurosci. 26 (2006) 5360-5369
39. Narayanan N.S., and Laubach M. Neuronal correlates of post-error slowing in the rat dorsomedial prefrontal cortex. J. Neurophysiol. 100 (2008) 520-525
40. Otani S., Auclair N., Desce J.M., Roisin M.P., and Crépel F. Dopamine receptors and groups I and II mGluRs cooperate for long-term depression induction in rat prefrontal cortex through converging postsynaptic activation of MAP kinases. J. Neurosci. 19 (1999) 9788-9802
41. Passingham R.E. The Frontal Lobes and Voluntary Action (1995), Oxford University Press, Oxford
42. Pasupathy A., and Miller E.K. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433 (2005) 873-876
43. Pavlov I.P. Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex (1927), Oxford University Press, London
44. Petrides M. Deficits on conditional associative-learning tasks after frontal- and temporal-lobe lesions in man. Neuropsychologia 23 (1985) 601-614
45. Petrides M. Frontal lobes and behaviour. Curr. Opin. Neurobiol. 4 (1994) 207-211
46. Petrides M., and Pandya D.N. Efferent association pathways originating in the caudal prefrontal cortex in the macaque monkey. J. Comp. Neurol. 498 (2006) 227-251
47. Petrides M., and Pandya D.N. Efferent association pathways from the rostral prefrontal cortex in the macaque monkey. J. Neurosci. 27 (2007) 11573-11586
48. Rangel A., Camerer C., and Montague P.R. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9 (2008) 545-556
49. Rumelhart D.E., Hinton G.E., and Williams R.J. Learning internal representations by error propagation. In: Rumelhart D.E., and McClelland J.L. (Eds). Parallel Distributed Processing: Explorations in the Microstructure of Cognition (1986), The MIT Press, Cambridge, MA 318-362
50. Rushworth M.F., and Behrens T.E. Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 11 (2008) 389-397
51. Schmitzer-Torbert N., and Redish A.D. Neuronal activity in the rodent dorsal striatum in sequential navigation: separation of spatial and reward responses on the multiple T task. J. Neurophysiol. 91 (2004) 2259-2272
52. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80 (1998) 1-27
53. Schultz W., Apicella P., and Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 13 (1993) 900-913
54. Schultz W., Apicella P., Ljungberg T., Romo R., and Scarnati E. Reward-related activity in the monkey striatum and substantia nigra. Prog. Brain Res. 99 (1993) 227-235
55. Seo H., and Lee D. Behavioral and neural changes after gains and losses of conditioned reinforcers. J. Neurosci. 29 (2009) 3627-3641
56. Seo H., Barraclough D.J., and Lee D. Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex. Cereb. Cortex 17 Suppl 1 (2007) i110-i117
57. Sidiropoulou K., Lu F.M., Fowler M.A., Xiao R., Phillips C., Ozkan E.D., Zhu M.X., White F.J., and Cooper D.C. Dopamine modulates an mGluR5-mediated depolarization underlying prefrontal persistent activity. Nat. Neurosci. 12 (2009) 190-199
58. Sugrue L.P., Corrado G.S., and Newsome W.T. Choosing the greater of two goods: neural currencies for valuation and decision making. Nat. Rev. Neurosci. 6 (2005) 363-375
59. Thomson A.M., and Deuchars J. Temporal and spatial properties of local circuits in neocortex. Trends Neurosci. 17 (1994) 119-126
60. Tsodyks M.V., and Markram H. The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. Proc. Natl. Acad. Sci. USA 94 (1997) 719-723
61. Uchida Y., Lu X., Ohmae S., Takahashi T., and Kitazawa S. Neuronal activity related to reward size and rewarded target position in primate supplementary eye field. J. Neurosci. 27 (2007) 13750-13755
62. Wallis J.D., Anderson K.C., and Miller E.K. Single neurons in prefrontal cortex encode abstract rules. Nature 411 (2001) 953-956
63. Watanabe M. The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units. Neurosci. Lett. 101 (1989) 113-117
64. Williams S.M., and Goldman-Rakic P.S. Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody. Cereb. Cortex 3 (1993) 199-222
65. Williams Z.M., and Eskandar E.N. Selective enhancement of associative learning by microstimulation of the anterior caudate. Nat. Neurosci. 9 (2006) 562-568
66. Wirth S., Avsar E., Chiu C.C., Sharma V., Smith A.C., Brown E., and Suzuki W.A. Trial outcome and associative learning signals in the monkey hippocampus. Neuron 61 (2009) 930-940
67. Wise S.P., Murray E.A., and Gerfen C.R. The frontal cortex-basal ganglia system in primates. Crit. Rev. Neurobiol. 10 (1996) 317-356