Dopamine Neurons Encoding Long-Term Memory of Object Value for Habitual Behavior

Cell

Volumn 163, Issue 5, 2015, Pages 1165-1175

  Kim, Hyoung F ^a,b,c   Ghazizadeh, Ali ^a   Hikosaka, Okihide ^a,d  

^a NATIONAL EYE INSTITUTE   (United States)

^b Institute for Basic Science   (South Korea)

^c Sungkyunkwan University   (South Korea)

^d NATIONAL INSTITUTES OF HEALTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

4 AMINOBUTYRIC ACID RECEPTOR; DOPAMINE;

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; CAUDATE NUCLEUS; CONTROLLED STUDY; DOPAMINERGIC NERVE CELL; LONG TERM MEMORY; MALE; NONHUMAN; OBJECT RELATION; PRIORITY JOURNAL; REWARD; SUBSTANTIA NIGRA PARS COMPACTA; ANIMAL; BASAL GANGLION; CYTOLOGY; HABIT; METABOLISM; NERVE CELL; PHYSIOLOGY; RHESUS MONKEY; VISUAL SYSTEM FUNCTION;

ANIMALS; BASAL GANGLIA; BEHAVIOR, ANIMAL; DOPAMINE; HABITS; MACACA MULATTA; MALE; MEMORY, LONG-TERM; NEURONS; OCULAR PHYSIOLOGICAL PHENOMENA;

EID: 84947756032     PISSN: 00928674     EISSN: 10974172     Source Type: Journal    
DOI: 10.1016/j.cell.2015.10.063     Document Type: Article

References (45)

1. B.W. Balleine, and A. Dickinson Goal-directed instrumental action: contingency and incentive learning and their cortical substrates Neuropharmacology 37 1998 407 419
2. B.W. Balleine, and J.P. O'Doherty Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action Neuropsychopharmacology 35 2010 48 69
3. P.J. Bayley, J.C. Frascino, and L.R. Squire Robust habit learning in the absence of awareness and independent of the medial temporal lobe Nature 436 2005 550 553
4. F. Brischoux, S. Chakraborty, D.I. Brierley, and M.A. Ungless Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli Proc. Natl. Acad. Sci. USA 106 2009 4894 4899
5. J.Y. Cohen, S. Haesler, L. Vong, B.B. Lowell, and N. Uchida Neuron-type-specific signals for reward and punishment in the ventral tegmental area Nature 482 2012 85 88
6. E. Comoli, V. Coizet, J. Boyes, J.P. Bolam, N.S. Canteras, R.H. Quirk, P.G. Overton, and P. Redgrave A direct projection from superior colliculus to substantia nigra for detecting salient visual events Nat. Neurosci. 6 2003 974 980
7. K. D'Ardenne, S.M. McClure, L.E. Nystrom, and J.D. Cohen BOLD responses reflecting dopaminergic signals in the human ventral tegmental area Science 319 2008 1264 1267
8. J.M. Deniau, S.T. Kitai, J.P. Donoghue, and I. Grofova Neuronal interactions in the substantia nigra pars reticulata through axon collaterals of the projection neurons. An electrophysiological and morphological study Exp. Brain Res. 47 1982 105 113
9. J. Fernandez-Ruiz, J. Wang, T.G. Aigner, and M. Mishkin Visual habit formation in monkeys with neurotoxic lesions of the ventrocaudal neostriatum Proc. Natl. Acad. Sci. USA 98 2001 4196 4201
10. C.R. Gerfen The neostriatal mosaic: multiple levels of compartmental organization Trends Neurosci. 15 1992 133 139
11. M.E. Goldberg, and R.H. Wurtz Activity of superior colliculus in behaving monkey. I. Visual receptive fields of single neurons J. Neurophysiol. 35 1972 542 559
12. R.Z. Goldstein, A.D.B. Craig, A. Bechara, H. Garavan, A.R. Childress, M.P. Paulus, and N.D. Volkow The neurocircuitry of impaired insight in drug addiction Trends Cogn. Sci. 13 2009 372 380
13. S. Goto, A. Hirano, and S. Matsumoto Subdivisional involvement of nigrostriatal loop in idiopathic Parkinson's disease and striatonigral degeneration Ann. Neurol. 26 1989 766 770
14. A.A. Grace, and B.S. Bunney Intracellular and extracellular electrophysiology of nigral dopaminergic neurons - 1. Identification and characterization Neuroscience 10 1983 301 315
15. A.M. Graybiel Habits, rituals, and the evaluative brain Annu. Rev. Neurosci. 31 2008 359 387
16. O. Hikosaka, M. Sakamoto, and S. Usui Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward J. Neurophysiol. 61 1989 814 832
17. O. Hikosaka, M. Sakamoto, and S. Usui Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements J. Neurophysiol. 61 1989 780 798
18. O. Hikosaka, H. Nakahara, M.K. Rand, K. Sakai, X. Lu, K. Nakamura, S. Miyachi, and K. Doya Parallel neural networks for learning sequential procedures Trends Neurosci. 22 1999 464 471
19. O. Hikosaka, S. Yamamoto, M. Yasuda, and H.F. Kim Why skill matters Trends Cogn. Sci. 17 2013 434 441
20. T. Ikeda, and O. Hikosaka Reward-dependent gain and bias of visual responses in primate superior colliculus Neuron 39 2003 693 700
21. T. Ikeda, and O. Hikosaka Positive and negative modulation of motor response in primate superior colliculus by reward expectation J. Neurophysiol. 98 2007 3163 3170
22. H.F. Kim, and O. Hikosaka Distinct basal ganglia circuits controlling behaviors guided by flexible and stable values Neuron 79 2013 1001 1010
23. H.F. Kim, and O. Hikosaka Parallel basal ganglia circuits for voluntary and automatic behaviour to reach rewards Brain 138 2015 1776 1800
24. H.F. Kim, A. Ghazizadeh, and O. Hikosaka Separate groups of dopamine neurons innervate caudate head and tail encoding flexible and stable value memories Front. Neuroanat. 8 2014 120
25. S. Lehéricy, H. Benali, P.F. Van de Moortele, M. Pélégrini-Issac, T. Waechter, K. Ugurbil, and J. Doyon Distinct basal ganglia territories are engaged in early and advanced motor sequence learning Proc. Natl. Acad. Sci. USA 102 2005 12566 12571
26. T.N. Lerner, C. Shilyansky, T.J. Davidson, K.E. Evans, K.T. Beier, K.A. Zalocusky, A.K. Crow, R.C. Malenka, L. Luo, R. Tomer, and K. Deisseroth Intact-brain analyses reveal distinct information carried by SNc dopamine subcircuits Cell 162 2015 635 647
27. M. Matsumoto, and O. Hikosaka Two types of dopamine neuron distinctly convey positive and negative motivational signals Nature 459 2009 837 841
28. T.D. Moody, G.Y. Chang, Z.F. Vanek, and B.J. Knowlton Concurrent discrimination learning in Parkinson's disease Behav. Neurosci. 124 2010 1 8
29. P. Redgrave, M. Rodriguez, Y. Smith, M.C. Rodriguez-Oroz, S. Lehericy, H. Bergman, Y. Agid, M.R. DeLong, and J.A. Obeso Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease Nat. Rev. Neurosci. 11 2010 760 772
30. E.K. Richfield, A.B. Young, and J.B. Penney Comparative distribution of dopamine D-1 and D-2 receptors in the basal ganglia of turtles, pigeons, rats, cats, and monkeys J. Comp. Neurol. 262 1987 446 463
31. W. Schultz Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey J. Neurophysiol. 56 1986 1439 1461
32. W. Schultz Predictive reward signal of dopamine neurons J. Neurophysiol. 80 1998 1 27
33. W. Schultz, P. Dayan, and P.R. Montague A neural substrate of prediction and reward Science 275 1997 1593 1599
34. C.A. Seger, and B.J. Spiering A critical review of habit learning and the Basal Ganglia Front. Syst. Neurosci. 5 2011 66
35. D.J. Surmeier, J. Ding, M. Day, Z. Wang, and W. Shen D1 and D2 dopamine-receptor modulation of striatal glutamatergic signaling in striatal medium spiny neurons Trends Neurosci. 30 2007 228 235
36. R.S. Sutton Learning to predict by the methods of temporal differences Mach. Learn. 3 1988 9 44
37. J.R. Taylor, and T.W. Robbins 6-Hydroxydopamine lesions of the nucleus accumbens, but not of the caudate nucleus, attenuate enhanced responding with reward-related stimuli produced by intra-accumbens d-amphetamine Psychopharmacology (Berl.) 90 1986 390 397
38. J.M. Tepper, L.P. Martin, and D.R. Anderson GABAA receptor-mediated inhibition of rat substantia nigra dopaminergic neurons by pars reticulata projection neurons J. Neurosci. 15 1995 3092 3103
39. P.N. Tobler, C.D. Fiorillo, and W. Schultz Adaptive coding of reward value by dopamine neurons Science 307 2005 1642 1645
40. A.R. West, and A.A. Grace Opposite influences of endogenous dopamine D1 and D2 receptor activation on activity states and electrophysiological properties of striatal neurons: studies combining in vivo intracellular recordings and reverse microdialysis J. Neurosci. 22 2002 294 304
41. S. Yamamoto, I.E. Monosov, M. Yasuda, and O. Hikosaka What and where information in the caudate tail guides saccades to visual objects J. Neurosci. 32 2012 11005 11016
42. S. Yamamoto, H.F. Kim, and O. Hikosaka Reward value-contingent changes of visual responses in the primate caudate tail associated with a visuomotor skill J. Neurosci. 33 2013 11227 11238
43. M. Yasuda, and O. Hikosaka Functional territories in primate substantia nigra pars reticulata separately signaling stable and flexible values J. Neurophysiol. 113 2015 1681 1696
44. M. Yasuda, S. Yamamoto, and O. Hikosaka Robust representation of stable object values in the oculomotor Basal Ganglia J. Neurosci. 32 2012 16917 16932
45. H.H. Yin, and B.J. Knowlton The role of the basal ganglia in habit formation Nat. Rev. Neurosci. 7 2006 464 476