Dynamic Nigrostriatal Dopamine Biases Action Selection

Neuron

Volumn 93, Issue 6, 2017, Pages 1436-1450.e8

  Howard, Christopher D ^a   Li, Hao ^a   Geddes, Claire E ^a,b   Jin, Xin ^a  

^a SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

action selection; basal ganglia; conditional knockout; direct and indirect pathway; dopamine; electrophysiology; fast scan cyclic voltammetry; network model; optogenetics; striatum

Indexed keywords

DOPAMINE; N METHYL DEXTRO ASPARTIC ACID RECEPTOR;

ACTION SELECTION; ANIMAL EXPERIMENT; ARTICLE; BASAL GANGLION; BEHAVIOR CHANGE; CONTROLLED STUDY; CYCLIC POTENTIOMETRY; DECISION MAKING; DELAY DISCOUNTING; DOPAMINE BRAIN LEVEL; DOPAMINE RELEASE; DOPAMINERGIC NERVE CELL; DORSAL STRIATUM; FEMALE; FIRING RATE; MALE; MOUSE; NEUROMODULATION; NIGRONEOSTRIATAL SYSTEM; NONHUMAN; OPTOGENETICS; REWARD; SIGNAL TRANSDUCTION; ANIMAL; CORPUS STRIATUM; GENETICS; INSTRUMENTAL CONDITIONING; KNOCKOUT MOUSE; METABOLISM; NERVE TRACT; PHYSIOLOGY; SUBSTANTIA NIGRA; TRANSGENIC MOUSE;

ANIMALS; CONDITIONING, OPERANT; CORPUS STRIATUM; DOPAMINE; DOPAMINERGIC NEURONS; FEMALE; MALE; MICE; MICE, KNOCKOUT; MICE, TRANSGENIC; NEURAL PATHWAYS; RECEPTORS, N-METHYL-D-ASPARTATE; REWARD; SUBSTANTIA NIGRA;

EID: 85014697534     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2017.02.029     Document Type: Article

References (69)

1. Barter, J.W., Li, S., Lu, D., Bartholomew, R.A., Rossi, M.A., Shoemaker, C.T., Salas-Meza, D., Gaidis, E., Yin, H.H., Beyond reward prediction errors: the role of dopamine in movement kinematics. Front. Integr. Nuerosci., 9, 2015, 39.
2. Berridge, K.C., Robinson, T.E., What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res. Brain Res. Rev. 28 (1998), 309–369.
3. Bonci, A., Malenka, R.C., Properties and plasticity of excitatory synapses on dopaminergic and GABAergic cells in the ventral tegmental area. J. Neurosci. 19 (1999), 3723–3730.
4. Bromberg-Martin, E.S., Matsumoto, M., Hikosaka, O., Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68 (2010), 815–834.
5. Brunton, B.W., Botvinick, M.M., Brody, C.D., Rats and humans can optimally accumulate evidence for decision-making. Science 340 (2013), 95–98.
6. Bucher, E.S., Wightman, R.M., Electrochemical analysis of neurotransmitters. Annu. Rev. Anal. Chem. (Palo Alto, Calif.) 8 (2015), 239–261.
7. Bucher, E.S., Brooks, K., Verber, M.D., Keithley, R.B., Owesson-White, C., Carroll, S., Takmakov, P., McKinney, C.J., Wightman, R.M., Flexible software platform for fast-scan cyclic voltammetry data acquisition and analysis. Anal. Chem. 85 (2013), 10344–10353.
8. Buhusi, C.V., Meck, W.H., What makes us tick? Functional and neural mechanisms of interval timing. Nat. Rev. Neurosci. 6 (2005), 755–765.
9. Cachope, R., Mateo, Y., Mathur, B.N., Irving, J., Wang, H.L., Morales, M., Lovinger, D.M., Cheer, J.F., Selective activation of cholinergic interneurons enhances accumbal phasic dopamine release: setting the tone for reward processing. Cell Rep. 2 (2012), 33–41.
10. Calabresi, P., Pisani, A., Mercuri, N.B., Bernardi, G., Long-term potentiation in the striatum is unmasked by removing the voltage-dependent magnesium block of NMDA receptor channels. Eur. J. Neurosci. 4 (1992), 929–935.
11. Chow, B.Y., Han, X., Dobry, A.S., Qian, X., Chuong, A.S., Li, M., Henninger, M.A., Belfort, G.M., Lin, Y., Monahan, P.E., Boyden, E.S., High-performance genetically targetable optical neural silencing by light-driven proton pumps. Nature 463 (2010), 98–102.
12. Church, R.M., Deluty, M.Z., Bisection of temporal intervals. J. Exp. Psychol. Anim. Behav. Process. 3 (1977), 216–228.
13. Clark, J.J., Sandberg, S.G., Wanat, M.J., Gan, J.O., Horne, E.A., Hart, A.S., Akers, C.A., Parker, J.G., Willuhn, I., Martinez, V., et al. Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals. Nat. Methods 7 (2010), 126–129.
14. Cohen, J.Y., Haesler, S., Vong, L., Lowell, B.B., Uchida, N., Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482 (2012), 85–88.
15. Dang, M.T., Yokoi, F., Yin, H.H., Lovinger, D.M., Wang, Y., Li, Y., Disrupted motor learning and long-term synaptic plasticity in mice lacking NMDAR1 in the striatum. Proc. Natl. Acad. Sci. USA 103 (2006), 15254–15259.
16. Ding, L., Gold, J.I., Separate, causal roles of the caudate in saccadic choice and execution in a perceptual decision task. Neuron 75 (2012), 865–874.
17. Engblom, D., Bilbao, A., Sanchis-Segura, C., Dahan, L., Perreau-Lenz, S., Balland, B., Parkitna, J.R., Luján, R., Halbout, B., Mameli, M., et al. Glutamate receptors on dopamine neurons control the persistence of cocaine seeking. Neuron 59 (2008), 497–508.
18. Everitt, B.J., Robbins, T.W., Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 8 (2005), 1481–1489.
19. Gallistel, C.R., The Organization of Learning. 1990, MIT Press.
20. Gerfen, C.R., Surmeier, D.J., Modulation of striatal projection systems by dopamine. Annu. Rev. Neurosci. 34 (2011), 441–466.
21. Graybiel, A.M., The basal ganglia and chunking of action repertoires. Neurobiol. Learn. Mem. 70 (1998), 119–136.
22. Graybiel, A.M., Rauch, S.L., Toward a neurobiology of obsessive-compulsive disorder. Neuron 28 (2000), 343–347.
23. Hamid, A.A., Pettibone, J.R., Mabrouk, O.S., Hetrick, V.L., Schmidt, R., Vander Weele, C.M., Kennedy, R.T., Aragona, B.J., Berke, J.D., Mesolimbic dopamine signals the value of work. Nat. Neurosci. 19 (2016), 117–126.
24. Hikosaka, O., GABAergic output of the basal ganglia. Prog. Brain Res. 160 (2007), 209–226.
25. Hikosaka, O., Miyashita, K., Miyachi, S., Sakai, K., Lu, X., Differential roles of the frontal cortex, basal ganglia, and cerebellum in visuomotor sequence learning. Neurobiol. Learn. Mem. 70 (1998), 137–149.
26. Hikosaka, O., Takikawa, Y., Kawagoe, R., Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol. Rev. 80 (2000), 953–978.
27. Howard, C.D., Daberkow, D.P., Ramsson, E.S., Keefe, K.A., Garris, P.A., Methamphetamine-induced neurotoxicity disrupts naturally occurring phasic dopamine signaling. Eur. J. Neurosci. 38 (2013), 2078–2088.
28. Howe, M.W., Dombeck, D.A., Rapid signalling in distinct dopaminergic axons during locomotion and reward. Nature 535 (2016), 505–510.
29. Howe, M.W., Tierney, P.L., Sandberg, S.G., Phillips, P.E., Graybiel, A.M., Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 500 (2013), 575–579.
30. Janssen, P., Shadlen, M.N., A representation of the hazard rate of elapsed time in macaque area LIP. Nat. Neurosci. 8 (2005), 234–241.
31. Jin, X., Costa, R.M., Start/stop signals emerge in nigrostriatal circuits during sequence learning. Nature 466 (2010), 457–462.
32. Jin, X., Costa, R.M., Shaping action sequences in basal ganglia circuits. Curr. Opin. Neurobiol. 33 (2015), 188–196.
33. Jin, X., Tecuapetla, F., Costa, R.M., Basal ganglia subcircuits distinctively encode the parsing and concatenation of action sequences. Nat. Neurosci. 17 (2014), 423–430.
34. Jog, M.S., Kubota, Y., Connolly, C.I., Hillegaart, V., Graybiel, A.M., Building neural representations of habits. Science 286 (1999), 1745–1749.
35. Keithley, R.B., Heien, M.L., Wightman, R.M., Multivariate concentration determination using principal component regression with residual analysis. Trends Analyt. Chem. 28 (2009), 1127–1136.
36. Kim, H.F., Ghazizadeh, A., Hikosaka, O., Dopamine Neurons Encoding Long-Term Memory of Object Value for Habitual Behavior. Cell 163 (2015), 1165–1175.
37. Lau, B., Glimcher, P.W., Value representations in the primate striatum during matching behavior. Neuron 58 (2008), 451–463.
38. Lauwereyns, J., Watanabe, K., Coe, B., Hikosaka, O., A neural correlate of response bias in monkey caudate nucleus. Nature 418 (2002), 413–417.
39. Lima, S.Q., Hromádka, T., Znamenskiy, P., Zador, A.M., PINP: a new method of tagging neuronal populations for identification during in vivo electrophysiological recording. PLoS ONE, 4, 2009, e6099.
40. Lo, C.C., Wang, X.J., Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nat. Neurosci. 9 (2006), 956–963.
41. Madisen, L., Mao, T., Koch, H., Zhuo, J.M., Berenyi, A., Fujisawa, S., Hsu, Y.W., Garcia, A.J. 3rd, Gu, X., Zanella, S., et al. A toolbox of Cre-dependent optogenetic transgenic mice for light-induced activation and silencing. Nat. Neurosci. 15 (2012), 793–802.
42. Mailly, P., Charpier, S., Menetrey, A., Deniau, J.M., Three-dimensional organization of the recurrent axon collateral network of the substantia nigra pars reticulata neurons in the rat. J. Neurosci. 23 (2003), 5247–5257.
43. Matsumoto, M., Hikosaka, O., Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459 (2009), 837–841.
44. Mink, J.W., The Basal Ganglia and involuntary movements: impaired inhibition of competing motor patterns. Arch. Neurol. 60 (2003), 1365–1368.
45. Morris, G., Nevet, A., Arkadir, D., Vaadia, E., Bergman, H., Midbrain dopamine neurons encode decisions for future action. Nat. Neurosci. 9 (2006), 1057–1063.
46. Niv, Y., Daw, N.D., Joel, D., Dayan, P., Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl.) 191 (2007), 507–520.
47. Nugent, F.S., Penick, E.C., Kauer, J.A., Opioids block long-term potentiation of inhibitory synapses. Nature 446 (2007), 1086–1090.
48. Oleson, E.B., Cachope, R., Fitoussi, A., Tsutsui, K., Wu, S., Gallegos, J.A., Cheer, J.F., Cannabinoid receptor activation shifts temporally engendered patterns of dopamine release. Neuropsychopharmacology 39 (2014), 1441–1452.
49. Panigrahi, B., Martin, K.A., Li, Y., Graves, A.R., Vollmer, A., Olson, L., Mensh, B.D., Karpova, A.Y., Dudman, J.T., Dopamine is required for the neural representation and control of movement vigor. Cell 162 (2015), 1418–1430.
50. Parker, N.F., Cameron, C.M., Taliaferro, J.P., Lee, J., Choi, J.Y., Davidson, T.J., Daw, N.D., Witten, I.B., Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target. Nat. Neurosci. 19 (2016), 845–854.
51. Phillips, P.E., Stuber, G.D., Heien, M.L., Wightman, R.M., Carelli, R.M., Subsecond dopamine release promotes cocaine seeking. Nature 422 (2003), 614–618.
52. Redgrave, P., Gurney, K., The short-latency dopamine signal: a role in discovering novel actions?. Nat. Rev. Neurosci. 7 (2006), 967–975.
53. Redgrave, P., Prescott, T.J., Gurney, K., The basal ganglia: a vertebrate solution to the selection problem?. Neuroscience 89 (1999), 1009–1023.
54. Redgrave, P., Rodriguez, M., Smith, Y., Rodriguez-Oroz, M.C., Lehericy, S., Bergman, H., Agid, Y., DeLong, M.R., Obeso, J.A., Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease. Nat. Rev. Neurosci. 11 (2010), 760–772.
55. Roesch, M.R., Calu, D.J., Schoenbaum, G., Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat. Neurosci. 10 (2007), 1615–1624.
56. Samejima, K., Ueda, Y., Doya, K., Kimura, M., Representation of action-specific reward values in the striatum. Science 310 (2005), 1337–1340.
57. Schultz, W., Multiple dopamine functions at different time courses. Annu. Rev. Neurosci. 30 (2007), 259–288.
58. Schultz, W., Dayan, P., Montague, P.R., A neural substrate of prediction and reward. Science 275 (1997), 1593–1599.
59. Simen, P., Matell, M., Why does time seem to fly when we're having fun?. Science 354 (2016), 1231–1232.
60. Smith, Y., Bevan, M.D., Shink, E., Bolam, J.P., Microcircuitry of the direct and indirect pathways of the basal ganglia. Neuroscience 86 (1998), 353–387.
61. Soares, S., Atallah, B.V., Paton, J.J., Midbrain dopamine neurons control judgment of time. Science 354 (2016), 1273–1277.
62. Stopper, C.M., Tse, M.T., Montes, D.R., Wiedman, C.R., Floresco, S.B., Overriding phasic dopamine signals redirects action selection during risk/reward decision making. Neuron 84 (2014), 177–189.
63. Surmeier, D.J., Plotkin, J., Shen, W., Dopamine and synaptic plasticity in dorsal striatal circuits controlling action selection. Curr. Opin. Neurobiol. 19 (2009), 621–628.
64. Syed, E.C., Grima, L.L., Magill, P.J., Bogacz, R., Brown, P., Walton, M.E., Action initiation shapes mesolimbic dopamine encoding of future rewards. Nat. Neurosci. 19 (2016), 34–36.
65. Tai, L.H., Lee, A.M., Benavidez, N., Bonci, A., Wilbrecht, L., Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value. Nat. Neurosci. 15 (2012), 1281–1289.
66. Threlfell, S., Lalic, T., Platt, N.J., Jennings, K.A., Deisseroth, K., Cragg, S.J., Striatal dopamine release is triggered by synchronized activity in cholinergic interneurons. Neuron 75 (2012), 58–64.
67. Wang, X.J., Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36 (2002), 955–968.
68. Wickens, J.R., Horvitz, J.C., Costa, R.M., Killcross, S., Dopaminergic mechanisms in actions and habits. J. Neurosci. 27 (2007), 8181–8183.
69. Zweifel, L.S., Argilli, E., Bonci, A., Palmiter, R.D., Role of NMDA receptors in dopamine neurons for plasticity and addictive behaviors. Neuron 59 (2008), 486–496.