Physiological state gates acquisition and expression of mesolimbic reward prediction signals

Proceedings of the National Academy of Sciences of the United States of America

Volumn 113, Issue 7, 2016, Pages 1943-1948

  Cone, Jackson J ^a,d   Fortin, Samantha M ^a   McHenry, Jenna A ^b   Stuber, Garret D ^b   McCutcheon, James E ^c   Roitman, Mitchell F ^a  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^b UNIVERSITY OF NORTH CAROLINA SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF LEICESTER   (United Kingdom)

^d UNIVERSITY OF CHICAGO   (United States)

Author keywords

Dopamine; Learning; Motivation; Nucleus accumbens; Voltammetry

Indexed keywords

DOPAMINE; SODIUM; SODIUM CHANNEL; SALT INTAKE;

ANIMAL EXPERIMENT; ARTICLE; CONTROLLED STUDY; CYCLIC POTENTIOMETRY; DOPAMINE RELEASE; DOPAMINERGIC NERVE CELL; ELECTROSTIMULATION; LATERAL HYPOTHALAMUS; LIMBIC SYSTEM; MALE; NONHUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; RAT; REINFORCEMENT; REWARD; SODIUM APPETITE; SODIUM BALANCE; SODIUM DEPLETION; VENTRAL TEGMENTUM; ADMINISTRATION AND DOSAGE; ANIMAL; APPETITE; PHYSIOLOGY; SALT INTAKE; SPRAGUE DAWLEY RAT;

ANIMALS; APPETITE; LIMBIC SYSTEM; MALE; RATS; RATS, SPRAGUE-DAWLEY; REWARD; SODIUM CHLORIDE, DIETARY;

EID: 84959020405     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1519643113     Document Type: Article

References (54)

1. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement, Classical Conditioning II Current Research and Theory (Appleton-Century-Crofts, New York), pp 64-99.
2. Sutton RS, Barto AG (1981) Toward a modern theory of adaptive networks: Expectation and prediction. Psychol Rev 88(2):135-170.
3. Day JJ, Roitman MF, Wightman RM, Carelli RM (2007) Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat Neurosci 10(8):1020-1028.
4. Hollerman JR, Schultz W (1998) Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1(4):304-309.
5. Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16(5):1936-1947.
6. Stuber GD, et al. (2008) Reward-predictive cues enhance excitatory synaptic strength onto midbrain dopamine neurons. Science 321(5896):1690-1692.
7. Pan W-X, Brown J, Dudman JT (2013) Neural signals of extinction in the inhibitory microcircuit of the ventral midbrain. Nat Neurosci 16(1):71-78.
8. Waelti P, Dickinson A, Schultz W (2001) Dopamine responses comply with basic assumptions of formal learning theory. Nature 412(6842):43-48.
9. Steinberg EE, et al. (2013) A causal link between prediction errors, dopamine neurons and learning. Nat Neurosci 16(7):966-973.
10. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ (2011) Model-based influences on humans' choices and striatal prediction errors. Neuron 69(6):1204-1215.
11. Robinson MJF, Berridge KC (2013) Instant transformation of learned repulsion into motivational "wanting". Curr Biol 23(4):282-289.
12. Richter CP (1936) Increased salt appetite in adrenalectomized rats. Am J Physiol 115: 155-161.
13. Quartermain D, Miller NE, Wolf G (1967) Role of experience in relationship between sodium deficiency and rate of bar pressing for salt. J Comp Physiol Psychol 63(3):417-420.
14. Handal PJ (1965) Immediate acceptance of sodium salts by sodium deficient rats. Psychon Sci 3(1):315-316.
15. Geran LC, Spector AC (2004) Anion size does not compromise sodium recognition by rats after acute sodium depletion. Behav Neurosci 118(1):178-183.
16. Tsai H-C, et al. (2009) Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324(5930):1080-1084.
17. Witten IB, et al. (2011) Recombinase-driver rat lines: Tools, techniques, and optogenetic application to dopamine-mediated reinforcement. Neuron 72(5):721-733.
18. Matsumoto M, Hikosaka O (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459(7248):837-841.
19. Cohen JY, Haesler S, Vong L, Lowell BB, Uchida N (2012) Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482(7383):85-88.
20. Lerner TN, et al. (2015) Intact-Brain Analyses Reveal Distinct Information Carried by SNc Dopamine Subcircuits. Cell 162(3):635-647.
21. Mirenowicz J, SchultzW(1996) Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379(6564):449-451.
22. Fiorillo CD (2013) Two dimensions of value: Dopamine neurons represent reward but not aversiveness. Science 341(6145):546-549.
23. Bernstein IL, Hennessy CJ (1987) Amiloride-sensitive sodium channels and expression of sodium appetite in rats. Am J Physiol 253(2 Pt 2):R371-R374.
24. Roitman MF, Wheeler RA, Wightman RM, Carelli RM (2008) Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli. Nat Neurosci 11(12):1376-1377.
25. McCutcheon JE, Ebner SR, Loriaux AL, Roitman MF (2012) Encoding of aversion by dopamine and the nucleus accumbens. Front Neurosci 6:137.
26. Berridge KC, Flynn FW, Schulkin J, Grill HJ (1984) Sodium depletion enhances salt palatability in rats. Behav Neurosci 98(4):652-660.
27. Brischoux F, Chakraborty S, Brierley DI, UnglessMA (2009) Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc Natl Acad Sci USA 106(12):4894-4899.
28. Lammel S, Lim BK, Malenka RC (2014) Reward and aversion in a heterogeneous midbrain dopamine system. Neuropharmacology 76(Pt B):351-359.
29. Oka Y, Butnaru M, von Buchholtz L, Ryba NJP, Zuker CS (2013) High salt recruits aversive taste pathways. Nature 494(7438):472-475.
30. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD (2006) Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442(7106):1042-1045.
31. Wassum KM, Ostlund SB, Loewinger GC, Maidment NT (2013) Phasic mesolimbic dopamine release tracks reward seeking during expression of Pavlovian-toinstrumental transfer. Biol Psychiatry 73(8):747-755.
32. Nakahara H, Itoh H, Kawagoe R, Takikawa Y, Hikosaka O (2004) Dopamine neurons can represent context-dependent prediction error. Neuron 41(2):269-280.
33. Cone JJ, McCutcheon JE, Roitman MF (2014) Ghrelin acts as an interface between physiological state and phasic dopamine signaling. J Neurosci 34(14):4905-4913.
34. Cone JJ, Roitman JD, Roitman MF (2015) Ghrelin regulates phasic dopamine and nucleus accumbens signaling evoked by food-predictive stimuli. J Neurochem 133(6):844-856.
35. Lin S, et al. (2014) Neural correlates of water reward in thirsty Drosophila. Nat Neurosci 17(11):1536-1542.
36. Huetteroth W, et al. (2015) Sweet taste and nutrient value subdivide rewarding dopaminergic neurons in Drosophila. Curr Biol 25(6):751-758.
37. Committee on Care and Use of Laboratory Animals (1996) Guide for the Care and Use of Laboratory Animals (Natl Inst Health, Bethesda), DHHS Publ No (NIH) 85-23.
38. Fortin SM, Cone JJ, Ng-Evans S, McCutcheon JE, Roitman MF (2015) Sampling phasic dopamine signaling with fast-scan cyclic voltammetry in awake, behaving rats. Curr Protoc Neurosci 70:7.25.1-7.25.20.
39. Heien MLAV, Johnson MA, Wightman RM (2004) Resolving neurotransmitters detected by fast-scan cyclic voltammetry. Anal Chem 76(19):5697-5704.
40. Grill HJ, Norgren R (1978) The taste reactivity test. I. Mimetic responses to gustatory stimuli in neurologically normal rats. Brain Res 143(2):263-279.
41. Paxinos G, Watson C (2007) The Rat Brain in Stereotaxic Coordinates (Elsevier, London), 6th Ed, pp 547-612.
42. Schiffman SS, Lockhead E, Maes FW (1983) Amiloride reduces the taste intensity of Na+ and Li+ salts and sweeteners. Proc Natl Acad Sci USA 80(19):6136-6140.
43. Heck GL, Mierson S, DeSimone JA (1984) Salt taste transduction occurs through an amiloride-sensitive sodium transport pathway. Science 223(4634):403-405.
44. Spector AC, Guagliardo NA, St John SJ (1996) Amiloride disrupts NaCl versus KCl discrimination performance: Implications for salt taste coding in rats. J Neurosci 16(24):8115-8122.
45. Stamatakis AM, Stuber GD (2012) Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance. Nat Neurosci 15(8):1105-1107.
46. van Zessen R, Phillips JL, Budygin EA, Stuber GD (2012) Activation of VTA GABA neurons disrupts reward consumption. Neuron 73(6):1184-1194.
47. Schindelin J, et al. (2012) Fiji: An open-source platform for biological-image analysis. Nat Methods 9(7):676-682.
48. Watabe-Uchida M, Zhu L, Ogawa SKK, Vamanrao A, Uchida N (2012) Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron 74(5):858-873.
49. Dayawansa S, Peckins S, Ruch S, Norgren R (2011) Parabrachial and hypothalamic interaction in sodium appetite. Am J Physiol Regul Integr Comp Physiol 300(5): R1091-R1099.
50. Scalera G, Spector AC, Norgren R (1995) Excitotoxic lesions of the parabrachial nuclei prevent conditioned taste aversions and sodium appetite in rats. Behav Neurosci 109(5):997-1008.
51. Hajnal A, Norgren R (2005) Taste pathways that mediate accumbens dopamine release by sapid sucrose. Physiol Behav 84(3):363-369.
52. Geerling JC, Loewy AD (2008) Central regulation of sodium appetite. Exp Physiol 93(2):177-209.
53. Wolf G (1964) Effect of Dorsolateral Hypothalamic Lesions on Sodium Appetite Elicited By Desoxycorticosterone and By Acute Hyponatremia. J Comp Physiol Psychol 58(3):396-402.
54. Sakai RR, Fine WB, Epstein AN, Frankmann SP (1987) Salt appetite is enhanced by one prior episode of sodium depletion in the rat. Behav Neurosci 101(5):724-731.