Nucleus accumbens core dopamine signaling tracks the need-based motivational value of food-paired cues

Journal of Neurochemistry

Volumn 136, Issue 5, 2016, Pages 1026-1036

  Aitken, Tara J ^a   Greenfield, Venuz Y ^a   Wassum, Kate M ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

hunger; mesolimbic dopamine; Pavlovian to instrumental transfer; reward; satiety; voltammetry

Indexed keywords

DOPAMINE;

ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; ASSOCIATION; COMPARATIVE STUDY; CONDITIONING; CONTROLLED STUDY; CYCLIC POTENTIOMETRY; DISSOCIATION; DOPAMINE RELEASE; DOPAMINE SIGNALING; FAST SCAN CYCLIC VOLTAMMETRY; FOOD PAIRED CUES; HISTOLOGY; HUNGER; INSTRUMENTAL CONDITIONING; MALE; MOTIVATION; NEED BASED MOTIVATIONAL VALUE; NONHUMAN; NUCLEUS ACCUMBENS CORE; PAVLOVIAN CONDITIONING; PRIORITY JOURNAL; RAT; REWARD; SATIETY; SCANNING ELECTRON MICROSCOPY; SIGNAL TRANSDUCTION; TASK PERFORMANCE; VISUAL DISCRIMINATION; ANIMAL; CONDITIONED REFLEX; DRUG EFFECTS; FOOD; METABOLISM; NUCLEUS ACCUMBENS; PHYSIOLOGY; SPRAGUE DAWLEY RAT;

ANIMALS; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; CUES; DOPAMINE; FOOD; MALE; MOTIVATION; NUCLEUS ACCUMBENS; RATS, SPRAGUE-DAWLEY; REWARD; SIGNAL TRANSDUCTION;

EID: 84958115705     PISSN: 00223042     EISSN: 14714159     Source Type: Journal    
DOI: 10.1111/jnc.13494     Document Type: Article

References (76)

1. Ackroff K., Manza L., and, Sclafani A., (1993) The rat's preference for sucrose, polycose and their mixtures. Appetite 21, 69-80.
2. Ahn S., and, Phillips A. G., (1999) Dopaminergic correlates of sensory-specific satiety in the medial prefrontal cortex and nucleus accumbens of the rat. J. Neurosci. 19, RC29.
3. Balleine B., (1994) Asymmetrical interactions between thirst and hunger in Pavlovian-instrumental transfer. Q. J. Exp. Psychol. B 47, 211-231.
4. Beeler J. A., McCutcheon J. E., Cao Z. F., Murakami M., Alexander E., Roitman M. F., and, Zhuang X., (2012) Taste uncoupled from nutrition fails to sustain the reinforcing properties of food. Eur. J. Neurosci. 36, 2533-2546.
5. Berridge K. C., (2001) Reward learning: Reinforcement, incentives and expectations, in The Psychology of Learning and Motivation (, Medin D. L., ed.), Vol. 40, pp. 223-278. Academic Press, San Diego, CA.
6. Berridge K. C., (2007) The debate over dopamine's role in reward: The case for incentive salience. Psychopharmacology 191, 391-431.
7. Bindra D., (1968) Neuropsychological interpretation of the effects of drive and incentive-motivation on general activity and instrumental behavior. Psychol. Rev. 75, 1-22.
8. Branch S. Y., Goertz R. B., Sharpe A. L., Pierce J., Roy S., Ko D., Paladini C. A., and, Beckstead M. J., (2013) Food restriction increases glutamate receptor-mediated burst firing of dopamine neurons. J. Neurosci. 33, 13861-13872.
9. Cartoni E., Puglisi-Allegra S., and, Baldassarre G., (2013) The three principles of action: A Pavlovian-instrumental transfer hypothesis. Front. Behav. Neurosci. 7, 153.
10. Clark J. J., Sandberg S. G., Wanat M. J., et al,. (2010) Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals. Nat. Methods 7, 126-129.
11. Clark J. J., Collins A. L., Sanford C. A., and, Phillips P. E., (2013) Dopamine encoding of Pavlovian incentive stimuli diminishes with extended training. J. Neurosci. 33, 3526-3532.
12. Cleland G. G., and, Davey G. C., (1983) Autoshaping in the rat: The effects of localizable visual and auditory signals for food. J. Exp. Anal. Behav. 40, 47-56.
13. Collins A. L., Greenfield V. Y., Bye J. K., Linker K. E., Wang A. S., and, Wassum K. M., (in press) Dynamic mesolimbic dopamine signaling during action sequence learning and expectation violation. Sci. Reports. Accepted: December 23, 2015.
14. Colwill R. M., and, Motzkin D. K., (1994) Encoding of the unconditioned stimulus in Pavlovian conditioning. Anim. Learn. Behav. 22, 384-394.
15. Cone J. J., McCutcheon J. E., and, Roitman M. F., (2014) Ghrelin acts as an interface between physiological state and phasic dopamine signaling. J. Neurosci. 34, 4905-4913.
16. Cone J. J., Roitman J. D., and, Roitman M. F., (2015) Ghrelin regulates phasic dopamine and nucleus accumbens signaling evoked by food-predictive stimuli. J. Neurochem. 133, 844-856.
17. Corbit L. H., and, Balleine B. W., (2005) Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. J. Neurosci. 25, 962-970.
18. Corbit L. H., and, Balleine B. W., (2011) The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. J. Neurosci. 31, 11786-11794.
19. Corbit L. H., Janak P. H., and, Balleine B. W., (2007) General and outcome-specific forms of Pavlovian-instrumental transfer: The effect of shifts in motivational state and inactivation of the ventral tegmental area. Eur. J. Neurosci. 26, 3141-3149.
20. Day J. J., Roitman M. F., Wightman R. M., and, Carelli R. M., (2007) Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat. Neurosci. 10, 1020-1028.
21. Day J. J., Jones J. L., Wightman R. M., and, Carelli R. M., (2010) Phasic nucleus accumbens dopamine release encodes effort- and delay-related costs. Biol. Psychiatry 68, 306-309.
22. Dayan P., and, Berridge K. C., (2014) Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation. Cogn. Affect. Behav. Neurosci. 14, 473-492.
23. Dickinson A., and, Balleine B. W., (1994) Motivational control over goal-directed action. Anim. Learn. Behav. 22, 1-18.
24. Dickinson A., and, Balleine B. W., (2002) The role of learning in the operation of motivational systems, in Learning, Motivation and Emotion, Volume 3 of Steven's Handbook of Experimental Psychology, vol. 3, (, Gallistel C. R., ed.), pp. 497-533. John Wiley & Sons, New York.
25. Dickinson A., and, Dawson G. R., (1987) Pavlovian processes in the motivational control of instrumental performance. Q. J. Exp. Psychol. B 39, 201-213.
26. Dickinson A., Smith J., and, Mirenowicz J., (2000) Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behav. Neurosci. 114, 468-483.
27. Estes W., (1948) Discriminative conditioning. II. Effects of a Pavlovian conditioned stimulus upon a subsequently established operant response. J. Exp. Psychol. 38, 173-177.
28. Everitt B. J., Parkinson J. A., Olmstead M. C., Arroyo M., Robledo P., and, Robbins T. W., (1999) Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems. Ann. N. Y. Acad. Sci. 877, 412-438.
29. Fanselow M. S., and, Wassum K. M., (2015) The Origins and Organization of Vertebrate Pavlovian Conditioning. Cold Spring Harb. Perspect. Biol. doi: 10.1101/cshperspect.a021717.
30. Flagel S. B., Clark J. J., Robinson T. E., et al,. (2011) A selective role for dopamine in stimulus-reward learning. Nature 469, 53-57.
31. Gan J. O., Walton M. E., and, Phillips P. E., (2009) Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat. Neurosci. 13, 25-27.
32. Garbusow M., Schad D. J., Sommer C., et al,. (2014) Pavlovian-to-instrumental transfer in alcohol dependence: A pilot study. Neuropsychobiology 70, 111-121.
33. Glasner S. V., Overmier J. B., and, Balleine B. W., (2005) The role of Pavlovian cues in alcohol seeking in dependent and nondependent rats. J. Stud. Alcohol 66, 53-61.
34. Hart A. S., Clark J. J., and, Phillips P. E., (2015) Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning. Neurobiol. Learn. Mem. 117, 84-92.
35. Heien M. L., Khan A. S., Ariansen J. L., Cheer J. F., Phillips P. E., Wassum K. M., and, Wightman R. M., (2005) Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats. Proc. Natl Acad. Sci. USA 102, 10023-10028.
36. Hogarth L., Maynard O. M., and, Munafò M. R., (2014) Plain cigarette packs do not exert Pavlovian to instrumental transfer of control over tobacco-seeking. Addiction 110, 174-182.
37. Hollon N. G., Arnold M. M., Gan J. O., Walton M. E., and, Phillips P. E., (2014) Dopamine-associated cached values are not sufficient as the basis for action selection. Proc. Natl Acad. Sci. USA 111, 18357-18362.
38. Johnson A. W., (2013) Eating beyond metabolic need: How environmental cues influence feeding behavior. Trends Neurosci. 36, 101-109.
39. Keithley R. B., and, Wightman R. M., (2011) Assessing principal component regression prediction of neurochemicals detected with fast-scan cyclic voltammetry. ACS Chem. Neurosci. 2, 514-525.
40. Kenny P. J., (2011) Reward mechanisms in obesity: New insights and future directions. Neuron 69, 664-679.
41. Kruse H., Overmier J., Konz W., and, Rokke E., (1983) Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific. Learn. Motiv. 14, 165-181.
42. Laurent V., and, Balleine B. W., (2015) Factual and counterfactual action-outcome mappings control choice between goal-directed actions in rats. Curr. Biol. 25, 1074-1079.
43. LeBlanc K. H., Maidment N. T., and, Ostlund S. B., (2013) Repeated cocaine exposure facilitates the expression of incentive motivation and induces habitual control in rats. PLoS ONE 8, e61355.
44. LeBlanc K. H., Maidment N. T., and, Ostlund S. B., (2014) Impact of repeated intravenous cocaine administration on incentive motivation depends on mode of drug delivery. Addict. Biol. 19, 965-971.
45. Lex A., and, Hauber W., (2008) Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer. Learn. Mem. 15, 483-491.
46. Lex B., and, Hauber W., (2010) The role of nucleus accumbens dopamine in outcome encoding in instrumental and Pavlovian conditioning. Neurobiol. Learn. Mem. 93, 283-290.
47. Lovibond P. F., (1983) Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus. J. Exp. Psychol. Anim. Behav. Process. 9, 225-247.
48. Ludwig A. M., Wikler A., and, Stark L. H., (1974) The first drink: Psychobiological aspects of craving. Arch. Gen. Psychiatry 30, 539-547.
49. Malvaez M., Greenfield V. Y., Wang A. S., Yorita A. M., Feng L., Linker K. E., Monbouquette H. G., and, Wassum K. M., (2015) Basolateral amygdala rapid glutamate release encodes an outcome-specific representation vital for reward-predictive cues to selectively invigorate reward-seeking actions. Sci. Rep. 5, 12511.
50. Martinovic J., Jones A., Christiansen P., Rose A. K., Hogarth L., and, Field M., (2014) Electrophysiological responses to alcohol cues are not associated with Pavlovian-to-instrumental transfer in social drinkers. PLoS ONE 9, e94605.
51. McCutcheon J. E., (2015) The role of dopamine in the pursuit of nutritional value. Physiol. Behav. 152, 408-415.
52. McCutcheon J. E., Beeler J. A., and, Roitman M. F., (2012) Sucrose-predictive cues evoke greater phasic dopamine release than saccharin-predictive cues. Synapse 66, 346-351.
53. Milton A. L., and, Everitt B. J., (2012) The persistence of maladaptive memory: Addiction, drug memories and anti-relapse treatments. Neurosci. Biobehav. Rev. 36, 1119-1139.
54. Nasrallah N. A., Clark J. J., Collins A. L., Akers C. A., Phillips P. E., and, Bernstein I. L., (2011) Risk preference following adolescent alcohol use is associated with corrupted encoding of costs but not rewards by mesolimbic dopamine. Proc. Natl Acad. Sci. USA 108, 5466-5471.
55. Ostlund S. B., and, Balleine B. W., (2008) On habits and addiction: An associative analysis of compulsive drug seeking. Drug Discov. Today Dis. Models 5, 235-245.
56. Ostlund S. B., and, Maidment N. T., (2012) Dopamine receptor blockade attenuates the general incentive motivational effects of noncontingently delivered rewards and reward-paired cues without affecting their ability to bias action selection. Neuropsychopharmacology 37, 508-519.
57. Ostlund S. B., Wassum K. M., Murphy N. P., Balleine B. W., and, Maidment N. T., (2011) Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning. J. Neurosci. 31, 200-207.
58. Ostlund S. B., LeBlanc K. H., Kosheleff A. R., Wassum K. M., and, Maidment N. T., (2014) Phasic mesolimbic dopamine signaling encodes the facilitation of incentive motivation produced by repeated cocaine exposure. Neuropsychopharmacology 39, 2441-2449.
59. Paxinos G., and, Watson C., (1998) The Rat Brain in Stereotaxic Coordinates. Academic Press, San Diego, CA.
60. Peciña S., and, Berridge K. C., (2013) Dopamine or opioid stimulation of nucleus accumbens similarly amplify cue-triggered 'wanting' for reward: Entire core and medial shell mapped as substrates for PIT enhancement. Eur. J. Neurosci. 37, 1529-1540.
61. Phillips P. E., Robinson D. L., Stuber G. D., Carelli R. M., and, Wightman R. M., (2003) Real-time measurements of phasic changes in extracellular dopamine concentration in freely moving rats by fast-scan cyclic voltammetry. Methods Mol. Med. 79, 443-464.
62. Rescorla R. A., and, Solomon R. L., (1967) Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. Psychol. Rev. 74, 151-182.
63. Roitman M. F., Stuber G. D., Phillips P. E., Wightman R. M., and, Carelli R. M., (2004) Dopamine operates as a subsecond modulator of food seeking. J. Neurosci. 24, 1265-1271.
64. Saddoris M. P., Sugam J. A., Stuber G. D., Witten I. B., Deisseroth K., and, Carelli R. M., (2015) Mesolimbic dopamine dynamically tracks, and is causally linked to, discrete aspects of value-based decision making. Biol. Psychiatry 77, 903-911.
65. Saunders B. T., and, Robinson T. E., (2012) The role of dopamine in the accumbens core in the expression of Pavlovian-conditioned responses. Eur. J. Neurosci. 36, 2521-2532.
66. Sclafani A., (1991) Starch and sugar tastes in rodents: An update. Brain Res. Bull. 27, 383-386.
67. Taylor J. R., and, Jentsch J. D., (2001) Repeated intermittent administration of psychomotor stimulant drugs alters the acquisition of Pavlovian approach behavior in rats: Differential effects of cocaine, d-amphetamine and 3,4- methylenedioxy-methamphetamine ("Ecstasy"). Biol. Psychiatry 50, 137-143.
68. Volkow N. D., Wang G. J., and, Baler R. D., (2011) Reward, dopamine and the control of food intake: Implications for obesity. Trends Cogn. Sci. 15, 37-46.
69. Wanat M. J., Kuhnen C. M., and, Phillips P. E., (2010) Delays conferred by escalating costs modulate dopamine release to rewards but not their predictors. J. Neurosci. 30, 12020-12027.
70. Wassum K. M., Ostlund S. B., Balleine B. W., and, Maidment N. T., (2011) Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling. Learn. Mem. 18, 475-483.
71. Wassum K. M., Ostlund S. B., and, Maidment N. T., (2012) Phasic mesolimbic dopamine signaling precedes and predicts performance of a self-initiated action sequence task. Biol. Psychiatry 71, 846-854.
72. Wassum K. M., Ostlund S. B., Loewinger G. C., and, Maidment N. T., (2013) Phasic mesolimbic dopamine release tracks reward seeking during expression of pavlovian-to-instrumental transfer. Biol. Psychiatry 73, 747-755.
73. Watson P., Wiers R. W., Hommel B., and, de Wit S., (2014) Working for food you don't desire. Cues interfere with goal-directed food-seeking. Appetite 79, 139-148.
74. Willuhn I., Burgeno L. M., Everitt B. J., and, Phillips P. E., (2012) Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use. Proc. Natl Acad. Sci. USA 109, 20703-20708.
75. Wyvell C. L., and, Berridge K. C., (2000) Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: Enhancement of reward "wanting" without enhanced "liking" or response reinforcement. J. Neurosci. 20, 8122-8130.
76. Wyvell C. L., and, Berridge K. C., (2001) Incentive sensitization by previous amphetamine exposure: Increased cue-triggered "wanting" for sucrose reward. J. Neurosci. 21, 7831-7840.