Lateral Hypothalamic GABAergic Neurons Encode Reward Predictions that Are Relayed to the Ventral Tegmental Area to Regulate Learning

Current Biology

Volumn 27, Issue 14, 2017, Pages 2089-2100.e5

  Sharpe, Melissa J ^a,b   Marchant, Nathan J ^a,c   Whitaker, Leslie R ^a   Richie, Christopher T ^a   Zhang, Yajun J ^a,d   Campbell, Erin J ^e   Koivula, Pyry P ^a   Necarsulmer, Julie C ^a   Mejias Aponte, Carlos ^a   Morales, Marisela ^a   Pickel, James ^f   Smith, Jeffrey C ^g   Niv, Yael ^b   Shaham, Yavin ^a   Harvey, Brandon K ^a   Schoenbaum, Geoffrey ^a,h,i  

^a NATIONAL INSTITUTE ON DRUG ABUSE   (United States)

^b PRINCETON UNIVERSITY   (United States)

^c UNIVERSITY OF MELBOURNE   (Australia)

^d NATIONAL INSTITUTE ON ALCOHOL ABUSE AND ALCOHOLISM   (United States)

^e HUNTER MEDICAL RESEARCH INSTITUTE   (Australia)

^f NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

^g NATIONAL INSTITUTE OF NEUROLOGICAL DISORDERS AND STROKE   (United States)

^h UNIVERSITY OF MARYLAND SCHOOL OF MEDICINE   (United States)

ⁱ JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

appetitive conditioning; dopamine; feeding; GABA; lateral hypothalamus; learning; Pavlovian conditioning; prediction error; reward

Indexed keywords

4 AMINOBUTYRIC ACID RECEPTOR;

ANIMAL; ASSOCIATION; FEEDING BEHAVIOR; FEMALE; LATERAL HYPOTHALAMUS; LEARNING; LONG EVANS RAT; MALE; MOTIVATION; OPTOGENETICS; PHYSIOLOGY; RAT; REWARD; VENTRAL TEGMENTUM;

ANIMALS; CUES; FEEDING BEHAVIOR; FEMALE; GABAERGIC NEURONS; HYPOTHALAMIC AREA, LATERAL; LEARNING; MALE; MOTIVATION; OPTOGENETICS; RATS; RATS, LONG-EVANS; REWARD; VENTRAL TEGMENTAL AREA;

EID: 85021836787     PISSN: 09609822     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cub.2017.06.024     Document Type: Article

References (58)

1. Changizi, M.A., McGehee, R.M.F., Hall, W.G., Evidence that appetitive responses for dehydration and food-deprivation are learned. Physiol. Behav. 75 (2002), 295–304.
2. Hall, W.G., Feeding and behavioral activation in infant rats. Science 205 (1979), 206–209.
3. Hall, W.G., Arnold, H.M., Myers, K.P., The acquisition of an appetite. Psychol. Sci. 11 (2000), 101–105.
4. Friedman, M.I., Campbell, B.A., Ontogeny of thirst in the rat: effects of hypertonic saline polyethylene glycol, and vena cava ligation. J. Comp. Physiol. Psychol. 87 (1974), 37–46.
5. Galef, B.G., Social effects in the weaning of domestic rat pups. J. Comp. Physiol. Psychol. 75 (1971), 358–362.
6. Balleine, B., Dickinson, A., Instrumental performance following reinforcer devaluation depends upon incentive learning. Q. J. Exp. Psychol. B 43 (1991), 279–296.
7. Balleine, B.W., Dickinson, A., The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety. Anim. Learn. Behav. 26 (1998), 46–59.
8. Jennings, J.H., Rizzi, G., Stamatakis, A.M., Ung, R.L., Stuber, G.D., The inhibitory circuit architecture of the lateral hypothalamus orchestrates feeding. Science 341 (2013), 1517–1521.
9. Stuber, G.D., Wise, R.A., Lateral hypothalamic circuits for feeding and reward. Nat. Neurosci. 19 (2016), 198–205.
10. Delgado, J.M., Anand, B.K., Increase of food intake induced by electrical stimulation of the lateral hypothalamus. Am. J. Physiol. 172 (1953), 162–168.
11. Hoebel, B.G., Teitelbaum, P., Hypothalamic control of feeding and self-stimulation. Science 135 (1962), 375–377.
12. Schwartz, M.W., Woods, S.C., Porte, D. Jr., Seeley, R.J., Baskin, D.G., Central nervous system control of food intake. Nature 404 (2000), 661–671.
13. Saper, C.B., Chou, T.C., Elmquist, J.K., The need to feed: homeostatic and hedonic control of eating. Neuron 36 (2002), 199–211.
14. Horvath, T.L., Diano, S., The floating blueprint of hypothalamic feeding circuits. Nat. Rev. Neurosci. 5 (2004), 662–667.
15. Kenny, P.J., Reward mechanisms in obesity: new insights and future directions. Neuron 69 (2011), 664–679.
16. Anand, B.K., Brobeck, J.R., Localization of a “feeding center” in the hypothalamus of the rat. Proc. Soc. Exp. Biol. Med. 77 (1951), 323–324.
17. Wise, R.A., Lateral hypothalamic electrical stimulation: does it make animals ‘hungry’?. Brain Res. 67 (1974), 187–209.
18. Petrovich, G.D., Gallagher, M., Control of food consumption by learned cues: a forebrain-hypothalamic network. Physiol. Behav. 91 (2007), 397–403.
19. Kelley, A.E., Berridge, K.C., The neuroscience of natural rewards: relevance to addictive drugs. J. Neurosci. 22 (2002), 3306–3311.
20. Kalivas, P.W., Nakamura, M., Neural systems for behavioral activation and reward. Curr. Opin. Neurobiol. 9 (1999), 223–227.
21. Marchant, N.J., Hamlin, A.S., McNally, G.P., Lateral hypothalamus is required for context-induced reinstatement of extinguished reward seeking. J. Neurosci. 29 (2009), 1331–1342.
22. Marchant, N.J., Kaganovsky, K., Shaham, Y., Bossert, J.M., Role of corticostriatal circuits in context-induced reinstatement of drug seeking. Brain Res. 1628:Pt A (2015), 219–232.
23. Sternson, S.M., Nicholas Betley, J., Cao, Z.F.H., Neural circuits and motivational processes for hunger. Curr. Opin. Neurobiol. 23 (2013), 353–360.
24. Wise, R.A., Plasticity of hypothalamic motivational systems. Science 165 (1969), 929–930.
25. Nieh, E.H., Matthews, G.A., Allsop, S.A., Presbrey, K.N., Leppla, C.A., Wichmann, R., Neve, R., Wildes, C.P., Tye, K.M., Decoding neural circuits that control compulsive sucrose seeking. Cell 160 (2015), 528–541.
26. Wise, R.A., Albin, J., Stimulation-induced eating disrupted by a conditioned taste aversion. Behav. Biol. 9 (1973), 289–297.
27. Harris, G.C., Wimmer, M., Aston-Jones, G., A role for lateral hypothalamic orexin neurons in reward seeking. Nature 437 (2005), 556–559.
28. Burton, M.J., Rolls, E.T., Mora, F., Effects of hunger on the responses of neurons in the lateral hypothalamus to the sight and taste of food. Exp. Neurol. 51 (1976), 668–677.
29. Ono, T., Nishino, H., Sasaki, K., Fukuda, M., Muramoto, K.-I., Monkey lateral hypothalamic neuron response to sight of food, and during bar press and ingestion. Neurosci. Lett. 21 (1981), 99–104.
30. Valenstein, E.S., Cox, V.C., Kakolewski, J.W., Modification of motivated behavior elicited by electrical stimulation of the hypothalamus. Science 159 (1968), 1119–1121.
31. Berridge, K.C., Valenstein, E.S., What psychological process mediates feeding evoked by electrical stimulation of the lateral hypothalamus?. Behav. Neurosci. 105 (1991), 3–14.
32. Petrovich, G.D., Holland, P.C., Gallagher, M., Amygdalar and prefrontal pathways to the lateral hypothalamus are activated by a learned cue that stimulates eating. J. Neurosci. 25 (2005), 8295–8302.
33. Ragan, T., Kadiri, L.R., Venkataraju, K.U., Bahlmann, K., Sutin, J., Taranda, J., Arganda-Carreras, I., Kim, Y., Seung, H.S., Osten, P., Serial two-photon tomography for automated ex vivo mouse brain imaging. Nat. Methods 9 (2012), 255–258.
34. Mahn, M., Prigge, M., Ron, S., Levy, R., Yizhar, O., Biophysical constraints of optogenetic inhibition at presynaptic terminals. Nat. Neurosci. 19 (2016), 554–556.
35. Ghirlanda, S., Enquist, M., A century of generalization. Anim. Behav. 66 (2003), 15–36.
36. Schultz, W., Dayan, P., Montague, P.R., A neural substrate of prediction and reward. Science 275 (1997), 1593–1599.
37. Jennings, J.H., Ung, R.L., Resendez, S.L., Stamatakis, A.M., Taylor, J.G., Huang, J., Veleta, K., Kantak, P.A., Aita, M., Shilling-Scrivo, K., et al. Visualizing hypothalamic network dynamics for appetitive and consummatory behaviors. Cell 160 (2015), 516–527.
38. Balleine, B.W., Killcross, S., Parallel incentive processing: an integrated view of amygdala function. Trends Neurosci. 29 (2006), 272–279.
39. Blundell, P., Hall, G., Killcross, S., Preserved sensitivity to outcome value after lesions of the basolateral amygdala. J. Neurosci. 23 (2003), 7702–7709.
40. Killcross, S., Coutureau, E., Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb. Cortex 13 (2003), 400–408.
41. Sharpe, M.J., Schoenbaum, G., Back to basics: making predictions in the orbitofrontal-amygdala circuit. Neurobiol. Learn. Mem. 131 (2016), 201–206.
42. Day, J.J., Roitman, M.F., Wightman, R.M., Carelli, R.M., Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat. Neurosci. 10 (2007), 1020–1028.
43. Barbano, M.F., Wang, H.-L., Morales, M., Wise, R.A., Feeding and reward are differentially induced by activating GABAergic lateral hypothalamic projections to VTA. J. Neurosci. 36 (2016), 2975–2985.
44. Takahashi, Y.K., Roesch, M.R., Stalnaker, T.A., Haney, R.Z., Calu, D.J., Taylor, A.R., Burke, K.A., Schoenbaum, G., The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62 (2009), 269–280.
45. Takahashi, Y.K., Langdon, A.J., Niv, Y., Schoenbaum, G., Temporal specificity of reward prediction errors signaled by putative dopamine neurons in rat VTA depends on ventral striatum. Neuron 91 (2016), 182–193.
46. Tian, J., Huang, R., Cohen, J.Y., Osakada, F., Kobak, D., Machens, C.K., Callaway, E.M., Uchida, N., Watabe-Uchida, M., Distributed and mixed information in monosynaptic inputs to dopamine neurons. Neuron 91 (2016), 1374–1389.
47. Gradinaru, V., Zhang, F., Ramakrishnan, C., Mattis, J., Prakash, R., Diester, I., Goshen, I., Thompson, K.R., Deisseroth, K., Molecular and cellular approaches for diversifying and extending optogenetics. Cell 141 (2010), 154–165.
48. Warming, S., Costantino, N., Court, D.L., Jenkins, N.A., Copeland, N.G., Simple and highly efficient BAC recombineering using galK selection. Nucleic Acids Res., 33, 2005, e36.
49. Shimshek, D.R., Kim, J., Hübner, M.R., Spergel, D.J., Buchholz, F., Casanova, E., Stewart, A.F., Seeburg, P.H., Sprengel, R., Codon-improved Cre recombinase (iCre) expression in the mouse. Genesis 32 (2002), 19–26.
50. Filipiak, W.E., Saunders, T.L., Advances in transgenic rat production. Transgenic Res. 15 (2006), 673–686.
51. Henderson, M.J., Wires, E.S., Trychta, K.A., Richie, C.T., Harvey, B.K., SERCaMP: a carboxy-terminal protein modification that enables monitoring of ER calcium homeostasis. Mol. Biol. Cell 25 (2014), 2828–2839.
52. Paxinos, G.W.C., The Rat Brain in Stereotaxic Coordinates. 1998, Academic Press.
53. Chang, C.Y., Esber, G.R., Marrero-Garcia, Y., Yau, H.J., Bonci, A., Schoenbaum, G., Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors. Nat. Neurosci. 19 (2016), 111–116.
54. Sharpe, M.J., Killcross, S., The prelimbic cortex contributes to the down-regulation of attention toward redundant cues. Cereb. Cortex 24 (2014), 1066–1074.
55. Sharpe, M.J., Killcross, S., The prelimbic cortex directs attention toward predictive cues during fear learning. Learn. Mem. 22 (2015), 289–293.
56. Sharpe, M.J., Killcross, S., The prelimbic cortex uses higher-order cues to modulate both the acquisition and expression of conditioned fear. Front. Syst. Neurosci., 8, 2015, 235.
57. Zhang, F., Wang, L.-P., Brauner, M., Liewald, J.F., Kay, K., Watzke, N., Wood, P.G., Bamberg, E., Nagel, G., Gottschalk, A., Deisseroth, K., Multimodal fast optical interrogation of neural circuitry. Nature 446 (2007), 633–639.
58. Jones, J.L., Esber, G.R., McDannald, M.A., Gruber, A.J., Hernandez, A., Mirenzi, A., Schoenbaum, G., Orbitofrontal cortex supports behavior and learning using inferred but not cached values. Science 338 (2012), 953–956.