Prospective coding of dorsal raphe reward signals by the orbitofrontal cortex

Journal of Neuroscience

Volumn 35, Issue 6, 2015, Pages 2717-2730

  Zhou, Jingfeng ^a,b   Jia, Chunying ^b   Feng, Qiru ^b   Bao, Junhong ^b   Luo, Minmin ^b,c  

^a PEKING UNIVERSITY   (China)

^b NATIONAL INSTITUTE OF BIOLOGICAL SCIENCES   (China)

^c TSINGHUA UNIVERSITY   (China)

Author keywords

Dorsal raphe nucleus; Multichannel recording; Optogenetics; Orbitofrontal cortex; Pavlovian conditioning

Indexed keywords

SEROTONIN; SUCROSE; VIRUS VECTOR;

ADENO ASSOCIATED VIRUS; ANIMAL CELL; ANIMAL EXPERIMENT; AREA UNDER THE CURVE; ARTICLE; BEHAVIOR; BRAIN DEPTH STIMULATION; CONTROLLED STUDY; DORSAL RAPHE NUCLEUS; EXCITATION; GENE EXPRESSION; MOUSE; NERVE STIMULATION; NERVOUS SYSTEM ELECTROPHYSIOLOGY; NEURAL OSCILLATION; NONHUMAN; OPTOGENETICS; ORBITAL CORTEX; OSCILLATION; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; SIGNAL NOISE RATIO; SIGNAL PROCESSING; SIGNAL TRANSDUCTION; STIMULUS RESPONSE; TASK PERFORMANCE; ANIMAL; ANIMAL BEHAVIOR; CONDITIONED REFLEX; DISCRIMINATION LEARNING; FEMALE; FRONTAL LOBE; MALE; NERVE CELL; ODOR; PHYSIOLOGY; RAPHE NUCLEUS; REWARD;

ANIMALS; BEHAVIOR, ANIMAL; CONDITIONING, CLASSICAL; DISCRIMINATION LEARNING; FEMALE; FRONTAL LOBE; MALE; MICE; NEURONS; OPTOGENETICS; RAPHE NUCLEI; REWARD; SMELL;

EID: 84922496487     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.4017-14.2015     Document Type: Article

References (79)

1. Anikeeva P, Andalman AS, Witten I, Warden M, Goshen I, Grosenick L, Gunaydin LA, Frank LM, Deisseroth K (2012) Optetrode: a multichannel readout for optogenetic control in freely moving mice. Nat Neurosci 15: 163-170. CrossRef Medline.
2. Armbruster BN, Li X, Pausch MH, Herlitze S, Roth BL (2007) Evolving the lock to fit the key to create a family of G protein-coupled receptors potently activated by an inert ligand. Proc Natl Acad Sci U S A 104: 5163-5168. CrossRef Medline.
3. Bechara A, Damasio H, Damasio AR (2000) Emotion, decision making and the orbitofrontal cortex. Cereb Cortex 10: 295-307. CrossRef Medline.
4. Berndt A, Lee SY, Ramakrishnan C, Deisseroth K (2014) Structure-guided transformation of channelrhodopsin into a light-activated chloride channel. Science 344: 420-424. CrossRef Medline.
5. Boulougouris V, RobbinsTW (2010) Enhancement of spatial reversal learning by 5-HT2C receptor antagonism is neuroanatomically specific. J Neurosci 30: 930-938. CrossRef Medline.
6. Bromberg-Martin ES, Hikosaka O, Nakamura K (2010) Coding of task reward value in the dorsal raphe nucleus. J Neurosci 30: 6262-6272. CrossRef Medline.
7. Burke KA, Franz TM, Miller DN, Schoenbaum G (2008) The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards. Nature 454: 340-344. CrossRef Medline.
8. Cardin JA, CarleńM, Meletis K, Knoblich U, Zhang F, Deisseroth K, Tsai LH, Moore CI (2010) Targeted optogenetic stimulation and recording of neurons in vivo usingcell-type-specificexpressionofchannelrhodopsin-2. NatProtoc5: 247-254. CrossRef Medline.
9. Carmichael ST, Price JL (1995) Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J Comp Neurol 363: 615-641. CrossRef Medline.
10. Cavada C, Compañy T, Tejedor J, Cruz-Rizzolo RJ, Reinoso-Suárez F (2000) The anatomical connections of the macaque monkey orbitofrontal cortex. A review. Cereb Cortex 10: 220-242. CrossRef Medline.
11. Charney DS, Woods SW, Goodman WK, Heninger GR (1987) Serotonin function in anxiety. Psychopharmacology 92: 14-24. CrossRef Medline.
12. Chib VS, Rangel A, Shimojo S, O'Doherty JP (2009) Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. J Neurosci 29: 12315-12320. CrossRef Medline.
13. Clarke HF, Dalley JW, Crofts HS, Robbins TW, Roberts AC (2004) Cogni-tive inflexibility after prefrontal serotonin depletion. Science 304: 878-880. CrossRef Medline.
14. Clarke HF, Walker SC, Dalley JW, Robbins TW, Roberts AC (2007) Cognitive inflexibility after prefrontal serotonin depletion is behaviorally and neurochemically specific. Cereb Cortex 17: 18-27. CrossRef Medline.
15. Cohen JY, Haesler S, Vong L, Lowell BB, Uchida N (2012) Neuron-typespecific signals for reward and punishment in the ventral tegmental area. Nature 482: 85-88. CrossRef Medline.
16. De Almeida RM, Rosa MM, Santos DM, Saft DM, Benini Q, Miczek KA (2006) 5-HT1B receptors, ventral orbitofrontal cortex, and aggressive behavior in mice. Psychopharmacology 185: 441-450. CrossRef Medline.
17. Feierstein CE, Quirk MC, Uchida N, Sosulski DL, Mainen ZF (2006) Representation of spatial goals in rat orbitofrontal cortex. Neuron 51: 495-507. CrossRef Medline.
18. FitzGerald TH, Seymour B, Dolan RJ (2009) The role of human orbitofrontal cortex in value comparison for incommensurable objects. J Neurosci 29: 8388-8395. CrossRef Medline.
19. Furuyashiki T, Holland PC, Gallagher M (2008) Rat orbitofrontal cortex separately encodes response and outcome information during performance of goal-directed behavior. J Neurosci 28: 5127-5138. CrossRef Medline.
20. Glimcher PW (2011) Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proc Natl Acad Sci U S A 108: 15647-15654. CrossRef Medline.
21. Gradinaru V, Thompson KR, Zhang F, Mogri M, Kay K, Schneider MB, Deisseroth K (2007) Targeting and readout strategies for fast optical neural control in vitro and in vivo. J Neurosci 27: 14231-14238. CrossRef Medline.
22. Gradinaru V, Thompson KR, Deisseroth K (2008) eNpHR: a Natronomonas halorhodopsin enhanced for optogenetic applications. Brain Cell Biol 36: 129-139. CrossRef Medline.
23. Graeff FG, Guimarães FS, De Andrade TG, Deakin JF (1996) Role of 5-HT in stress, anxiety, and depression. Pharmacol Biochem Behav 54: 129-141. CrossRef Medline.
24. Inaba K, Mizuhiki T, Setogawa T, Toda K, Richmond BJ, Shidara M (2013) Neurons in monkey dorsal raphe nucleus code beginning and progress of step-by-step schedule, reward expectation, and amount of reward outcome in the reward schedule task. J Neurosci 33: 3477-3491. CrossRef Medline.
25. Jacobs BL, Azmitia EC (1992) Structure and function of the brain serotonin system. Physiol Rev 72: 165-229. Medline.
26. Jennings JH, Sparta DR, Stamatakis AM, Ung RL, Pleil KE, Kash TL, Stuber GD (2013) Distinct extended amygdala circuits for divergent motivational states. Nature 496: 224-228. CrossRef Medline.
27. Jones JL, Esber GR, McDannald MA, Gruber AJ, Hernandez A, Mirenzi A, Schoenbaum G (2012) Orbitofrontal cortex supports behavior and learning using inferred but not cached values. Science 338: 953-956. CrossRef Medline.
28. Kepecs A, Uchida N, Zariwala HA, Mainen ZF (2008) Neural correlates, computation and behavioural impact of decision confidence. Nature 455: 227-231. CrossRef Medline.
29. Kim H, Shimojo S, O'Doherty JP (2011) Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. Cereb Cortex 21: 769-776. CrossRef Medline.
30. Kim TI, McCall JG, Jung YH, Huang X, Siuda ER, Li Y, Song J, Song YM, Pao HA, Kim RH, Lu C, Lee SD, Song IS, Shin G, Al-Hasani R, Kim S, Tan MP, Huang Y, Omenetto FG, Rogers JA, et al (2013) Injectable, cellular-scale optoelectronics with applications for wireless optogenetics. Science 340: 211-216. CrossRef Medline.
31. Kobayashi S, Pinto de Carvalho O, SchultzW (2010) Adaptation of reward sensitivity in orbitofrontal neurons. J Neurosci 30: 534-544. CrossRef Medline.
32. Kvitsiani D, Ranade S, Hangya B, Taniguchi H, Huang JZ, Kepecs A (2013) Distinct behavioural and network correlates of two interneuron types in prefrontal cortex. Nature 498: 363-366. CrossRef Medline.
33. Levy DJ, Glimcher PW (2011) Comparing apples and oranges: using reward-specific and reward-general subjective value representation in the brain. J Neurosci 31: 14693-14707. CrossRef Medline.
34. Levy DJ, Glimcher PW (2012) The root of all value: a neural common currency for choice. Curr Opin Neurobiol 22: 1027-1038. CrossRef Medline.
35. Lewis DA (1990) The organization of chemically-identified neural systems in monkey prefrontal cortex: afferent systems. Prog Neuropsychopharmacol Biol Psychiatry 14: 371-377. CrossRef Medline.
36. Lima SQ, Hromádka T, Znamenskiy P, Zador AM (2009) PINP: a new method of tagging neuronal populations for identification during in vivo electrophysiological recording. PLoS One 4: e6099. CrossRef Medline.
37. Lin A, Adolphs R, Rangel A (2012) Social and monetary reward learning engage overlapping neural substrates. Soc Cogn Affect Neurosci 7: 274-281. CrossRef Medline.
38. Liu Z, Zhou J, Li Y, Hu F, Lu Y, MaM, Feng Q, Zhang JE, Wang D, Zeng J, Bao J, Kim JY, Chen ZF, El Mestikawy S, LuoM (2014) Dorsal raphe neurons signal reward through 5-HT and glutamate. Neuron 81: 1360-1374. CrossRef Medline.
39. Lorrain DS, Matuszewich L, Friedman RD, Hull EM (1997) Extracellular serotonin in the lateral hypothalamic area is increased during the postejaculatory interval and impairs copulation in male rats. J Neurosci 17: 9361-9366. Medline.
40. Man MS, Dalley JW, Roberts AC (2010) Opposing effects of 5, 7-DHT infusions into the orbitofrontal cortex and amygdala on flexible responding. Cereb Cortex 20: 1668-1675. CrossRef Medline.
41. McDannald MA, Lucantonio F, Burke KA, Niv Y, Schoenbaum G (2011) Ventral striatum and orbitofrontal cortex are both required for modelbased, but not model-free, reinforcement learning. J Neurosci 31: 2700-2705. CrossRef Medline.
42. McDannald MA, Esber GR, Wegener MA, Wied HM, Liu TL, Stalnaker TA, Jones JL, Trageser J, Schoenbaum G (2014) Orbitofrontal neurons acquire responses to "valueless" Pavlovian cues during unblocking. eLife 3: e02653. CrossRef Medline.
43. McDevitt RA, Tiran-Cappello A, Shen H, Balderas I, Britt JP, Marino RA, Chung SL, Richie CT, Harvey BK, Bonci A (2014) Serotonergic versus nonserotonergic dorsal raphe projection neurons: differential participation in reward circuitry. Cell Rep 8: 1857-1869. CrossRef Medline.
44. Millan MJ (2000) Improving the treatment of schizophrenia: focus on serotonin (5-HT) 1A receptors. J Pharmacol Exp Ther 295: 853-861. Medline.
45. Miyazaki KW, Miyazaki K, Doya K (2011b) Activation of the central serotonergic system in response to delayed but not omitted rewards. Eur J Neurosci 33: 153-160. CrossRef Medline.
46. Miyazaki KW, Miyazaki K, Tanaka KF, Yamanaka A, Takahashi A, Tabuchi S, Doya K (2014) Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards. Curr Biol 24: 2033-2040. CrossRef Medline.
47. Miyazaki K, Miyazaki KW, Doya K (2011a) Activation of dorsal raphe serotonin neurons underlies waiting for delayed rewards. J Neurosci 31: 469-479. CrossRef Medline.
48. Müller CP, Carey RJ, Huston JP, De Souza Silva MA (2007) Serotonin and psychostimulant addiction: focus on 5-HT-sub-1A-/sub-receptors. Prog Neurobiol 81: 133-178. CrossRef Medline.
49. Nakamura K, Matsumoto M, Hikosaka O (2008) Reward-dependent modulation of neuronal activity in the primate dorsal raphe nucleus. J Neurosci 28: 5331-5343. CrossRef Medline.
50. Ogawa SK, Cohen JY, Hwang D, Uchida N, Watabe-Uchida M (2014) Organization of monosynaptic inputs to the serotonin and dopamine neuromodulatory systems. Cell Rep 8: 1105-1118. CrossRef Medline.
51. Ongür D, An X, Price JL (1998) Prefrontal cortical projections to the hypothalamus in macaque monkeys. J Comp Neurol 401: 480-505. CrossRef Medline.
52. Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441: 223-226. CrossRef Medline.
53. Padoa-Schioppa C, Assad JA (2008) The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat Neurosci 11: 95-102. CrossRef Medline.
54. Phillips AG, Carter DA, Fibiger HC (1976) Differential effects of parachlorophenylalanine on self-stimulation in caudate-putamen and lateral hypothalamus. Psychopharmacology 49: 23-27. Medline.
55. Pollak Dorocic I, Fürth D, Xuan Y, Johansson Y, Pozzi L, Silberberg G, Carleń M, Meletis K (2014) A whole-brain atlas of inputs to serotonergic neurons of the dorsal and median raphe nuclei. Neuron 83: 663-678. CrossRef Medline.
56. Puig MV, Gulledge AT (2011) Serotonin and prefrontal cortex function: neurons, networks, and circuits. Mol Neurobiol 44: 449-464. CrossRef Medline.
57. Qi J, Zhang S, Wang HL, Wang H, de Jesus Aceves Buendia J, Hoffman AF, Lupica CR, Seal RP, Morales M (2014) A glutamatergic reward input from the dorsal raphe to ventral tegmental area dopamine neurons. Nat Commun 5: 5390. CrossRef Medline.
58. Ranade SP, Mainen ZF (2009) Transient firing of dorsal raphe neurons encodes diverse and specific sensory, motor, and reward events. J Neurophysiol 102: 3026-3037. CrossRef Medline.
59. Redgrave P, Horrell RI (1976) Potentiation of central reward by localised perfusion of acetylcholine and 5-hydroxytryptamine. Nature 262: 305-307. CrossRef Medline.
60. Roberts AC (2011) The importance of serotonin for orbitofrontal function. Biol Psychiatry 69: 1185-1191. CrossRef Medline.
61. Roesch MR, Taylor AR, Schoenbaum G (2006) Encoding of timediscounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51: 509-520. CrossRef Medline.
62. Schoenbaum G, Chiba AA, Gallagher M (1998) Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat Neurosci 1: 155-159. CrossRef Medline.
63. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275: 1593-1599. CrossRef Medline.
64. Schwartz DH, Hernandez L, Hoebel BG (1990) Serotonin release in lateral and medial hypothalamus during feeding and its anticipation. Brain Res Bull 25: 797-802. CrossRef Medline.
65. Scott MM, Wylie CJ, Lerch JK, Murphy R, Lobur K, Herlitze S, Jiang W, Conlon RA, Strowbridge BW, Deneris ES (2005) A genetic approach to access serotonin neurons for in vivo and in vitro studies. Proc Natl Acad Sci U S A 102: 16472-16477. CrossRef Medline.
66. Sellers EM, Higgins GA, Sobell MB (1992) 5-HT and alcohol abuse. Trends Pharmacol Sci 13: 69-75. CrossRef Medline.
67. Smith DV, Hayden BY, Truong TK, Song AW, Platt ML, Huettel SA (2010) Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J Neurosci 30: 2490-2495. CrossRef Medline.
68. Stalnaker TA, Cooch NK, McDannald MA, Liu TL, Wied H, Schoenbaum G (2014) Orbitofrontal neurons infer the value and identity of predicted outcomes. Nat Commun 5: 3926. CrossRef Medline.
69. Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S (2004) Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat Neurosci 7: 887-893. CrossRef Medline.
70. Tremblay L, Schultz W (1999) Relative reward preference in primate orbitofrontal cortex. Nature 398: 704-708. CrossRef Medline.
71. Tsujimoto S, Genovesio A, Wise SP (2009) Monkey orbitofrontal cortex encodes response choices near feedback time. J Neurosci 29: 2569-2574. CrossRef Medline.
72. Vertes RP (1991) A PHA-L analysis of ascending projections of the dorsal raphe nucleus in the rat. J Comp Neurol 313: 643-668. CrossRef Medline.
73. Waelti P, Dickinson A, SchultzW (2001) Dopamine responses comply with basic assumptions of formal learning theory. Nature 412: 43-48. CrossRef Medline.
74. Walker SC, Mikheenko YP, Argyle LD, Robbins TW, Roberts AC (2006) Selective prefrontal serotonin depletion impairs acquisition of a detourreaching task. Eur J Neurosci 23: 3119-3123. CrossRef Medline.
75. Wallis JD (2007) Orbitofrontal cortex and its contribution to decisionmaking. Annu Rev Neurosci 30: 31-56. CrossRef Medline.
76. Weissbourd B, Ren J, DeLoach KE, Guenthner CJ, Miyamichi K, Luo L (2014) Presynaptic partners of dorsal raphe serotonergic and GABAergic neurons. Neuron 83: 645-662. CrossRef Medline.
77. West EA, Forcelli PA, McCue DL, Malkova L (2013) Differential effects of serotonin-specific and excitotoxic lesions of OFC on conditioned reinforcer devaluation and extinction in rats. Behav Brain Res 246: 10-14. CrossRef Medline.
78. Wilson MA, Molliver ME (1991) The organization of serotonergic projections to cerebral cortex in primates: regional distribution of axon terminals. Neuroscience 44: 537-553. CrossRef Medline.
79. Zhan C, Luo M (2010) Diverse patterns of odor representation by neurons in the anterior piriform cortex of awake mice. J Neurosci 30: 16662-16672. CrossRef Medline.