Functional heterogeneity within rat orbitofrontal cortex in reward learning and decision making

Journal of Neuroscience

Volumn 37, Issue 44, 2017, Pages 10529-10540

  Izquierdo, Alicia ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Basolateral amygdala; Cognitive flexibility; Devaluation; OFC; Prefrontal cortex; Reversal learning

Indexed keywords

IBOTENIC ACID; MUSCIMOL; N METHYL DEXTRO ASPARTIC ACID; QUINOLINIC ACID;

ARTICLE; BASOLATERAL AMYGDALA; BEHAVIOR DISORDER; CELL HETEROGENEITY; CLINICAL DECISION MAKING; DELAY DISCOUNTING; ELECTROPHYSIOLOGY; LEARNING; NONHUMAN; OLFACTORY DISCRIMINATION; ORBITAL CORTEX; PREFRONTAL CORTEX; PRIORITY JOURNAL; RAT; SENSORY ANALYSIS; THALAMUS DORSOMEDIAL NUCLEUS; VISUAL DISCRIMINATION; ANIMAL; DECISION MAKING; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; REWARD;

ANIMALS; DECISION MAKING; LEARNING; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE; RATS; REWARD;

EID: 85032934502     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.1678-17.2017     Document Type: Article

References (119)

1. Akaishi R, Kolling N, Brown JW, Rushworth M (2016) Neural mechanisms of credit assignment in a multicue environment. J Neurosci 36:1096-1112. CrossRef Medline
2. Amodeo LR, McMurray MS, Roitman JD (2017) Orbitofrontal cortex reflects changes in response-outcome contingencies during probabilistic reversal learning. Neuroscience 345:27-37. CrossRef Medline
3. Bakhurin KI, Goudar V, Shobe JL, Claar LD, Buonomano DV, Masmanidis SC (2017) Differential encoding of time by prefrontal and striatal network dynamics. J Neurosci 37:854-870. CrossRef Medline
4. Becker JB, Prendergast BJ, Liang JW (2016) Female rats are not more variable than male rats: a meta-analysis of neuroscience studies. Biol Sex Differ 7:34. CrossRef Medline
5. Bissonette GB, Martins GJ, Franz TM, Harper ES, Schoenbaum G, Powell EM (2008) Double dissociation of the effects of medial and orbital prefrontal cortical lesions on attentional and affective shifts in mice. J Neurosci 28:11124-11130. CrossRef Medline
6. Bissonette GB, Schoenbaum G, Roesch MR, Powell EM (2015) Interneurons are necessary for coordinated activity during reversal learning in orbitofrontal cortex. Biol Psychiatry 77:454-464. CrossRef Medline
7. Bohn I, Giertler C, Hauber W (2003a) Orbital prefrontal cortex and guidance of instrumental behavior of rats by visuospatial stimuli predicting reward magnitude. Learn Mem 10: 177-186. CrossRef Medline
8. Bohn I, Giertler C, Hauber W (2003b) Orbital prefrontal cortex and guidance of instrumental behaviour in rats under reversal conditions. Behav Brain Res 143:49-56. CrossRef Medline
9. Boulougouris V, Dalley JW, Robbins TW (2007) Effects of orbitofrontal, infralimbic and prelimbic cortical lesions on serial spatial reversal learning in the rat. Behav Brain Res 179:219-228. CrossRef Medline
10. Bradfield LA, Dezfouli A, van Holstein M, Chieng B, Balleine BW (2015) Medial orbitofrontal cortex mediates outcome retrieval in partially observable task situations. Neuron 88:1268-1280. CrossRef Medline
11. Brigman JL, Daut RA, Wright T, Gunduz-Cinar O, Graybeal C, Davis MI, Jiang Z, Saksida LM, Jinde S, Pease M, Bussey TJ, Lovinger DM, Nakazawa K, Holmes A (2013) GluN2B in corticostriatal circuits governs choice learning and choice shifting. Nat Neurosci 16:1101-1110. CrossRef Medline
12. Bryden DW, Roesch MR (2015) Executive control signals in orbitofrontal cortex during response inhibition. J Neurosci 35:3903-3914. CrossRef Medline
13. Burguière E, Monteiro P, Feng G, Graybiel AM (2013) Optogenetic stimulation of lateral orbitofronto-striatal pathway suppresses compulsive behaviors. Science 340:1243-1246. CrossRef Medline
14. Burke KA, Takahashi YK, Correll J, Brown PL, Schoenbaum G (2009) Orbitofrontal inactivation impairs reversal of Pavlovian learning by interfering with ‘disinhibition’ of responding for previously unrewarded cues. Eur J Neurosci 30:1941-1946. CrossRef Medline
15. Burton AC, Kashtelyan V, Bryden DW, Roesch MR (2014) Increased firing to cues that predict low-value reward in the medial orbitofrontal cortex. Cereb Cortex 24:3310-3321. CrossRef Medline
16. Butter CM, Mishkin M, Rosvold HE (1963) Conditioning and extinction of a food-rewarded response after selective ablations of frontal cortex in rhesus monkeys. Exp Neurol 7:65-75. CrossRef Medline
17. Camille N, Coricelli G, Sallet J, Pradat-Diehl P, Duhamel JR, Sirigu A (2004) The involvement of the orbitofrontal cortex in the experience of regret. Science 304:1167-1170. CrossRef Medline
18. Chase EA, Tait DS, Brown VJ (2012) Lesions of the orbital prefrontal cortex impair the formation of attentional set in rats. Eur J Neurosci 36:2368-2375. CrossRef Medline
19. Chau BK, Sallet J, Papageorgiou GK, Noonan MP, Bell AH, Walton ME, Rushworth MF (2015) Contrasting roles for orbitofrontal cortex and amygdala in credit assignment and learning in macaques. Neuron 87: 1106-1118. CrossRef Medline
20. Chudasama Y, Robbins TW (2003) Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J Neurosci 23:8771-8780. Medline
21. Chudasama Y, Passetti F, Rhodes SE, Lopian D, Desai A, Robbins TW (2003) Dissociable aspects of performance on the 5-choice serial reaction time task following lesions of the dorsal anterior cingulate, infralimbic and orbitofrontal cortex in the rat: differential effects on selectivity, impulsivity and compulsivity. Behav Brain Res 146:105-119. CrossRef Medline
22. Dalton GL, Wang NY, Phillips AG, Floresco SB (2016) Multifaceted contributions by different regions of the orbitofrontal and medial prefrontal cortex to probabilistic reversal learning. J Neurosci 36:1996-2006. CrossRef Medline
23. de Carvalho LP, Bochet P, Rossier J (1996) The endogenous agonist quinolinic acid and the nonendogenous homoquinolinic acid discriminate between NMDAR2 receptor subunits. Neurochem Int 28:445-452. CrossRef Medline
24. Eagle DM, Baunez C, Hutcheson DM, Lehmann O, Shah AP, Robbins TW (2008) Stop-signal reaction-time task performance: role of prefrontal cortex and subthalamic nucleus. Cereb Cortex 18:178-188. CrossRef Medline
25. Fanous S, Goldart EM, Theberge FR, Bossert JM, Shaham Y, Hope BT (2012) Role of orbitofrontal cortex neuronal ensembles in the expression of incubation of heroin craving. J Neurosci 32:11600-11609. CrossRef Medline
26. Fuchs RA, Evans KA, Parker MP, See RE (2004) Differential involvement of orbitofrontal cortex subregions in conditioned cue-induced and cocaineprimed reinstatement of cocaine seeking in rats. J Neurosci 24:6600-6610. CrossRef Medline
27. Gallagher M, McMahan RW, Schoenbaum G (1999) Orbitofrontal cortex and representation of incentive value in associative learning. J Neurosci 19:6610-6614. Medline
28. Goldman PS (1971) Functional development of the prefrontal cortex in early life and the problem of neuronal plasticity. Exp Neurol 32:366-387. CrossRef Medline
29. Gourley SL, Taylor JR (2016) Going and stopping: dichotomies in behavioral control by the prefrontal cortex. Nat Neurosci 19:656-664. CrossRef Medline
30. Gourley SL, Olevska A, Zimmermann KS, Ressler KJ, Dileone RJ, Taylor JR (2013) The orbitofrontal cortex regulates outcome-based decisionmaking via the lateral striatum. Eur J Neurosci 38:2382-2388. CrossRef Medline
31. Gourley SL, Zimmermann KS, Allen AG, Taylor JR (2016) The medial orbitofrontal cortex regulates sensitivity to outcome value. J Neurosci 36: 4600-4613. CrossRef Medline
32. Gremel CM, Costa RM (2013) Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions. Nat Commun 4:2264. CrossRef Medline
33. Groenewegen HJ (1988) Organization of the afferent connections of the mediodorsal thalamic nucleus in the rat, related to the mediodorsalprefrontal topography. Neuroscience 24:379-431. CrossRef Medline
34. Hamilton DA, Brigman JL (2015) Behavioral flexibility in rats and mice: contributions of distinct frontocortical regions. Genes Brain Behav 14:4-21. CrossRef Medline
35. Hardung S, Epple R, Jäckel Z, Eriksson D, Uran C, Senn V, Gibor L, Yizhar O, Diester I (2017) A functional gradient in the rodent prefrontal cortex supports behavioral inhibition. Curr Biol 27:549-555. CrossRef Medline
36. Heilbronner SR, Rodriguez-Romaguera J, Quirk GJ, Groenewegen HJ, Haber SN (2016) Circuit-based corticostriatal homologies between rat and primate. Biol Psychiatry 80:509-521. CrossRef Medline
37. Hoover WB, Vertes RP (2011) Projections of the medial orbital and ventral orbital cortex in the rat. J Comp Neurol 519:3766-3801. CrossRef Medline
38. Hunt LT, Hayden BY (2017) A distributed, hierarchical and recurrent framework for reward-based choice. Nat Rev Neurosci 18:172-182. CrossRef Medline
39. Izquierdo A, Darling C, Manos N, Pozos H, Kim C, Ostrander S, Cazares V, Stepp H, Rudebeck PH (2013) Basolateral amygdala lesions facilitate reward choices after negative feedback in rats. J Neurosci 33:4105-4109. CrossRef Medline
40. Izquierdo A, Brigman JL, Radke AK, Rudebeck PH, Holmes A (2017) The neural basis of reversal learning: an updated perspective. Neuroscience 345:12-26. CrossRef Medline
41. Jang AI, Costa VD, Rudebeck PH, Chudasama Y, Murray EA, Averbeck BB (2015) The role of frontal cortical and medial-temporal lobe brain areas in learning a Bayesian prior belief on reversals. J Neurosci 35:11751-11760. CrossRef Medline
42. Jean-Richard-Dit-Bressel P, McNally GP (2016) Lateral, not medial, prefrontal cortex contributes to punishment and aversive instrumental learning. Learn Mem 23:607-617. CrossRef Medline
43. Jentsch JD, Ashenhurst JR, Cervantes MC, Groman SM, James AS, Pennington ZT (2014) Dissecting impulsivity and its relationships to drug addictions. Ann N Y Acad Sci 1327:1-26. CrossRef Medline
44. Jo S, Jung MW (2016) Differential coding of uncertain reward in rat insular and orbitofrontal cortex. Sci Rep 6:24085. CrossRef Medline
45. Jones B, Mishkin M (1972) Limbic lesions and the problem of stimulusreinforcement associations. Exp Neurol 36:362-377. CrossRef Medline
46. Kepecs A, Mainen ZF (2012) A computational framework for the study of confidence in humans and animals. Philos Trans R Soc Lond B Biol Sci 367:1322-1337. CrossRef Medline
47. Kepecs A, Uchida N, Zariwala HA, Mainen ZF (2008) Neural correlates, computation and behavioural impact of decision confidence. Nature 455: 227-231. CrossRef Medline
48. Kheramin S, Body S, Mobini S, Ho MY, Velazquez-Martinez DN, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2002) Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis. Psychopharmacology (Berl) 165:9-17. CrossRef Medline
49. Kheramin S, Body S, Ho M, Velázquez-Martinez DN, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2003) Role of the orbital prefrontal cortex in choice between delayed and uncertain reinforcers: a quantitative analysis. Behav Processes 64:239-250. CrossRef Medline
50. Kheramin S, Body S, Herrera FM, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2005) The effect of orbital prefrontal cortex lesions on performance on a progressive ratio schedule: implications for models of inter-temporal choice. Behav Brain Res 156:145-152. CrossRef Medline
51. Kim J, Ragozzino ME (2005) The involvement of the orbitofrontal cortex in learning under changing task contingencies. Neurobiol Learn Mem 83: 125-133. CrossRef Medline
52. Kolb B (1984) Functions of the frontal cortex of the rat: a comparative review. Brain Res 320:65-98. Medline
53. Lak A, Costa GM, Romberg E, Koulakov AA, Mainen ZF, Kepecs A (2014) Orbitofrontal cortex is required for optimal waiting based on decision confidence. Neuron 84:190-201. CrossRef Medline
54. Lichtenberg NT, Pennington ZT, Holley SM, Greenfield VY, Cepeda C, Levine MS, Wassum KM (2017) Basolateral amygdala to orbitofrontal cortex projections enable cue-triggered reward expectations. J Neurosci 37:8374-8384. Medline
55. Lopatina N, McDannald MA, Styer CV, Sadacca BF, Cheer JF, Schoenbaum G (2015) Lateral orbitofrontal neurons acquire responses to upshifted, downshifted, or blocked cues during unblocking. Elife 4:e11299. CrossRef Medline
56. Lopatina N, McDannald MA, Styer CV, Peterson JF, Sadacca BF, Cheer JF, Schoenbaum G (2016) Medial orbitofrontal neurons preferentially signal cues predicting changes in reward during unblocking. J Neurosci 36:8416-8424. CrossRef Medline
57. Lopatina N, Sadacca BF, McDannald MA, Styer CV, Peterson JF, Cheer JF, Schoenbaum G (2017) Ensembles in medial and lateral orbitofrontal cortex construct cognitive maps emphasizing different features of the behavioral landscape. Behav Neurosci 131:201-212. CrossRef Medline
58. Lucantonio F, Takahashi YK, Hoffman AF, Chang CY, Bali-Chaudhary S, Shaham Y, Lupica CR, Schoenbaum G (2014) Orbitofrontal activation restores insight lost after cocaine use. Nat Neurosci 17:1092-1099. CrossRef Medline
59. Lucantonio F, Gardner MP, Mirenzi A, Newman LE, Takahashi YK, Schoenbaum G (2015) Neural estimates of imagined outcomes in basolateral amygdala depend on orbitofrontal cortex. J Neurosci 35:16521-16530. CrossRef Medline
60. Lugo-Huitrón R, Ugalde Muñiz P, Pineda B, Pedraza-Chaverrí J, Ríos C, Pérez-de la Cruz V (2013) Quinolinic acid: an endogenous neurotoxin with multiple targets. Oxid Med Cell Longev 2013:104024. CrossRef Medline
61. Mansouri FA, Buckley MJ, Tanaka K (2014) The essential role of primate orbitofrontal cortex in conflict-induced executive control adjustment. J Neurosci 34:11016-11031. CrossRef Medline
62. Mar AC, Walker AL, Theobald DE, Eagle DM, Robbins TW (2011) Dissociable effects of lesions to orbitofrontal cortex subregions on impulsive choice in the rat. J Neurosci 31:6398-6404. CrossRef Medline
63. Markowitsch HJ, Pritzel M (1979) Prefrontal cortex: projection area of the thalamic mediodorsal nucleus. Physiol Psychol 7:1-6. CrossRef
64. McAlonan K, Brown VJ (2003) Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat. Behav Brain Res 146: 97-103. CrossRef Medline
65. McDannald MA, Lucantonio F, Burke KA, Niv Y, Schoenbaum G (2011) Ventral striatum and orbitofrontal cortex are both required for modelbased, but not model-free, reinforcement learning. J Neurosci 31:2700-2705. CrossRef Medline
66. McDannald MA, Esber GR, Wegener MA, Wied HM, Liu TL, Stalnaker TA, Jones JL, Trageser J, Schoenbaum G (2014) Orbitofrontal neurons acquire responses to ‘valueless’ Pavlovian cues during unblocking. Elife 3:e02653. CrossRef Medline
67. Meyer HC, Bucci DJ (2016) Imbalanced activity in the orbitofrontal cortex and nucleus accumbens impairs behavioral inhibition. Curr Biol 26: 2834-2839. CrossRef Medline
68. Mobini S, Body S, Ho MY, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2002) Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 160: 290-298. CrossRef Medline
69. Moorman DE, Aston-Jones G (2014) Orbitofrontal cortical neurons encode expectation-driven initiation of reward-seeking. J Neurosci 34:10234-10246. CrossRef Medline
70. Nogueira R, Abolafia JM, Drugowitsch J, Balaguer-Ballester E, Sanchez-Vives MV, Moreno-Bote R (2017) Lateral orbitofrontal cortex anticipates choices and integrates prior with current information. Nat Commun 8:14823. CrossRef Medline
71. Noonan MP, Kolling N, Walton ME, Rushworth MF (2012) Re-evaluating the role of the orbitofrontal cortex in reward and reinforcement. Eur J Neurosci 35:997-1010. CrossRef Medline
72. Noonan MP, Chau BK, Rushworth MF, Fellows LK (2017) Contrasting effects of medial and lateral orbitofrontal cortex lesions on credit assignment and decision making in humans. J Neurosci 37:7023-7035. CrossRef Medline
73. Ongür D, Price JL (2000) The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb Cortex 10:206-219. CrossRef Medline
74. Orsini CA, Trotta RT, Bizon JL, Setlow B (2015) Dissociable roles for the basolateral amygdala and orbitofrontal cortex in decision-making under risk of punishment. J Neurosci 35:1368-1379. CrossRef Medline
75. Ostlund SB, Balleine BW (2007) Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J Neurosci 27:4819-4825. CrossRef Medline
76. Ostrander S, Cazares VA, Kim C, Cheung S, Gonzalez I, Izquierdo A (2011) Orbitofrontal cortex and basolateral amygdala lesions result in suboptimal and dissociable reward choices on cue-guided effort in rats. Behav Neurosci 125:350-359. CrossRef Medline
77. Otchy TM, Wolff SB, Rhee JY, Pehlevan C, Kawai R, Kempf A, Gobes SM, Ölveczky BP (2015) Acute off-target effects of neural circuit manipulations. Nature 528:358-363. CrossRef Medline
78. Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223-226. CrossRef Medline
79. Parkes SL, Ravassard PM, Cerpa JC, Wolff M, Ferreira G, Coutureau E (2017) Insular and ventrolateral orbitofrontal cortices differentially contribute to goal-directed behavior in rodents. Cereb Cortex. Advance online publication. Retrieved May 25, 2017. doi: 10.1093/cercor/bhx132. CrossRef Medline
80. Passingham RE, Wise SP (2012) The neurobiology of the prefrontal cortex: anatomy, evolution, and the origin of insight. Oxford: Oxford UP.
81. Paxinos G, Watson C (2007) The rat brain in stereotaxic coordinates, Ed 6. Burlington, MA: Academic.
82. Pickens CL, Saddoris MP, Setlow B, Gallagher M, Holland PC, Schoenbaum G (2003) Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J Neurosci 23:11078-11084. Medline
83. Pickens CL, Saddoris MP, Gallagher M, Holland PC (2005) Orbitofrontal lesions impair use of cue-outcome associations in a devaluation task. Behav Neurosci 119:317-322. CrossRef Medline
84. Price JL (2007) Definition of the orbital cortex in relation to specific connections with limbic and visceral structures and other cortical regions. Ann N Y Acad Sci 1121:54-71. CrossRef Medline
85. Radke AK, Jury NJ, Kocharian A, Marcinkiewcz CA, Lowery-Gionta EG, Pleil KE, McElligott ZA, McKlveen JM, Kash TL, Holmes A (2017) Chronic EtOH effects on putative measures of compulsive behavior in mice. Addict Biol 22:423-434. CrossRef Medline
86. Ramírez-Lugo L, Peñas-Rincón A, Ángeles-Durán S, Sotres-Bayon F (2016) Choice behavior guided by learned, but not innate, taste aversion recruits the orbitofrontal cortex. J Neurosci 36:10574-10583. CrossRef Medline
87. Ray JP, Price JL (1992) The organization of the thalamocortical connections of the mediodorsal thalamic nucleus in the rat, related to the ventral forebrain-prefrontal cortex topography. J Comp Neurol 323:167-197. CrossRef Medline
88. Rempel-Clower NL (2007) Role of orbitofrontal cortex connections in emotion. Ann N Y Acad Sci 1121:72-86. CrossRef Medline
89. Riceberg JS, Shapiro ML (2012) Reward stability determines the contribution of orbitofrontal cortex to adaptive behavior. J Neurosci 32:16402-16409. CrossRef Medline
90. Riceberg JS, Shapiro ML (2017) Orbitofrontal cortex signals expected outcomes with predictive codes when stable contingencies promote the integration of reward history. J Neurosci 37:2010-2021. CrossRef Medline
91. Rose JE, Woolsey CN (1948) The orbitofrontal cortex and its connections with the mediodorsal nucleus in rabbit, sheep and cat. Res Publ Assoc Res Nerv Ment Dis 27:210-232. Medline
92. Rudebeck PH, Murray EA (2014) The orbitofrontal oracle: cortical mechanisms for the prediction and evaluation of specific behavioral outcomes. Neuron 84:1143-1156. CrossRef Medline
93. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF (2006) Separate neural pathways process different decision costs. Nat Neurosci 9:1161-1168. CrossRef Medline
94. Rudebeck PH, Walton ME, Millette BH, Shirley E, Rushworth MF, Bannerman DM (2007) Distinct contributions of frontal areas to emotion and social behaviour in the rat. Eur J Neurosci 26:2315-2326. CrossRef Medline
95. Schoenbaum G, Chiba AA, Gallagher M (1999) Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. J Neurosci 19:1876-1884. Medline
96. Schoenbaum G, Chiba AA, Gallagher M (2000) Changes in functional connectivity in orbitofrontal cortex and basolateral amygdala during learning and reversal training. J Neurosci 20:5179-5189. Medline
97. Schoenbaum G, Setlow B, Nugent SL, Saddoris MP, Gallagher M (2003) Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn Mem 10:129-140. CrossRef Medline
98. Schuck NW, Cai MB, Wilson RC, Niv Y (2016) Human orbitofrontal cortex represents a cognitive map of state space. Neuron 91:1402-1412. CrossRef Medline
99. Stalnaker TA, Cooch NK, Schoenbaum G (2015) What the orbitofrontal cortex does not do. Nat Neurosci 18:620-627. CrossRef Medline
100. Steiner AP, Redish AD (2012) The road not taken: neural correlates of decision making in orbitofrontal cortex. Front Neurosci 6:131. Medline
101. Steiner AP, Redish AD (2014) Behavioral and neurophysiological correlates of regret in rat decision-making on a neuroeconomic task. Nat Neurosci 17:995-1002. CrossRef Medline
102. Stolyarova A, Izquierdo A (2017) Complementary contributions of basolateral amygdala and orbitofrontal cortex to value learning under uncertainty. Elife 6:e27483. CrossRef Medline
103. Stopper CM, Green EB, Floresco SB (2014) Selective involvement by the medial orbitofrontal cortex in biasing risky, but not impulsive, choice. Cereb Cortex 24:154-162. CrossRef Medline
104. Stott JJ, Redish AD (2014) A functional difference in information processing between orbitofrontal cortex and ventral striatum during decisionmaking behaviour. Philos Trans R Soc Lond B Biol Sci 369:20130472. CrossRef Medline
105. Tait DS, Brown VJ (2007) Difficulty overcoming learned non-reward during reversal learning in rats with ibotenic acid lesions of orbital prefrontal cortex. Ann N Y Acad Sci 1121:407-420. CrossRef Medline
106. Takahashi YK, Roesch MR, Stalnaker TA, Haney RZ, Calu DJ, Taylor AR, Burke KA, Schoenbaum G (2009) The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62:269-280. CrossRef Medline
107. Takahashi YK, Chang CY, Lucantonio F, Haney RZ, Berg BA, Yau HJ, Bonci A, Schoenbaum G (2013) Neural estimates of imagined outcomes in the orbitofrontal cortex drive behavior and learning. Neuron 80:507-518. CrossRef Medline
108. Torregrossa MM, Quinn JJ, Taylor JR (2008) Impulsivity, compulsivity, and habit: the role of orbitofrontal cortex revisited. Biol Psychiatry 63:253-255. CrossRef Medline
109. Tremblay L, Schultz W (1999) Relative reward preference in primate orbitofrontal cortex. Nature 398:704-708. CrossRef Medline
110. Tremblay L, Schultz W (2000) Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. J Neurophysiol 83:1877-1885. Medline
111. Uylings HB, van Eden CG (1990) Qualitative and quantitative comparison of the prefrontal cortex in rat and in primates, including humans. Prog Brain Res 85:31-62. Medline
112. Wallis JD (2011) Cross-species studies of orbitofrontal cortex and valuebased decision-making. Nat Neurosci 15:13-19. CrossRef Medline
113. Walton ME, Behrens TE, Noonan MP, Rushworth MF (2011) Giving credit where credit is due: orbitofrontal cortex and valuation in an uncertain world. Ann N Y Acad Sci 1239:14-24. CrossRef Medline
114. Wassum KM, Izquierdo A (2015) The basolateral amygdala in reward learning and addiction. Neurosci Biobehav Rev 57:271-283. CrossRef Medline
115. Wikenheiser AM, Marrero-Garcia Y, Schoenbaum G (2017) Suppression of ventral hippocampal output impairs integrated orbitofrontal encoding of task structure. Neuron 95:1197-1207.e3. CrossRef Medline
116. Wilson RC, Takahashi YK, Schoenbaum G, Niv Y (2014) Orbitofrontal cortex as a cognitive map of task space. Neuron 81:267-279. CrossRef Medline
117. Winstanley CA, Theobald DE, Cardinal RN, Robbins TW (2004) Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J Neurosci 24:4718-4722. CrossRef Medline
118. Young JJ, Shapiro ML (2011) Dynamic coding of goal-directed paths by orbital prefrontal cortex. J Neurosci 31:5989-6000. CrossRef Medline
119. Zeeb FD, Floresco SB, Winstanley CA (2010) Contributions of the orbitofrontal cortex to impulsive choice: interactions with basal levels of impulsivity, dopamine signalling, and reward-related cues. Psychopharmacology (Berl) 211:87-98. CrossRef Medline