The orbitofrontal cortex as part of a hierarchical neural system mediating choice between two good options

Journal of Neuroscience

Volumn 33, Issue 40, 2013, Pages 15989-15998

  Keiflin, Ronald ^a   Reese, Rebecca M ^a   Woods, Catherine A ^a   Janak, Patricia H ^a,b  

^a UNIVERSITY OF CALIFORNIA SAN FRANCISCO   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

GLUCOSE POLYMER; SUCROSE;

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; ASSOCIATION; CONTROLLED STUDY; DECISION MAKING; FOOD PREFERENCE; HISTOLOGY; LEARNING; MALE; NONHUMAN; ORBITAL CORTEX; PRIORITY JOURNAL; RAT; RECALL; REWARD; SCORING SYSTEM; STIMULUS RESPONSE; TASK PERFORMANCE; TRAINING;

ANIMALS; BACLOFEN; BEHAVIOR, ANIMAL; CHOICE BEHAVIOR; FRONTAL LOBE; GABA-A RECEPTOR AGONISTS; GABA-B RECEPTOR AGONISTS; MALE; MUSCIMOL; NERVE NET; RATS; RATS, LONG-EVANS; REVERSAL LEARNING; REWARD;

EID: 84884956507     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.0026-13.2013     Document Type: Article

References (57)

1. Agustín-Pavon C, Parkinson J, Man MS, Roberts AC (2011) Contribution of the amygdala, but not orbitofrontal or medial prefrontal cortices, to the expression of flavour preferences in marmoset monkeys. Eur J Neurosci 34:1006-1017. CrossRef Medline
2. Boulougouris V, Dalley JW, Robbins TW (2007) Effects of orbitofrontal, infralimbic and prelimbic cortical lesions on serial spatial reversal learning in the rat. Behav Brain Res 179:219-228. CrossRef Medline
3. Bouton ME, Kenney FA, Rosengard C (1990) State-dependent fear extinction with two benzodiazepine tranquilizers. Behav Neurosci 104:44-55. CrossRef Medline
4. Burke KA, Takahashi YK, Correll J, Brown PL, Schoenbaum G (2009) Orbitofrontal inactivation impairs reversal of Pavlovian learning by interfering with 'disinhibition' of responding for previously unrewarded cues. Eur J Neurosci 30:1941-1946. CrossRef Medline
5. Chudasama Y, Robbins TW (2003) Dissociable contributions of the orbitofrontal and infralimbic cortex to Pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J Neurosci 23:8771-8780. Medline
6. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ (2011) Model-based influences on humans' choices and striatal prediction errors. Neuron 69:1204-1215. CrossRef Medline
7. Fortis-Santiago Y, Rodwin BA, Neseliler S, Piette CE, Katz DB (2010) State dependence of olfactory perception as a function of taste cortical inactivation. Nat Neurosci 13:158-159. CrossRef Medline
8. Frank MJ, Claus ED (2006) Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev 113:300-326. CrossRef Medline
9. Gabbott PL, Warner TA, Jays PR, Salway P, Busby SJ (2005) Prefrontal cortex in the rat: projections to subcortical autonomic, motor, and limbic centers. J Comp Neurol 492:145-177. CrossRef Medline
10. Ghods-Sharifi S, Haluk DM, Floresco SB (2008) Differential effects of inactivation of the orbitofrontal cortex on strategy set-shifting and reversal learning. Neurobiol Learn Mem 89:567-573. CrossRef Medline
11. Gottfried JA, Zelano C (2011) The value of identity: olfactory notes on orbitofrontal cortex function. Ann N Y Acad Sci 1239:138-148. CrossRef Medline
12. Gremel CM, Costa RM (2013) Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions. Nat Commun 4:2264. CrossRef Medline
13. Izquierdo A, Suda RK, Murray EA (2004) Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J Neurosci 24:7540-7548. CrossRef Medline
14. Joel D, Niv Y, Ruppin E (2002) Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural Netw 15:535-547. CrossRef Medline
15. Kim J, Ragozzino ME (2005) The involvement of the orbitofrontal cortex in learning under changing task contingencies. Neurobiol Learn Mem 83: 125-133. CrossRef Medline
16. LaLumiere RT, Niehoff KE, Kalivas PW (2010) The infralimbic cortex regulates the consolidation of extinction after cocaine self-administration. Learn Mem 17:168-175. CrossRef Medline
17. Laurent V, Westbrook RF (2009) Inactivation of the infralimbic but not the prelimbic cortex impairs consolidation and retrieval of fear extinction. Learn Mem 16:520-529. CrossRef Medline
18. Maia TV (2009) Reinforcement learning, conditioning, and the brain: successes and challenges. Cogn Affect Behav Neurosci 9:343-364. CrossRef Medline
19. McAlonan K, Brown VJ (2003) Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat. Behav Brain Res 146: 97-103. CrossRef Medline
20. McDannald MA, Lucantonio F, Burke KA, Niv Y, Schoenbaum G (2011) Ventral striatum and orbitofrontal cortex are both required for modelbased, but not model-free, reinforcement learning. J Neurosci 31:2700-2705. CrossRef Medline
21. McDannald MA, Takahashi YK, Lopatina N, Pietras BW, Jones JL, Schoenbaum G (2012) Model-based learning and the contribution of the orbitofrontal cortex to the model-free world. Eur J Neurosci 35:991-996. CrossRef Medline
22. Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-1947. Medline
23. Murray EA, O'Doherty JP, Schoenbaum G (2007) What we know and do not know about the functions of the orbitofrontal cortex after 20 years of cross-species studies. J Neurosci 27:8166-8169. CrossRef Medline
24. Nissenbaum JW, Sclafani A (1987a) Qualitative differences in polysaccharide and sugar tastes in the rat: a two-carbohydrate taste model. Neurosci Biobehav Rev 11:187-196. CrossRef Medline
25. Nissenbaum JW, Sclafani A (1987b) Sham-feeding response of rats to polycose and sucrose. Neurosci Biobehav Rev 11:215-222. CrossRef Medline
26. Ostlund SB, Balleine BW (2007) The contribution of orbitofrontal cortex to action selection. Ann N Y Acad Sci 1121:174-192. CrossRef Medline
27. Overton DA (1991) Historical context of state dependent learning and discriminative drug effects. Behav Pharmacol 2:253-264. Medline
28. Padoa-Schioppa C (2011) Neurobiology of economic choice: a good-based model. Annu Rev Neurosci 34:333-359. CrossRef Medline
29. Paton JJ, Belova MA, Morrison SE, Salzman CD (2006) The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439:865-870. CrossRef Medline
30. Paxinos G, Watson C (1998) The rat brain in stereotaxic coordinates, ed 2. San Diego: Academic.
31. Pickens CL, Saddoris MP, Gallagher M, Holland PC (2005) Orbitofrontal lesions impair use of cue-outcome associations in a devaluation task. Behav Neurosci 119:317-322. CrossRef Medline
32. Quirk GJ, Russo GK, Barron JL, Lebron K (2000) The role of ventromedial prefrontal cortex in the recovery of extinguished fear. J Neurosci 20:6225-6231. Medline
33. Ragozzino ME (2007) The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility. Ann N Y Acad Sci 1121:355-375. CrossRef Medline
34. Riceberg JS, Shapiro ML (2012) Rewardstability determines the contribution of orbitofrontal cortex to adaptive behavior. J Neurosci 32:16402-16409. CrossRef Medline
35. Rich EL, Shapiro ML (2007) Prelimbic/infralimbic inactivation impairs memory for multiple task switches, but not flexible selection of familiar tasks. J Neurosci 27:4747-4755. CrossRef Medline
36. Roesch MR, Singh T, Brown PL, Mullins SE, Schoenbaum G (2009) Ventral striatal neurons encode the value of the chosen action in rats deciding between differently delayed or sized rewards. J Neurosci 29:13365-13376. CrossRef Medline
37. Roesch MR, Calu DJ, Esber GR, Schoenbaum G (2010) All that glitters...; dissociating attention and outcome expectancy from prediction errors signals. J Neurophysiol 104:587-595. CrossRef Medline
38. Rolls ET, Grabenhorst F (2008) The orbitofrontal cortex and beyond: from affect to decision-making. Prog Neurobiol 86:216-244. CrossRef Medline
39. Saddoris MP, Gallagher M, Schoenbaum G (2005) Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex. Neuron 46:321-331. CrossRef Medline
40. Schilman EA, Uylings HB, Galis-de Graaf Y, Joel D, Groenewegen HJ (2008) The orbital cortex in rats topographically projects to central parts of the caudate-putamen complex. Neurosci Lett 432:40-45. CrossRef Medline
41. Schoenbaum G, Setlow B (2005) Cocaine makes actions insensitive to outcomes but not extinction: implications for altered orbitofrontalamygdalar function. Cereb Cortex 15:1162-1169. Medline
42. Schoenbaum G, Setlow B, Nugent SL, Saddoris MP, Gallagher M (2003) Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn Mem 10:129-140. CrossRef Medline
43. Schoenbaum G, Roesch MR, Stalnaker TA, Takahashi YK (2009) A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat Rev Neurosci 10:885-892. CrossRef Medline
44. Sclafani A, Hertwig H, Vigorito M, Feigin MB (1987) Sex differences in polysaccharide and sugar preferences in rats. Neurosci Biobehav Rev 11: 241-251. CrossRef Medline
45. Setlow B, Schoenbaum G, Gallagher M (2003) Neural encoding in ventral striatum during olfactory discrimination learning. Neuron 38:625-636. CrossRef Medline
46. Stalnaker TA, Franz TM, Singh T, Schoenbaum G (2007) Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron 54:51-58. CrossRef Medline
47. Stalnaker TA, Calhoon GG, Ogawa M, Roesch MR, Schoenbaum G (2010) Neural correlates of stimulus-response and response-outcome associations in dorsolateral versus dorsomedial striatum. Front Integr Neurosci 4:12. CrossRef Medline
48. St Onge JR, Floresco SB (2010) Prefrontal cortical contribution to riskbased decision making. Cereb Cortex 20:1816-1828. CrossRef Medline
49. Stopper CM, Green EB, Floresco SB (2012) Selective involvement by the medial orbitofrontal cortex in biasing risky, but not impulsive, choice. Cereb Cortex. Advance online publication. Retrieved August 22, 2013. doi:10.1093/cercor/bhs297. CrossRef Medline
50. Tait DS, Brown VJ (2007) Difficulty overcoming learned nonreward during reversal learning in rats with ibotenic acid lesions of orbital prefrontal cortex. Ann N Y Acad Sci 1121:407-420. CrossRef Medline
51. Takahashi YK, Roesch MR, Stalnaker TA, Haney RZ, Calu DJ, Taylor AR, Burke KA, Schoenbaum G (2009) The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62:269-280. CrossRef Medline
52. Treesukosol Y, Smith KR, Spector AC (2011) Behavioral evidence for a glucose polymer taste receptor that is independent of the T1R2+3 heterodimer in a mouse model. J Neurosci 31:13527-13534. CrossRef Medline
53. Walton ME, Behrens TE, Buckley MJ, Rudebeck PH, Rushworth MF (2010) Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65:927-939. CrossRef Medline
54. White NM, McDonald RJ (2002) Multiple parallel memory systems in the brain of the rat. Neurobiol Learn Mem 77:125-184. CrossRef Medline
55. Young JJ, Shapiro ML (2009) Double dissociation and hierarchical organization of strategy switches and reversals in the rat PFC. Behav Neurosci 123:1028-1035. CrossRef Medline
56. Young JJ, Shapiro ML (2011) The orbitofrontal cortex and response selection. Ann N Y Acad Sci 1239:25-32. CrossRef Medline
57. Zeeb FD, Floresco SB, Winstanley CA (2010) Contributions of the orbitofrontal cortex to impulsive choice: interactions with basal levels of impulsivity, dopamine signalling, and reward-related cues. Psychopharmacology (Berl) 211:87-98. CrossRef Medline