Orbitofrontal cortex signals expected outcomes with predictive codes when stable contingencies promote the integration of reward history

Journal of Neuroscience

Volumn 37, Issue 8, 2017, Pages 2010-2021

  Riceberg, Justin S ^a   Shapiro, Matthew L ^a  

^a MOUNT SINAI SCHOOL OF MEDICINE   (United States)

Author keywords

Decision making; Neurophysiology; Orbitofrontal cortex; Reversal learning; Reward prediction; Single units

Indexed keywords

ADULT; ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; DECISION MAKING; ELEVATED PLUS MAZE TEST; FEMALE; FIRING RATE; NERVE CELL; NONHUMAN; ORBITAL CORTEX; OUTCOME ASSESSMENT; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; RAT; REWARD; SPATIAL BEHAVIOR; SPATIAL LEARNING; SPIKE WAVE; ACTION POTENTIAL; ANIMAL; CYTOLOGY; DEPTH PERCEPTION; DISCRIMINATION LEARNING; LEARNING; LONG EVANS RAT; MALE; MAZE TEST; MOTIVATION; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; PREFRONTAL CORTEX;

ACTION POTENTIALS; ANIMALS; ASSOCIATION LEARNING; DISCRIMINATION LEARNING; GOALS; MALE; MAZE LEARNING; MOVEMENT; NEURONS; PREFRONTAL CORTEX; RATS; RATS, LONG-EVANS; REVERSAL LEARNING; REWARD; SPACE PERCEPTION;

EID: 85013677236     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2951-16.2016     Document Type: Article

References (38)

1. Baxter MG, Parker A, Lindner CCC, Izquierdo AD, Murray EA (2000) Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J Neurosci 20:4311–4319. Medline
2. Boulougouris V, Dalley JW, Robbins TW (2007) Effects of orbitofrontal, infralimbic and prelimbic cortical lesions on serial spatial reversal learning in the rat. Behav Brain Res 179:219–228. CrossRef Medline
3. Butter CM, McDonald JA, Snyder DR (1969) Orality, preference behavior, and reinforcement value of nonfood object in monkeys with orbital frontal lesions. Science 164:1306–1307. CrossRef Medline
4. Hampson RE, Simeral JD, Deadwyler SA (2002) Keeping on track: firing of hippocampal neurons during delayed-nonmatch-to-sample performance. J Neurosci 22:RC198. Medline
5. Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning, Vol 18. New York: Springer.
6. Kennerley SW, Wallis JD (2009) Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. J Neurophysiol 102:3352–3364. CrossRef Medline
7. Kim JJ, Baxter MG (2001) Multiple brain memory systems: the whole does not equal the sum of its parts. Trends Neurosci 24:324–330. Medline
8. Kobayashi S, Pinto de Carvalho O, Schultz W (2010) Adaptation of reward sensitivity in orbitofrontal neurons. J Neurosci 30:534–544. CrossRef Medline
9. Mar AC, Walker AL, Theobald DE, Eagle DM, Robbins TW (2011) Dissociable effects of lesions to orbitofrontal cortex subregions on impulsive choice in the rat. J Neurosci 31:6398–6404. CrossRef Medline
10. Meunier M, Bachevalier J, Mishkin M (1997) Effects of orbital frontal and anterior cingulate lesions on object and spatial memory in rhesus monkeys. Neuropsychologia 35:999–1015. CrossRef Medline
11. Morrison SE, Saez A, Lau B, Salzman CD (2011) Different time courses for learning-related changes in amygdala and orbitofrontal cortex. Neuron 71:1127–1140. CrossRef Medline
12. Pickens CL, Saddoris MP, Setlow B, Gallagher M, Holland PC, Schoenbaum G (2003) Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J Neurosci 23:11078–11084. Medline
13. Riceberg JS, Shapiro ML (2012) Reward stability determines the contribution of orbitofrontal cortex to adaptive behavior. J Neurosci 32:16402– 16409. CrossRef Medline
14. Rich EL, Shapiro M (2009) Rat prefrontal cortical neurons selectively code strategy switches. J Neurosci 29:7208–7219. CrossRef Medline
15. Rich EL, Wallis JD (2016) Decoding subjective decisions from orbitofrontal cortex. Nat Neurosci 19:973–980. CrossRef Medline
16. Rolls ET (2004) The functions of the orbitofrontal cortex. Brain Cogn 55: 11–29. CrossRef Medline
17. Saddoris MP, Gallagher M, Schoenbaum G (2005) Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex. Neuron 46:321–331. CrossRef Medline
18. Schilman EA, Klavir O, Winter C, Sohr R, Joel D (2010) The role of the striatum in compulsive behavior in intact and orbitofrontal-cortex-lesioned rats: possible involvement of the serotonergic system. Neuropsychopharmacology 35:1026–1039. CrossRef Medline
19. Schoenbaum G, Nugent SL, Saddoris MP, Setlow B (2002) Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. Neuroreport 13(6):885–890.
20. Schoenbaum G, Setlow B, Saddoris MP, Gallagher M (2003) Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron 39: 855–867. CrossRef Medline
21. Schoenbaum G, Roesch MR, Stalnaker TA, Takahashi YK (2009) A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat Rev Neurosci 10:885–892. CrossRef Medline
22. Smith AC, Frank LM, Wirth S, Yanike M, Hu D, Kubota Y, Graybiel AM, Suzuki WA, Brown EN (2004) Dynamic analysis of learning in behavioral experiments. J Neurosci 24:447–461. CrossRef Medline
23. Spellman T, Rigotti M, Ahmari SE, Fusi S, Gogos JA, Gordon JA (2015) Hippocampal-prefrontal input supports spatial encoding in working memory. Nature 522:309–314. CrossRef Medline
24. Stalnaker TA, Roesch MR, Franz TM, Burke KA, Schoenbaum G (2006) Abnormal associative encoding in orbitofrontal neurons in cocaine-experienced rats during decision-making. Eur J Neurosci 24:2643–2653. CrossRef Medline
25. Stalnaker TA, Franz TM, Singh T, Schoenbaum G (2007) Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron 54:51–58. CrossRef Medline
26. Stalnaker TA, Cooch NK, Schoenbaum G (2015) What the orbitofrontal cortex does not do. Nat Neurosci 18:620–627. CrossRef Medline
27. Takahashi YK, Roesch MR, Wilson RC, Toreson K, O’Donnell P, Niv Y, Schoenbaum G (2011) Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nat Neurosci 14:1590– 1597. CrossRef Medline
28. van Wingerden M, Vinck M, Lankelma J, Pennartz CM (2010a) Theta-band phase locking of orbitofrontal neurons during reward expectancy. J Neurosci 30:7078–7087. CrossRef Medline
29. van Wingerden M, Vinck M, Lankelma JV, Pennartz CM (2010b) Learning-associated gamma-band phase-locking of action-outcome selective neurons in orbitofrontal cortex. J Neurosci 30:10025–10038. CrossRef Medline
30. van Wingerden M, Vinck M, Tijms V, Ferreira IR, Jonker AJ, Pennartz CM (2012) NMDA receptors control cue-outcome selectivity and plasticity of orbitofrontal firing patterns during associative stimulus-reward learning. Neuron 76:813–825. CrossRef Medline
31. van Wingerden M, van der Meij R, Kalenscher T, Maris E, Pennartz CM (2014) Phase-amplitude coupling in rat orbitofrontal cortex discriminates between correct and incorrect decisions during associative learning. J Neurosci 34:493–505. CrossRef Medline
32. Walton ME, Behrens TE, Buckley MJ, Rudebeck PH, Rushworth MF (2010) Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65:927–939. CrossRef Medline
33. Wilson FA, O’Scalaidhe SP, Goldman-Rakic PS (1994) Functional synergism between putative gamma-aminobutyrate-containing neurons and pyramidal neurons in prefrontal cortex. Proc Natl Acad Sci U S A 91: 4009–4013. CrossRef Medline
34. Wilson RC, Takahashi YK, Schoenbaum G, Niv Y (2014) Orbitofrontal cortex as a cognitive map of task space. Neuron 81:267–279. CrossRef Medline
35. Young JJ, Shapiro ML (2011a) Dynamic coding of goal-directed paths by orbital prefrontal cortex. J Neurosci 31:5989–6000. CrossRef Medline
36. Young JJ, Shapiro ML (2011b) The orbitofrontal cortex and response selection. Ann N Y Acad Sci 1239:25–32. CrossRef Medline
37. Zald DH (2006) The rodent orbitofrontal cortex gets time and direction. Neuron 51:395–397. CrossRef Medline
38. Zhou J, Jia C, Feng Q, Bao J, Luo M (2015) Prospective coding of dorsal raphe reward signals by the orbitofrontal cortex. J Neurosci 35:2717– 2730. CrossRef Medline