Orbitofrontal cortex reflects changes in response–outcome contingencies during probabilistic reversal learning

Neuroscience

Volumn 345, Issue , 2017, Pages 27-37

  Amodeo, L R ^a   McMurray, M S ^b   Roitman, J D ^a  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^b MIAMI UNIVERSITY   (United States)

Author keywords

cognitive flexibility; electrophysiology; orbitofrontal cortex; probabilistic reversal learning; reward

Indexed keywords

ADULT; ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; CONTROLLED STUDY; DECISION MAKING; LEARNING; MALE; NEUROMODULATION; NONHUMAN; ORBITAL CORTEX; PROBABILISTIC REVERSAL LEARNING; RAT; REWARD; ANIMAL; ELECTRODE IMPLANT; EXECUTIVE FUNCTION; NERVE CELL; NEUROPSYCHOLOGICAL TEST; PERCEPTIVE DISCRIMINATION; PHYSIOLOGY; PREFRONTAL CORTEX; SPRAGUE DAWLEY RAT;

ANIMALS; DISCRIMINATION (PSYCHOLOGY); ELECTRODES, IMPLANTED; EXECUTIVE FUNCTION; MALE; NEURONS; NEUROPSYCHOLOGICAL TESTS; PREFRONTAL CORTEX; PROBABILITY LEARNING; RATS, SPRAGUE-DAWLEY; REVERSAL LEARNING; REWARD;

EID: 85012904674     PISSN: 03064522     EISSN: 18737544     Source Type: Journal    
DOI: 10.1016/j.neuroscience.2016.03.034     Document Type: Article

References (44)

1. Amodeo, D.A., Jones, J.H., Sweeney, J.A., Ragozzino, M.E., Differences in BTBR T+ tf/J and C57BL/6J mice on probabilistic reversal learning and stereotyped behaviors. Behav Brain Res 227 (2012), 64–72.
2. Bissonette, G.B., Schoenbaum, G., Roesch, M.R., Powell, E.M., Interneurons are necessary for coordinated activity during reversal learning in orbitofrontal cortex. Biol Psychiatry 77 (2015), 454–464.
3. Brown, H.D., McCutcheon, J.E., Cone, J.J., Ragozzino, M.E., Roitman, M.F., Primary food reward and reward-predictive stimuli evoke different patterns of phasic dopamine signaling throughout the striatum. Eur J Neurosci 34 (2011), 1997–2006.
4. Castane, A., Theobald, D.E., Robbins, T.W., Selective lesions of the dorsomedial striatum impair serial spatial reversal learning in rats. Behav Brain Res 210 (2010), 74–83.
5. Chudasama, Y., Robbins, T.W., Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J Neurosci 23 (2003), 8771–8780.
6. Dalton, G.L., Phillips, A.G., Floresco, S.B., Preferential involvement by nucleus accumbens shell in mediating probabilistic learning and reversal shifts. J Neurosci 34 (2014), 4618–4626.
7. Dalton, G.L., Wang, N.Y., Phillips, A.G., Floresco, S.B., Multifaceted contributions by different regions of the orbitofrontal and medial prefrontal cortex to probabilistic reversal learning. J Neurosci 36 (2016), 1996–2006.
8. D'Cruz, A.M., Ragozzino, M.E., Mosconi, M.W., Shrestha, S., Cook, E.H., Sweeney, J.A., Reduced behavioral flexibility in autism spectrum disorders. Neuropsychology 27 (2013), 152–160.
9. Dias, R., Robbins, T.W., Roberts, A.C., Primate analogue of the Wisconsin Card Sorting Test: effects of excitotoxic lesions of the prefrontal cortex in the marmoset. Behav Neurosci 110 (1996), 872–886.
10. Gallagher, M., McMahan, R.W., Schoenbaum, G., Orbitofrontal cortex and representation of incentive value in associative learning. J Neurosci 19 (1999), 6610–6614.
11. Haluk, D.M., Floresco, S.B., Ventral striatal dopamine modulation of different forms of behavioral flexibility. Neuropsychopharmacology 34 (2009), 2041–2052.
12. Izquierdo, A.D., Suda, R.K., Murray, E.A., Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J Neurosci 24 (2004), 7540–7548.
13. Jones, B., Mishkin, M., Limbic lesions and the problem of stimulus-reinforcement associations. Exp Neurol 36 (1972), 362–377.
14. Kennerley, S.W., Dahmubed, A.F., Lara, A.H., Wallis, J.D., Neurons in the frontal lobe encode the value of multiple decision variables. J Cogn Neurosci 21 (2009), 1162–1178.
15. Kepecs, A., Uchida, N., Zariwala, H.A., Mainen, Z.F., Neural correlates, computation and behavioural impact of decision confidence. Nature 455 (2008), 227–231.
16. Kim, J., Ragozzino, M.E., The involvement of the orbitofrontal cortex in learning under changing task contingencies. Neurobiol Learn Mem 83 (2005), 125–133.
17. Machado, C.J., Bachevalier, J., Measuring reward assessment in a semi-naturalistic context: the effects of selective amygdala, orbital frontal or hippocampal lesions. Neurosci 148 (2007), 599–611.
18. Mante, V., Sussillo, D., Shenoy, K.V., Newsome, W.T., Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 503 (2013), 78–84.
19. McDannald, M.A., Takahashi, Y.K., Lopatina, N., Pietras, B.W., Jones, J.L., Schoenbaum, G., Model-based learning and the contribution of the orbitofrontal cortex to the model-free world. Eur J Neurosci 35 (2012), 991–996.
20. McMurray, M.S., Amodeo, L.R., Roitman, J.D., Consequences of adolescent ethanol consumption on risk preference and orbitofrontal cortex encoding of reward. Neuropsychopharmacology, 2015, 10.1038/npp.2015.288 [Epub ahead of print].
21. Morrison, S.E., Salzman, C.D., The convergence of information about rewarding and aversive stimuli in single neurons. J Neurosci 29 (2009), 11471–11483.
22. Murray, E.A., O'Doherty, J.P., Schoenbaum, G., What we know and do not know about the functions of the orbitofrontal cortex after 20 years of cross-species studies. J Neurosci 27 (2007), 8166–8169.
23. O'Neill, M., Schultz, W., Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 68 (2010), 789–800.
24. Padoa-Schioppa, C., Neurobiology of ECONOMIC CHOICE: A GOOD-BASED MODEL. Annu Rev Neurosci 34 (2011), 333–359.
25. Padoa-Schioppa, C., Assad, J.A., Neurons in the orbitofrontal cortex encode economic value. Nature 441 (2006), 223–226.
26. Paxinos, G., Watson, C., The rat brain in stereotaxic coordinates. 2007, Academic Press, London, UK.
27. Ragozzino, M.E., The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility. Ann N Y Acad Sci 1121 (2007), 355–375.
28. Rangel, A., Camerer, C., Montague, P.R., A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9 (2008), 545–556.
29. Riceberg, J.S., Shapiro, M.L., Reward stability determines the contribution of orbitofrontal cortex to adaptive behavior. J Neurosci 32 (2012), 16402–16409.
30. Roesch, M.R., Taylor, A.R., Schoenbaum, G., Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51 (2006), 509–520.
31. Roitman, J.D., Roitman, M.F., Risk-preference differentiates orbitofrontal cortex responses to freely chosen reward outcomes. Eur J Neurosci 31 (2010), 1492–1500.
32. Rudebeck, P.H., Saunders, R.C., Prescott, A.T., Chau, L.S., Murray, E.A., Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating. Nat Neurosci 16 (2013), 1140–1145.
33. Schoenbaum, G., Eichenbaum, H., Information coding in the rodent prefrontal cortex. II. Ensemble activity in orbitofrontal cortex. J Neurophysiol 74 (1995), 751–762.
34. Schoenbaum, G., Nugent, S.L., Saddoris, M.P., Setlow, B., Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. NeuroReport 13 (2002), 885–890.
35. Schoenbaum, G., Takahashi, Y., Liu, T., McDannald, M.A., Does the orbitofrontal cortex signal value?. Ann N Y Acad Sci 1239 (2011), 87–99.
36. Stalnaker, T.A., Roesch, M.R., Franz, T.M., Burke, K.A., Schoenbaum, G., Abnormal associative encoding in orbitofrontal neurons in cocaine-experienced rats during decision-making. Eur J Neurosci 24 (2006), 2643–2653.
37. Stalnaker, T.A., Cooch, N.K., Schoenbaum, G., What the orbitofrontal cortex does not do. Nat Neurosci 18 (2015), 620–627.
38. Teitelbaum, H., A comparison of effects of orbitofrontal and hippocampal lesions upon discrimination learning and reversal in the cat. Exp Neurol 9 (1964), 452–462.
39. Tremblay, L., Schultz, W., Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J Neurophysiol 83 (2000), 1864–1876.
40. Tsuchida, A., Doll, B.B., Fellows, L.K., Beyond reversal: a critical role for human orbitofrontal cortex in flexible learning from probabilistic feedback. J Neurosci 30 (2010), 16,868–16,875.
41. Wallis, J.D., Neuronal mechanisms in prefrontal cortex underlying adaptive choice behavior. Ann N Y Acad Sci 1121 (2007), 447–460.
42. Walton, M.E., Behrens, T.E., Noonan, M.P., Rushworth, M.F., Giving credit where credit is due: orbitofrontal cortex and valuation in an uncertain world. Ann N Y Acad Sci 1239 (2011), 14–24.
43. Waltz, J.A., Gold, J.M., Probabilistic reversal learning impairments in schizophrenia: further evidence of orbitofrontal dysfunction. Schizophr Res 93 (2007), 296–303.
44. Young, J.J., Shapiro, M.L., The orbitofrontal cortex and response selection. Ann N Y Acad Sci 1239 (2011), 25–32.