Increased firing to cues that predict low-value reward in the medial orbitofrontal cortex

Cerebral Cortex

Volumn 24, Issue 12, 2014, Pages 3310-3321

  Burton, Amanda C ^a   Kashtelyan, Vadim ^a   Bryden, Daniel W ^a   Roesch, Matthew R ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

Discounting; Inhibition; Orbitofrontal cortex; Prediction; Reward; Single unit; Value

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ANTICIPATION; ARTICLE; ASSOCIATION; FORCED CHOICE METHOD; LEARNING; LICKING; MALE; MEDIAL ORBITOFRONTAL CORTEX; NERVE POTENTIAL; NONHUMAN; ODOR; OLFACTORY DISCRIMINATION; ORBITAL CORTEX; PRIORITY JOURNAL; RAT; REFRACTORY PERIOD; RESPONSE TIME; REWARD; SATIETY; SWALLOWING; ACTION POTENTIAL; ANALYSIS OF VARIANCE; ANIMAL; CYTOLOGY; DECISION MAKING; FRONTAL LOBE; LONG EVANS RAT; NERVE CELL; PATCH CLAMP TECHNIQUE; PHYSIOLOGY; STATISTICS;

ACTION POTENTIALS; ANALYSIS OF VARIANCE; ANIMALS; CHOICE BEHAVIOR; CUES; FRONTAL LOBE; MALE; NEURONS; ODORS; PATCH-CLAMP TECHNIQUES; RATS; RATS, LONG-EVANS; REWARD; STATISTICS AS TOPIC;

EID: 84920774886     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bht189     Document Type: Article

References (75)

1. Bechara A, Damasio H, Damasio AR. 2000. Emotion, decision making and the orbitofrontal cortex. Cereb Cortex. 10:295-307.
2. Berlin HA, Rolls ET, Kischka U. 2004. Impulsivity, time perception, emotion and reinforcement sensitivity in patients with orbitofrontal cortex lesions. Brain. 127:1108-1126.
3. Bouret S, Richmond BJ. 2010. Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J Neurosci. 30:8591-8601.
4. Bryden DW, Johnson EE, Diao X, Roesch MR. 2011. Impact of expected value on neural activity in rat substantia nigra pars reticulata. Eur J Neurosci. 33:2308-2317.
5. Bryden DW, Johnson EE, Tobia SC, Kashtelyan V, Roesch MR. 2011. Attention for learning signals in anterior cingulate cortex. J Neurosci. 31:18266-18274.
6. Cardinal RN, Winstanley CA, Robbins TW, Everitt BJ. 2004. Limbic corticostriatal systems and delayed reinforcement. Ann N Y Acad Sci. 1021:33-50.
7. Carmichael ST, Price JL. 1996. Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys. J Comp Neurol. 371:179-207.
8. Carmichael ST, Price JL. 1995a. Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J Comp Neurol. 363:615-641.
9. Carmichael ST, Price JL. 1995b. Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J Comp Neurol. 363:642-664.
10. Churchwell JC, Morris AM, Heurtelou NM, Kesner RP. 2009. Interactions between the prefrontal cortex and amygdala during delay discounting and reversal. Behav Neurosci. 123:1185-1196.
11. Clark L, Bechara A, Damasio H, Aitken MR, Sahakian BJ, Robbins TW. 2008. Differential effects of insular and ventromedial prefrontal cortex lesions on risky decision-making. Brain. 131:1311-1322.
12. Damasio H, Grabowski T, Frank R, Galaburda AM, Damasio AR. 1994. The return of Phineas Gage: clues about the brain from the skull of a famous patient. Science. 264:1102-1105.
13. Elliott R, Dolan RJ, Frith CD. 2000. Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies. Cereb Cortex. 10:308-317.
14. Feierstein CE, Quirk MC, Uchida N, Sosulski DL, Mainen ZF. 2006. Representation of spatial goals in rat orbitofrontal cortex. Neuron. 51:495-507.
15. Fiorillo CD, Newsome WT, Schultz W. 2008. The temporal precision of reward prediction in dopamine neurons. Nat Neurosci. 11:966-973.
16. Gruber AJ, Calhoon GG, Shusterman I, Schoenbaum G, Roesch MR, O'Donnell P. 2010. More is less: a disinhibited prefrontal cortex impairs cognitive flexibility. J Neurosci. 30:17102-17110.
17. Gutierrez R, Carmena JM, Nicolelis MA, Simon SA. 2006. Orbitofrontal ensemble activity monitors licking and distinguishes among natural rewards. J Neurophysiol. 95:119-133.
18. Hoover WB, Vertes RP. 2011. Projections of the medial orbital and ventral orbital cortex in the rat. J Comp Neurol. 519:3766-3801.
19. Iversen SD, Mishkin M. 1970. Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Exp Brain Res. 11:376-386.
20. Kable JW, Glimcher PW. 2009. The neurobiology of decision: consensus and controversy. Neuron. 63:733-745.
21. Kahnt T, Chang LJ, Park SQ, Heinzle J, Haynes JD. 2012. Connectivitybased parcellation of the human orbitofrontal cortex. J Neurosci. 32:6240-6250.
22. Kalenscher T, Pennartz CM. 2008. Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Prog Neurobiol. 84:284-315.
23. Kennerley SW, Behrens TE, Wallis JD. 2011. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat Neurosci. 14:1581-1589.
24. Kennerley SW, Wallis JD. 2009. Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. J Neurophysiol. 102:3352-3364.
25. Kheramin S, Body S, Mobini S, Ho MY, Velazquez-Martinez DN, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM. 2002. Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis. Psychopharmacology (Berl). 165:9-17.
26. Kobayashi S, Schultz W. 2008. Influence of reward delays on responses of dopamine neurons. J Neurosci. 28:7837-7846.
27. Kringelbach ML. 2005. The human orbitofrontal cortex: linking reward to hedonic experience. Nat Rev Neurosci. 6:691-702.
28. Kringelbach ML, Rolls ET. 2004. The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Prog Neurobiol. 72:341-372.
29. Mar. AC, Walker AL, Theobald DE, Eagle DM, Robbins TW. 2011. Dissociable effects of lesions to orbitofrontal cortex subregions on impulsive choice in the rat. J Neurosci. 31:6398-6404.
30. McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD. 2007. Time discounting for primary rewards. J Neurosci. 27:5796-5804.
31. McClure SM, Laibson DI, Loewenstein G, Cohen JD. 2004. Separate neural systems value immediate and delayed monetary rewards. Science. 306:503-507.
32. Minamimoto T, Hori Y, Kimura M. 2005. Complementary process to response bias in the centromedian nucleus of the thalamus. Science. 308:1798-1801.
33. Mobini S, Body S, Ho MY, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM. 2002. Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharma-cology (Berl). 160:290-298.
34. Morecraft RJ, Geula C, Mesulam MM. 1992. Cytoarchitecture and neural afferents of orbitofrontal cortex in the brain of the monkey. J Comp Neurol. 323:341-358.
35. Morrison SE, Saez A, Lau B, Salzman CD. 2011. Different time courses for learning-related changes in amygdala and orbitofrontal cortex. Neuron. 71:1127-1140.
36. Morrison SE, Salzman CD. 2011. Representations of appetitive and aversive information in the primate orbitofrontal cortex. Ann N Y Acad Sci. 1239:59-70.
37. Murray EA, O'Doherty JP, Schoenbaum G. 2007. What we know and do not know about the functions of the orbitofrontal cortex after 20 years of cross-species studies. J Neurosci. 27:8166-8169.
38. Noonan MP, Walton ME, Behrens TE, Sallet J, Buckley MJ, Rushworth MF. 2010. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc Natl Acad Sci USA. 107:20547-20552.
39. O'Doherty J, Kringelbach ML, Rolls ET, Hornak J, Andrews C. 2001. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci. 4:95-102.
40. Padoa-Schioppa C. 2011. Neurobiology of economic choice: a goodbased model. Annu Rev Neurosci. 34:333-359.
41. Padoa-Schioppa C, Assad JA. 2006. Neurons in the orbitofrontal cortex encode economic value. Nature. 441:223-226.
42. Paxinos G, Watson C. 1997. The Rat Brain in Stereotaxic Coordinates, Compact 3rd ed. London: Academic Press. p 11-15.
43. Price JL. 2007. Definition of the orbital cortex in relation to specific connections with limbic and visceral structures and other cortical regions. Ann N Y Acad Sci. 1121:54-71.
44. Price JL, Carmichael ST, Drevets WC. 1996. Networks related to the orbital and medial prefrontal cortex: a substrate for emotional behavior? Prog Brain Res. 107:523-536.
45. Roesch MR, Bryden DW. 2011. Impact of size and delay on neural activity in the rat limbic corticostriatal system. Front Neurosci. 5:130.
46. Roesch MR, Bryden DW, Cerri DH, Haney ZR, Schoenbaum G. 2012. Willingness to wait and altered encoding of time-discounted reward in the orbitofrontal cortex with normal aging. J Neurosci. 32:5525-5533.
47. Roesch MR, Calu DJ, Burke KA, Schoenbaum G. 2007. Should I stay or should I go? Transformation of time-discounted rewards in orbitofrontal cortex and associated brain circuits. Ann N Y Acad Sci. 1104:21-34.
48. Roesch MR, Olson CR. 2005. Neuronal activity in primate orbitofrontal cortex reflects the value of time. J Neurophysiol. 94:2457-2471.
49. Roesch MR, Olson CR. 2007. Neuronal activity related to anticipated reward in frontal cortex: does it represent value or reflect motivation? Ann N Y Acad Sci. 1121:431-446.
50. Roesch MR, Olson CR. 2004. Neuronal activity related to reward value and motivation in primate frontal cortex. Science. 304:307-310.
51. Roesch MR, Taylor AR, Schoenbaum G. 2006. Encoding of timediscounted rewards in orbitofrontal cortex is independent of value representation. Neuron. 51:509-520.
52. Rudebeck PH, Murray EA. 2011a. Balkanizing the primate orbitofrontal cortex: distinct subregions for comparing and contrasting values. Ann N Y Acad Sci. 1239:1-13.
53. Rudebeck PH, Murray EA. 2011b. Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on rewardguided behavior. J Neurosci. 31:10569-10578.
54. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF. 2006. Separate neural pathways process different decision costs. Nat Neurosci. 9:1161-1168.
55. Rygula R, Walker SC, Clarke HF, Robbins TW, Roberts AC. 2010. Differential contributions of the primate ventrolateral prefrontal and orbitofrontal cortex to serial reversal learning. J Neurosci. 30:14552-14559.
56. Saleem KS, Kondo H, Price JL. 2008. Complementary circuits connecting the orbital and medial prefrontal networks with the temporal, insular, and opercular cortex in the macaque monkey. J Comp Neurol. 506:659-693.
57. Schilman EA, Uylings HB, Galis-de Graaf Y, Joel D, Groenewegen HJ. 2008. The orbital cortex in rats topographically projects to central parts of the caudate-putamen complex. Neurosci Lett. 432:40-45.
58. Schoenbaum G, Roesch M. 2005. Orbitofrontal cortex, associative learning, and expectancies. Neuron. 47:633-636.
59. Schoenbaum G, Roesch MR, Stalnaker TA, Takahashi YK. 2009. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat Rev Neurosci. 10:885-892.
60. Sellitto M, Ciaramelli E, di Pellegrino G. 2010. Myopic discounting of future rewards after medial orbitofrontal damage in humans. J Neurosci. 30:16429-16436.
61. Simmons JM, Ravel S, Shidara M, Richmond BJ. 2007. A comparison of reward-contingent neuronal activity in monkey orbitofrontal cortex and ventral striatum: guiding actions toward rewards. Ann N Y Acad Sci. 1121:376-394.
62. St Onge JR, Floresco SB. 2010. Prefrontal cortical contribution to riskbased decision making. Cereb Cortex. 20:1816-1828.
63. Stopper CM, Green EB, Floresco SB. 2014. Selective involvement by the medial orbitofrontal cortex in biasing risky, but not impulsive, choice. Cereb Cortex. 24:154-162.
64. Takahashi YK, Roesch MR, Stalnaker TA, Haney RZ, Calu DJ, Taylor AR, Burke KA, Schoenbaum G. 2009. The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron. 62:269-280.
65. Torregrossa MM, Quinn JJ, Taylor JR. 2008. Impulsivity, compulsivity, and habit: the role of orbitofrontal cortex revisited. Biol Psychiatry. 63:253-255.
66. Tremblay L, Schultz W. 1999. Relative reward preference in primate orbitofrontal cortex. Nature. 398:704-708.
67. van Duuren E, Escamez FA, Joosten RN, Visser R, Mulder AB, Pennartz CM. 2007. Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task. Learn Mem. 14:446-456.
68. van Duuren E, van der Plasse G, Lankelma J, Joosten RN, Feenstra MG, Pennartz CM. 2009. Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat. J Neurosci. 29:8965-8976.
69. Vertes RP, Hoover WB, Rodriguez JJ. 2012. Projections of the central medial nucleus of the thalamus in the rat: node in cortical, striatal and limbic forebrain circuitry. Neuroscience. 219:120-136.
70. Wallis JD. 2012. Cross-species studies of orbitofrontal cortex and valuebased decision-making. Nat Neurosci. 15:13-19.
71. Wallis JD. 2007. Orbitofrontal cortex and its contribution to decisionmaking. Annu Rev Neurosci. 30:31-56.
72. Wallis JD, Miller EK. 2003. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur J Neurosci. 18:2069-2081.
73. Winstanley CA. 2007. The orbitofrontal cortex, impulsivity, and addiction: probing orbitofrontal dysfunction at the neural, neurochemical, and molecular level. Ann N Y Acad Sci. 1121:639-655.
74. Winstanley CA, Theobald DE, Cardinal RN, Robbins TW. 2004. Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J Neurosci. 24:4718-4722.
75. Zeeb FD, Floresco SB, Winstanley CA. 2010. Contributions of the orbitofrontal cortex to impulsive choice: interactions with basal levels of impulsivity, dopamine signalling, and reward-related cues. Psychopharmacology (Berl). 211:87-98.