The medial orbitofrontal cortex encodes a general unsigned value signal during anticipation of both appetitive and aversive events

Cortex

Volumn 63, Issue , 2015, Pages 42-54

  Metereau, Elise ^a   Dreher, Jean Claude ^a  

^a INSTITUT DES SCIENCES COGNITIVES   (France)

Author keywords

Appetitive conditioning; Aversive conditioning; Expected value; FMRI; Orbitofrontal cortex

Indexed keywords

ADULT; ANTICIPATION; APPETITIVE CONDITIONING; ARTICLE; ASSOCIATION; AVERSIVE BEHAVIOR; CONDITIONING; CUNEUS; ELECTROENCEPHALOGRAM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEMISPHERIC DOMINANCE; HUMAN; HUMAN EXPERIMENT; INFERIOR PARIETAL LOBULE; INSULA; LEARNING; MALE; MEDIAL ORBITOFRONTAL CORTEX; NORMAL HUMAN; ORBITAL CORTEX; PRIMARY MOTOR CORTEX; PUNISHMENT; REINFORCEMENT; RESPONSE TIME; REWARD; VENTROMEDIAL PREFRONTAL CORTEX; ADOLESCENT; BRAIN MAPPING; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOSTIMULATION; PHYSIOLOGY; PREFRONTAL CORTEX; REACTION TIME; THEORETICAL MODEL; YOUNG ADULT;

ADOLESCENT; ADULT; BRAIN MAPPING; CUES; FEMALE; HUMANS; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MODELS, THEORETICAL; PHOTIC STIMULATION; PREFRONTAL CORTEX; PUNISHMENT; REACTION TIME; REWARD; YOUNG ADULT;

EID: 84907867365     PISSN: 00109452     EISSN: 19738102     Source Type: Journal    
DOI: 10.1016/j.cortex.2014.08.012     Document Type: Article

References (90)

1. Basten U., Biele G., Heekeren H.R., Fiebach C.J. How the brain integrates costs and benefits during decision making. Proceedings of the National Academy of Sciences of the United States of America 2010, 107:21767-21772.
2. Behrens T.E.J., Hunt L.T., Woolrich M.W., Rushworth M.F.S. Associative learning of social value. Nature 2008, 456:245-249.
3. Berns G.S., McClure S.M., Pagnoni G., Montague P.R. Predictability modulates human brain response to reward. The Journal of Neuroscience 2001, 21:2793-2798.
4. Boorman E.D., Noonan M.P. Contributions of ventromedial prefrontal and frontal polar cortex to reinforcement learning and value-based choice. Neural basis of motivational and cognitive control 2011, 54-74. The MIT Press. R.B. Mars, J. Sallet, M.F.S. Rushworth, N. Yeung (Eds.).
5. Boorman E.D., Rushworth M.F.S. Conceptual representation and the making of new decisions. Neuron 2009, 63:721-723.
6. Bouret S., Richmond B.J. Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. The Journal of Neuroscience 2010, 30:8591-8601.
7. Bray S., O'Doherty J. Neural coding of reward-prediction error signals during classical conditioning with attractive faces. Journal of Neurophysiology 2007, 97:3036-3045.
8. Breiter H.C., Aharon I., Kahneman D., Dale A., Shizgal P. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 2001, 30:619-639.
9. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 2010, 68:815-834.
10. Büchel C., Dolan R.J., Armony J.L., Friston K.J. Amygdala-hippocampal involvement in human aversive trace conditioning revealed through event-related functional magnetic resonance imaging. The Journal of Neuroscience 1999, 19:10869-10876.
11. Chib V.S., Rangel A., Shimojo S., O'Doherty J.P. Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. The Journal of Neuroscience 2009, 29:12315-12320.
12. Clithero J.A., Rangel A. Informatic parcellation of the network involved in the computation of subjective value. Social Cognitive and Affective Neuroscience 2013, 9:1289-1302.
13. Critchley H.D., Mathias C.J., Dolan R.J. Fear conditioning in humans: the influence of awareness and autonomic arousal on functional neuroanatomy. Neuron 2002, 33:653-663.
14. D'Ardenne K., McClure S.M., Nystrom L.E., Cohen J.D. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 2008, 319:1264-1267.
15. Delgado M.R., Li J., Schiller D., Phelps E.A. The role of the striatum in aversive learning and aversive prediction errors. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences 2008, 363:3787-3800.
16. Elliott R., Agnew Z., Deakin J.F.W. Hedonic and informational functions of the human orbitofrontal cortex. Cerebral Cortex 2010, 20:198-204.
17. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
18. FitzGerald T.H.B., Seymour B., Dolan R.J. The role of human orbitofrontal cortex in value comparison for incommensurable objects. The Journal of Neuroscience 2009, 29:8388-8395.
19. Francis S., Rolls E.T., Bowtell R., McGlone F., O'Doherty J., Browning A., et al. The representation of pleasant touch in the brain and its relationship with taste and olfactory areas. NeuroReport 1999, 10:453-459.
20. Friston K.J., Penny W.D., Glaser D.E. Conjunction revisited. NeuroImage 2005, 25:661-667.
21. Gläscher J., Hampton A.N., O'Doherty J.P. Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cerebral Cortex 2009, 19:483-495.
22. Gottfried J.A., Deichmann R., Winston J.S., Dolan R.J. Functional heterogeneity in human olfactory cortex: an event-related functional magnetic resonance imaging study. The Journal of Neuroscience 2002, 22:10819-10828.
23. Gottfried J.A., O'Doherty J., Dolan R.J. Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 2003, 301:1104-1107.
24. Hammers A., Allom R., Koepp M.J., Free S.L., Myers R., Lemieux L., et al. Three-dimensional maximum probability atlas of the human brain, with particular reference to the temporal lobe. Human Brain Mapping 2003, 19:224-247.
25. Hare T.A., O'Doherty J., Camerer C.F., Schultz W., Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. The Journal of Neuroscience 2008, 28:5623-5630.
26. Hare T.A., Schultz W., Camerer C.F., O'Doherty J.P., Rangel A. Transformation of stimulus value signals into motor commands during simple choice. Proceedings of the National Academy of Sciences of the United States of America 2011, 108:18120-18125.
27. Hosokawa T., Kato K., Inoue M., Mikami A. Neurons in the macaque orbitofrontal cortex code relative preference of both rewarding and aversive outcomes. Neuroscience Research 2007, 57:434-445.
28. Jensen J., McIntosh A.R., Crawley A.P., Mikulis D.J., Remington G., Kapur S. Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 2003, 40:1251-1257.
29. Jensen J., Smith A.J., Willeit M., Crawley A.P., Mikulis D.J., Vitcu I., et al. Separate brain regions code for salience vs. valence during reward prediction in humans. Human Brain Mapping 2007, 28:294-302.
30. Kahnt T., Heinzle J., Park S.Q., Haynes J.-D. The neural code of reward anticipation in human orbitofrontal cortex. Proceedings of the National Academy of Sciences of the United States of America 2010, 107:6010-6015.
31. Kahnt T., Heinzle J., Park S.Q., Haynes J.-D. Decoding the formation of reward predictions across learning. The Journal of Neuroscience 2011, 31:14624-14630.
32. Kennerley S.W., Dahmubed A.F., Lara A.H., Wallis J.D. Neurons in the frontal lobe encode the value of multiple decision variables. Journal of Cognitive Neuroscience 2009, 21:1162-1178.
33. Kim H., Shimojo S., O'Doherty J.P. Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. Cerebral Cortex 2010, 21:769-776.
34. Knight D.C., Waters N.S., King M.K., Bandettini P.A. Learning-related diminution of unconditioned SCR and fMRI signal responses. NeuroImage 2010, 49:843-848.
35. Knutson B., Westdorp A., Kaiser E., Hommer D. FMRI visualization of brain activity during a monetary incentive delay task. NeuroImage 2000, 12:20-27.
36. Kobayashi S., Pinto de Carvalho O., Schultz W. Adaptation of reward sensitivity in orbitofrontal neurons. The Journal of Neuroscience 2010, 30:534-544.
37. LaBar K.S., Gatenby J.C., Gore J.C., LeDoux J.E., Phelps E.A. Human amygdala activation during conditioned fear acquisition and extinction: a mixed-trial fMRI study. Neuron 1998, 20:937-945.
38. Lang P.J., Bradley M.M., Cuthbert B.N. International affective picture system (IAPS): Affective ratings of pictures and instruction manual 2005, University of Florida, Gainesville, FL.
39. Lim S.-L., O'Doherty J.P., Rangel A. The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention. The Journal of Neuroscience 2011, 31:13214-13223.
40. Lin A., Adolphs R., Rangel A. Social and monetary reward learning engage overlapping neural substrates. Social Cognitive and Affective Neuroscience 2012, 7:274-281.
41. Litt A., Plassmann H., Shiv B., Rangel A. Dissociating valuation and saliency signals during decision-making. Cerebral Cortex 2011, 21:95-102.
42. Liu X., Powell D.K., Wang H., Gold B.T., Corbly C.R., Joseph J.E. Functional dissociation in frontal and striatal areas for processing of positive and negative reward information. The Journal of Neuroscience 2007, 27:4587-4597.
43. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.
44. McClure S.M., Berns G.S., Montague P.R. Temporal prediction errors in a passive learning task activate human striatum. Neuron 2003, 38:339-346.
45. Menon M., Jensen J., Vitcu I., Graff-Guerrero A., Crawley A., Smith M.A., et al. Temporal difference modeling of the blood-oxygen level dependent response during aversive conditioning in humans: effects of dopaminergic modulation. Biological Psychiatry 2007, 62:765-772.
46. Metereau E., Dreher J.-C. Cerebral correlates of salient prediction error for different rewards and punishments. Cerebral Cortex 2013, 23:477-487.
47. Monosov I.E., Hikosaka O. Regionally distinct processing of rewards and punishments by the primate ventromedial prefrontal cortex. The Journal of Neuroscience 2012, 32:10318-10330.
48. Morrison S.E., Salzman C.D. The convergence of information about rewarding and aversive stimuli in single neurons. The Journal of Neuroscience 2009, 29:11471-11483.
49. Nichols T., Brett M., Andersson J., Wager T., Poline J.-B. Valid conjunction inference with the minimum statistic. NeuroImage 2005, 25:653-660.
50. Nieuwenhuis S., Slagter H.A., von Geusau N.J.A., Heslenfeld D.J., Holroyd C.B. Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes. European Journal of Neuroscience 2005, 21:3161-3168.
51. Noonan M.P., Mars R.B., Rushworth M.F.S. Distinct roles of three frontal cortical areas in reward-guided behavior. The Journal of Neuroscience 2011, 31:14399-14412.
52. O'Doherty J.P., Buchanan T.W., Seymour B., Dolan R.J. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron 2006, 49:157-166.
53. O'Doherty J., Critchley H., Deichmann R., Dolan R.J. Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. The Journal of Neuroscience 2003, 23:7931-7939.
54. O'Doherty J.P., Deichmann R., Critchley H.D., Dolan R.J. Neural responses during anticipation of a primary taste reward. Neuron 2002, 33:815-826.
55. O'Doherty J.P., Dayan P., Friston K., Critchley H., Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 2003, 38:329-337.
56. O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004, 304:452-454.
57. O'Doherty J., Kringelbach M.L., Rolls E.T., Hornak J., Andrews C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nature Neuroscience 2001, 4:95-102.
58. O'Doherty J., Rolls E.T., Francis S., Bowtell R., McGlone F. Representation of pleasant and aversive taste in the human brain. Journal of Neurophysiology 2001, 85:1315-1321.
59. Ogawa M., van der Meer M.A.A., Esber G.R., Cerri D.H., Stalnaker T.A., Schoenbaum G. Risk-responsive orbitofrontal neurons track acquired salience. Neuron 2013, 77:251-258.
60. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971, 9:97-113.
61. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
62. Padoa-Schioppa C., Assad J.A. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nature Neuroscience 2008, 11:95-102.
63. Peelen M.V., Downing P.E. Using multi-voxel patternanalysis of fMRI data to interpret overlapping functional activations. Trends in Cognitive Sciences 2007, 11:4-5.
64. Plassmann H., O'Doherty J., Rangel A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. The Journal of Neuroscience 2007, 27:9984-9988.
65. Plassmann H., O'Doherty J.P., Rangel A. Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. The Journal of Neuroscience 2010, 30:10799-10808.
66. Prevost C., Pessiglione M., Metereau E., Clery-Melin M.-L., Dreher J.-C. Separate valuation subsystems for delay and effort decision costs. The Journal of Neuroscience 2010, 30:14080-14090.
67. Rushworth M.F.S., Behrens T.E.J. Choice, uncertainty and value in prefrontal and cingulate cortex. Nature Neuroscience 2008, 11:389-397.
68. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience 2008, 9:545-556.
69. Rangel A., Clithero J.A. Value normalization in decision making: theory and evidence. Current Opinion in Neurobiology 2012, 22:970-981.
70. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and non-reinforcement. Classical conditioning ii: Current research and theory 1972, 64-99. Appleton-Century-Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
71. Schultz W. Predictive reward signal of dopamine neurons. Journal of Neurophysiology 1998, 80:1-27.
72. Sescousse G., Barbalat G., Domenech P., Dreher J.-C. Imbalance in the sensitivity to different types of rewards in pathological gambling. Brain 2013, 136:2527-2538.
73. Sescousse G., Caldú X., Segura B., Dreher J.-C. Processing of primary and secondary rewards: a quantitative meta-analysis and review of human functional neuroimaging studies. Neuroscience & Biobehavioral Reviews 2013, 37:681-696.
74. Sarinopoulos I., Grupe D.W., Mackiewicz K.L., Herrington J.D., Lor M., Steege E.E., et al. Uncertainty during anticipation modulates neural responses to aversion in human insula and amygdala. Cerebral Cortex 2010, 20:929-940.
75. Sescousse G., Li Y., Dreher J.-C. A common currency for the computation of motivational values in the human striatum. Social Cognitive and Affective Neuroscience 2014, (Epub ahead of print).
76. Seymour B., O'Doherty J.P., Dayan P., Koltzenburg M., Jones A.K., Dolan R.J., et al. Temporal difference models describe higher-order learning in humans. Nature 2004, 429:664-667.
77. Seymour B., O'Doherty J.P., Koltzenburg M., Wiech K., Frackowiak R., Friston K., et al. Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nature Neuroscience 2005, 8:1234-1240.
78. Sescousse G., Redoute J., Dreher J.-C. The architecture of reward value coding in the human orbitofrontal cortex. The Journal of Neuroscience 2010, 30:13095-13104.
79. Schoenbaum G., Roesch M.R., Stalnaker T.A., Takahashi Y.K. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nature Reviews Neuroscience 2009, 10:885-892.
80. Schoenbaum G., Saddoris M.P., Stalnaker T.A. Reconciling the roles of orbitofrontal cortex in reversal learning and the encoding of outcome expectancies. Annual Meeting of the New York Academy of Sciences 2007, 1121:320-335.
81. Schoenbaum G., Takahashi Y., Liu T.-L., McDannald M.A. Does the orbitofrontal cortex signal value?. Annual Meeting of the New York Academy of Sciences 2011, 1239:87-99.
82. Small D.M., Zald D.H., Jones-Gotman M., Zatorre R.J., Pardo J.V., Frey S., et al. Human cortical gustatory areas: a review of functional neuroimaging data. NeuroReport 1999, 10:7-14.
83. Tanaka S.C., Doya K., Okada G., Ueda K., Okamoto Y., Yamawaki S. Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nature Neuroscience 2004, 7:887-893.
84. Tom S.M., Fox C.R., Trepel C., Poldrack R.A. The neural basis of loss aversion in decision-making under risk. Science 2007, 315:515-518.
85. Tobler P.N., O'doherty J.P., Dolan R.J., Schultz W. Human neural learning depends on reward prediction errors in the blocking paradigm. Journal of Neurophysiology 2006, 95:301-310.
86. Takahashi Y.K., Roesch M.R., Wilson R.C., Toreson K., O'Donnell P., Niv Y., et al. Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. The Journal of Neuroscience 2011, 14:1590-1597.
87. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 1999, 398:704-708.
88. Ursu S., Carter C.S. Outcome representations, counterfactual comparisons and the human orbitofrontal cortex: implications for neuroimaging studies of decision-making. Brain Research. Cognitive Brain Research 2005, 23:51-60.
89. Wunderlich K., Rangel A., O'Doherty J.P. Economic choices can be made using only stimulus values. Proceedings of the National Academy of Sciences of the United States of America 2010, 107:15005-15010.
90. Zald D.H., Lee J.T., Fluegel K.W., Pardo J.V. Aversive gustatory stimulation activates limbic circuits in humans. Brain 1998, 121(Pt 6):1143-1154.