Identity-specific reward representations in orbitofrontal cortex are modulated by selective devaluation

Journal of Neuroscience

Volumn 37, Issue 10, 2017, Pages 2627-2638

  Howard, James D ^a   Kahnt, Thorsten ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Decision making; Devaluation; fMRI; Olfaction; Orbitofrontal cortex; Reward

Indexed keywords

ADULT; ARTICLE; BREATHING; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; MALE; ORBITAL CORTEX; PRIORITY JOURNAL; STIMULUS; VENTROMEDIAL PREFRONTAL CORTEX; VISUAL ANALOG SCALE; ANTICIPATION; FOOD INTAKE; PHYSIOLOGICAL FEEDBACK; PHYSIOLOGY; PREFRONTAL CORTEX; REWARD; TASK PERFORMANCE; YOUNG ADULT;

ADULT; ANTICIPATION, PSYCHOLOGICAL; APPETITE REGULATION; CHOICE BEHAVIOR; FEEDBACK, PHYSIOLOGICAL; FEMALE; HUMANS; MALE; PREFRONTAL CORTEX; REWARD; TASK PERFORMANCE AND ANALYSIS; YOUNG ADULT;

EID: 85014750862     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3473-16.2017     Document Type: Article

References (71)

1. Ahn S, Phillips AG (1999) Dopaminergic correlates of sensory-specific sati-ety in the medial prefrontal cortex and nucleus accumbens of the rat. J Neurosci 19:RC29(1-6).
2. Balleine BW, Dickinson A (1998) Goal-directed instrumental action: con-tingency and incentive learning and their cortical substrates. Neuropharmacology 37:407-419.
3. Baxter MG, Parker A, Lindner CC, Izquierdo AD, Murray EA (2000) Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J Neurosci 20:4311-4319.
4. Bechara A, Tranel D, Damasio H (2000) Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. Brain 123:2189-2202.
5. Boorman ED, Rajendran VG, O’Reilly JX, Behrens TE (2016) Two anatom-ically and computationally distinct learning signals predict changes to stimulus-outcome associations in hippocampus. Neuron 89:1343-1354.
6. Burke KA, Franz TM, Miller DN, Schoenbaum G (2008) The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards. Nature 454:340-344.
7. Camille N, Griffiths CA, Vo K, Fellows LK, Kable JW (2011) Ventromedial frontal lobe damage disrupts value maximization in humans. J Neurosci 31:7527-7532.
8. Cardinal RN, Parkinson JA, Hall J, Everitt BJ (2002) Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci Biobehav Rev 26:321-352.
9. Carmichael ST, Price JL (1995) Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J Comp Neurol 363:642-664.
10. Carmichael ST, Price JL (1996) Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys. J Comp Neurol 371: 179-207.
11. Chib VS, Rangel A, Shimojo S, O’Doherty JP (2009) Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. J Neurosci 29:12315-12320.
12. Daw ND, O’Doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Cortical substrates for exploratory decisions in humans. Nature 441:876-879.
13. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ (2011) Model-based influences on humans’ choices and striatal prediction errors. Neuron 69:1204-1215.
14. de Araujo IE, Ferreira JG, Tellez LA, Ren X, Yeckel CW (2012) The gut-brain dopamine axis: a regulatory system for caloric intake. Physiol Behav 106:394-399.
15. Dickinson A, Balleine B (1994) Motivational control of goal-directed action. Anim Learn Behav 22:1-18.
16. Fellows LK, Farah MJ (2007) The role of ventromedial prefrontal cortex in decision making: judgment under uncertainty or judgment perse? Cereb Cortex 17:2669-2674.
17. Gallagher M, McMahan RW, Schoenbaum G (1999) Orbitofrontal cortex and representation of incentive value in associative learning. J Neurosci 19:6610-6614.
18. Gläscher J, Daw N, Dayan P, O’Doherty JP (2010) States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66:585-595.
19. Gottfried JA, O’Doherty J, Dolan RJ (2003) Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 301:1104-1107.
20. Gremel CM, Costa RM (2013) Orbitofrontal and striatal circuits dynami-cally encode the shift between goal-directed and habitual actions. Nat Commun 4:2264.
21. Hampton AN, O’Doherty JP (2007) Decoding the neural substrates of reward-related decision making with functional MRI. Proc Natl Acad Sci USA 104:1377-1382.
22. Henssen A, Zilles K, Palomero-Gallagher N, Schleicher A, Mohlberg H, Ger-boga F, Eickhoff SB, Bludau S, Amunts K (2016) Cytoarchitecture and probability maps of the human medial orbitofrontal cortex. Cortex 75: 87-112.
23. Howard JD, Plailly J, Grueschow M, Haynes JD, Gottfried JA (2009) Odor quality coding and categorization in human posterior piriform cortex. Nat Neurosci 12:932-938.
24. Howard JD, Gottfried JA, Tobler PN, Kahnt T (2015) Identity-specific cod-ing of future rewards in the human orbitofrontal cortex. Proc Natl Acad Sci U S A 112:5195-5200.
25. Howard JD, Kahnt T, Gottfried JA (2016) Converging prefrontal pathways support associative and perceptual features of conditioned stimuli. Nat Commun 7:11546.
26. Izquierdo A, Suda RK, Murray EA (2004) Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J Neurosci 24:7540-7548.
27. Jones JL, Esber GR, McDannald MA, Gruber AJ, Hernandez A, Mirenzi A, Schoenbaum G (2012) Orbitofrontal cortex supports behavior and learning using inferred but not cached values. Science 338:953-956.
28. Kahnt T, Heinzle J, Park SQ, Haynes JD (2010) The neural code of reward anticipation in human orbitofrontal cortex. Proc Natl Acad Sci U S A 107:6010-6015.
29. Kahnt T, Chang LJ, Park SQ, Heinzle J, Haynes JD (2012) Connectivity-based parcellation of the human orbitofrontal cortex. J Neurosci 32: 6240-6250.
30. Kahnt T, Park SQ, Haynes JD, Tobler PN (2014) Disentangling neural rep-resentations of value and salience in the human brain. Proc Natl Acad Sci USA 111:5000-5005.
31. Kahnt T, Tobler PN (2017) Dopamine modulates the functional organization of the orbitofrontal cortex. J Neurosci 37:1493-1504.
32. Kennerley SW, Behrens TE, Wallis JD (2011) Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat Neu-rosci 14:1581-1589.
33. Klein-Flugge MC, Barron HC, Brodersen KH, Dolan RJ, Behrens TE (2013) Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex. J Neurosci 33:3202-3211.
34. Kriegeskorte N, Goebel R, Bandettini P (2006) Information-based functional brain mapping. Proc Natl Acad Sci U S A 103:3863-3868.
35. Lebreton M, Jorge S, Michel V, Thirion B, Pessiglione M (2009) An automatic valuation system in the human brain: evidence from functional neuroimaging. Neuron 64:431-439.
36. Levy DJ, Glimcher PW (2011) Comparing apples and oranges: using reward-specific and reward-general subjective value representation in the brain. J Neurosci 31:14693-14707.
37. Mackey S, Petrides M (2010) Quantitative demonstration of comparable architectonic areas within the ventromedial and lateral orbital frontal cortex in the human and the macaque monkey brains. Eur J Neurosci 32:1940-1950.
38. McDannald MA, Esber GR, Wegener MA, Wied HM, Liu TL, Stalnaker TA, Jones JL, Trageser J, Schoenbaum G (2014) Orbitofrontal neurons acquire responses to “valueless” Pavlovian cues during unblocking. Elife 3:e02653.
39. McLaren DG, Ries ML, Xu G, Johnson SC (2012) A generalized form of context-dependent psychophysiological interactions (gPPI): a comparison to standard approaches. Neuroimage 61:1277-1286.
40. McNamee D, Rangel A, O’Doherty JP (2013) Category-dependent and category-independent goal-value codes in human ventromedial prefrontal cortex. Nat Neurosci 16:479-485.
41. Murray EA, Moylan EJ, Saleem KS, Basile BM, Turchi J (2015) Specialized areas for value updating and goal selection in the primate orbitofrontal cortex. Elife 4:e11695.
42. Neubert FX, Mars RB, Sallet J, Rushworth MF (2015) Connectivity reveals relationship of brain areas for reward-guided learning and decision making in human and monkey frontal cortex. Proc Natl Acad Sci U S A 112: E2695-2704.
43. O’Doherty J, Rolls ET, Francis S, Bowtell R, McGlone F, Kobal G, Renner B, Ahne G (2000) Sensory-specific satiety-related olfactory activation of the human orbitofrontal cortex. Neuroreport 11:893-897.
44. O’Doherty JP, Deichmann R, Critchley HD, Dolan RJ (2002) Neural re-sponses during anticipation of a primary taste reward. Neuron 33:815-826.
45. O’Doherty JP, Cockburn J, Pauli WM (2017) Learning, reward, and deci-sion making. Annu Rev Psychol 68:73-100.
46. Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223-226.
47. Pickens CL, Saddoris MP, Setlow B, Gallagher M, Holland PC, Schoenbaum G (2003) Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J Neurosci 23:11078-11084.
48. Plassmann H, O’Doherty J, Rangel A (2007) Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J Neurosci 27: 9984-9988.
49. Prévost C, McNamee D, Jessup RK, Bossaerts P, O’Doherty JP (2013) Evidence for model-based computations in the human amygdala during Pavlovian conditioning. PLoS Comput Biol 9:e1002918.
50. Rhodes SE, Murray EA (2013) Differential effects of amygdala, orbital prefrontal cortex, and prelimbic cortex lesions on goal-directed behavior in rhesus macaques. J Neurosci 33:3380-3389.
51. Rich EL, Wallis JD (2016) Decoding subjective decisions from orbitofrontal cortex. Nat Neurosci 19:973-980.
52. Roitman MF, Stuber GD, Phillips PE, Wightman RM, Carelli RM (2004) Dopamine operates as a subsecond modulator of food seeking. J Neurosci 24:1265-1271.
53. Rolls ET (2015) Taste, olfactory, and food reward value processing in the brain. Prog Neurobiol 127-128 64-90.
54. Rolls ET, Sienkiewicz ZJ, Yaxley S (1989) Hunger modulates the responses to gustatory stimuli of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. Eur J Neurosci 1:53-60.
55. Rudebeck PH, Murray EA (2014) The orbitofrontal oracle: cortical mechanisms for the prediction and evaluation of specific behavioral outcomes. Neuron 84:1143-1156.
56. Rudebeck PH, Saunders RC, Prescott AT, Chau LS, Murray EA (2013) Pre-frontal mechanisms of behavioral flexibility, emotion regulation and value updating. Nat Neurosci 16:1140-1145.
57. Rushworth MF, Kolling N, Sallet J, Mars RB (2012) Valuation and decision-making in frontal cortex: one or many serial or parallel systems? Curr Opin Neurobiol 22:946-955.
58. Schoenbaum G, Chiba AA, Gallagher M (1998) Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat Neurosci 1:155-159.
59. Schuck NW, Cai MB, Wilson RC, Niv Y (2016) Human orbitofrontal cortex represents a cognitive map of state space. Neuron 91:1402-1412.
60. Sescousse G, Redouté J, Dreher JC (2010) The architecture of reward value coding in the human orbitofrontal cortex. J Neurosci 30:13095-13104.
61. Small DM, Zatorre RJ, Dagher A, Evans AC, Jones-Gotman M (2001) Changes in brain activity related to eating chocolate: from pleasure to aversion. Brain 124:1720-1733.
62. Stalnaker TA, Cooch NK, McDannald MA, Liu TL, Wied H, Schoenbaum G (2014) Orbitofrontal neurons infer the value and identity of predicted outcomes. Nat Commun 5:3926.
63. Stettler DD, Axel R (2009) Representations of odor in the piriform cortex. Neuron 63:854-864.
64. Strait CE, Blanchard TC, Hayden BY (2014) Reward value comparison via mutual inhibition in ventromedial prefrontal cortex. Neuron 82:1357-1366.
65. Tremblay L, Schultz W (1999) Relative reward preference in primate or-bitofrontal cortex. Nature 398:704-708.
66. Valentin VV, Dickinson A, O’Doherty JP (2007) Determining the neural substrates of goal-directed learning in the human brain. J Neurosci 27: 4019-4026.
67. Wallis JD (2011) Cross-species studies of orbitofrontal cortex and value-based decision-making. Nat Neurosci 15:13-19.
68. Wellman LL, Gale K, Malkova L (2005) GABAA-mediated inhibition of basolateral amygdala blocks reward devaluation in macaques. J Neurosci 25:4577-4586.
69. Wilson RC, Takahashi YK, Schoenbaum G, Niv Y (2014) Orbitofrontal cortex as a cognitive map of task space. Neuron 81:267-279.
70. Zeeb FD, Winstanley CA (2013) Functional disconnection of the orbito-frontal cortex and basolateral amygdala impairs acquisition of a rat gambling task and disrupts animals’ ability to alter decision-making behavior after reinforcer devaluation. J Neurosci 33:6434-6443.
71. Zelano C, Mohanty A, Gottfried JA (2011) Olfactory predictive codes and stimulus templates in piriform cortex. Neuron 72:178-187.