Segregated and integrated coding of reward and punishment in the cingulate cortex

Journal of Neurophysiology

Volumn 101, Issue 6, 2009, Pages 3284-3293

  Fujiwara, Juri ^a   Tobler, Philippe N ^c   Taira, Masato ^b   Iijima, Toshio ^a   Tsutsui, Ken Ichiro ^a  

^a TOHOKU UNIVERSITY   (Japan)

^b NIHON UNIVERSITY   (Japan)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BEHAVIORAL RESEARCH; BRAIN FUNCTION; BRAIN REGION; CINGULATE GYRUS; CONTROLLED STUDY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; PRIORITY JOURNAL; TASK PERFORMANCE;

ADULT; BRAIN MAPPING; CHOICE BEHAVIOR; FEMALE; GYRUS CINGULI; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; NEUROPSYCHOLOGICAL TESTS; OXYGEN; PUNISHMENT; REWARD; YOUNG ADULT;

EID: 66349122013     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.90909.2008     Document Type: Article

References (69)

1. Amiez C, Joseph JP, Procyk E. Anterior cingulate error-related activity is modulated by predicted reward. Eur J Neurosci 21: 3447-3452, 2005. (Pubitemid 40961439)
2. Amiez C, Joseph JP, Procyk E. Reward encoding in the monkey anterior cingulate cortex. Cereb Cortex 16: 1040-1055, 2006. (Pubitemid 43992453)
3. Amsel A. Frustration Theory: An Analysis of Dispositional Learning and Memory. Cambridge, UK: Cambridge Univ. Press, 1992.
4. Berridge KC, Robinson TE. Parsing reward. Trends Neurosci 26: 507-513, 2003. (Pubitemid 37025790)
5. Brooks VB. How does the limbic system assist motor learning? A limbic comparator hypothesis. Brain Behav Evol 29: 29-53, 1986. (Pubitemid 17048082)
6. Bush G, Luu P, Posner MI. Cognitive and emotional influences in anterior cingulate cortex. Trends Cogn Sci 4: 215-222, 2000. (Pubitemid 30332147)
7. Bush G, Vogt BA, Holmes J, Dale AM, Greve D, Jenike MA, Rosen BR. Dorsal anterior cingulate cortex: a role in reward-based decision making. Proc Natl Acad Sci USA 99: 523-528, 2002. (Pubitemid 34060394)
8. Carmichael ST, Price JL. Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys. J Comp Neurol 371: 179-207, 1996. (Pubitemid 26260010)
9. Coricelli G, Critchley HD, Joffily M, O'Doherty JP, Sirigu A, Dolan RJ. Regret and its avoidance: a neuroimaging study of choice behavior. Nat Neurosci 8: 1255-1262, 2005. (Pubitemid 43348146)
10. Critchley HD, Mathias CJ, Dolan RJ. Neural activity in the human brain relating to uncertainty and arousal during anticipation. Neuron 29: 537-545, 2001. (Pubitemid 32206490)
11. Damasio AR, Grabowski TJ, Bechara A, Damasio H, Ponto LL, Parvizi J, Hichwa RD. Subcortical and cortical brain activity during the feeling of self-generated emotions. Nat Neurosci 3: 1049-1056, 2000.
12. D'Ardenne K, McClure SM, Nystrom LE, Cohen JD. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319: 1264-1267, 2008.
13. Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA. Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol 84: 3072-3077, 2000.
14. Derbyshire SWG, Whalley MG, Stenger VA, Oakley DA. Cerebral activation during hypnotically induced and imagined pain. Neuroimage 23: 392-401, 2004. (Pubitemid 39119470)
15. Eisenberger NI, Lieberman MD, Williams KD. Does rejection hurt? An fMRI study of social exclusion. Science 302: 290-292, 2003. (Pubitemid 37248760)
16. Ernst M, Nelson EE, McClure EB, Monk CS, Munson S, Eshel N, Zarahn E, Leibenluft E, Zametkin A, Towbin K, Blair J, Charney D, Pine DS. Choice selection and reward anticipation: an fMRI study. Neuropsychologia 42: 1585-1597, 2004. (Pubitemid 39140870)
17. Friston KJ, Tononi G, Reeke GN, Sporns O, Edelman GM. Value-dependent selection in the brain: simulation in a synthetic neural model. Neuroscience 59: 229-243, 1995.
18. Fujiwara J, Tobler PN, Taira M, Iijima T, Tsutsui K. Personality- dependent dissociation of absolute and relative loss processing in orbitofrontal cortex. Eur J Neurosci 27: 1547-1552, 2008.
19. Fujiwara J, Tobler PN, Taira M, Iijima T, Tsutsui K. A parametric relief signal in ventrolateral prefrontal cortex. Neuroimage 44: 1163-1170, 2009.
20. Fuster J. The Prefrontal Cortex Anatomy, Physiology, and Neuropsychology of the Frontal Lobe. Philadelphia, PA: Lippincott-Raven Publishers, 1997.
21. Gehring WJ, Willoughby AR. The medial frontal cortex and the rapid processing of monetary gains and losses. Science 295: 2279-2282, 2002. (Pubitemid 34258845)
22. Holroyd CB, Coles MG. Dorsal anterior cingulate cortex integrates reinforcement history to guide voluntary behavior. Cortex 44: 548-559, 2008.
23. Holroyd CB, Nieuwenhuis S, Yeung N, Nystrom L, Mars RB, Coles MG, Cohen JD. Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals. Nat Neurosci 7: 497-498, 2004. (Pubitemid 38544587)
24. Ito S, Stuphorn V, Brown JW, Schall JD. Performance monitoring by the anterior cingulate cortex during saccade countermanding. Science 302: 120-122, 2003. (Pubitemid 37210702)
25. Izuma K, Saito DN, Sadato N. Processing of social and monetary rewards in the human striatum. Neuron 58: 284-294, 2008.
26. Kahneman D, Tversky A. Prospect theory: analysis of decision under risk. Econometrica 47: 263-291, 1979.
27. Kennerley SW, Walton ME, Behrens TE, Buckley MJ, Rushworth MF. Optimal decision making and the anterior cingulate cortex. Nat Neurosci 9: 940-947, 2006. (Pubitemid 43980509)
28. Kim H, Shimojo S, O'Doherty JP. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol 4: e233, 2006. (Pubitemid 44243400)
29. Knutson B, Fong GW, Adams CM, Varner JL, Hommer D. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport 12: 3683-3687, 2001. (Pubitemid 33105151)
30. Kobayashi S, Nomoto K, Watanabe M, Hikosaka O, Schultz W, Sakagami M. Influences of rewarding and aversive outcomes on activity in macaque lateral prefrontal cortex. Neuron 51: 861-870, 2006. (Pubitemid 44374914)
31. Lang PJ, Davis M. Emotion, motivation, and the brain: reflex foundations in animal and human research. Prog Brain Res 156: 3-29, 2006. (Pubitemid 44466038)
32. Levin H, Eisenberg H, Benton A. Frontal Lobe Function and Dysfunction. New York: Oxford Univ. Press, 1991.
33. Liu X, Powell DK, Wang H, Gold BT, Corbly CR, Joseph JE. Functional dissociation in frontal and striatal areas for processing of positive and negative reward information. J Neurosci 27: 4587-4597, 2007. (Pubitemid 46663580)
34. Löw A, Lang PJ, Smith JC, Bradley MM. Both predator and prey: emotional arousal in threat and reward. Psychol Sci 19: 865-873, 2008.
35. Maldijan JA, Laurienti PJ, Kraft RA, Burdette JH. An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage 19: 1233-1239, 2003. (Pubitemid 36918259)
36. Mars RB, Coles MG, Grol MJ, Holroyd CB, Nieuwenhuis S, Hulstijn W, Toni I. Neural dynamics of error processing in medial frontal cortex. Neuroimage 28: 1007-1013, 2005. (Pubitemid 41713634)
37. Marsh AA, Blair KS, Vythilingam M, Busis S, Blair RJ. Response options and expectations of reward in decision-making: the differential roles of dorsal and rostral anterior cingulate cortex. Neuroimage 35: 979-988, 2007. (Pubitemid 46420424)
38. Matsumoto M, Matsumoto K, Abe H, Tanaka K. Medial prefrontal cell activity signaling prediction errors of action values. Nat Neurosci 10: 647-656, 2007. (Pubitemid 46652446)
39. McCoy AN, Crowley JC, Haghighian G, Dean HL, Platt ML. Saccade reward signals in posterior cingulate cortex. Neuron 40: 1031-1040, 2003. (Pubitemid 37522060)
40. Michelet T, Bioulac B, Guehl D, Escola L, Burbaud P. Impact of commitment on performance evaluation in the rostral cingulate motor area. J Neurosci 27: 7482-7489, 2007. (Pubitemid 47066575)
41. Morecraft RJ, Van Hoesen GW. Convergence of limbic input to the cingulate motor cortex in the rhesus monkey. Brain Res Bull 45: 209-232, 1998. (Pubitemid 28027806)
42. Ng CW, Noblejas MI, Rodefer JS, Smith CB, Poremba A. Double dissociation of attentional resources: prefrontal versus cingulate cortices. J Neurosci 27: 12123-12131, 2007. (Pubitemid 350085468)
43. Nieuwenhuis S, Slagter HA, von Geusau NJ, Heslenfeld DJ, Holroyd CB. Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes. Eur J Neurosci 21: 3161-3168, 2005. (Pubitemid 40917076)
44. Niki H, Watanabe M. Cingulate unit activity and delayed response. Brain Res 110: 381-386, 1976.
45. Niki H, Watanabe M. Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Res 171: 213-224, 1979. (Pubitemid 10246665)
46. O'Doherty J, Critchley H, Deichmann R, Dolan RJ. Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J Neurosci 23: 7931-7939, 2003. (Pubitemid 37052362)
47. O'Doherty J, Kringelbach ML, Rolls ET, Hornak J, Andrews C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci 4: 95-102, 2001. (Pubitemid 32095532)
48. O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ. Neural responses during anticipation of a primary taste reward. Neuron 33: 815-826, 2002. (Pubitemid 34219251)
49. Oliveira FT, McDonald JJ, Goodman D. Performance monitoring in the anterior cingulate is not all error related: expectancy deviation and the representation of action-outcome associations. J Cogn Neurosci 19: 1994-2004, 2007. (Pubitemid 350220511)
50. Quilodran R, Roth M, Procyk E. Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron 57: 314-325, 2008.
51. Raij TT, Numminen J, Narvanen S, Hiltunen J, Hari R. Brain correlates of subjective reality of physically and psychologically induced pain. Proc Natl Acad Sci USA 102: 2147-2151, 2005. (Pubitemid 40262026)
52. Rescorla RA, Wagner AR. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical Conditioning II: Current Research and Theory, edited by Black AH, Prokasy WF. New York: Appleton-Century-Crofts, 1972, p. 64-99.
53. Rushworth MF, Behrens TE, Rudebeck PH, Walton ME. Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour. Trends Cogn Sci 11: 168-176, 2007. (Pubitemid 46467492)
54. Rushworth MF, Walton ME, Kennerley SW, Bannerman DM. Action sets and decisions in the medial frontal cortex. Trends Cogn Sci. 8: 410-417, 2004. (Pubitemid 39179904)
55. Sallet J, Quilodran R, Roth M, Vezoli J, Joseph JP, Procyk E. Expectations, gains, and losses in the anterior cingulate cortex. Cogn Affect Behav Neurosci 7: 327-336, 2007.
56. Seo H, Lee D. Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J Neurosci 27: 8366-8377, 2007. (Pubitemid 47219624)
57. Seymour B, Daw N, Dayan P, Singer T, Dolan R. Differential encoding of losses and gains in the human striatum. J Neurosci 27: 4826-4831, 2007. (Pubitemid 46699059)
58. Shidara M, Richmond BJ. Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science 296: 1709-1711, 2002. (Pubitemid 34579174)
59. Shima K, Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282: 1335-1338, 1998. (Pubitemid 28524499)
60. Singer T, Seymour B, O'Doherty J, Kaube H, Dolan RJ, Frith CD. Empathy for pain involves the affective but not sensory components of pain. Science 303: 1157-1162, 2004. (Pubitemid 38233574)
61. Stuss DT, Benson DF. The Frontal Lobes. New York: Raven Press, 1986.
62. Tobler PN, O'Doherty JP, Dolan RJ, Schultz W. Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol 97: 1621-1632, 2007. (Pubitemid 46239533)
63. Tom SM, Fox CR, Trepel C, Poldrack RA. The neural basis of loss aversion in decision-making under risk. Science 315: 515-518, 2007. (Pubitemid 46175755)
64. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15: 273-289, 2002.
65. Vogt BA, Vogt L, Farber NB, Bush G. Architecture and neurocytology of monkey cingulate gyrus. J Comp Neurol 485: 218-239, 2005. (Pubitemid 40471300)
66. Walton ME, Croxson PL, Behrens TE, Kennerley SW, Rushworth MF. Adaptive decision making and value in the anterior cingulate cortex. Neuroimage 36, Suppl. 2: T142-T154, 2007. (Pubitemid 46702736)
67. Walton ME, Devlin JT, Rushworth MF. Interactions between decision making and performance monitoring within prefrontal cortex. Nat Neurosci 7: 1259-1265, 2004. (Pubitemid 39426246)
68. Wang Y, Shima K, Sawamura H, Tanji J. Spatial distribution of cingulate cells projecting to the primary, supplementary, and pre-supplementary motor areas: a retrograde multiple labeling study in the macaque monkey. Neurosci Res 39: 39-49, 2001. (Pubitemid 32042504)
69. Williams ZM, Bush G, Rauch SL, Cosgrove GR, Eskandar EN. Human anterior cingulate neurons and the integration of monetary reward with motor responses. Nat Neurosci 7: 1370-1375, 2004. (Pubitemid 41057760)