How humans integrate the prospects of pain and reward during choice

Journal of Neuroscience

Volumn 29, Issue 46, 2009, Pages 14617-14626

  Talmi, Deborah ^a   Dayan, Peter ^b   Kiebel, Stefan J ^a,d   Frith, Chris D ^a,c   Dolan, Raymond J ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c AARHUS UNIVERSITY HOSPITAL   (Denmark)

^d MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AVERSION; BEHAVIOR; CINGULATE GYRUS; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; ELECTROSTIMULATION; GOAL DIRECTED BEHAVIOR; HUMAN; HUMAN EXPERIMENT; NEUROIMAGING; NORMAL HUMAN; PAIN; PRIORITY JOURNAL; REWARD; SOCIAL INTERACTION; THEORETICAL MODEL;

ADULT; BRAIN; BRAIN MAPPING; CHOICE BEHAVIOR; FEMALE; HUMANS; MALE; PAIN; PAIN MEASUREMENT; PHOTIC STIMULATION; REWARD; YOUNG ADULT;

EID: 70949088167     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2026-09.2009     Document Type: Article

References (51)

1. Aberman JE, Salamone JD (1999) Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience 92:545-552.
2. Andersson JL, Hutton C, Ashburner J, Turner R, Friston K (2001) Modeling geometric deformations in EPI time series. Neuroimage 13:903-919. (Pubitemid 32848335)
3. Ashburner J, Friston KJ (2005) Unified segmentation. Neuroimage 26:839-851.
4. Bach DR, Flandin G, Friston KJ, Dolan RJ (2009) Time-series analysis for rapid event-related skin conductance responses. J Neurosci Methods 84:224-234.
5. Berns GS, McClure SM, Pagnoni G, Montague PR (2001) Predictability modulates human brain response to reward. J Neurosci 21:2793-2798. (Pubitemid 32298220)
6. Berridge KC, Grill HJ (1984) Isohedonic tastes support a two-dimensional hypothesis of palatability. Appetite 5:221-231.
7. Brog JS, Salyapongse A, Deutch AY, Zahm DS (1993) The patterns of afferent innervation of the core and shell in the "accumbens" part of the rat ventral striatum: immunohistochemical detection of retrogradely transported fluoro-gold. J Comp Neurol 338:255-278.
8. Cacioppo JT, Berntson GG (1994) Relationship between attitudes and evaluative space: a critical review, with emphasis on the separability of positive and negative substrates. Psychol Bull 115:401-423. (Pubitemid 24976753)
9. Caine SB, Koob GF (1994) Effects of dopamine D-1 and D-2 antagonists on cocaine self-administration under different schedules of reinforcement in the rat. J Pharmacol Exp Ther 270:209-218.
10. Cardinal RN, Everitt BJ (2004) Neural and psychological mechanisms underlying appetitive learning: links to drug addiction. Curr Opin Neurobiol 14:156-162.
11. Chumbley JR, Friston KJ (2009) False discovery rate revisited: FDR and topological inference using Gaussian random fields. Neuroimage 44:62-70.
12. Craig AD (2003) Interoception: the sense of the physiological condition of the body. Curr Opin Neurobiol 13:500-505.
13. Croxson PL, Walton ME, O'Reilly JX, Behrens TE, Rushworth MF (2009) Effort-based cost-benefit valuation and the human brain. J Neurosci 29:4531-4541.
14. Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8:1704-1711. (Pubitemid 41683198)
15. Dayan P, Balleine BW (2002) Reward, motivation, and reinforcement learning. Neuron 36:285-298.
16. Dickinson A, Balleine B (1994) Motivational control of goal-directed action. Anim Learn Behav 22:1-18.
17. Friston KJ, Ashburner J, Frith CD, Poline JB, Heather JD, Frackowiak RSJ (1995a) Spatial registration and normalization of images. Hum Brain Mapp 2:165-189.
18. Friston KJ, Holmes AP, Worsley KJ, Poline JB, Frith CD, Frackowiak RSJ (1995b) Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp 2:189-210.
19. Friston KJ, Buechel C, Fink GR, Morris J, Rolls E, Dolan RJ (1997) Psychophysiological and modulatory interactions in neuroimaging. Neuroimage 6:218-229.
20. Green RF, Goldried MR (1965) On the bipolarity of semantic space. Psychol Monogr 79.
21. Hoebel BG, Avena NM, Rada P (2007) Accumbens dopamine-acetylcholine balance in approach and avoidance. Curr Opin Pharmacol 7:617-627.
22. Iordanova MD, Westbrook RF, Killcross AS (2006) Dopamine activity in the nucleus accumbens modulates blocking in fear conditioning. Eur J Neurosci 24:3265-3270.
23. Jensen J, McIntosh AR, Crawley AP, Mikulis DJ, Remington G, Kapur S (2003) Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 40:1251-1257. (Pubitemid 38032799)
24. Larsen JT, McGraw AP, Cacioppo JT (2001) Can people feel happy and sad at the same time? J Pers Soc Psychol 81:684-696.
25. Larsen JT, McGraw AP, Mellers BA, Cacioppo JT (2004) The agony of victory and thrill of defeat: mixed emotional reactions to disappointing wins and relieving losses. Psychol Sci 15:325-330.
26. Leknes S, Tracey I (2008) A common neurobiology for pain and pleasure. Nat Rev Neurosci 9:314-320.
27. Lundqvist D, Litton A, Öhman A (1998) Karolinska directed emotional faces. Stockholm: Karolinska Institute.
28. Miller NE (1959) Liberalization of basic S-R concepts: extensions to conflict behavior, motivation and social learning. In: Psychology: a study of a science (Koch S, ed). New York: McGraw-Hill.
29. Montague PR, Hyman SE, Cohen JD (2004) Computational roles for dopamine in behavioural control. Nature 431:760-767.
30. Montague PR, King-Casas B (2007) Efficient statistics, common currencies and the problem of reward-harvesting. Trends Cogn Sci 11:514-519.
31. O'Doherty JP (2007) Lights, camembert, action! The role of human orbitofrontal cortex in encoding stimuli, rewards, and choices. Ann N Y Acad Sci 1121:254-272.
32. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337. (Pubitemid 36555657)
33. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454. (Pubitemid 38495943)
34. Parkinson JA, Robbins TW, Everitt BJ (1999) Selective excitotoxic lesions of the nucleus accumbens core and shell differentially affect aversive Pavlovian conditioning to discrete and contextual cues. Psychobiology 27:256-266.
35. Phillips PE, Walton ME, Jhou TC (2007) Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology 191:483-495.
36. Prelec D, Loewenstein G (1998) The red and the black: mental accounting of savings and debt. Marketing Science 17:4-28. (Pubitemid 128069457)
37. Salamone JD, Correa M (2002) Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav Brain Res 137:3-25.
38. Schimmack U (2001) Pleasure, displeasure, and mixed feelings: are semantic opposites mutually exclusive? Cogn Emot 15:81-97.
39. Schultz W (2006) Behavioral theories and the neurophysiology of reward. Annu Rev Psychol 57:87-115.
40. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
41. Schweimer J, Saft S, Hauber W (2005) Involvement of catecholamine neurotransmission in the rat anterior cingulate in effort-related decision making. Behav Neurosci 119:1687-1692. (Pubitemid 43145741)
42. Seymour B, McClure SM (2008) Anchors, scales and the relative coding of value in the brain. Curr Opin Neurobiol 18:173-178.
43. Seymour B, O'Doherty JP, Dayan P, Koltzenburg M, Jones AK, Dolan RJ, Friston KJ, Frackowiak RS (2004) Temporal difference models describe higher-order learning in humans. Nature 429:664-667.
44. Seymour B, Singer T, Dolan R (2007) The neurobiology of punishment. Nat Rev Neurosci 8:300-311.
45. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. Cambridge, MA: MIT.
46. Talairach J, Tournaux P (1998) Co-planar stereotaxic atlas of the human brain. Stuttgart, Germany: Thieme.
47. Tobler PN, O'Doherty JP, Dolan RJ, Schultz W (2007) Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol 97:1621-1632.
48. Valentin VV, Dickinson A, O'Doherty JP (2007) Determining the neural substrates of goal-directed learning in the human brain. J Neurosci 27:4019-4026. (Pubitemid 46597159)
49. Walton ME, Bannerman DM, Alterescu K, Rushworth MFS (2003) Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions. J Neurosci 23:6475-6479. (Pubitemid 36909873)
50. Walton ME, Rudebeck PH, Bannerman DM, Rushworth MFS (2007) Calculating the cost of acting in frontal cortex. Ann N Y Acad Sci 1104:340-356.
51. Weiskopf N, Hutton C, Josephs O, Deichmann R (2006) Optimal EPI parameters for reduction of susceptibility-induced BOLD sensitivity losses: a whole-brain analysis at 3 T and 1.5 T. Neuroimage 33:493-504. (Pubitemid 44485564)