Action-specific value signals in reward-related regions of the human brain

Journal of Neuroscience

Volumn 32, Issue 46, 2012, Pages 16417-16423

  FitzGerald, Thomas H B ^a   Friston, Karl J ^a   Dolan, Raymond J ^a  

^a WELLCOME TRUST CENTRE FOR NEUROIMAGING   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BEHAVIOR; ADULT; ARTICLE; BAYES THEOREM; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INSULA; LEARNING; MALE; NERVE CELL NETWORK; NORMAL HUMAN; PRIORITY JOURNAL; PSYCHOMOTOR PERFORMANCE; PUTAMEN; REWARD; SPATIAL DISCRIMINATION; TASK PERFORMANCE; THALAMUS; VENTROMEDIAL PREFRONTAL CORTEX; VISUAL STIMULATION;

ADAPTATION, PSYCHOLOGICAL; ADULT; ALGORITHMS; BAYES THEOREM; BEHAVIOR; BRAIN; CUES; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MULTIVARIATE ANALYSIS; NEOSTRIATUM; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE; REWARD; YOUNG ADULT;

EID: 84869036509     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3254-12.2012     Document Type: Article

References (54)

1. Anderson TJ, Jenkins IH, Brooks DJ, Hawken MB, Frackowiak RS, Kennard C (1994) Cortical control of saccades and fixation in man: a PET study. Brain 117:1073-1084. CrossRef Medline
2. Ashburner J (2007) A fast diffeomorphic image registration algorithm. Neuroimage 38:95-113. CrossRef Medline
3. Balleine BW (2005) Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol Behav 86:717-730. CrossRef Medline
4. Benjamini Y, Hochberg J (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc B 57:289-300.
5. Boorman ED, Behrens TE, Woolrich MW, Rushworth MF (2009) How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62:733-743. CrossRef Medline
6. Bunzeck N, Düzel E (2006) Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron 51:369-379. CrossRef Medline
7. Feierstein CE, Quirk MC, Uchida N, Sosulski DL, Mainen ZF (2006) Representation of spatial goals in rat orbitofrontal cortex. Neuron 51:495-507. CrossRef Medline
8. Fink GR, Frackowiak RS, Pietrzyk U, Passingham RE (1997) Multiple nonprimary motor areas in the human cortex. J Neurophysiol 77:2164-2174. Medline
9. Fisher S (1925) Statistical methods for research workers. Edinburgh: Oliver and Boyd.
10. FitzGerald TH, Seymour B, Dolan RJ (2009) The role of human orbitofrontal cortex in value comparison for incommensurable objects. J Neurosci 29:8388-8395. CrossRef Medline
11. Friston KJ, Holmes AP, Worsley KJ, Poline J-P, Frith CD, Frackowiak RSJ (1994) Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp 2:189-210. CrossRef
12. Friston K, Mattout J, Trujillo-Barreto N, Ashburner J, Penny W (2007) Variational free energy and the Laplace approximation. Neuroimage 34: 220-234. CrossRef Medline
13. Friston K, Chu C, Mourão-Miranda J, Hulme O, Rees G, Penny W, Ashburner J (2008) Bayesian decoding of brain images. Neuroimage 39: 181-205. CrossRef Medline
14. Gershman SJ, Pesaran B, Daw ND (2009) Human reinforcement learning subdivides structured action spaces by learning effector-specific values. J Neurosci 29:13524-13531. CrossRef Medline
15. Gläscher J, Hampton AN, O'Doherty JP (2009) Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb Cortex 19:483-495. Medline
16. Gottfried JA, O'Doherty J, Dolan RJ (2003) Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 301: 1104-1107. CrossRef Medline
17. Griswold MA, Jakob PM, Heidemann RM, Nittka M, Jellus V, Wang J, Kiefer B, Haase A (2002) Generalized autocalibrating partially parallel acquisitions (GRAPPA). Magn Reson Med 47:1202-1210. CrossRef Medline
18. Guitart-Masip M, Fuentemilla L, Bach DR, Huys QJ, Dayan P, Dolan RJ, Duzel E (2011) Action dominates valence in anticipatory representations in the human striatum and dopaminergic midbrain. J Neurosci 31:7867-7875. CrossRef Medline
19. Helms G, Draganski B, Frackowiak R, Ashburner J, Weiskopf N (2009) Improved segmentation of deep brain grey matter structures using magnetization transfer (MT) parameter maps. Neuroimage 47:194-198. CrossRef Medline
20. Hori Y, Minamimoto T, Kimura M (2009) Neuronal encoding of reward value and direction of actions in the primate putamen. J Neurophysiol 102:3530-3543. CrossRef Medline
21. Hutton C, Bork A, Josephs O, Deichmann R, Ashburner J, Turner R (2002) Image distortion correction in fMRI: a quantitative evaluation. Neuroimage 16:217-240. CrossRef Medline
22. Kahnt T, Heinzle J, Park SQ, Haynes JD (2010) The neural code of reward anticipation in human orbitofrontal cortex. Proc Natl Acad Sci U S A 107:6010-6015. CrossRef Medline
23. Kahnt T, Heinzle J, Park SQ, Haynes JD (2011) Decoding the formation of reward predictions across learning. J Neurosci 31:14624-14630. CrossRef Medline
24. Kennerley SW, Wallis JD (2009) Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables. Eur J Neurosci 29:2061-2073. CrossRef Medline
25. Kennerley SW, Dahmubed AF, Lara AH, Wallis JD (2009) Neurons in the frontal lobe encode the value of multiple decision variables. J Cogn Neurosci 21:1162-1178. CrossRef Medline
26. Kriegeskorte N, Bandettini P (2007) Analyzing for information, not activation, to exploit high-resolution fMRI. Neuroimage 38:649-662. CrossRef Medline
27. Lau B, Glimcher PW (2008) Value representations in the primate striatum during matching behavior. Neuron 58:451-463. CrossRef Medline
28. Lutti A, Thomas DL, Hutton C, Weiskopf N (2012) High-resolution functional MRI at 3 T: 3D/2D echo-planar imaging with optimized physiological noise correction. Magn Reson Med. Advance online publication. Retrieved Oct. 8, 2012. doi:10.1002/mrm.24398. CrossRef Medline
29. Maldjian JA, Laurienti PJ, Kraft RA, Burdette JH (2003) An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage 19:1233-1239. CrossRef Medline
30. Monchi O, Petrides M, Strafella AP, Worsley KJ, Doyon J (2006) Functional role of the basal ganglia in the planning and execution of actions. Ann Neurol 59:257-264. CrossRef Medline
31. Morcom AM, Friston KJ (2012) Decoding episodic memory in ageing: a Bayesian analysis of activity patterns predicting memory. Neuroimage 59:1772-1782. CrossRef Medline
32. Morris G, Nevet A, Arkadir D, Vaadia E, Bergman H (2006) Midbrain dopamine neurons encode decisions for future action. Nat Neurosci 9:1057-1063. CrossRef Medline
33. Nakahara H, Itoh H, Kawagoe R, Takikawa Y, Hikosaka O (2004) Dopamine neurons can represent context-dependent prediction error. Neuron 41:269-280. CrossRef Medline
34. Norman KA, Polyn SM, Detre GJ, Haxby JV (2006) Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn Sci 10:424-430. CrossRef Medline
35. O'Doherty JP (2011) Contributions of the ventromedial prefrontal cortex to goal-directed action selection. Ann N Y Acad Sci 1239:118-129. CrossRef Medline
36. Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223-226. CrossRef Medline
37. Palminteri S, Boraud T, Lafargue G, Dubois B, Pessiglione M (2009) Brain hemispheres selectively track the expected value of contralateral options. J Neurosci 29:13465-13472. CrossRef Medline
38. Pasquereau B, Nadjar A, Arkadir D, Bezard E, Goillandeau M, Bioulac B, Gross CE, Boraud T (2007) Shaping of motor responses by incentive values through the basal ganglia. J Neurosci 27:1176-1183. CrossRef Medline
39. Plassmann H, O'Doherty J, Rangel A (2007) Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J Neurosci 27: 9984-9988. CrossRef Medline
40. Platt ML, Glimcher PW (1999) Neural correlates of decision variables in parietal cortex. Nature 400:233-238. CrossRef Medline
41. Redgrave P, Rodriguez M, Smith Y, Rodriguez-Oroz MC, Lehericy S, Bergman H, Agid Y, DeLong MR, Obeso JA (2010) Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease. Nat Rev Neurosci 11:760-772. CrossRef Medline
42. Roesch MR, Calu DJ, Schoenbaum G (2007) Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat Neurosci 10:1615-1624. CrossRef Medline
43. Samejima K, Ueda Y, Doya K, Kimura M (2005) Representation of actionspecific reward values in the striatum. Science 310:1337-1340. CrossRef Medline
44. Seo M, Lee E, Averbeck BB (2012) Action selection and action value in frontal-striatal circuits. Neuron 74:947-960. CrossRef Medline
45. Stalnaker TA, Calhoon GG, Ogawa M, Roesch MR, Schoenbaum G (2012) Reward prediction error signaling in posterior dorsomedial striatum is action specific. J Neurosci 32:10296-10305. CrossRef Medline
46. Stephan KE, Penny WD, Daunizeau J, Moran RJ, Friston KJ (2009) Bayesian model selection for group studies. Neuroimage 46:1004-1017. CrossRef Medline
47. Sugrue LP, Corrado GS, Newsome WT (2004) Matching behavior and the representation of value in the parietal cortex. Science 304:1782-1787. CrossRef Medline
48. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15:273-289.
49. Vickery TJ, Chun MM, Lee D (2011) Ubiquity and specificity of reinforcement signals throughout the human brain. Neuron 72:166-177. CrossRef Medline
50. Watkins CJCH, Dayan P (1992) Q-learning. Mach Learn 8:279-292. CrossRef
51. Weiskopf N, Hutton C, Josephs O, Deichmann R (2006) Optimal EPI parameters for reduction of susceptibility-induced BOLD sensitivity losses: a whole-brain analysis at 3 T and 1.5 T. Neuroimage 33:493-504. CrossRef Medline
52. Wunderlich K, Rangel A, O'Doherty JP (2009) Neural computations underlying action-based decision making in the human brain. Proc Natl Acad Sci U S A 106:17199-17204. CrossRef Medline
53. Wunderlich K, Rangel A, O'Doherty JP (2010) Economic choices can be made using only stimulus values. Proc Natl Acad Sci U S A 107:15005-15010. CrossRef Medline
54. Wunderlich K, Dayan P, Dolan RJ (2012) Mapping value-based planning and extensively trained choice in the human brain. Nat Neurosci 15:786-791. CrossRef Medline