Reward-related activity in ventral striatum is action contingent and modulated by behavioral relevance

Journal of Neuroscience

Volumn 34, Issue 4, 2014, Pages 1271-1279

  FitzGerald, Thomas H B ^a   Schwartenbeck, Philipp ^a,b,c   Dolan, Raymond J ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF SALZBURG   (Austria)

^c PARACELSUS MEDICAL UNIVERSITY   (Austria)

Author keywords

Action value; Multisensory; Policy selection; Reward; Ventral striatum

Indexed keywords

ACTION VALUE; MULTISENSORY; POLICY SELECTION; REWARD; VENTRAL STRIATUM;

ADULT; BRAIN MAPPING; CHOICE BEHAVIOR; CORPUS STRIATUM; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; MOTIVATION; REWARD; YOUNG ADULT;

EID: 84892750543     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.4389-13.2014     Document Type: Article

References (56)

1. Ashburner J (2007) A fast diffeomorphic image registration algorithm. Neuroimage 38:95-113. CrossRef Medline
2. Balleine BW, Killcross S (2006) Parallel incentive processing: an integrated view of amygdala function. Trends Neurosci 29:272-279. CrossRef Medline
3. Bartra O, McGuire JT, Kable JW (2013) The valuation system: a coordinatebased meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage 76:412-427. CrossRef Medline
4. Boorman ED, Behrens TE, Rushworth MF (2011) Counterfactual choice and learning in a neural network centered on human lateral frontopolar cortex. PLoS Biol 9:e1001093. CrossRef Medline
5. Bray S, Rangel A, Shimojo S, Balleine B, O'Doherty JP (2008) The neural mechanisms underlying the influence of pavlovian cues on human decision making. J Neurosci 28:5861-5866. CrossRef Medline
6. Chadwick MJ, Bonnici HM, Maguire EA (2012) Decoding information in the human hippocampus: a user's guide. Neuropsychologia 50:3107-3121. CrossRef Medline
7. Chang CC, Lin CJ (2011) LIBSVM: A library for support vector machines. ACM Trans Intell Syst Technol 2:27.
8. Clithero JA, Rangel A (2013) Informatic parcellation of the network involved in the computation of subjective value. Soc Cogn Affect Neurosci. Advance online publication. Retrieved May 10, 2013. doi:10.1093/scan/ nst106. CrossRef Medline
9. Coricelli G, Critchley HD, Joffily M, O'Doherty JP, Sirigu A, Dolan RJ (2005) Regret and its avoidance: a neuroimaging study of choice behavior. Nat Neurosci 8:1255-1262. CrossRef Medline
10. Dayan P, Daw ND (2008) Decision theory, reinforcement learning, and the brain. Cogn Affect Behav Neurosci 8:429-453. CrossRef Medline
11. Dayan P, Solomon JA (2010) Selective Bayes: attentional load and crowding. Vision Res 50:2248-2260. CrossRef Medline
12. Dayan P, Kakade S, Montague PR (2000) Learning and selective attention. Nat Neurosci [3 Suppl]:1218-1223. Medline
13. Deichmann R, Gottfried JA, Hutton C, Turner R (2003) Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage 19:430-441. CrossRef Medline
14. Feldman H, Friston KJ (2010) Attention, uncertainty, and free-energy. Front Hum Neurosci 4:215. Medline
15. Fitz Gerald TH, Friston KJ, Dolan RJ (2012) Action-specific value signals in reward-related regions of the human brain. J Neurosci 32:16417-16423a. CrossRef Medline
16. Fitz Gerald TH, Friston KJ, Dolan RJ (2013) Characterising reward outcome signals in sensory cortex. Neuroimage 83:329-334. CrossRef Medline
17. Friston KJ, Daunizeau J, Kiebel SJ (2009) Reinforcement learning or active inference? PLoS One 4:e6421. CrossRef Medline
18. Gershman S, Cohen J, Niv Y (2010) Learning to selectively attend. 32nd Annual Conference of the Cognitive Science Society, Portland, OR.
19. Guitart-Masip M, Fuentemilla L, Bach DR, Huys QJ, Dayan P, Dolan RJ, Duzel E (2011) Action dominates valence in anticipatory representations in the human striatum and dopaminergic midbrain. J Neurosci 31:7867-7875. CrossRef Medline
20. Guitart-Masip M, Huys QJ, Fuentemilla L, Dayan P, Duzel E, Dolan RJ (2012) Go and no-go learning in reward and punishment: interactions between affect and effect. Neuroimage 62:154-166. CrossRef Medline
21. Hare TA, O'Doherty J, Camerer CF, Schultz W, Rangel A (2008) Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci 28:5623-5630. CrossRef Medline
22. Hutton C, Bork A, Josephs O, Deichmann R, Ashburner J, Turner R (2002) Image distortion correction in fMRI: a quantitative evaluation. Neuroimage 16:217-240. CrossRef Medline
23. Hutton C, Josephs O, Stadler J, Featherstone E, Reid A, Speck O, Bernarding J, Weiskopf N (2011) The impact of physiological noise correction on fMRI at 7 T. Neuroimage 57:101-112. CrossRef Medline
24. Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10:1625-1633. CrossRef Medline
25. Kamitani Y, Tong F (2005) Decoding the visual and subjective contents of the human brain. Nat Neurosci 8:679-685. CrossRef Medline
26. Kim H, Sul JH, Huh N, Lee D, JungMW (2009) Role of striatum in updating values of chosen actions. J Neurosci 29:14701-14712. CrossRef Medline
27. Klein TA, Endrass T, Kathmann N, Neumann J, von Cramon DY, Ullsperger M (2007) Neural correlates of error awareness. Neuroimage 34:1774-1781. CrossRef Medline
28. Klein-Flügge MC, Hunt LT, Bach DR, Dolan RJ, Behrens TE (2011) Dissociable reward and timing signals in human midbrain and ventral striatum. Neuron 72:654-664. CrossRef Medline
29. Knutson B, Adams CM, Fong GW, Hommer D (2001) Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21:RC159. Medline
30. Kriegeskorte N, Bandettini P (2007) Analyzing for information, not activation, to exploit high-resolution fMRI. Neuroimage 38:649-662. CrossRef Medline
31. Li J, Daw ND (2011) Signals in human striatum are appropriate for policy update rather than value prediction. J Neurosci 31:5504-5511. CrossRef Medline
32. Lim SL, O'Doherty JP, Rangel A (2011) The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention. J Neurosci 31:13214-13223. CrossRef Medline
33. Lohrenz T, McCabe K, Camerer CF, Montague PR (2007) Neural signature of fictive learning signals in a sequential investment task. Proc Natl Acad Sci U S A 104:9493-9498. CrossRef Medline
34. Misaki M, Kim Y, Bandettini PA, Kriegeskorte N (2010) Comparison of multivariate classifiers and response normalizations for pattern-information fMRI. Neuroimage 53:103-118. CrossRef Medline
35. Nicolle A, Bach DR, Driver J, Dolan RJ (2011) A role for the striatum in regret-related choice repetition. J Cogn Neurosci 23:845-856. CrossRef Medline
36. Norman KA, Polyn SM, Detre GJ, Haxby JV (2006) Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn Sci 10:424-430. CrossRef Medline
37. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454. CrossRef Medline
38. Pessiglione M, Petrovic P, Daunizeau J, Palminteri S, Dolan RJ, Frith CD (2008) Subliminal instrumental conditioning demonstrated in the human brain. Neuron 59:561-567. CrossRef Medline
39. Pleger B, Blankenburg F, Ruff CC, Driver J, Dolan RJ (2008) Reward facilitates tactile judgments and modulates hemodynamic responses in human primary somatosensory cortex. J Neurosci 28:8161-8168. CrossRef Medline
40. Pleger B, Ruff CC, Blankenburg F, Klöppel S, Driver J, Dolan RJ (2009) Influence of dopaminergically mediated reward on somatosensory decision-making. PLoS Biol 7:e1000164. CrossRef Medline
41. Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9:545-556. CrossRef Medline
42. Rao RP (2005) Bayesian inference and attentional modulation in the visual cortex. Neuroreport 16:1843-1848. CrossRef Medline
43. Ridderinkhof KR, Ullsperger M, Crone EA, Nieuwenhuis S (2004) The role of the medial frontal cortex in cognitive control. Science 306:443-447. CrossRef Medline
44. Schultz W, Apicella P, Scarnati E, Ljungberg T (1992) Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12:4595-4610. Medline
45. Seymour B, O'Doherty JP, Dayan P, Koltzenburg M, Jones AK, Dolan RJ, Friston KJ, Frackowiak RS (2004) Temporal difference models describe higher-order learning in humans. Nature 429:664-667. CrossRef Medline
46. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. Cambridge, MA: MIT.
47. Talmi D, Seymour B, Dayan P, Dolan RJ (2008) Human pavlovianinstrumental transfer. J Neurosci 28:360-368. CrossRef Medline
48. Tricomi EM, Delgado MR, Fiez JA (2004) Modulation of caudate activity by action contingency. Neuron 41:281-292. CrossRef Medline
49. Tucker M, Ellis R (2004) Action priming by briefly presented objects. Acta Psychol 116:185-203. CrossRef Medline
50. Watkins CJCH, Dayan P (1992) Q-learning. Mach Learn 8:279-292. CrossRef
51. Weil RS, Furl N, Ruff CC, Symmonds M, Flandin G, Dolan RJ, Driver J, Rees G (2010) Rewarding feedback after correct visual discriminations has both general and specific influences on visual cortex. J Neurophysiol 104:1746-1757. CrossRef Medline
52. Wilson RC, Niv Y (2011) Inferring relevance in a changing world. Front Hum Neurosci 5:189. Medline
53. Wright ND, Symmonds M, Dolan RJ (2013) Distinct encoding of risk and value in economic choice between multiple risky options. Neuroimage 81:431-440. CrossRef Medline
54. Yu AJ, Dayan P (2005) Uncertainty, neuromodulation, and attention. Neuron 46:681-692. CrossRef Medline
55. Yu AJ, Dayan P, Cohen JD (2009) Dynamics of attentional selection under conflict: toward a rational Bayesian account. J Exp Psychol Hum Percept Perform 35:700-717. CrossRef Medline
56. Zink CF, Pagnoni G, Martin-Skurski ME, Chappelow JC, Berns GS (2004) Human striatal responses to monetary reward depend on saliency. Neuron 42:509-517. CrossRef Medline