Uncovering the spatio-temporal dynamics of value-based decision-making in the human brain: A combined fmri–EEG study

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 369, Issue 1655, 2014, Pages

  Larsen, Tobias ^a,b   O’Doherty, John P ^a,b  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

Decision making; EEG; Model based; Reinforcement learning

Indexed keywords

BRAIN; DATA SET; DECISION MAKING; LEARNING; RESOLUTION; SPATIOTEMPORAL ANALYSIS;

BIOLOGICAL MODEL; BRAIN MAPPING; DECISION MAKING; ELECTROENCEPHALOGRAPHY; FEMALE; HUMAN; MALE; NUCLEAR MAGNETIC RESONANCE IMAGING; PARIETAL LOBE; PHYSIOLOGY; PREFRONTAL CORTEX; PROCEDURES; RANDOMIZATION; REGRESSION ANALYSIS; YOUNG ADULT;

BRAIN MAPPING; DECISION MAKING; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; PARIETAL LOBE; PREFRONTAL CORTEX; RANDOM ALLOCATION; REGRESSION ANALYSIS; YOUNG ADULT;

EID: 84907545890     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2013.0473     Document Type: Article

References (32)

1. O’Doherty J. 2004 Reward representations and reward-related learning in the human brain: insights from human neuroimaging. Curr. Opin. Neurobiol. 14, 769–776. (doi:10.1016/j.conb.2004.10.016)
2. Lau B, Glimcher PW. 2007 Action and outcome encoding in the primate caudate nucleus. J. Neurosci. 27, 14502–14514. (doi:10.1523/JNEUROSCI.3060-07.2007)
3. Gläscher J, Hampton AN, O’Doherty J.. 2009 Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cerebr. Cortex 19, 483–495. (doi:10.1093/cercor/bhn098)
4. Rangel A, Hare T. 2010 Neural computations associated with goal-directed choice. Curr. Opin. Neurobiol. 20, 262–270. (doi:10.1016/j.conb.2010. 03.001)
5. O’Doherty JP. 2011 Contributions of the ventromedial prefrontal cortex to goal-directed action selection. Ann. N.Y. Acad. Sci. 1239, 118–129. (doi:10.1111/j.1749-6632.2011.06290.x)
6. Platt ML, Glimcher PW. 1999 Neural correlates of decision variables in parietal cortex. Nature 400, 233–238. (doi:10.1038/22268)
7. Sugrue LP, Corrado GS, Newsome WT. 2004 Matching behavior and the representation of value in the parietal cortex. Science 304, 1782–1787. (doi:10.1126/science.1094765)
8. Padoa-Schioppa C, Assad JA. 2006 Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223–226. (doi:10.1038/nature04676)
9. Boorman ED, Behrens TE, Woolrich MW, Rushworth MF. 2009 How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62, 733–743. (doi:10.1016/j.neuron.2009.05.014)
10. Wunderlich K, Rangel A, O’Doherty JP. 2009 Neural computations underlying action-based decision making in the human brain. Proc. Natl Acad. Sci. USA 106, 17199–17204. (doi:10.1073/pnas. 0901077106)
11. Hare T., Schultz W, Camerer CF, O’Doherty J., Rangel A. 2011 Transformation of stimulus value signals into motor commands during simple choice. Proc. Natl Acad. Sci. USA 108, 18120–18125. (doi:10.1073/pnas.1109322108)
12. Noonan MP, Walton ME, Behrens TE., Sallet J, Buckley MJ, Rushworth MFS. 2010 Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc. Natl Acad. Sci. USA 107, 20547– 20552. (doi:10.1073/pnas.1012246107)
13. Shadlen MN, Newsome WT. 2001 Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J. Neurophysiol. 86, 1916–1936.
14. Harris A, Adolphs R, Camerer C, Rangel A. 2011 Dynamic construction of stimulus values in the ventromedial prefrontal cortex. PLoS ONE 6, e21074. (doi:10.1371/journal.pone.0021074)
15. Hunt LT, Kolling N, Soltani A, Woolrich MW, Rushworth MF, Behrens TE. 2012 Mechanisms underlying cortical activity during value-guided choice. Nat. Neurosci. 15, 470–476. (doi:10.1038/nn.3017)
16. Nolan H, Whelan R, Reilly RB. 2010 FASTER: fully automated statistical thresholding for EEG artifact rejection. J. Neurosci. Methods 192, 152–162. (doi:10.1016/j.jneumeth.2010.07.015)
17. O’Doherty J., Hampton A, Kim H. 2007 Model-based fMRI and its application to reward learning and decision making. Ann. N.Y. Acad. Sci. 1104, 35–53. (doi:10.1196/annals.1390.022)
18. Litvak V, Friston K. 2008 Electromagnetic source reconstruction for group studies. Neuroimage 42, 1490–1498. (doi:10.1016/j.neuroimage.2008. 06.022)
19. Sutton RS, Barto AG. 1998 Reinforcement learning: an introduction. Cambridge, MA: MIT Press.
20. Daw ND, Niv Y, Dayan P. 2005 Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704–1711. (doi:10.1038/nn1560)
21. Hampton AN, Bossaerts P, O’Doherty JP. 2006 The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J. Neurosci. 26, 8360– 8367. (doi:10.1523/JNEUROSCI.1010-06.2006)
22. Wunderlich K, Dayan P, Dolan RJ. 2012 Mapping value based planning and extensively trained choice in the human brain. Nat. Neurosci. 15, 786–791. (doi:10.1038/nn.3068)
23. Friston K, Schwartenbeck P, Fitzgerald T, Moutoussis M, Behrens T, Dolan RJ. 2013 The anatomy of choice: active inference and agency. Front. Hum. Neurosci. 7, 598. (doi:10.3389/fnhum.2013.00598)
24. Gold JI, Shadlen MN. 2002 Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 36, 299–308. (doi:10.1016/S0896-6273(02)00971-6)
25. Roitman JD, Shadlen MN. 2002 Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J. Neurosci. 22, 9475–9489.
26. Dorris MC, Glimcher PW. 2004 Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 44, 365–378. (doi:10.1016/j.neuron.2004.09.009)
27. Bendiksby MS, Platt ML. 2006 Neural correlates of reward and attention in macaque area LIP. Neuropsychologia 44, 2411–2420. (doi:10.1016/j. neuropsychologia.2006.04.011)
28. Kiani R, Hanks TD, Shadlen MN. 2008 Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. J. Neurosci. 28, 3017–3029. (doi:10. 1523/JNEUROSCI.4761-07.2008)
29. Rorie AE, Gao J, McClelland JL, Newsome WT. 2010 Integration of sensory and reward information during perceptual decision-making in lateral intraparietal cortex (LIP) of the macaque monkey. PLoS ONE 5, e9308. (doi:10.1371/journal.pone. 0009308)
30. Rushworth MF., Walton ME, Kennerley SW, Bannerman DM. 2004 Action sets and decisions in the medial frontal cortex. Trends Cogn. Sci. 8, 410–417. (doi:10.1016/j.tics.2004.07.009)
31. Nunez PL, Silberstein RB. 2000 On the relationship of synaptic activity to macroscopic measurements: does co-registration of EEG with fMRI make sense? Brain Topogr. 13, 79–96. (doi:10.1023/A:1026683200895)
32. Lee D, Seo H, Jung MW. 2012 Neural basis of reinforcement learning and decision making. Annu. Rev. Neurosci. 35, 287–308. (doi:10.1146/annurev-neuro-062111-150512)