Deciding when to decide: Time-variant sequential sampling models explain the emergence of value-based decisions in the human brain

Journal of Neuroscience

Volumn 32, Issue 31, 2012, Pages 10686-10698

  Gluth, Sebastian ^a   Rieskamp, Jörg ^b   Büchel, Christian ^a  

^a UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

^b UNIVERSITY OF BASEL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANTERIOR INSULA; ARTICLE; BAYES THEOREM; BEHAVIOR; CAUDATE NUCLEUS; COMPUTER MODEL; CORPUS STRIATUM; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INTRAPARIETAL SULCUS; MALE; NORMAL HUMAN; ORBITAL CORTEX; PREDICTION; PRIMARY MOTOR CORTEX; PRIORITY JOURNAL; QUESTIONNAIRE; SUPPLEMENTARY MOTOR AREA; TASK PERFORMANCE; VENTROMEDIAL PREFRONTAL CORTEX;

ADULT; BRAIN; BRAIN MAPPING; CHOICE BEHAVIOR; COMPUTER SIMULATION; DECISION MAKING; EXPLORATORY BEHAVIOR; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; NEURAL PATHWAYS; OXYGEN; PREDICTIVE VALUE OF TESTS; PROBABILITY; QUESTIONNAIRES; REACTION TIME; TIME FACTORS; YOUNG ADULT;

EID: 84864452211     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.0727-12.2012     Document Type: Article

References (64)

1. Anderson LR, Holt CA (1997) Information cascades in the laboratory. Am Econ Rev 87:847-862.
2. Bogacz R, Wagenmakers EJ, Forstmann BU, Nieuwenhuis S (2010) The neural basis of the speed-accuracy tradeoff. Trends Neurosci 33:10-16.
3. Busemeyer JR, Pleskac T (2009) Theoretical tools for understanding and aiding dynamic decision making. J Math Psychol 53:126-138.
4. Busemeyer JR, Townsend JT (1993) Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychol Rev 100:432-459.
5. Cai X, Kim S, Lee D (2011) Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice. Neuron 69:170-182.
6. Chib VS, Rangel A, Shimojo S, O'Doherty JP (2009) Evidence for acommon representation of decision values for dissimilar goods in human ventro-medial prefrontal cortex. J Neurosci 29:12315-12320.
7. Churchland AK, Kiani R, Shadlen MN (2008) Decision-making with multiple alternatives. Nat Neurosci 11:693-702.
8. Cisek P, Kalaska JF (2010) Neural mechanisms for interacting with a world full of action choices. Annu Rev Neurosci 33:269-298.
9. Cisek P, Puskas GA, El-Murr S (2009) Decisionsin changing conditions: the urgency-gating model. J Neurosci 29:11560-11571.
10. Cloninger CR (1994) The temperament and character inventory (TCI): a guide to its development and use. St. Louis: Center for Psychobiology of Personality, Washington University.
11. Coles MG (1989) Modern mind-brain reading: psychophysiology, physiology, and cognition. Psychophysiology 26:251-269.
12. Cox DR, Miller HD (1965) The theory of stochastic processes. London: Chapman and Hall.
13. Deichmann R, Gottfried JA, Hutton C, Turner R (2003) Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage 19:430-441.
14. de Lange FP, Jensen O, Dehaene S (2010) Accumulation of evidence during sequential decision making: the importance of top-down factors. J Neu-rosci 30:731-738.
15. Ding L, Gold JI (2010) Caudate encodes multiple computations for perceptual decisions. J Neurosci 30:15747-15759.
16. Ditterich J (2006a) Stochastic models of decisions about motion direction: behavior and physiology. Neural Netw 19:981-1012.
17. Ditterich J (2006b) Evidence for time-variant decision making. Eur J Neu-rosci 24:3628-3641.
18. Donner TH, Siegel M, Fries P, Engel AK (2009) Buildup of choice-predictive activity in human motor cortex during perceptual decision making. Curr Biol 19:1581-1585.
19. Engel C, Singer W (2008) Better than conscious?: decision making, the human mind, and implications for institutions. Cambridge, MA: MIT.
20. FitzGerald TH, Seymour B, Dolan RJ (2009) The role of human orbitofrontal cortex in value comparison for incommensurable objects. J Neurosci 29:8388-8395.
21. Forstmann BU, Dutilh G, Brown S, Neumann J, von Cramon DY, Ridderink-hof KR, Wagenmakers EJ (2008) Striatum and pre-SMA facilitate decision-making under time pressure. Proc Natl Acad Sci U S A 105:17538-17542.
22. Fried I, Mukame lR, Kreiman G (2011) Internally generated preactivation of single neurons in human medial frontal cortex predicts volition. Neuron 69:548-562.
23. Friston KJ, Mechelli A, Turner R, Price CJ (2000) Nonlinear responses in fMRI: the Balloon model, Volterra kernels, and other hemodynamics. Neuroimage 12:466-477.
24. Gläscher J (2009) Visualization of group inference data in functional neu-roimaging. Neuroinformatics 7:73-82.
25. Gläscher J, Hampton AN, O'Doherty JP (2009) Determining a role for ven-tromedial prefrontal cortexin encoding action-based value signals during reward-related decision making. Cereb Cortex 19:483-495.
26. Gold JI, Shadlen MN (2007) The neural basis of decision making. Annu Rev Neurosci 30:535-574.
27. Haggard P (2008) Human volition: towards a neuroscience of will. Nat Rev Neurosci 9:934-946.
28. Heekeren HR, Marrett S, Bandettini PA, Ungerleider LG (2004) A general mechanism for perceptual decision-making in the human brain. Nature 431:859-862.
29. Heekeren HR, Marrett S, Ungerleider LG (2008) The neural systems that mediate human perceptual decision making. Nat Rev Neurosci 9:467-479.
30. Ho TC, Brown S, Serences JT (2009) Domain general mechanisms of perceptual decision making in human cortex. J Neurosci 29:8675-8687.
31. Ivanoff J, Branning P, Marois R (2008) fMRI evidence for a dual process account of the speed-accuracy tradeoff in decision-making. PLoS ONE 3:e2635.
32. Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10:1625-1633.
33. Kriegeskorte N, Simmons WK, Bellgowan PS, Baker CI (2009) Circular analysisinsystems neuroscience: the dangersofdouble dipping. Nat Neu-rosci 12:535-540.
34. Lancaster JL, Woldorff MG, Parsons LM, Liotti M, Freitas CS, Rainey L, Kochunov PV, Nickerson D, Mikiten SA, Fox PT (2000) Automated Talairach atlas labels for functional brain mapping. Hum Brain Mapp 10:120-131.
35. Lebreton M, Jorge S, Michel V, Thirion B, Pessiglione M (2009) An automatic valuation system in the human brain: evidence from functional neuroimaging. Neuron 64:431-439.
36. Lewandowsky S, Farrell S (2011) Computational modeling in cognition: principles and practice. Thousand Oaks, CA: Sage.
37. Libet B, Gleason CA, Wright EW, Pearl DK (1983) Timeofconscious intention to act in relation to onset of cerebral activity (readiness-potential). The unconscious initiation of a freely voluntary act. Brain 106:623-642.
38. Lo C-C, Wang XJ (2006) Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nat Neurosci 9:956-963.
39. Mohr PN, Biele G, Heekeren HR (2010) Neural processing of risk. J Neuro-sci 30:6613-6619.
40. Mosteller F, Nogee P (1951) An experimental measurementof utility. JPolit Econ 59:371-404.
41. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454.
42. Pastor-Bernier A, Cisek P (2011) Neural correlates of biased competition in premotor cortex. J Neurosci 31:7083-7088.
43. Payne JW, Bettman JR, Johnson EJ (1988) Adaptive strategy selection in decision making. J Exp Psychol Learn Mem Cogn 14:534-552.
44. Philiastides MG, Biele G, Heekeren HR (2010) A mechanistic account of value computation in the human brain. Proc Natl Acad Sci USA 107:9430-9435.
45. Platt ML, Glimcher PW (1999) Neural correlates of decision variables in parietal cortex. Nature 400:233-238.
46. Ploran EJ, Nelson SM, Velanova K, Donaldson DI, Petersen SE, Wheeler ME (2007) Evidence accumulation and the moment of recognition: dissociating perceptual recognition processes using fMRI. J Neurosci 27:11912-11924.
47. Preuschoff K, Quartz SR, Bossaerts P (2008) Human insula activation reflects risk prediction errors as well as risk. J Neurosci 28:2745-2752.
48. Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9:545-556.
49. Ratcliff R (1978) A theory of memory retrieval. Psychol Rev 85:59-108.
50. Rieskamp J (2008) The probabilistic nature of preferential choice. J Exp Psychol Learn Mem Cogn 34:1446-1465.
51. Roitman JD, Shadlen MN (2002) Response of neurons in the lateral intra-parietal area during a combined visual discrimination reaction time task. J Neurosci 22:9475-9489.
52. Simon HA (1956) Rational choice and the structure of the environment. Psychol Rev 63:129-138.
53. Soltani A, Wang XJ (2010) Synaptic computation underlying probabilistic inference. Nat Neurosci 13:112-119.
54. Soon CS, Brass M, Heinze HJ, Haynes J-D (2008) Unconscious determinants of free decisions in the human brain. Nat Neurosci 11:543-545.
55. Stern ER, Gonzalez R, Welsh RC, Taylor SF (2010) Updating beliefs for a decision: neural correlates of uncertainty and underconfidence. J Neurosci 30:8032-8041.
56. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. Cambridge, MA: MIT.
57. Todd PM, Gigerenzer G (2007) Environments that make us smart: ecological rationality. Curr Dir Psychol Sci 16:167-171.
58. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Del-croix N, Mazoyer B, Joliot M (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15:273-289.
59. Usher M, McClelland JL (2001) The time course of perceptual choice: the leaky, competing accumulator model. Psychol Rev 108:550-592.
60. van Maanen L, Brown SD, Eichele T, Wagenmakers EJ, Ho T, Serences J, Forstmann BU (2011) Neural correlates of trial-to-trial fluctuations in response caution. J Neurosci 31:17488-17495.
61. van Veen V, Krug MK, Carter CS (2008) The neural and computational basis of controlled speed-accuracy tradeoff during task performance. J Cogn Neurosci 20:1952-1965.
62. Wallis JD (2007) Orbitofrontal cortex and its contribution to decision-making. Annu Rev Neurosci 30:31-56.
63. Yacubian J, Gläscher J, Schroeder K, Sommer T, Braus DF, Büchel C (2006) Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J Neurosci 26:9530-9537.
64. Yang T, Shadlen MN (2007) Probabilistic reasoning by neurons. Nature 447:1075-1080.