Decision Making and Sequential Sampling from Memory

Neuron

Volumn 90, Issue 5, 2016, Pages 927-939

  Shadlen, Michael N ^a   Shohamy, Daphna ^a  

^a Columbia University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; DECISION MAKING; DECISION TIME; HUMAN; HYPOTHESIS; INFORMATION RETRIEVAL; MEMORY; MEMORY RETRIEVAL; NERVE CELL NETWORK; NONHUMAN; PERCEPTION; PRIORITY JOURNAL; REACTION TIME; REVIEW; SAMPLING; SEQUENTIAL SAMPLING; PSYCHOLOGICAL THEORY; TIME FACTOR;

DECISION MAKING; HUMANS; MEMORY; PSYCHOLOGICAL THEORY; TIME FACTORS;

EID: 84977119810     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2016.04.036     Document Type: Review

References (157)

1. Addis, D.R., Wong, A.T., Schacter, D.L., Remembering the past and imagining the future: common and distinct neural substrates during event construction and elaboration. Neuropsychologia 45 (2007), 1363–1377.
2. Agranov, M., and Ortoleva, P. Stochastic choice and preferences for randomization. (2015). J. Pol. Econ. Forthcoming.
3. Andersen, R.A., Cui, H., Intention, action planning, and decision making in parietal-frontal circuits. Neuron 63 (2009), 568–583.
4. Anderson, J.R., Bothell, D., Byrne, M.D., Douglass, S., Lebiere, C., Qin, Y., An integrated theory of the mind. Psychol. Rev. 111 (2004), 1036–1060.
5. Badre, D., Lebrecht, S., Pagliaccio, D., Long, N.M., Scimeca, J.M., Ventral striatum and the evaluation of memory retrieval strategies. J. Cogn. Neurosci. 26 (2014), 1928–1948.
6. Barron, H.C., Dolan, R.J., Behrens, T.E.J., Online evaluation of novel choices by simultaneous representation of multiple memories. Nat. Neurosci. 16 (2013), 1492–1498.
7. Bartra, O., McGuire, J.T., Kable, J.W., The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage 76 (2013), 412–427.
8. Bogacz, R., Gurney, K., The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput. 19 (2007), 442–477.
9. Boorman, E.D., Rushworth, M.F., Conceptual representation and the making of new decisions. Neuron 63 (2009), 721–723.
10. Bornstein, A.M., Daw, N.D., Cortical and hippocampal correlates of deliberation during model-based decisions for rewards in humans. PLoS Comput. Biol., 9, 2013, e1003387.
11. Brogden, W., Sensory pre-conditioning. J. Exp. Psychol., 25, 1939, 323.
12. Brogden, W.J., Sensory pre-conditioning of human subjects. J. Exp. Psychol. 37 (1947), 527–539.
13. Buzsáki, G., Hippocampal sharp waves: their origin and significance. Brain Res. 398 (1986), 242–252.
14. Buzsáki, G., The structure of consciousness. Nature, 446, 2007, 267.
15. Camille, N., Griffiths, C.A., Vo, K., Fellows, L.K., Kable, J.W., Ventromedial frontal lobe damage disrupts value maximization in humans. J. Neurosci. 31 (2011), 7527–7532.
16. Chau, B.K., Kolling, N., Hunt, L.T., Walton, M.E., Rushworth, M.F., A neural mechanism underlying failure of optimal choice with multiple alternatives. Nat. Neurosci. 17 (2014), 463–470.
17. Cisek, P., Cortical mechanisms of action selection: the affordance competition hypothesis. Philos. Trans. R. Soc. Lond. B Biol. Sci. 362 (2007), 1585–1599.
18. Cisek, P., Making decisions through a distributed consensus. Curr. Opin. Neurobiol. 22 (2012), 927–936.
19. Clark, A.M., Bouret, S., Young, A.M., Murray, E.A., Richmond, B.J., Interaction between orbital prefrontal and rhinal cortex is required for normal estimates of expected value. J. Neurosci. 33 (2013), 1833–1845.
20. Clithero, J.A., Rangel, A., Informatic parcellation of the network involved in the computation of subjective value. Soc. Cogn. Affect. Neurosci. 9 (2014), 1289–1302.
21. Clos, M., Schwarze, U., Gluth, S., Bunzeck, N., Sommer, T., Goal- and retrieval-dependent activity in the striatum during memory recognition. Neuropsychologia 72 (2015), 1–11.
22. Cohen, N.J., Eichenbaum, H., Memory, Amnesia, and the Hippocampal System. 1993, MIT Press.
23. Conen, K.E., Padoa-Schioppa, C., Neuronal variability in orbitofrontal cortex during economic decisions. J. Neurophysiol. 114 (2015), 1367–1381.
24. Constantino, S.M., Daw, N.D., A closer look at choice. Nat. Neurosci. 13 (2010), 1153–1154.
25. Cui, H., Andersen, R.A., Different representations of potential and selected motor plans by distinct parietal areas. J. Neurosci. 31 (2011), 18130–18136.
26. Davachi, L., Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol. 16 (2006), 693–700.
27. Daw, N.D., O'Doherty, J.P., Dayan, P., Seymour, B., Dolan, R.J., Cortical substrates for exploratory decisions in humans. Nature 441 (2006), 876–879.
28. Ding, L., Distinct dynamics of ramping activity in the frontal cortex and caudate nucleus in monkeys. J. Neurophysiol. 114 (2015), 1850–1861.
29. Ding, L., Gold, J.I., Neural correlates of perceptual decision making before, during, and after decision commitment in monkey frontal eye field. Cereb. Cortex 22 (2012), 1052–1067.
30. Ding, L., Gold, J.I., The basal ganglia's contributions to perceptual decision making. Neuron 79 (2013), 640–649.
31. Doll, B.B., Duncan, K.D., Simon, D.A., Shohamy, D., Daw, N.D., Model-based choices involve prospective neural activity. Nat. Neurosci. 18 (2015), 767–772.
32. Dorris, M.C., Glimcher, P.W., Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 44 (2004), 365–378.
33. Drugowitsch, J., Moreno-Bote, R., Churchland, A.K., Shadlen, M.N., Pouget, A., The cost of accumulating evidence in perceptual decision making. J. Neurosci. 32 (2012), 3612–3628.
34. Duncan, J., The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour. Trends Cogn. Sci. 14 (2010), 172–179.
35. Dusek, J.A., Eichenbaum, H., The hippocampus and memory for orderly stimulus relations. Proc. Natl. Acad. Sci. USA 94 (1997), 7109–7114.
36. Eichenbaum, H., A cortical-hippocampal system for declarative memory. Nat. Rev. Neurosci. 1 (2000), 41–50.
37. Eichenbaum, H., Cohen, N.J., From Conditioning to Conscious Recollection: Memory Systems of the Brain. 2001, Oxford University Press.
38. Eldridge, M.A., Lerchner, W., Saunders, R.C., Kaneko, H., Krausz, K.W., Gonzalez, F.J., Ji, B., Higuchi, M., Minamimoto, T., Richmond, B.J., Chemogenetic disconnection of monkey orbitofrontal and rhinal cortex reversibly disrupts reward value. Nat. Neurosci. 19 (2016), 37–39.
39. Felleman, D.J., Van Essen, D.C., Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1 (1991), 1–47.
40. Fellows, L.K., Deciding how to decide: ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. Brain 129 (2006), 944–952.
41. Foerde, K., Shohamy, D., The role of the basal ganglia in learning and memory: insight from Parkinson's disease. Neurobiol. Learn. Mem. 96 (2011), 624–636.
42. Foerde, K., Race, E., Verfaellie, M., Shohamy, D., A role for the medial temporal lobe in feedback-driven learning: evidence from amnesia. J. Neurosci. 33 (2013), 5698–5704.
43. Foster, D.J., Wilson, M.A., Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 440 (2006), 680–683.
44. Funahashi, S., Bruce, C.J., Goldman-Rakic, P.S., Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J. Neurophysiol. 61 (1989), 331–349.
45. Fuster, J.M., Unit activity in prefrontal cortex during delayed-response performance: neuronal correlates of transient memory. J. Neurophysiol. 36 (1973), 61–78.
46. Fuster, J.M., Alexander, G.E., Neuron activity related to short-term memory. Science 173 (1971), 652–654.
47. Gerraty, R.T., Davidow, J.Y., Wimmer, G.E., Kahn, I., Shohamy, D., Transfer of learning relates to intrinsic connectivity between hippocampus, ventromedial prefrontal cortex, and large-scale networks. J. Neurosci. 34 (2014), 11297–11303.
48. Glimcher, P.W., Fehr, E., Neuroeconomics: Decision Making and the Brain. 2013, Academic Press.
49. Gluck, M.A., Shohamy, D., Myers, C., How do people solve the “weather prediction” task?: individual variability in strategies for probabilistic category learning. Learn. Mem. 9 (2002), 408–418.
50. Gluth, S., Sommer, T., Rieskamp, J., Büchel, C., Effective connectivity between hippocampus and ventromedial prefrontal cortex controls preferential choices from memory. Neuron 86 (2015), 1078–1090.
51. Gnadt, J.W., Andersen, R.A., Memory related motor planning activity in posterior parietal cortex of macaque. Exp. Brain Res. 70 (1988), 216–220.
52. Gold, J.I., Shadlen, M.N., The neural basis of decision making. Annu. Rev. Neurosci. 30 (2007), 535–574.
53. Gordon, A.M., Rissman, J., Kiani, R., Wagner, A.D., Cortical reinstatement mediates the relationship between content-specific encoding activity and subsequent recollection decisions. Cereb. Cortex 24 (2014), 3350–3364.
54. Greene, A.J., Gross, W.L., Elsinger, C.L., Rao, S.M., An FMRI analysis of the human hippocampus: inference, context, and task awareness. J. Cogn. Neurosci. 18 (2006), 1156–1173.
55. Grice, G.R., Davis, J.D., Effect of concurrent responses on the evocation and generalization of the conditioned eyeblink. J. Exp. Psychol. 59 (1960), 391–395.
56. Haber, S.N., Calzavara, R., The cortico-basal ganglia integrative network: the role of the thalamus. Brain Res. Bull. 78 (2009), 69–74.
57. Hare, T.A., O'Doherty, J., Camerer, C.F., Schultz, W., Rangel, A., Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 28 (2008), 5623–5630.
58. Hare, T.A., Schultz, W., Camerer, C.F., O'Doherty, J.P., Rangel, A., Transformation of stimulus value signals into motor commands during simple choice. Proc. Natl. Acad. Sci. 108 (2011), 18120–18125.
59. Hassabis, D., Kumaran, D., Vann, S.D., Maguire, E.A., Patients with hippocampal amnesia cannot imagine new experiences. Proc. Natl. Acad. Sci. USA 104 (2007), 1726–1731.
60. Heckers, S., Zalesak, M., Weiss, A.P., Ditman, T., Titone, D., Hippocampal activation during transitive inference in humans. Hippocampus 14 (2004), 153–162.
61. Hikosaka, O., Kim, H.F., Yasuda, M., Yamamoto, S., Basal ganglia circuits for reward value-guided behavior. Annu. Rev. Neurosci. 37 (2014), 289–306.
62. Hopkins, R.O., Myers, C.E., Shohamy, D., Grossman, S., Gluck, M., Impaired probabilistic category learning in hypoxic subjects with hippocampal damage. Neuropsychologia 42 (2004), 524–535.
63. Hunt, L.T., Kolling, N., Soltani, A., Woolrich, M.W., Rushworth, M.F., Behrens, T.E., Mechanisms underlying cortical activity during value-guided choice. Nat. Neurosci. 15 (2012), 470–476, S471–S473.
64. Hutchinson, J.B., Uncapher, M.R., Weiner, K.S., Bressler, D.W., Silver, M.A., Preston, A.R., Wagner, A.D., Functional heterogeneity in posterior parietal cortex across attention and episodic memory retrieval. Cereb. Cortex 24 (2014), 49–66.
65. Hutchinson, J.B., Uncapher, M.R., Wagner, A.D., Increased functional connectivity between dorsal posterior parietal and ventral occipitotemporal cortex during uncertain memory decisions. Neurobiol. Learn. Mem. 117 (2015), 71–83.
66. Jiang, X., Wang, G., Lee, A.J., Stornetta, R.L., Zhu, J.J., The organization of two new cortical interneuronal circuits. Nat. Neurosci. 16 (2013), 210–218.
67. Johnson, A., Redish, A.D., Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J. Neurosci. 27 (2007), 12176–12189.
68. Jones, E.G., The thalamic matrix and thalamocortical synchrony. Trends Neurosci. 24 (2001), 595–601.
69. Jones, J.L., Esber, G.R., McDannald, M.A., Gruber, A.J., Hernandez, A., Mirenzi, A., Schoenbaum, G., Orbitofrontal cortex supports behavior and learning using inferred but not cached values. Science 338 (2012), 953–956.
70. Kable, J.W., Glimcher, P.W., The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10 (2007), 1625–1633.
71. Kable, J.W., Glimcher, P.W., The neurobiology of decision: consensus and controversy. Neuron 63 (2009), 733–745.
72. Kahn, I., Davachi, L., Wagner, A.D., Functional-neuroanatomic correlates of recollection: implications for models of recognition memory. J. Neurosci. 24 (2004), 4172–4180.
73. Kemp, J.M., Powell, T.P., The connexions of the striatum and globus pallidus: synthesis and speculation. Philos. Trans. R. Soc. Lond. B Biol. Sci. 262 (1971), 441–457.
74. Kiani, R., Corthell, L., Shadlen, M.N., Choice certainty is informed by both evidence and decision time. Neuron 84 (2014), 1329–1342.
75. King, D.R., de Chastelaine, M., Elward, R.L., Wang, T.H., Rugg, M.D., Recollection-related increases in functional connectivity predict individual differences in memory accuracy. J. Neurosci. 35 (2015), 1763–1772.
76. Kira, S., Yang, T., Shadlen, M.N., A neural implementation of Wald's sequential probability ratio test. Neuron 85 (2015), 861–873.
77. Klein-Flügge, M.C., Barron, H.C., Brodersen, K.H., Dolan, R.J., Behrens, T.E., Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex. J. Neurosci. 33 (2013), 3202–3211.
78. Kolling, N., Behrens, T.E., Mars, R.B., Rushworth, M.F., Neural mechanisms of foraging. Science 336 (2012), 95–98.
79. Krajbich, I., Rangel, A., Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions. Proc. Natl. Acad. Sci. USA 108 (2011), 13852–13857.
80. Krajbich, I., Armel, C., Rangel, A., Visual fixations and the computation and comparison of value in simple choice. Nat. Neurosci. 13 (2010), 1292–1298.
81. Krajbich, I., Lu, D., Camerer, C., Rangel, A., The attentional drift-diffusion model extends to simple purchasing decisions. Front. Psychol., 3, 2012, 193.
82. Krajbich, I., Bartling, B., Hare, T., Fehr, E., Rethinking fast and slow based on a critique of reaction-time reverse inference. Nat. Commun., 6, 2015, 7455.
83. Kubanek, J., Snyder, L.H., Reward-based decision signals in parietal cortex are partially embodied. J. Neurosci. 35 (2015), 4869–4881.
84. Laming, D.R.J., Information Theory of Choice-Reaction Times. 1968, Academic Press.
85. Larkum, M., A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex. Trends Neurosci. 36 (2013), 141–151.
86. Larkum, M.E., The yin and yang of cortical layer 1. Nat. Neurosci. 16 (2013), 114–115.
87. Lee, A.K., Wilson, M.A., Memory of sequential experience in the hippocampus during slow wave sleep. Neuron 36 (2002), 1183–1194.
88. Lee, A.M., Tai, L.H., Zador, A., Wilbrecht, L., Between the primate and ‘reptilian’ brain: Rodent models demonstrate the role of corticostriatal circuits in decision making. Neuroscience 296 (2015), 66–74.
89. Leon, M.I., Shadlen, M.N., Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24 (1999), 415–425.
90. Li, N., Chen, T.W., Guo, Z.V., Gerfen, C.R., Svoboda, K., A motor cortex circuit for motor planning and movement. Nature 519 (2015), 51–56.
91. Link, S.W., The Wave Theory of Difference and Similarity. 1992, Lawrence Erlbaum Associates.
92. Mackey, S., Petrides, M., Quantitative demonstration of comparable architectonic areas within the ventromedial and lateral orbital frontal cortex in the human and the macaque monkey brains. Eur. J. Neurosci. 32 (2010), 1940–1950.
93. Mackey, S., Petrides, M., Architecture and morphology of the human ventromedial prefrontal cortex. Eur. J. Neurosci. 40 (2014), 2777–2796.
94. Meeter, M., Myers, C.E., Shohamy, D., Hopkins, R.O., Gluck, M.A., Strategies in probabilistic categorization: results from a new way of analyzing performance. Learn. Mem. 13 (2006), 230–239.
95. Middleton, F.A., Strick, P.L., The temporal lobe is a target of output from the basal ganglia. Proc. Natl. Acad. Sci. USA 93 (1996), 8683–8687.
96. Mitchell, K.J., Johnson, M.K., Source monitoring 15 years later: what have we learned from fMRI about the neural mechanisms of source memory?. Psychol. Bull. 135 (2009), 638–677.
97. Murray, J.D., Bernacchia, A., Freedman, D.J., Romo, R., Wallis, J.D., Cai, X., Padoa-Schioppa, C., Pasternak, T., Seo, H., Lee, D., Wang, X.J., A hierarchy of intrinsic timescales across primate cortex. Nat. Neurosci. 17 (2014), 1661–1663.
98. Neubert, F.X., Mars, R.B., Sallet, J., Rushworth, M.F., Connectivity reveals relationship of brain areas for reward-guided learning and decision making in human and monkey frontal cortex. Proc. Natl. Acad. Sci. USA 112 (2015), E2695–E2704.
99. Nyberg, L., Habib, R., McIntosh, A.R., Tulving, E., Reactivation of encoding-related brain activity during memory retrieval. Proc. Natl. Acad. Sci. USA 97 (2000), 11120–11124.
100. Ólafsdóttir, H.F., Barry, C., Saleem, A.B., Hassabis, D., Spiers, H.J., Hippocampal place cells construct reward related sequences through unexplored space. eLife, 4, 2015, e06063.
101. Padoa-Schioppa, C., Neurobiology of economic choice: a good-based model. Annu. Rev. Neurosci. 34 (2011), 333–359.
102. Padoa-Schioppa, C., Assad, J.A., Neurons in the orbitofrontal cortex encode economic value. Nature 441 (2006), 223–226.
103. Padoa-Schioppa, C., Rustichini, A., Rational Attention and Adaptive Coding: A Puzzle and a Solution. Am. Econ. Rev. 104 (2014), 507–513.
104. Palombo, D.J., Keane, M.M., Verfaellie, M., The medial temporal lobes are critical for reward-based decision making under conditions that promote episodic future thinking. Hippocampus 25 (2015), 345–353.
105. Pastor-Bernier, A., Tremblay, E., Cisek, P., Dorsal premotor cortex is involved in switching motor plans. Front. Neuroeng., 5, 2012, 5.
106. Peters, J., Büchel, C., Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron 66 (2010), 138–148.
107. Pfeiffer, B.E., Foster, D.J., Hippocampal place-cell sequences depict future paths to remembered goals. Nature 497 (2013), 74–79.
108. Platt, M.L., Glimcher, P.W., Neural correlates of decision variables in parietal cortex. Nature 400 (1999), 233–238.
109. Polanía, R., Krajbich, I., Grueschow, M., Ruff, C.C., Neural oscillations and synchronization differentially support evidence accumulation in perceptual and value-based decision making. Neuron 82 (2014), 709–720.
110. Preston, A.R., Shrager, Y., Dudukovic, N.M., Gabrieli, J.D., Hippocampal contribution to the novel use of relational information in declarative memory. Hippocampus 14 (2004), 148–152.
111. Raaijmakers, J.G., Shiffrin, R.M., Models for recall and recognition. Ann. Rev. Psychol. 43 (1992), 205–234.
112. Rangel, A., Camerer, C., Montague, P.R., A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9 (2008), 545–556.
113. Rao, R.P.N., Decision making under uncertainty: a neural model based on partially observable Markov decision processes. Front. Comput. Neurosci., 4, 2010, 146.
114. Ratcliff, R., A theory of memory retrieval. Psychol. Rev. 85 (1978), 59–108.
115. Ratcliff, R., Clark, S.E., Shiffrin, R.M., List-strength effect: I. Data and discussion. J. Exp. Psychol. 16 (1990), 163–178.
116. Rissman, J., Wagner, A.D., Distributed representations in memory: insights from functional brain imaging. Annu. Rev. Psychol. 63 (2012), 101–128.
117. Rockland, K.S., Pandya, D.N., Laminar origins and terminations of cortical connections of the occipital lobe in the rhesus monkey. Brain Res. 179 (1979), 3–20.
118. Rorie, A.E., Gao, J., McClelland, J.L., Newsome, W.T., Integration of sensory and reward information during perceptual decision-making in lateral intraparietal cortex (LIP) of the macaque monkey. PLoS One, 5, 2010, e9308.
119. Roth, M.M., Dahmen, J.C., Muir, D.R., Imhof, F., Martini, F.J., Hofer, S.B., Thalamic nuclei convey diverse contextual information to layer 1 of visual cortex. Nat. Neurosci. 19 (2016), 299–307.
120. Rudebeck, P.H., Murray, E.A., Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. J. Neurosci. 31 (2011), 10569–10578.
121. Rugg, M.D., Vilberg, K.L., Brain networks underlying episodic memory retrieval. Curr. Opin. Neurobiol. 23 (2013), 255–260.
122. Rushworth, M.F., Kolling, N., Sallet, J., Mars, R.B., Valuation and decision-making in frontal cortex: one or many serial or parallel systems?. Curr. Opin. Neurobiol. 22 (2012), 946–955.
123. Saez, A., Rigotti, M., Ostojic, S., Fusi, S., Salzman, C.D., Abstract context representations in primate amygdala and prefrontal cortex. Neuron 87 (2015), 869–881.
124. Schacter, D.L., Addis, D.R., Buckner, R.L., Remembering the past to imagine the future: the prospective brain. Nat. Rev. Neurosci. 8 (2007), 657–661.
125. Schacter, D.L., Addis, D.R., Hassabis, D., Martin, V.C., Spreng, R.N., Szpunar, K.K., The future of memory: remembering, imagining, and the brain. Neuron 76 (2012), 677–694.
126. Schapiro, A.C., Kustner, L.V., Turk-Browne, N.B., Shaping of object representations in the human medial temporal lobe based on temporal regularities. Curr. Biol. 22 (2012), 1622–1627.
127. Schoenbaum, G., Roesch, M., Orbitofrontal cortex, associative learning, and expectancies. Neuron 47 (2005), 633–636.
128. Schultz, W., Multiple reward signals in the brain. Nat. Rev. Neurosci. 1 (2000), 199–207.
129. Scimeca, J.M., Badre, D., Striatal contributions to declarative memory retrieval. Neuron 75 (2012), 380–392.
130. Shadlen, M.N., Kiani, R., Decision making as a window on cognition. Neuron 80 (2013), 791–806.
131. Shadlen, M.N., Kiani, R., Hanks, T.D., Churchland, A.K., Neurobiology of decision making: an intentional framework. Engel, C., Singer, W., (eds.) Better Than Conscious?: Decision Making, the Human Mind, and Implications for Institutions, 2008, MIT Press, 71–102.
132. Shiner, T., Seymour, B., Wunderlich, K., Hill, C., Bhatia, K.P., Dayan, P., Dolan, R.J., Dopamine and performance in a reinforcement learning task: evidence from Parkinson's disease. Brain 135 (2012), 1871–1883.
133. Shohamy, D., Learning and motivation in the human striatum. Curr. Opin. Neurobiol. 21 (2011), 408–414.
134. Shohamy, D., Daw, N.D., Integrating memories to guide decisions. Curr. Opin. Behav. Sci. 5 (2015), 85–90.
135. Shohamy, D., Wagner, A.D., Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events. Neuron 60 (2008), 378–389.
136. Shohamy, D., Myers, C.E., Grossman, S., Sage, J., Gluck, M.A., Poldrack, R.A., Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. Brain 127 (2004), 851–859.
137. Singer, A.C., Carr, M.F., Karlsson, M.P., Frank, L.M., Hippocampal SWR activity predicts correct decisions during the initial learning of an alternation task. Neuron 77 (2013), 1163–1173.
138. Smith, P.L., Ratcliff, R., Psychology and neurobiology of simple decisions. Trends Neurosci. 27 (2004), 161–168.
139. Smittenaar, P., Chase, H.W., Aarts, E., Nusselein, B., Bloem, B.R., Cools, R., Decomposing effects of dopaminergic medication in Parkinson's disease on probabilistic action selection–learning or performance?. Eur. J. Neurosci. 35 (2012), 1144–1151.
140. Snyder, L.H., Batista, A.P., Andersen, R.A., Coding of intention in the posterior parietal cortex. Nature 386 (1997), 167–170.
141. Speer, M.E., Bhanji, J.P., Delgado, M.R., Savoring the past: positive memories evoke value representations in the striatum. Neuron 84 (2014), 847–856.
142. Strait, C.E., Blanchard, T.C., Hayden, B.Y., Reward value comparison via mutual inhibition in ventromedial prefrontal cortex. Neuron 82 (2014), 1357–1366.
143. Sugrue, L.P., Corrado, G.S., Newsome, W.T., Choosing the greater of two goods: neural currencies for valuation and decision making. Nat. Rev. Neurosci. 6 (2005), 363–375.
144. Tremblay, L., Schultz, W., Relative reward preference in primate orbitofrontal cortex. Nature 398 (1999), 704–708.
145. Tremblay, L., Schultz, W., Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J. Neurophysiol. 83 (2000), 1864–1876.
146. Wallis, J.D., Anderson, K.C., Miller, E.K., Single neurons in prefrontal cortex encode abstract rules. Nature 411 (2001), 953–956.
147. Weber, E.U., Johnson, E.J., Constructing preferences from memory. Lichtenstein, S., Slovic, P., (eds.) The Construction of Preference, 2006, Cambridge University Press, 397–410.
148. Weber, E.U., Johnson, E.J., Milch, K.F., Chang, H., Brodscholl, J.C., Goldstein, D.G., Asymmetric discounting in intertemporal choice: a query-theory account. Psychol. Sci. 18 (2007), 516–523.
149. Wheeler, M.E., Petersen, S.E., Buckner, R.L., Memory's echo: vivid remembering reactivates sensory-specific cortex. Proc. Natl. Acad. Sci. USA 97 (2000), 11125–11129.
150. Wiecki, T.V., Frank, M.J., A computational model of inhibitory control in frontal cortex and basal ganglia. Psychol. Rev. 120 (2013), 329–355.
151. Wilson, R.C., Takahashi, Y.K., Schoenbaum, G., Niv, Y., Orbitofrontal cortex as a cognitive map of task space. Neuron 81 (2014), 267–279.
152. Wimmer, G.E., Shohamy, D., Preference by association: how memory mechanisms in the hippocampus bias decisions. Science 338 (2012), 270–273.
153. Yu, J.Y., Frank, L.M., Hippocampal-cortical interaction in decision making. Neurobiol. Learn. Mem. 117 (2015), 34–41.
154. Zeithamova, D., Dominick, A.L., Preston, A.R., Hippocampal and ventral medial prefrontal activation during retrieval-mediated learning supports novel inference. Neuron 75 (2012), 168–179.
155. Znamenskiy, P., Zador, A.M., Corticostriatal neurons in auditory cortex drive decisions during auditory discrimination. Nature 497 (2013), 482–485.
156. Zylberberg, A., Fernández Slezak, D., Roelfsema, P.R., Dehaene, S., Sigman, M., The brain's router: a cortical network model of serial processing in the primate brain. PLoS Comput. Biol., 6, 2010, e1000765.
157. Zylberberg, A., Dehaene, S., Roelfsema, P.R., Sigman, M., The human Turing machine: a neural framework for mental programs. Trends Cogn. Sci. 15 (2011), 293–300.