Online evaluation of novel choices by simultaneous representation of multiple memories

Nature Neuroscience

Volumn 16, Issue 10, 2013, Pages 1492-1498

  Barron, Helen C ^a   Dolan, Raymond J ^b   Behrens, Timothy E J ^a,b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION; ARTICLE; BRAIN REGION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HIPPOCAMPUS; HUMAN; MEMORY; NERVE CELL PLASTICITY; PREFRONTAL CORTEX; PRIORITY JOURNAL; REWARD;

ADULT; CHOICE BEHAVIOR; FEMALE; HIPPOCAMPUS; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MEMORY; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE;

EID: 84884876869     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.3515     Document Type: Article

References (50)

1. Wimmer, G.E. &Shohamy, D. Preference by association: how memory mechanisms in the hippocampus bias decisions. Science 338, 270-273 (2012).
2. Peters, J. &Büchel, C. Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron 66, 138-148 (2010).
3. Kumaran, D., Summerfield, J.J., Hassabis, D. &Maguire, E.A. Tracking the emergence of conceptual knowledge during human decision making. Neuron 63, 889-901 (2009).
4. Zeithamova, D., Dominick, A.L. &Preston, A.R. Hippocampal and ventral medial prefrontal activation during retrieval-mediated learning supports novel inference. Neuron 75, 168-179 (2012).
5. Hampton, A.N., Bossaerts, P. &O'Doherty, J.P. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J. Neurosci. 26, 8360-8367 (2006). (Pubitemid 44309850)
6. Gläscher, J., Daw, N., Dayan, P. &O'Doherty, J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66, 585-595 (2010).
7. Nicolle, A. et al. An agent independent axis for executed and modeled choice in medial prefrontal cortex. Neuron 75, 1114-1121 (2012).
8. Johnson, A. &Redish, A.D. Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J. Neurosci. 27, 12176-12189 (2007). (Pubitemid 350085471)
9. Steiner, A.P. &Redish, A.D. The road not taken: neural correlates of decision making in orbitofrontal cortex. Front. Neurosci. 6, 131 (2012).
10. Grill-Spector, K., Henson, R. &Martin, A. Repetition and the brain: neural models of stimulus-specific effects. Trends Cogn. Sci. 10, 14-23 (2006). (Pubitemid 43049768)
11. Kohn, A. Visual adaptation: physiology, mechanisms and functional benefits. J. Neurophysiol. 97, 3155-3164 (2007). (Pubitemid 47084734)
12. Doeller, C.F., Barry, C. &Burgess, N. Evidence for grid cells in a human memory network. Nature 463, 657-661 (2010).
13. Kourtzi, Z. &Kanwisher, N. Representation of perceived object shape by the human lateral occipital complex. Science 293, 1506-1509 (2001). (Pubitemid 32801555)
14. Becker, G.M., DeGroot, M.H. &Marschak, J. Measuring utility by a single-response sequential method. Behav. Sci. 9, 226-232 (1964).
15. Kable, J.W. &Glimcher, P.W. The neurobiology of decision: consensus and controversy. Neuron 63, 733-745 (2009).
16. Boorman, E.D., Behrens, T.E.J., Woolrich, M.W. &Rushworth, M.F.S. How green is the grass on the other side Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62, 733-743 (2009).
17. Hunt, L.T. et al. Mechanisms underlying cortical activity during value-guided choice. Nat. Neurosci. 15, 470-476 (2012).
18. Jocham, G., Hunt, L.T., Near, J. &Behrens, T.E.J. A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex. Nat. Neurosci. 15, 960-961 (2012).
19. Hassabis, D., Kumaran, D. &Maguire, E.A. Using imagination to understand the neural basis of episodic memory. J. Neurosci. 27, 14365-14374 (2007).
20. Schacter, D.L. &Addis, D.R. Constructive memory: the ghosts of past and future. Nature 445, 27 (2007). (Pubitemid 46067289)
21. Balleine, B.W. &Dickinson, A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37, 407-419 (1998). (Pubitemid 28306930)
22. Tolman, E.C. Cognitive maps in rats and men. Psychol. Rev. 55, 189-208 (1948).
23. Daw, N.D., Gershman, S.J., Seymour, B., Dayan, P. &Dolan, R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 69, 1204-1215 (2011).
24. Klein-Flügge, M.C., Barron, H.C., Brodersen, K.H., Dolan, R.J. &Behrens, T.E.J. Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex. J. Neurosci. 33, 3202-3211 (2013).
25. Wiggs, C.L. &Martin, A. Properties and mechanisms of perceptual priming. Curr. Opin. Neurobiol. 8, 227-233 (1998). (Pubitemid 28247804)
26. Desimone, R. Neural mechanisms for visual memory and their role in attention. Proc. Natl. Acad. Sci. USA 93, 13494-13499 (1996). (Pubitemid 26424147)
27. Summerfield, C., Trittschuh, E.H., Monti, J.M., Mesulam, M.-M. &Egner, T. Neural repetition suppression reflects fulfilled perceptual expectations. Nat. Neurosci. 11, 1004-1006 (2008).
28. Johnson, A., Van der Meer, M.A. &Redish, A.D. Integrating hippocampus and striatum in decision-making. Curr. Opin. Neurobiol. 17, 692-697 (2007).
29. Jones, J.L. et al. Orbitofrontal cortex supports behavior and learning using inferred but not cached values. Science 338, 953-956 (2012).
30. Sutton, R.S. Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. Proc. 7th Int. Conf. Mach. Learn. 216, 224 (1990).
31. Johnson, A. &Redish, A.D. Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model. Neural Netw. 18, 1163-1171 (2005). (Pubitemid 41642601)
32. Gershman, S.J., Markman, A.B. &Otto, A.R. Retrospective revaluation in sequential decision making: a tale of two systems. J. Exp. Psychol. Gen. published online, doi:10.1037/a0030844 (10 December 2012) (2012).
33. Kable, J.W. &Glimcher, P.W. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10, 1625-1633 (2007). (Pubitemid 350175876)
34. FitzGerald, T.H.B., Seymour, B. &Dolan, R.J. The role of human orbitofrontal cortex in value comparison for incommensurable objects. J. Neurosci. 29, 8388-8395 (2009).
35. Plassmann, H., O'Doherty, J. &Rangel, A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci. 27, 9984-9988 (2007). (Pubitemid 47404004)
36. Levy, I., Lazzaro, S.C., Rutledge, R.B. &Glimcher, P.W. Choice from non-choice: predicting consumer preferences from blood oxygenation level-dependent signals obtained during passive viewing. J. Neurosci. 31, 118-125 (2011).
37. Behrens, T.E.J., Hunt, L.T., Woolrich, M.W. &Rushworth, M.F.S. Associative learning of social value. Nature 456, 245-249 (2008).
38. Janowski, V., Camerer, C. &Rangel, A. Empathic choice involves vmPFC value signals that are modulated by social processing implemented in IPL. Soc. Cogn. Affect. Neurosci. 8, 201-208 (2012).
39. Daw, N.D., Niv, Y. &Dayan, P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704-1711 (2005). (Pubitemid 41683198)
40. McDannald, M.A. et al. Model-based learning and the contribution of the orbitofrontal cortex to the model-free world. Eur. J. Neurosci. 35, 991-996 (2012).
41. Dragoi, G. &Tonegawa, S. Preplay of future place cell sequences by hippocampal cellular assemblies. Nature 469, 397-401 (2011).
42. Doeller, C.F. &Burgess, N. Distinct error-correcting and incidental learning of location relative to landmarks and boundaries. Proc. Natl. Acad. Sci. USA 105, 5909-5914 (2008). (Pubitemid 351758472)
43. Hassabis, D. &Maguire, E.A. Deconstructing episodic memory with construction. Trends Cogn. Sci. 11, 299-306 (2007). (Pubitemid 46962328)
44. Klein, S.B., Loftus, J. &Kihlstrom, J.F. Memory and temporal experience: the effects of episodic memory loss on an amnesic patient's ability to remember the past and imagine the future. Soc. Cogn. 20, 353-379 (2002).
45. Buckner, R.L. The role of the hippocampus in prediction and imagination. Annu. Rev. Psychol. 61, 27-48 (2010).
46. Davachi, L. Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol. 16, 693-700 (2006). (Pubitemid 44802989)
47. Rudy, J.W. &Sutherland, R.J. The hippocampal formation is necessary for rats to learn and remember configural discriminations. Behav. Brain Res. 34, 97-109 (1989). (Pubitemid 19195287)
48. Schacter, D.L. &Addis, D.R. The cognitive neuroscience of constructive memory: remembering the past and imagining the future. Phil. Trans. R. Soc. Lond. B 362, 773-786 (2007). (Pubitemid 47056809)
49. Addis, D.R., Wong, A.T. &Schacter, D.L. Remembering the past and imagining the future: common and distinct neural substrates during event construction and elaboration. Neuropsychologia 45, 1363-1377 (2007). (Pubitemid 46096997)
50. Harris, A., Adolphs, R., Camerer, C. &Rangel, A. Dynamic construction of stimulus values in the ventromedial prefrontal cortex. PLoS ONE 6, e21074 (2011).