The striatum and beyond: Contributions of the hippocampus to decision making

Decision Making, Affect, and Learning: Attention and Performance XXIII

Volumn , Issue , 2011, Pages

  Elliott Wimmer, G ^a   Shohamy, Daphna ^a  

^a Department of Psychology Columbia University ^*  (United States)

Author keywords

Decision making; Dopamine; Hippocampus; Learning; Memory; Representational process; Striatum

Indexed keywords

EID: 84921634290     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/acprof:oso/9780199600434.003.0013     Document Type: Chapter

References (166)

1. Adcock, R.A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., Gabrieli, J.D. (2006). Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron, 50, 507-17.
2. Addis, D.R., Wong, A.T., and Schacter, D.L. (2007). Remembering the past and imagining the future: Common and distinct neural substrates during event construction and elaboration. Neuropsychologia, 45, 1363-77.
3. Aron, A.R., Shohamy, D., Clark, J., Myers, C., Gluck, M.A., and Poldrack, R.A. (2004). Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. J Neurophysiol, 92, 1144-52.
4. Barr, R., Marrott, H., and Rovee-Collier, C. (2003). The role of sensory preconditioning in memory retrieval by preverbal infants. Learn Behav, 31, 111-23.
5. Bayer, H.M. and Glimcher, P.W. (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129-41.
6. Beiser, D.G. and Houk, J.C. (1998). Model of cortical-basal ganglionic processing:encoding the serial order of sensory events. J Neurophysiol, 79, 3168-88.
7. Botzung, A. Denkova, E., and Manning, L. (2008). Experiencing past and future personal events: functional neuroimaging evidence on the neural bases of mental time travel. Brain Cogn, 66, 202-12.
8. Brewer, J.B., Zhao, Z., Desmond, J.E., Glover, G.H., and Gabrieli, J.D. (1998). Making memories: brain activity that predicts how well visual experience will be remembered. Science, 281, 1185-87.
9. Brogden, W.J. (1939). Sensory pre-conditioning. J Exp Psychol, 25, 323-32.
10. Brogden, W.J. (1947). Sensory pre-conditioning of human subjects. J Exp Psychol, 37, 527-39.
11. Buckmaster, C.A., Eichenbaum, H., Amaral, D.G., Suzuki, W.A., and Rapp, P.R. (2004). Entorhinal cortex lesions disrupt the relational organization of memory in monkeys. J Neurosci, 24, 9811-25.
12. Buckner, R.L., Andrews-Hanna, J.R., and Schacter, D.L. (2008). The brain's default network: anatomy, function, and relevance to disease. Ann NY Acad Sci, 1124, 1-38.
13. Bunsey, M. and Eichenbaum, H. (1996). Conservation of hippocampal memory function in rats and humans. Nature, 379, 255-57.
14. Bunzeck, N. and Duzel, E. (2006). Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron 51, 369-79.
15. Clement, N., Foerde, K., and Shohamy, D. (2008). Quantity vs. Quality: Practice affects medial temporal lobe and basal ganglia contributions to learning and generalization In Society for Neuroscience (Washington, DC).
16. Cohen, N.J. (1984). Preserved learning capacity in amnesia: evidence for multiple memory systems. (New York: Guilford).
17. Cohen, N.J. and Eichenbaum, H. (1993). Memory, amnesia, and the hippocampal system. (Cambridge, MA: MIT Press).
18. Cohen, N.J. and Squire, L.R. (1980). Preserved learning and retention of patternanalyzing skill in amnesia: dissociation of knowing how and knowing that. Science 210, 207-10.
19. Cohen, N.J. and Squire, L.R. (1981). Retrograde amnesia and remote memory impairment. Neuropsychologia, 19, 337-56.
20. Cohen, M.X., Schoene-Bake, J.C., Elger, C.E., and Weber, B. (2009). Connectivitybased segregation of the human striatum predicts personality characteristics. Nat Neurosci, 12, 32-4.
21. Cools, R., Clark, L., Owen, A.M., and Robbins, T.W. (2002). Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J Neurosci, 22, 4563-67.
22. Cools, R., Altamirano, L., and D'Esposito, M. (2006). Reversal learning in Parkinson's disease depends on medication status and outcome valence. Neuropsychologia, 44, 1663-73.
23. Couvillon, P.A. and Bitterman, M.E. (1992). A conventional conditioning analysis of "transitive inference" in pigeons. J Exp Psychol Anim Behav Process, 18, 308-310.
24. D'Ardenne, K., McClure, S.M., Nystrom, L.E., and Cohen, J.D. (2008). BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science, 319, 1264-67.
25. Davachi, L. (2006). Item, context and relational episodic encoding in humans. Curr Opin Neurobiol, 16, 693-700.
26. Daw, N.D. and Doya, K. (2006). The computational neurobiology of learning and reward. Curr Opin Neurobiol, 16, 199-204.
27. Daw, N.D., Niv, Y., and Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci, 8, 1704-1711.
28. Daw, N.D. and Shohamy, D. (2008). The cognitive neuroscience of motivation and learning. Soc Cogn, 26, 593-620.
29. Dayan, P. and Abbott, L.F. (2001). Theoretical neuroscience (Cambridge, MA: MIT Press).
30. Delgado, M.R., Nystrom, L.E., Fissell, C., Noll, D.C., and Fiez, J.A. (2000). Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol, 84, 3072-77.
31. Delgado, M.R., Frank, R.H., and Phelps, E.A. (2005a). Perceptions of moral character modulate the neural systems of reward during the trust game. Nat Neurosci, 8, 1611-18.
32. Delgado, M.R., Miller, M.M., Inati, S., and Phelps, E.A. (2005b). An fMRI study of reward-related probability learning. Neuroimage, 24, 862-73.
33. Downes, J.J., Roberts, A.C., Sahakian, B.J., Evenden, J.L., Morris, R.G., and Robbins, T.W. (1989). Impaired extra-dimensional shift performance in medicated and unmedicated Parkinson's disease: evidence for a specific attentional dysfunction. Neuropsychologia, 27, 1329-43.
34. Dusek, J.A. and Eichenbaum, H. (1997). The hippocampus and memory for orderly stimulus relations. Proc Natl Acad Sci USA, 94, 7109-14.
35. Dwyer, D.M. and Killcross, S. (2006). Lesions of the basolateral amygdala disrupt conditioning based on the retrieved representations of motivationally significant events. J Neurosci, 26, 8305-309.
36. Eichenbaum, H. (2000). A cortical-hippocampal system for declarative memory. Nat Rev Neurosci, 1, 41-50.
37. Eichenbaum, H. and Cohen, N.J. (2001). From conditioning to conscious recollection:memory systems of the brain (New York: Oxford University Press).
38. Eichenbaum, H., Stewart, C., and Morris, R.G. (1990). Hippocampal representation in place learning. J Neurosci, 10, 3531-42.
39. Eichenbaum, H., Yonelinas, A.P., and Ranganath, C. (2007). The medial temporal lobe and recognition memory. Annu Rev Neurosci, 30, 123-52.
40. Frank, M.J., Rudy, J.W., and O'Reilly, R.C. (2003). Transitivity, flexibility, conjunctive representations, and the hippocampus. II. A computational analysis. Hippocampus, 13, 341-54.
41. Frank, M.J., Seeberger, L.C., and O'Reilly R, C. (2004). By carrot or by stick:cognitive reinforcement learning in parkinsonism. Science, 306, 1940-43.
42. Frey, U., Schroeder, H., and Matthies, H. (1990). Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices. Brain Res, 522, 69-75.
43. Fuxe, K. (1965). Evidence for the existence of monoamine neurons in the central nervous System. Iv. Distribution of monoamine nerve terminals in the central nervous system. Acta Physiol Scand Suppl, SUPPL 247:37.
44. Fyhn, M., Molden, S., Hollup, S., Moser, M.B., and Moser, E. (2002). Hippocampal neurons responding to first-time dislocation of a target object. Neuron, 35, 555-66.
45. Gabrieli, J.D. (1998). Cognitive neuroscience of human memory. Annu Rev Psychol, 49, 87-115.
46. Gasbarri, A., Packard, M.G., Campana, E., and Pacitti, C. (1994). Anterograde and retrograde tracing of projections from the ventral tegmental area to the hippocampal formation in the rat. Brain Res Bull, 33, 445-52.
47. Gasbarri, A., Sulli, A., Innocenzi, R., Pacitti, C., and Brioni, J.D. (1996). Spatial memory impairment induced by lesion of the mesohippocampal dopaminergic system in the rat. Neuroscience, 74, 1037-44.
48. Gewirtz, J.C. and Davis, M. (1997). Second-order fear conditioning prevented by blocking NMDA receptors in amygdala. Nature, 388, 471-74.
49. Gewirtz, J.C. and Davis, M. (2000). Using pavlovian higher-order conditioning paradigms to investigate the neural substrates of emotional learning and memory. Learn Mem, 7, 257-66.
50. Gilbert, D.T. and Wilson, T.D. (2007). Prospection: experiencing the future. Science, 317, 1351-54.
51. Gluck, M.A. and Myers, C.E. (1993). Hippocampal mediation of stimulus representation: a computational theory. Hippocampus, 3, 491-516.
52. Granado, N., Ortiz, O., Suarez, L.M., Martin, E.D., Cena, V., Solis, J.M., and Moratalla, R. (2008). D1 but not D5 dopamine receptors are critical for LTP, spatial learning, and LTP-Induced arc and zif268 expression in the hippocampus. Cereb Cortex, 18, 1-12.
53. Haber, S.N. and Knutson, B. (2010). The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35, 4-26.
54. Haber, S.N., Kim, K.S., Mailly, P., and Calzavara, R. (2006). Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning. J Neurosci, 26, 8368-76.
55. Hall, D. and Suboski, M.D. (1995). Sensory preconditioning and secord-order conditioning of alarm reactions in zebra danio fish (Brachydanio rerio). J Comp Psych, 109, 76-84.
56. Hall, G. (1996). Learning about associatively activated stimulus representations:Implications for acquired equivalence and perceptual learning. Anim Learn Beh, 24, 233-55.
57. Hampton, A.N. and O'Doherty J, P. (2007). Decoding the neural substrates of reward-related decision making with functional MRI. Proc Natl Acad Sci USA, 104, 1377-82.
58. Hare, T.A., O'Doherty, J., Camerer, C.F., Schultz, W., and Rangel, A. (2008). Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci, 28, 5623-30.
59. Hassabis, D., Kumaran, D., Vann, S.D., and Maguire, E.A. (2007). Patients with hippocampal amnesia cannot imagine new experiences. Proc Natl Acad Sci USA, 104, 1726-31.
60. Hatfield, T., Han, J.S., Conley, M., Gallagher, M., and Holland, P. (1996). Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects. J Neurosci, 16, 5256-65.
61. Heckers, S., Zalesak, M., Weiss, A.P., Ditman, T., and Titone, D. (2004). Hippocampal activation during transitive inference in humans. Hippocampus, 14, 153-62.
62. Hoffeld, D.R., Kendall, S.B., Thompson, R.F., and Brogden, W.J. (1960). Effect of amount of preconditioning training upon the magnitude of sensory preconditioning. J Exp Psychol, 59, 198-204.
63. Huang, Y.Y. and Kandel, E.R. (1995). D1/D5 receptor agonists induce a protein synthesis-dependent late potentiation in the CA1 region of the hippocampus. Proc Natl Acad Sci USA, 92, 2446-50.
64. Karn, H.W. (1947). Sensory pre-conditioning and incidental learning in human subjects. J Exp Psychol, 37, 540-44.
65. Kesner, R.P., Bolland, B.L., and Dakis, M. (1993). Memory for spatial locations, motor responses, and objects: triple dissociation among the hippocampus, caudate nucleus, and extrastriate visual cortex. Exp Brain Res, 93, 462-70.
66. Kimmel, H.D. (1977). Notes from "Pavlov's Wednesdays": sensory preconditioning. Am J Psychol, 90, 319-21.
67. King-Casas, B., Tomlin, D., Anen, C., Camerer, C.F., Quartz, S.R., and Montague, P.R. (2005). Getting to know you: reputation and trust in a two-person economic exchange. Science, 308, 78-83.
68. Kirchhoff, B.A., Wagner, A.D., Maril, A., and Stern, C.E. (2000). Prefrontaltemporal circuitry for episodic encoding and subsequent memory. J Neurosci, 20, 6173-80.
69. Kirsch, P., Schienle, A., Stark, R., Sammer, G., Blecker, C., Walter, B., Ott, U., Burkart, J., and Vaitl, D. (2003). Anticipation of reward in a nonaversive differential conditioning paradigm and the brain reward system: an event-related fMRI study. Neuroimage, 20, 1086-95.
70. Knowlton, B.J., Mangels, J.A., and Squire, L.R. (1996). A neostriatal habit learning system in humans. Science, 273, 1399-1402.
71. Knutson, B. and Gibbs, S.E. (2007). Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology (Berl), 191, 813-22.
72. Knutson, B., Adams, C.M., Fong, G.W., and Hommer, D. (2001). Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci, 21, RC159.
73. Knutson, B., Rick, S., Wimmer, G.E., Prelec, D., and Loewenstein, G. (2007). Neural predictors of purchases. Neuron, 53, 147-56.
74. Kojima, S., Kobayashi, S., Yamanaka, M., Sadamoto, H., Nakamura, H., Fujito, Y., Kawai, R., Sakakibara, M., and Ito, E. (1998). Sensory preconditioning for feeding response in the pond snail, Lymnaea stagnalis. Brain Res, 808, 113-115.
75. Krebs, R.M., Schott, B.H., and Duzel, E. (2009). Personality traits are differentially associated with patterns of reward and novelty processing in the human substantia nigra/ventral tegmental area. Biol Psychiatry, 65, 103-110.
76. Kumaran, D. and Maguire, E.A. (2006). An unexpected sequence of events: mismatch detection in the human hippocampus. PLoS Biol, 4, e424.
77. Kumaran, D. and Maguire, E.A. (2007). Match mismatch processes underlie human hippocampal responses to associative novelty. J Neurosci, 27, 8517-24.
78. Kumaran, D. and Maguire, E.A. (2009). Novelty signals: a window into hippocampal information processing. Trends Cogn Sci, 13, 47-54.
79. Lansink, C.S., Goltstein, P.M., Lankelma, J.V., McNaughton, B.L., and Pennartz, C.M. (2009). Hippocampus leads ventral striatum in replay of place-reward information. PLoS Biol, 7, e1000173.
80. Lee, A.S., Duman, R.S., and Pittenger, C. (2008). A double dissociation revealing bidirectional competition between striatum and hippocampus during learning. Proc Natl Acad Sci USA, 105, 17163-68.
81. Legault, M. and Wise, R.A. (1999). Injections of N-methyl-D-aspartate into the ventral hippocampus increase extracellular dopamine in the ventral tegmental area and nucleus accumbens. Synapse, 31, 241-49.
82. Lemon, N., and Manahan-Vaughan, D. (2006). Dopamine D1/D5 receptors gate the acquisition of novel information through hippocampal long-term potentiation and long-term depression. J Neurosci, 26, 7723-29.
83. Lengyel, M. and Dayan, P. (2005). Hippocampal contributions to control: the third way. In Advances in neural information processing systems 20, J. Platt, D. Koller, Y. Singer, and S. Roweis, eds. (Cambridge, MA: MIT Press).
84. Li, S., Cullen, W.K., Anwyl, R., and Rowan, M.J. (2003). Dopamine-dependent facilitation of LTP induction in hippocampal CA1 by exposure to spatial novelty. Nat Neurosci, 6, 526-31.
85. Lindvall, O. and Bjorklund, A. (1974). The organization of the ascending catecholamine neuron systems in the rat brain as revealed by the glyoxylic acid fluorescence method. Acta Physiol Scand Suppl, 412, 1-48.
86. Lisman, J.E. and Grace, A.A. (2005). The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron, 46, 703-13.
87. Ljungberg, T., Apicella, P., and Schultz, W. (1992). Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol, 67, 145-63.
88. Lodge, D.J. and Grace, A.A. (2006). The hippocampus modulates dopamine neuron responsivity by regulating the intensity of phasic neuron activation. Neuropsychopharmacology, 31, 1356-61.
89. Lodge, D.J. and Grace, A.A. (2008). Amphetamine activation of hippocampal drive of mesolimbic dopamine neurons: a mechanism of behavioral sensitization. J Neurosci, 28, 7876-82.
90. McClure, S.M., Berns, G.S., and Montague, P.R. (2003). Temporal prediction errors in a passive learning task activate human striatum. Neuron, 38, 339-46.
91. McClure, S.M., Li, J., Tomlin, D., Cypert, K.S., Montague, L.M., and Montague, P.R. (2004). Neural correlates of behavioral preference for culturally familiar drinks. Neuron, 44, 379-87.
92. McDonald, R.J. and White, N.M. (1993). A triple dissociation of memory systems:hippocampus, amygdala, and dorsal striatum. Behav Neurosci, 107, 3-22.
93. Montague, P.R., Dayan, P., and Sejnowski, T.J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci, 16, 1936-47.
94. Montague, P.R., King-Casas, B., and Cohen, J.D. (2006). Imaging valuation models in human choice. Annu Rev Neurosci, 29, 417-48.
95. Moustafa, A.A., Cohen, M.X., Sherman, S.J., and Frank, M.J. (2008). A role for dopamine in temporal decision making and reward maximization in Parkinsonism. J Neurosci, 28, 12294-304.
96. Muller, D., Gerber, B., Hellstern, F., Hammer, M., and Menzel, R. (2000). Sensory preconditioning in honeybees. J Exp Biol, 203, 1351-64.
97. Myers, C.E., Shohamy, D., Gluck, M.A., Grossman, S., Kluger, A., Ferris, S., Golomb, J., Schnirman, G., and Schwartz, R. (2003). Dissociating hippocampal versus basal ganglia contributions to learning and transfer. J Cogn Neurosci, 15, 185-93.
98. Nagy, H., Keri, S., Myers, C.E., Benedek, G., Shohamy, D., and Gluck, M.A. (2007). Cognitive sequence learning in Parkinson's disease and amnestic mild cognitive impairment: dissociation between sequential and non-sequential learning of associations. Neuropsychologia, 45, 1386-92.
99. Nicholson, D.A. and Freeman, J.H., Jr (2000). Lesions of the perirhinal cortex impair sensory preconditioning in rats. Behav Brain Res, 112, 69-75.
100. O'Doherty, J.P. (2004). Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr Opin Neurobiol, 14, 769-76.
101. O'Doherty, J.P., Dayan, P., Friston, K., Critchley, H., and Dolan, R.J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron, 38, 329-37.
102. Otmakhova, N.A., and Lisman, J.E. (1996). D1/D5 dopamine receptor activation increases the magnitude of early long-term potentiation at CA1 hippocampal synapses. J Neurosci, 16, 7478-86.
103. Otten, L.J., Henson, R.N., and Rugg, M.D. (2001). Depth of processing effects on neural correlates of memory encoding: relationship between findings from across-and within-task comparisons. Brain, 124, 399-412.
104. Owen, A.M., Beksinska, M., James, M., Leigh, P.N., Summers, B.A., Marsden, C.D., Quinn, N.P., Sahakian, B.J., and Robbins, T.W. (1993). Visuospatial memory deficits at different stages of Parkinson's disease. Neuropsychologia, 31, 627-44.
105. Packard, M.G. (1999). Glutamate infused posttraining into the hippocampus or caudateputamen differentially strengthens place and response learning. Proc Natl Acad Sci USA, 96, 12881-86.
106. Packard, M.G. and McGaugh, J.L. (1996). Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol Learn Mem, 65, 65-72.
107. Packard, M.G., Hirsh, R., and White, N.M. (1989). Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: evidence for multiple memory systems. J Neurosci, 9, 1465-72.
108. Padoa-Schioppa, C. and Assad, J.A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature, 441, 223-26.
109. Paller, K.A. and Wagner, A.D. (2002). Observing the transformation of experience into memory. Trends Cogn Sci, 6, 93-102.
110. Palminteri, S., Lebreton, M., Worbe, Y., Grabli, D., Hartmann, A., and Pessiglione, M. (2009). Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes. Proc Natl Acad Sci USA.
111. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R.J., and Frith, C.D. (2006). Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature, 442, 1042-45.
112. Plassmann, H., O'Doherty, J., and Rangel, A. (2007). Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J Neurosci, 27, 9984-88.
113. Poldrack, R.A., Clark, J., Pare-Blagoev, E.J., Shohamy, D., Creso Moyano, J., Myers, C., and Gluck, M.A. (2001). Interactive memory systems in the human brain. Nature, 414, 546-50.
114. Poldrack, R.A. and Packard, M.G. (2003). Competition among multiple memory systems: converging evidence from animal and human brain studies. Neuropsychologia, 41, 245-51.
115. Port, R.L. and Patterson, M.M. (1984). Fimbrial lesions and sensory preconditioning. Behav Neurosci, 98, 584-89.
116. Port, R.L., Beggs, A.L., and Patterson, M.M. (1987). Hippocampal substrate of sensory associations. Physiol Behav, 39, 643-47.
117. Preston, A.R., Shrager, Y., Dudukovic, N.M., and Gabrieli, J.D. (2004). Hippocampal contribution to the novel use of relational information in declarative memory. Hippocampus, 14, 148-52.
118. Rangel, A., Camerer, C., and Montague, P.R. (2008). A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9, 545-56.
119. Rescorla, R.A. (1980). Simultaneous and successive associations in sensory preconditioning. J Exp Psychol Anim Behav Process, 6, 207-16.
120. Robbins, T.W. (1996). Refining the taxonomy of memory. Science, 273, 1353-54.
121. Robinson, S., Rainwater, A.J., Hnasko, T.S., and Palmiter, R.D. (2007). Viral restoration of dopamine signaling to the dorsal striatum restores instrumental conditioning to dopamine-deficient mice. Psychopharmacology (Berl), 191, 567-78.
122. Rossato, J.I., Bevilaqua, L.R., Izquierdo, I., Medina, J.H., and Cammarota, M. (2009). Dopamine controls persistence of long-term memory storage. Science, 325, 1017-20.
123. Saint-Cyr, J.A., Taylor, A.E., and Lang, A.E. (1988). Procedural learning and neostriatal dysfunction in man. Brain, 111 (Pt 4), 941-59.
124. Samejima, K., Ueda, Y., Doya, K., and Kimura, M. (2005). Representation of actionspecific reward values in the striatum. Science, 310, 1337-40.
125. Schacter, D.L. (1990). Perceptual representation systems and implicit memory. Toward a resolution of the multiple memory systems debate. Ann NY Acad Sci, 608, 543-67; discussion 567-571.
126. Schacter, D.L. and Graf, P. (1986). Preserved learning in amnesic patients:perspectives from research on direct priming. J Clin Exp Neuropsychol 8, 727-43.
127. Schacter, D.L. and Wagner, A.D. (1999). Medial temporal lobe activations in fMRI and PET studies of episodic encoding and retrieval. Hippocampus 9, 7-24.
128. Schendan, H.E., Searl, M.M., Melrose, R.J., and Stern, C.E. (2003). An FMRI study of the role of the medial temporal lobe in implicit and explicit sequence learning. Neuron, 37, 1013-25.
129. Schonberg, T., O'Doherty, J.P., Joel, D., Inzelberg, R., Segev, Y., and Daw, N.D. Selective impairment of prediction error signaling in human dorsolateral but not ventral striatum in Parkinson's disease patients: evidence from a model-based fMRI study. Neuroimage, 49, 772-81.
130. Schott, B.H., Sellner, D.B., Lauer, C.J., Habib, R., Frey, J.U., Guderian, S., Heinze, H.J., and Duzel, E. (2004). Activation of midbrain structures by associative novelty and the formation of explicit memory in humans. Learn Mem, 11, 383-87.
131. Schott, B.H., Seidenbecher, C.I., Fenker, D.B., Lauer, C.J., Bunzeck, N., Bernstein, H.G., Tischmeyer, W., Gundelfinger, E.D., Heinze, H.J., and Duzel, E. (2006). The dopaminergic midbrain participates in human episodic memory formation:evidence from genetic imaging. J Neurosci, 26, 1407-1417.
132. Schultz, W. (2006). Behavioral theories and the neurophysiology of reward. Annu Rev Psychol, 57, 87-115.
133. Schultz, W., Dayan, P., and Montague, P.R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-99.
134. Setlow, B., Gallagher, M., and Holland, P.C. (2002a). The basolateral complex of the amygdala is necessary for acquisition but not expression of CS motivational value in appetitive Pavlovian second-order conditioning. Eur J Neurosci, 15, 1841-53.
135. Setlow, B., Holland, P.C., and Gallagher, M. (2002b). Disconnection of the basolateral amygdala complex and nucleus accumbens impairs appetitive pavlovian second-order conditioned responses. Behav Neurosci, 116, 267-75.
136. Shohamy, D. and Wagner, A.D. (2008). Integrating memories in the human brain:hippocampal-midbrain encoding of overlapping events. Neuron, 60, 378-89.
137. Shohamy, D., Myers, C.E., Grossman, S., Sage, J., Gluck, M.A., and Poldrack, R.A. (2004a). Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. Brain, 127, 851-59.
138. Shohamy, D., Myers, C.E., Onlaor, S., and Gluck, M.A. (2004b). Role of the basal ganglia in category learning: how do patients with Parkinson's disease learn? Behav Neurosci, 118, 676-86.
139. Shohamy, D., Myers, C.E., Grossman, S., Sage, J., and Gluck, M.A. (2005). The role of dopamine in cognitive sequence learning: evidence from Parkinson's disease. Behav Brain Res, 156, 191-99.
140. Shohamy, D., Myers, C.E., Geghman, K.D., Sage, J., and Gluck, M.A. (2006). Ldopa impairs learning, but spares generalization, in Parkinson's disease. Neuropsychologia, 44, 774-84.
141. Smith-Roe, S.L. and Kelley, A.E. (2000). Coincident activation of NMDA and dopamine D1 receptors within the nucleus accumbens core is required for appetitive instrumental learning. J Neurosci, 20, 7737-42.
142. Squire, L.R. (1987). The organization and neural substrates of human memory. Int J Neurol, 21-22, 218-22.
143. Squire, L.R. (1992). Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. Psychol Rev, 99, 195-231.
144. Staresina, B.P. and Davachi, L. (2009). Mind the gap: binding experiences across space and time in the human hippocampus. Neuron, 63, 267-76.
145. Suri, R.E. and Schultz, W. (1998). Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Exp Brain Res, 121, 350-54.
146. Sutton, R.S. and Barto, A.G. (1998). Reinforcement learning: an introduction (Cambridge, MA: MIT Press).
147. Swainson, R., Rogers, R.D., Sahakian, B.J., Summers, B.A., Polkey, C.E., and Robbins, T.W. (2000). Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: possible adverse effects of dopaminergic medication. Neuropsychologia, 38, 596-612.
148. Swanson, L.W. (1982). The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat. Brain Res Bull, 9, 321-53.
149. Szpunar, K.K., Watson, J.M., and McDermott, K.B. (2007). Neural substrates of envisioning the future. Proc Natl Acad Sci USA, 104, 642-47.
150. Talk, A.C., Gandhi, C.C., and Matzel, L.D. (2002). Hippocampal function during behaviorally silent associative learning: dissociation of memory storage and expression. Hippocampus, 12, 648-56.
151. Tran, A.H., Uwano, T., Kimura, T., Hori, E., Katsuki, M., Nishijo, H., and Ono, T. (2008). Dopamine D1 receptor modulates hippocampal representation plasticity to spatial novelty. J Neurosci, 28, 13390-400.
152. Tsai, H.C., Zhang, F., Adamantidis, A., Stuber, G.D., Bonci, A., de Lecea, L., and Deisseroth, K. (2009). Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science, 324, 1080-84.
153. Tulving, E., Schacter, D.L., McLachlan, D.R., and Moscovitch, M. (1988). Priming of semantic autobiographical knowledge: a case study of retrograde amnesia. Brain Cogn, 8, 3-20.
154. van der Meer, M.A. and Redish, A.D. (2009). Covert Expectation-of-Reward in Rat Ventral Striatum at Decision Points. Front Integr Neurosci, 3, 1.
155. von Fersen, L., Wynne, C.D.L., Delius, J.D., and Staddon, J.E.R. (1991). Transitive inference in pigeons. J Exp Psychol Anim Behav Process, 17, 334-41.
156. Wagner, A.D., Schacter, D.L., Rotte, M., Koutstaal, W., Maril, A., Dale, A.M., Rosen, B.R., and Buckner, R.L. (1998). Building memories: remembering and forgetting of verbal experiences as predicted by brain activity. Science, 281, 1188-91.
157. Walther, E. (2002). Guilty by mere association: evaluative conditioning and the spreading attitude effect. J Pers Soc Psychol, 82, 919-34.
158. Ward-Robinson, J., Coutureau, E., Good, M., Honey, R.C., Killcross, A.S., and Oswald, C.J. (2001). Excitotoxic lesions of the hippocampus leave sensory preconditioning intact: implications for models of hippocampal function. Behav Neurosci, 115, 1357-62.
159. Ward-Robinson, J. and Hall, G. (1996). Backward sensory preconditioning. J Exp Psychol Anim Behav Processes, 22, 395-404.
160. Weber, E.U., Johnson, E.J., Milch, K.F., Chang, H., Brodscholl, J.C., and Goldstein, D.G. (2007). Asymmetric discounting in intertemporal choice: a query-theory account. Psych Science, 18, 516-23.
161. White, N.M. (1997). Mnemonic functions of the basal ganglia. Curr Opin Neurobiol, 7, 164-69.
162. Wittmann, B.C., Bunzeck, N., Dolan, R.J., and Duzel, E. (2007). Anticipation of novelty recruits reward system and hippocampus while promoting recollection. Neuroimage, 38, 194-202.
163. Wittmann, B.C., Schott, B.H., Guderian, S., Frey, J.U., Heinze, H.J., and Duzel, E. (2005). Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron, 45, 459-67.
164. Wynne, C.D.L., Ferser, L., and Von Staddon, J.E.R. (1992). Pigeons' inferences are transitive and the outcome of elementary conditioning principles: a response. J Exp Psychol Anim Behav Proc, 18, 313-15.
165. Zaghloul, K.A., Blanco, J.A., Weidemann, C.T., McGill, K., Jaggi, J.L., Baltuch, G.H., and Kahana, M.J. (2009). Human substantia nigra neurons encode unexpected financial rewards. Science, 323, 1496-99.
166. Zilli, E.A., and Hasselmo, M.E. (2008). Modeling the role of working memory and episodic memory in behavioral tasks. Hippocampus, 18, 193-209.