Age-associated changes in the hippocampal-ventral striatum-ventral tegmental loop that impact learning, prediction, and context discrimination

Frontiers in Aging Neuroscience

Volumn 4, Issue AUG, 2012, Pages

  Penner, Marsha R ^a   Mizumori, Sheri J Y ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Adaptive navigation; Context discrimination; Decision making; Error prediction; Hippocampus; Ventral striatum Ventral tegmental area

Indexed keywords

DOPAMINE;

AGING; AMYGDALOID NUCLEUS; ARTICLE; ASSOCIATION; COGNITION; CORPUS STRIATUM; DENTATE GYRUS; DISCRIMINATION LEARNING; DOPAMINERGIC SYSTEM; EPISODIC MEMORY; HIPPOCAMPAL CA1 REGION; HIPPOCAMPAL CA3 REGION; HIPPOCAMPUS; HUMAN; LIMBIC SYSTEM; MEMORY; MESENCEPHALON; MOTIVATION; NEURONAVIGATION; ORBITAL CORTEX; ORIENTATION; PERCEPTION; PREDICTION; PREFRONTAL CORTEX; PYRAMIDAL NERVE CELL; RETICULAR FORMATION; REWARD;

EID: 84865090672     PISSN: None     EISSN: 16634365     Source Type: Journal    
DOI: 10.3389/fnagi.2012.00022     Document Type: Article

References (148)

1. Aberman, J. E., and Salamone, J. D. (1999). Nucleus accumbens dopamine depletions make rats more sensitive to high ratio require-ments but do not impair primary food reinforcement. Neuroscience 92, 545-552.
2. Aberman, J. E., Ward, S. J., and Salamone, J. D. (1998). Effects of dopamine antagonists and accumbens dopamine depletions on time-constrained progressive-ratio performance. Pharmacol. Biochem. Behav. 61, 341-348.
3. Anderson, M.I.,andJeffery, K.J. (2003). Heterogeneous mod-ulation of place cell firing by changes in context. J. Neurosci. 23, 8827-8835.
4. Annett, L. E., McGregor, A., and Robbins, T. W. (1989). The effects of ibotenic acid lesions of the nucleus accumbens on spatial learning and extinction in the rat. Behav. Brain Res. 31, 231-242.
5. Arnsten, A. F., and Goldman-Rakic, P. S. (1985). Catecholamines and cog- nitive decline in aged nonhuman primates. Ann. N.Y. Acad. Sci. 444, 218-234.
6. Backman, L., Ginovart, N., Dixon, R. A., Wahlin, T. B., Wahlin, A., Halldin, C., and Farde, L. (2000). Age-related cognitive deficits medi- ated by changes in the striatal dopamine system. Am. J. Psychiatry 157, 635-637.
7. Backman, L., Lindenberger, U., Li, S. C., and Nyberg, L. (2010). Linking cognitive aging to alterations in dopamine neurotransmitter func- tioning: recent data and future avenues. Neurosci. Biobehav. Rev. 34, 670-677.
8. Backman, L., Nyberg, L., Lindenberger, U., Li, S. C., and Farde, L. (2006). The correlative triad among aging, dopamine, and cogni- tion: current status and future prospects. Neurosci. Biobehav. Rev. 30, 791-807.
9. Bakker, A., Kirwan, C. B., Miller, M., and Stark, C. E. (2008). Pattern sep- aration in the human hippocampal CA3 and dentate gyrus. Science 319, 1640-1642.
10. Barnes, C. A. (1979). Memory deficits associated with senescence: a neuro- physiological and behavioral study in the rat. J. Comp. Physiol. Psychol. 93, 74-104.
11. Barnes, C.A., McNaughton, B.L., Mizumori, S. J., Leonard, B. W., and Lin, L. H. (1990). Comparison of spatial and temporal charac- teristics of neuronal activity in sequential stages of hippocampal processing. Prog. Brain Res. 83, 287-300.
12. Barnes, C. A., McNaughton, B. L., and O'Keefe, J. (1983). Loss of place specificity in hippocampal com- plex spike cells of senescent rat. Neurobiol. Aging 4, 113-119.
13. Barnes, C. A., Suster, M. S., Shen, J., and McNaughton, B. L. (1997). Multistability of cognitive maps in the hippocampus of old rats. Nature 388, 272-275.
14. Bayer, H.M.,and Glimcher, P.W. (2005). Midbrain dopamine neu- rons encode a quantitative reward prediction error signal. Neuron 47, 129-141.
15. Belova, M.A., Paton, J.J., Morrison, S. E., and Salzman, C. D. (2007). Expectation modulates neural responses to pleasant and aver- sive stimuli in primate amygdala. Neuron 55, 970-984.
16. Berridge, K. C. (2007). The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology (Berl.) 191, 391-431.
17. Bethus, I., Tse, D., and Morris, R. G. (2010). Dopamine and memory: modulation of the persistence of memory for novel hippocam- pal NMDA receptor-dependent paired associates. J. Neurosci. 30, 1610-1618.
18. Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834.
19. Cruz-Muros, I., Afonso-Oramas, D., Abreu, P., Perez-Delgado, M. M., Rodriguez, M., and Gonzalez- Hernandez, T. (2009). Aging effects on the dopamine transporter expression and compensatory mechanisms. Neurobiol. Aging 30, 973-986.
20. Day, J. J., Jones, J. L., and Carelli, R. M. (2011). Nucleus accumbens neu- rons encode predicted and ongoing reward costs in rats. Eur. J. Neurosci. 33, 308-321.
21. Day, J. J., Roitman, M. F., Wightman, R. M., and Carelli, R. M. (2007). Associative learning mediates dynamic shifts in dopamine signal- ing in the nucleus accumbens. Nat. Neurosci. 10, 1020-1028.
22. Eppinger, B., Hammerer, D., and Li, S. C. (2011). Neuromodulation of reward-based learning and decision making in human aging. Ann. N.Y. Acad. Sci. 1235, 1-17.
23. Eppinger, B., Herbert, M., and Kray, J. (2010). We remember the good things: age differences in learn- ing and memory. Neurobiol. Learn. Mem. 93, 515-521.
24. Eschenko, O., and Mizumori, S. J. (2007). Memory influences on hip- pocampal and striatal neural codes: effects of a shift between task rules. Neurobiol. Learn. Mem. 87, 495-509.
25. Ferbinteanu, J., and Shapiro, M. L. (2003). Prospective and retrospec-tive memory coding in the hip- pocampus. Neuron 40, 1227-1239.
26. Ferretti, V., Roullet, P., Sargolini, F., Rinaldi, A., Perri, V., DelFabbro, M., Costantini, V. J., Annese, V., Scesa, G., De Stefano, M. E., Oliverio, A., and Mele, A. (2010). Ventral striatal plasticity and spatial memory. Proc. Natl. Acad. Sci. U.S.A. 107, 7945-7950.
27. Fiorillo, C.D., Tobler, P.N.,and Schultz, W. (2003). Discrete coding of reward probability and uncer- tainty by dopamine neurons. Science 299, 1898-1902.
28. Fiorillo, C.D., Tobler, P.N.,and Schultz, W. (2005). Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors. Behav. Brain Funct. 1, 7.
29. Floresco, S. B., Seamans, J. K., and Phillips, A. G. (1997). Selective roles for hippocampal, prefrontal cor- tical, and ventral striatal circuits in radial-arm maze tasks with or without a delay. J. Neurosci. 17, 1880-1890.
30. Floresco, S. B., Todd, C. L., and Grace, A. A. (2001). Glutamatergic afferents from the hippocampus to the nucleus accumbens regulate activity of ventral tegmental area dopamine neurons. J. Neurosci. 21, 4915-4922.
31. Floresco, S. B., West, A. R., Ash, B., Moore, H., and Grace, A. A. (2003) Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine trans- mission. Nat. Neurosci. 6, 968-973.
32. Gal, G., Joel, D., Gusak, O., Feldon, J., and Weiner, I. (1997). The effects of electrolytic lesion to the shell subterritory of the nucleus accumbens on delayed non- matching-to-sample and four-arm baited eight-arm radial-maze tasks. Behav. Neurosci. 111, 92-103.
33. Gallagher, M., and Rapp, P. R. (1997). The use of animal models to study the effects of aging on cognition. Annu. Rev. Psychol. 48, 339-370.
34. Gasbarri, A., Packard, M. G., Campana, E., and Pacitti, C. (1994). Anterograde and retro- grade tracing of projections from the ventral tegmental area to the hippocampal formation in the rat. Brain Res. Bull. 33, 445-452.
35. Goldman-Rakic, P. S., and Brown, R. M. (1981). Regional changes of monoamines in cerebral cor- tex and subcortical structures of aging rhesus monkeys. Neuroscience 6, 177-187.
36. Gothard, K. M., Skaggs, W. E., Moore, K. M., and McNaughton, B. L. (1996). Binding of hippocampal CA1 neural activity to multiple ref- erence frames in a landmark-based navigation task. J. Neurosci. 16, 823-835.
37. Guzowski, J. F., Knierim, J. J., and Moser, E. I. (2004). Ensemble dynamics of hippocampal regions CA3 and CA1. Neuron 44, 581-584
38. Hasselmo, M. E. (2005). The role of hippocampal regions CA3 and CA1 in matching entorhinal input with retrieval of associations between objects and context: theoretical comment on Lee et al. (2005). Behav. Neurosci. 119, 342-345.
39. Hauber, W., and Sommer, S. (2009). Prefrontostriatal circuitry regulates effort-related decision making. Cereb. Cortex 19, 2240-2247.
40. Heimer, L., Zahm, D. S., Churchill, L., Kalivas, P. W., and Wohltmann, C. (1991). Specificity in the projection patterns of accumbal core and shell in the rat. Neuroscience 41, 89-125
41. Herbert, M., Eppinger, B., and Kray, J. (2011). Younger but not older adults benefit from salient feedback during learning. Front. Psychol. 2:171. doi: 10.3389/fpsyg.2011.00171
42. Holden, H. M., Hoebel, C., Loftis, K., and Gilbert, P. E. (2012). Spatial pattern separation in cognitively normal young and older adults. Hippocampus. doi: 10.1002/hipo. 22017. [Epub ahead of print].
43. Humphries, M. D., and Prescott, T. J. (2010). The ventral basal ganglia, a selection mechanism at the cross- roads of space, strategy, and reward. Prog. Neurobiol. 90, 385-417.
44. Ito, R., Robbins, T. W., Pennartz, C. M., and Everitt, B. J. (2008). Functional interaction between the hippocam- pus and nucleus accumbens shell is necessary for the acquisition of appetitive spatial context condition- ing. J. Neurosci. 28, 6950-6959.
45. Jeffery, K. J., Anderson, M. I., Hayman, R., and Chakraborty, S. (2004). A proposed architecture for the neu- ral representation of spatial con- text. Neurosci. Biobehav. Rev. 28, 201-218.
46. Kaasinen, V., Vilkman, H., Hietala, J., Nagren, K., Helenius, H., Olsson, H., Farde, L., and Rinne, J. (2000). Age-related dopamine D2/D3 receptor loss in extrastriatal regions of the human brain. Neurobiol. Aging 21, 683-688.
47. Kalivas, P. W., Churchill, L., and Klitenick, M. A. (1993). GABA and enkephalin projection from the nucleus accumbens and ventral pal- lidum to the ventral tegmental area. Neuroscience 57, 1047-1060.
48. Kennedy, P.J.,andShapiro, M.L.(2004). Retrieving memories via internal context requires the hippocampus. J. Neurosci. 24, 6979-6985.
49. Lacy, J. W., Yassa, M. A., Stark, S. M., Muftuler, L. T., and Stark, C. E. (2011). Distinct pattern sep- aration related transfer functions in human CA3/dentate and CA1 revealed using high-resolution fMRI and variable mnemonic similarity. Learn. Mem. 18, 15-18.
50. Lavoie, A.M.,andMizumori, S.J. (1994). Spatial, movement- and reward-sensitive discharge by medial ventral striatum neurons of rats. Brain Res. 638, 157-168.
51. Lee, I., Yoganarasimha, D., Rao, G., and Knierim, J. J. (2004). Comparison of population coherence of place cells in hippocampal subfields CA1 and CA3. Nature 430, 456-459.
52. Legault, M., and Wise, R. A. (2001). Novelty-evoked elevations of nucleus accumbens dopamine: dependence on impulse flow from the ventral subiculum and glu- tamatergic neurotransmission in the ventral tegmental area. Eur. J. Neurosci. 13, 819-828.
53. Leutgeb, S., Leutgeb, J. K., Treves, A., Moser, M. B., and Moser, E. I. (2004). Distinct ensemble codes in hippocampal areas CA3 and CA1. Science 305, 1295-1298.
54. Lisman, J. E., and Grace, A. A. (2005). The hippocampal-VTA loop: con-trolling the entry of information into long-term memory. Neuron 46, 703-713.
55. Luo, A. H., Tahsili-Fahadan, P., Wise, R. A., Lupica, C. R., and Aston- Jones, G. (2011). Linking context with reward: a functional circuit from hippocampal CA3 to ven- tral tegmental area. Science 333, 353-357.
56. Maldonado-Irizarry, C. S., and Kelley, A. E. (1995). Excitatory amino acid receptors within nucleus accum- bens subregions differentially medi- ate spatial learning in the rat. Behav. Pharmacol. 6, 527-539.
57. Markus, E.J., Barnes, C.A., McNaughton, B. L., Gladden, V. L., and Skaggs, W. E. (1994). Spatial information content and reliability of hippocampal CA1 neurons: effects of visual input. Hippocampus 4, 410-421.
58. Marr, D. (1971). Simple memory: a the-ory for archicortex. Philos. Trans. R. Soc. Lond. B Biol. Sci. 262, 23-81.
59. Martig, A.K., Jones, G.L., Smith, K. E., and Mizumori, S. J. (2009). Context dependent effects of ventral tegmental area inactivation on spa-tial working memory. Behav. Brain Res. 203, 316-320.
60. Martig, A.K.,andMizumori, S.J. (2011). Ventral tegmental area and substantia nigra neural correlates of spatial learning. Learn. Mem. 18, 260-271.
61. Martig, A.K.,andMizumori, S.J. (2011). Ventral tegmental area dis- ruption selectively affects CA1/CA2 but not CA3 place fields dur-ing a differential reward work- ing memory task. Hippocampus 21, 172-184.
62. Matsumoto, M., and Hikosaka, O. (2007). Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447, 1111-1115.
63. McClure, S. M., Berns, G. S., and Montague, P. R. (2003). Temporal prediction errors in a passive learn- ing task activate human striatum. Neuron 38, 339-346.
64. McEchron, M. D., and Disterhoft, J. F. (1999). Hippocampal encoding of non-spatial trace conditioning. Hippocampus 9, 385-396.
65. McNaughton, B. L., and Morris, R. G. M. (1987). Hippocampal synap- tic enhancement and information storage within a distributed mem- ory system. Trends Neurosci. 10, 408-415.
66. Mell, T., Heekeren, H. R., Marschner, A., Wartenburger, I., Villringer, A., and Reischies, F. M. (2005). Effect of aging on stimulus-reward associ- ation learning. Neuropsychologia 43, 554-563.
67. Miyashita, T., Kubik, S., Haghighi, N., Steward, O.,andGuzowski, J. F. (2009). Rapid activation of plasticity-associated gene transcrip- tion in hippocampal neurons pro- vides a mechanism for encoding of one-trial experience. J. Neurosci. 29, 898-906.
68. Mizumori, S.J., Lavoie, A.M.,and Kalyani, A. (1996). Redistribution of spatial representation in the hip- pocampus of aged rats perform- ing a spatial memory task. Behav. Neurosci. 110, 1006-1016.
69. Mizumori, S.J., Ragozzino, K.E., Cooper, B. G., and Leutgeb, S. (1999). Hippocampal representa- tional organization and spatial con- text. Hippocampus 9, 444-451.
70. Mizumori, S. J., Smith, D. M., and Puryear, C. B. (2007a). Hippocampal and neocortical interactions during context dis- crimination: electrophysiological evidence from the rat. Hippocampus 17, 851-862.
71. Mizumori, S.J.Y., Smith, D.M.,and Puryear, C. B. (2007b). "Mnemonic contributions of hippocampal place cells," in Neurobiology of Learning and Memory, eds J.L. Martinez and R.P. Kesner(NewYork, NY: Academic Press), 155-189.
72. Mizumori, S. J. Y. (ed.). (2008). A Context for Hippocampal Place Cells During Learning. New York, NY: Oxford University Press.
73. Mizumori, S.J., Yeshenko, O., Gill, K. M., and Davis, D. M. (2004). Parallel processing across neural systems: implications for a multiple memory system hypothesis. Neurobiol. Learn. Mem. 82, 278-298.
74. Mogenson, G. J., Jones, D. L., and Yim, C. Y. (1980). From motiva- tion to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 14, 69-97.
75. Mozley, L.H., Gur, R.C., Mozley, P. D., and Gur, R. E. (2001). Striatal dopamine transporters and cogni- tive functioning in healthy men and women. Am. J. Psychiatry 158, 1492-1499.
76. Muller, R. U., and Kubie, J. L. (1987). The effects of changes in the envi- ronment on the spatial firing of hippocampal complex-spike cells. J. Neurosci. 7, 1951-1968.
77. Nadel, L. (2008). "The Hippocampus and Context Revisited," in Hippo- campal Place Fields: Relevance to Learning and Memory, ed S.J.Y. Mizumori (New York, NY: Oxford University Press), 3-15.
78. Nadel, L., and Payne, J. D. (2002). "The hippocampus, wayfinding and episodic memory," in The Neural Basis of Navigation: Evidence from Single Cell Recording,edP. E. Sharp (MA: Kluwer Academic Publication).
79. Nadel, L., and Wilner, J. (1980). Context and conditioning: a place for space.Physiol.Psychol.8, 218-228.
80. Nakazawa, K., Sun, L.D., Quirk, M.C., Rondi-Reig, L., Wilson, M. A., and Tonegawa, S. (2003). Hippocampal CA3 NMDA receptors are cru-cial for memory acquisition of one-time experience. Neuron 38, 305-315.
81. Nieuwenhuis, S., Ridderinkhof, K. R., Talsma, D., Coles, M. G., Holroyd, C. B., Kok, A., and Van Der Molen, M. W. (2002). A computational account of altered error process-ing in older age: dopamine and the error-related negativity. Cogn. Affect.Behav.Neurosci.2, 19-36.
82. Nobre, A. C., Coull, J. T., Frith, C. D., and Mesulam, M. M. (1999). Orbitofrontal cortex is activated during breaches of expectation in tasks of visual attention. Nat. Neurosci. 2, 11-12.
83. O'Keefe, J. (1976). Place units in the hippocampus of the freely moving rat. Exp. Neurol. 51, 78-109.
84. O'Keefe, J., and Burgess, N. (1996). Geometric determinants of the place fields of hippocampal neurons. Nature 381, 425-428.
85. O'Keefe, J., and Conway, D. H. (1978). Hippocampal place units in the freely moving rat: why they fire where they fire. Exp. Brain Res. 31, 573-590.
86. O'Keefe, J., and Dostrovsky, J. (1971). The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res. 34, 171-175.
87. O'Keefe, J., and Nadel, L. (1978). The Hippocampus as a Cognitive Map. Oxford, UK: Oxford University Press.
88. O'Reilly, R. C., and McClelland, J. L. (1994). Hippocampal conjunc- tive encoding, storage, and recall: avoiding a trade-off. Hippocampus 4, 661-682.
89. Oler, J. A., and Markus, E. J. (2000). Age-related deficits in the abil- ity to encode contextual change: a place cell analysis. Hippocampus 10, 338-350.
90. Olton, D. S., Branch, M., and Best, P. J. (1978). Spatial correlates of hip-pocampal unit activity. Exp. Neurol. 58, 387-409.
91. Pearce, J. M., and Hall, G. (1980). A model for Pavlovian learning: variations in the effectiveness of conditioned but not of uncondi- tioned stimuli. Psychol. Rev. 87, 532-552.
92. Pennartz, C.M., Berke, J.D., Graybiel, A. M., Ito, R., Lansink, C. S., Van Der Meer, M., Redish, A. D., Smith, K. S., and Voorn, P. (2009). Corticostriatal interactions during learning, memory processing, and decision making. J. Neurosci. 29, 12831-12838.
93. Pennartz, C. M., Ito, R., Verschure, P.F., Battaglia, F.P.,and Robbins, T. W. (2011). The hippocampal- striatal axis in learning, prediction and goal-directed behavior. Trends Neurosci. 34, 548-559.
94. Penner, M. R., and Mizumori, S. J. (2012). Neural systems analysis of decision making during goal- directed navigation. Prog. Neurobiol. 96, 96-135.
95. Penner, M. R., Roth, T. L., Chawla, M. K., Hoang, L. T., Roth, E. D., Lubin, F. D., Sweatt, J. D., Worley, P. F., and Barnes, C. A. (2011). Age- related changes in Arc transcription and DNA methylation within the hippocampus. Neurobiol. Aging 32, 2198-2210.
96. Pezze, M. A., and Feldon, J. (2004). Mesolimbic dopaminergic path- ways in fear conditioning. Prog. Neurobiol. 74, 301-320.
97. Pezze, M.A., Heidbreder, C.A., Feldon, J., and Murphy, C. A. (2001). Selective responding of nucleus accumbens core and shell dopamine to aversively conditioned contextual and discrete stimuli. Neuroscience 108, 91-102.
98. Puryear, C.B., Kim, M.J.,and Mizumori, S. J. (2010). Conjunctive encoding of movement and reward by ventral tegmental area neurons in the freely navigating rodent. Behav. Neurosci. 124, 234-247.
99. Puryear, C.B.,andMizumori, S.J. (2008). Reward prediction error sig- nals by reticular formation neurons. Learn. Mem. 15, 895-898.
100. Ranck, J. B. Jr. (1973). Studies on sin-gle neurons in dorsal hippocam- pal formation and septum in unre- strained rats. I. Behavioral correlates and firing repertoires. Exp. Neurol. 41, 461-531.
101. Rangel, A., Camerer, C., and Montague, P. R. (2008). A framework for study- ing the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9, 545-556.
102. Redgrave, P., and Gurney, K. (2006). The short-latency dopamine sig- nal: a role in discovering novel actions? Nat. Rev. Neurosci. 7, 967-975.
103. Rescorla, R.A.,and Wagner, A.R. (eds). (1972). ATheoryofPavlovian Conditioning: Variations in the Effectiveness of Reinforcement and Nonreinforcement.NewYork, NY: Appleton Century Crofts.
104. Roesch, M.R., Calu, D.J.,and Schoenbaum, G. (2007). Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat. Neurosci. 10, 1615-1624.
105. Rosenzweig, E. S., and Barnes, C. A. (2003). Impact of aging on hippocampal function: plasticity, network dynamics, and cognition. Prog. Neurobiol. 69, 143-179.
106. Rossato, J. I., Bevilaqua, L. R., Izquierdo, I., Medina, J. H., and Cammarota, M. (2009). Dopamine controls persistence of long-term memory storage. Science 325, 1017-1020.
107. Samanez-Larkin, G. R., Gibbs, S. E., Khanna, K., Nielsen, L., Carstensen, L. L., and Knutson, B. (2007). Anticipation of monetary gain but not loss in healthy older adults. Nat. Neurosci. 10, 787-791.
108. Samsonovich, A., and McNaughton, B. L. (1997). Path integration and cognitive mapping in a continu- ous attractor neural network model. J. Neurosci. 17, 5900-5920.
109. Sargolini, F., Florian, C., Oliverio, A., Mele, A., and Roullet, P. (2003). Differential involvement of NMDA and AMPA receptors within the nucleus accumbens in consolida- tion of information necessary for place navigation and guidance strat- egy of mice. Learn. Mem. 10, 285-292.
110. Satoh, T., Nakai, S., Sato, T., and Kimura, M. (2003). Correlated cod-ing of motivation and outcome of decision by dopamine neurons. J. Neurosci. 23, 9913-9923.
111. Save, E., Nerad, L., and Poucet, B. (2000). Contribution of multiple sensory information to place field stability in hippocampal place cells. Hippocampus 10, 64-76.
112. Schott, B. H., Niehaus, L., Wittmann, B. C., Schütze, H., Seidenbecher, C. I., Heinze, H. J., and Düzel, E. (2007). Ageing and early-stage Parkinson's disease affect separa-ble neural mechanisms of mesolim- bic reward processing. Brain 130, 2412-2424.
113. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
114. Schultz, W., and Dickinson, A. (2000). Neuronal coding of prediction errors. Annu. Rev. Neurosci. 23, 473-500.
115. Schultz, W., Preuschoff, K., Camerer, C., Hsu, M., Fiorillo, C. D., Tobler, P. N., and Bossaerts, P. (2008). Explicit neural signals reflecting reward uncertainty. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363, 3801-3811.
116. Seamans, J.K.,andPhillips, A.G. (1994). Selective memory impair- ments produced by transient lidocaine-induced lesions of the nucleus accumbens in rats. Behav. Neurosci. 108, 456-468.
117. Setlow, B., and McGaugh, J. L. (1998). Sulpiride infused into the nucleus accumbens posttraining impairs memory of spatial water maze training. Behav. Neurosci. 112, 603-610.
118. Shen, J., Barnes, C. A., McNaughton, B.L., Skaggs, W.E.,andWeaver, K. L. (1997). The effect of aging on experience-dependent plasticity of hippocampal place cells. J. Neurosci. 17, 6769-6782.
119. Small, S. A., Chawla, M. K., Buonocore, M., Rapp, P.R.,andBarnes, C. A. (2004). Imaging correlates of brain function in monkeys and rats isolates a hippocampal subregion differentially vulnerable to aging. Proc. Natl. Acad. Sci. U.S.A. 101, 7181-7186.
120. Smith, D.M.,andMizumori, S.J. (2006). Hippocampal place cells, context, and episodic memory. Hippocampus 16, 716-729.
121. Smith, D.M.,andMizumori, S.J. (2006). Learning-related develop- ment of context-specific neuronal responses to places and events: the hippocampal role in context pro- cessing. J. Neurosci. 26, 3154-3163.
122. Smith, K. S., Berridge, K. C., and Aldridge, J. W. (2011). Disentangling pleasure from incentive salience and learning signals in brain reward circuitry. Proc. Natl. Acad. Sci. U.S.A. 108, E255-E264.
123. Smith-Roe, S. L., Sadeghian, K., and Kelley, A. E. (1999). Spatial learning and performance in the radial arm maze is impaired after N-methyl- D-aspartate (NMDA) receptor blockade in striatal subregions. Behav. Neurosci. 113, 703-717.
124. Stark, S.M., Yassa, M.A., and Stark, C. E. (2010). Individual differences in spatial pattern separation performance associated with healthy aging in humans. Learn. Mem. 17, 284-288.
125. Sutton, R., and Barto, A. (1998). Reinforcement Learning: An Intro- duction. Cambridge, UK: MIT Press. Sutton, R. S. (1988). Learning to predict by the methods of temporal differ- ences. Mach. Learn. 3, 9-44.
126. Tanila, H., Shapiro, M., Gallagher, M., and Eichenbaum, H. (1997). Brain aging: changes in the nature of information coding by the hippocampus. J. Neurosci. 17, 5155-5166.
127. Tobler, P. N., O'Doherty, J. P., Dolan, R. J., and Schultz, W. (2006). Human neural learning depends on reward prediction errors in the block- ing paradigm. J. Neurophysiol. 95, 301-310.
128. Tse, D., Langston, R. F., Kakeyama, M., Bethus, I., Spooner, P. A., Wood, E. R., Witter, M. P., and Morris, R. G. (2007). Schemas and memory con- solidation. Science 316, 76-82.
129. Vazdarjanova, A., and Guzowski, J. F. (2004). Differences in hippocam- pal neuronal population responses to modifications of an environmen- tal context: evidence for distinct, yet complementary, functions of CA3 and CA1 ensembles. J. Neurosci. 24, 6489-6496.
130. Volkow, N.D., Gur, R.C., Wang, G. J., Fowler, J. S., Moberg, P. J., Ding, Y.S., Hitzemann, R., Smith, G., and Logan, J. (1998a). Association between decline in brain dopamine activity with age and cognitive and motor impairment in healthy individuals. Am. J. Psychiatry 155, 344-349.
131. Volkow, N.D., Wang, G.J., Fowler, J. S., Ding, Y. S., Gur, R. C., Gatley, J., Logan, J., Moberg, P. J., Hitzemann, R., Smith, G., and Pappas, N. (1998). Parallel loss of presynaptic and postsynaptic dopamine mark- ers in normal aging. Ann. Neurol. 44, 143-147.
132. Volkow, N.D., Wang, G.J., Fowler, J.S., Logan, J., Gatley, S. J., Macgregor, R. R., Schlyer, D. J., Hitzemann, R., and Wolf, A. P. (1996). Measuring age-related changes in dopamine D2 receptors with 11C-raclopride and 18F-N-methylspiroperidol. Psychiatry Res. 67, 11-16.
133. Voorn, P., Vanderschuren, L. J., Groenewegen, H. J., Robbins, T. W., and Pennartz, C. M. (2004). Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci. 27, 468-474.
134. Wang, Y., Chan, G. L., Holden, J. E., Dobko, T., Mak, E., Schulzer, M., Huser, J. M., Snow, B. J., Ruth, T. J., Calne, D.B.,andStoessl, A.J. (1998). Age-dependent decline of dopamine D1 receptors in human brain: a PET study. Synapse 30, 56-61.
135. Wiener, S. I. (1996). Spatial, behavioral and sensory correlates of hippocam- pal CA1 complex spike cell activity: implications for information pro- cessing functions. Prog. Neurobiol. 49, 335-361.
136. Wikenheiser, A. M., and Redish, A. D. (2011). Changes in reward contingency modulate the trial- to-trial variability of hippocampal place cells. J. Neurophysiol. 106, 589-598.
137. Wilson, I. A., Gallagher, M., Eichenbaum, H., and Tanila, H. (2006). Neurocognitive aging: prior memories hinder new hippocampal encoding. Trends Neurosci. 29, 662-670.
138. Wilson, I. A., Ikonen, S., Gallagher, M., Eichenbaum, H., and Tanila, H. (2005). Age-associated alterations of hippocampal place cells are sub-region specific. J. Neurosci. 25, 6877-6886.
139. Wilson, I.A., Ikonen, S., Gureviciene, I., McMahan, R. W., Gallagher, M., Eichenbaum, H., and Tanila, H. (2004). Cognitive aging and the hip- pocampus: how old rats represent new environments. J. Neurosci. 24, 3870-3878.
140. Wilson, I. A., Ikonen, S., McMahan, R. W., Gallagher, M., Eichenbaum, H., and Tanila, H. (2003). Place cell rigidity correlates with impaired spatial learning in aged rats. Neurobiol. Aging 24, 297-305.
141. Yacubian, J., Glascher, J., Schroeder, K., Sommer, T., Braus, D.F.,and Buchel, C. (2006). Dissociable sys- tems for gain- and loss-related value predictions and errors of prediction in the human brain. J. Neurosci. 26, 9530-9537.
142. Yang, C.R.,andMogenson, G.J. (1987). Hippocampal signal trans- mission to the pedunculopontine nucleus and its regulation by dopamine D2 receptors in the nucleus accumbens: an electrophys- iological and behavioural study. Neuroscience 23, 1041-1055.
143. Yassa, M. A., Lacy, J. W., Stark, S. M., Albert, M. S., Gallagher, M., and Stark, C. E. (2011a). Pattern separation deficits associated with increased hippocampal CA3 and dentate gyrus activity in nonde- mented older adults. Hippocampus 21, 968-979.
144. Yassa, M. A., Mattfeld, A. T., Stark, S. M., and Stark, C. E. (2011b). Age-related memory deficits linked to circuit-specific dis-ruptions in the hippocampus. Proc. Natl. Acad. Sci. U.S.A. 108, 8873-8878.
145. Yassa, M. A., and Stark, C. E. (2011). Pattern separation in the hip- pocampus. Trends Neurosci. 34, 515-525.
146. Young, B.J., Fox, G.D.,and Eichenbaum, H. (1994). Correlates of hippocampal complex-spike cell activity in rats performing a non- spatial radial maze task. J. Neurosci. 14, 6553-6563.
147. Zamarian, L., Sinz, H., Bonatti, E., Gamboz, N., and Delazer, M. (2008). Normal aging affects decisions under ambiguity, but not decisions under risk. Neuropsychology 22, 645-657.
148. Zweifel, L. S., Parker, J. G., Lobb, C. J., Rainwater, A., Wall, V. Z., Fadok, J.P., Darvas, M., Kim, M. J., Mizumori, S. J., Paladini, C. A., Phillips, P. E., and Palmiter, R. D. (2009). Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine dependent behavior. Proc. Natl. Acad. Sci. U.S.A. 106, 7281-7288.