Homeostatic regulation of memory systems and adaptive decisions

Hippocampus

Volumn 23, Issue 11, 2013, Pages 1103-1124

  Mizumori, Sheri J Y ^a   Jo, Yong Sang ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Error correction; Hippocampus; Predictions; Prefrontal cortex; Striatum

Indexed keywords

ADAPTIVE BEHAVIOR; CORPUS STRIATUM; DECISION MAKING; HIPPOCAMPUS; HOMEOSTASIS; HUMAN; MEMORY; MESENCEPHALON; NERVE POTENTIAL; NONHUMAN; NOTE; OUTCOME ASSESSMENT; PREFRONTAL CORTEX; PRIORITY JOURNAL; WORKING MEMORY;

ERROR CORRECTION; HIPPOCAMPUS; PREDICTIONS; PREFRONTAL CORTEX; STRIATUM;

ADAPTATION, PSYCHOLOGICAL; ANIMALS; CORPUS STRIATUM; DECISION MAKING; HIPPOCAMPUS; HOMEOSTASIS; HUMANS; MEMORY; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; PREFRONTAL CORTEX; SYSTEMS BIOLOGY;

EID: 84886266001     PISSN: 10509631     EISSN: 10981063     Source Type: Journal    
DOI: 10.1002/hipo.22176     Document Type: Note

References (226)

1. Adams GK, Watson KK, Pearson J, Platt ML. 2012. Neuroethology of decision-making. Curr Opin Neurobiol 22:982-989.
2. Alexander GE, Crutcher MD. 1990. Functional architecture of basal ganglia circuits: Neural substrates of parallel processing. Trends Neurosci 13:266-271.
3. Alexander GE, DeLong MR, Strick PL. 1986. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9:357-381.
4. Anagnostaras SG, Gale GD, Fanselow MS. 2001. Hippocampus and contextual fear conditioning: recent controversies and advances. Hippocampus 11:8-17.
5. Arnsten AFT. 2011. Prefrontal cortical network connections: Key site of vulnerability in stress and schizophrenia. Int J Dev Neurosci 29:21-223.
6. Arnsten AFT, Wang MJ, Paspalas CD. 2012. Neuromodulation of thought: Flexibilities and vulnerabilities in prefrontal cortical network synapses. Neuron 76:223-239.
7. Bach DR, Dolan RJ. 2012. Knowing how much you don't know: A neural organization of uncertainty estimates. Nat Rev Neurosci 13:572-586.
8. Barnes TD, Kubota Y, Hu D, Jin DZ, Graybiel AM. 2005. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437:1158-1161.
9. Baxter LR, Schwartz JM, Phelps ME, Mazziotta JC, Guze BH, Selin CE, Gerner RH, Sumida RM. 1989. Reduction of prefrontal cortex glucose metabolism common to three types of depression. Arch Gen Psychiat 46:243-250.
10. Bayer HM, Glimcher PW. 2005. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47:129-141.
11. Bender D, Wilson MA. 2012. Biasing the content of hippocampal replay during sleep. Nat Neurosci 15:1439-1444.
12. Bisley JW, Zaksas D, Droll JA, Pasternak T. 2004. Activity of neurons in cortical area MT during a memory for motion task. J Neurophysiol 91:286-300.
13. Bouton ME, Westbrook RF, Corcoran KA, Maren S. 2006. Contextual and temporal modulation of extinction: Behavioral and biological mechanisms. Biol Psychiat 60:352-360.
14. Boyden ES, Katoh A, Raymond JL. 2004. Cerebellum-dependent learning: The role of multiple plasticity mechanisms. Ann Rev Neurosci 27:581-609.
15. Burgess N, O'Keefe J. 2003. Neural representation in human spatial memory. Trends Cogn Sci 7:517-519.
16. Burrone J, O'Bryne M, Murthy VN. 2002. Multiple forms of synaptic plasticity triggered by selective suppression of activity in individual neurons. Nature 420:414-419.
17. Buzsaki G. 1989. Two-stage model of memory trace formation: A role for "noisy" brain states. Neuroscience 31:551-570.
18. Buzsaki G. 2013. Time, space and memory. Nature 497:568-569.
19. Buzsaki G, Wang XJ. 2012. Mechanisms of gamma oscillations. Ann Rev Neurosci 35:203-225.
20. Cagniard B, Beeler JA, Britt JP, McGhee DS, Marinelli M, Zhuang X. 2006. Dopamine scales performance in the absence of new learning. Neuron 51:541-547.
21. Calhoon GG, O'Donnell P. 2013. Closing the gate in the limbic striatum: Prefrontal suppression of hippocampal and thalamic inputs. Neuron 78:181-190.
22. Cannon WB. 1932. The Wisdom of the Body. New York: WW Norton Co Inc.
23. Cardinal RN, Daw N, Robbins TW, Everitt BJ. 2002. Local analysis of behavior in the adjusting-delay task for assessing choice of delayed reinforcement. Neural Netw 15:617-634.
24. Chau LS, Galvez R. 2012. Amygdala's involvement in facilitating associative learning-induced plasticity: A promiscuous role for the amygdala in memory acquisition. Front Integ Neurosci 6:92.
25. Chen J, Olsen RK, Preston AR, Glover GH, Wagner AD. 2011. Associative retrieval processes in the human medial temporal lobe: Hippocampal retrieval success and CA1 mismatch detection. Learn Mem 18:523-528.
26. Ciocchi S, Herry C, Grenier F, Wolff SB, Letzkus JJ, Vlachos I, Ehrlich I, Sprengel R, Deisseroth K, Stadler MB, Müller C, Lüthi A. 2010. Encoding of conditioned fear in central amygdala inhibitory circuits. Nature 468:277-282.
27. Cohen NJ, Eichenbaum H. 1993. Memory, Amnesia, and the Hippocampal System. Massachusetts: Cambridge MIT Press.
28. Colombo PJ. 2004. Learning-induced activation of transcription factors among multiple memory systems. Neurobiol Learn Mem 82:268-277.
29. Cooper BG, Mizumori SJY. 2001. Temporary inactivation of the retrosplenial cortex causes a transient reorganization of spatial coding in the hippocampus. J Neurosci 21:3986-4001.
30. Covington HE, Lobo MK, Maze I, Vialou V, Hyman JM, Zaman S, LaPlant Q, Mouzon E, Ghose S, Tamminga CA, Neve RL, Deisseroth K, Nestler EJ. 2010. Antidepressant effect of optogenetic stimulation of the medial prefrontal cortex. J Neurosci 30:16082-16090.
31. Dayan P. 2012. Twenty-five lessions from computational neuromodulation. Neuron 76:240-256.
32. DeCoteau WE, Thorn C, Gibson DJ, Courtemanche R, Mitra P, Kubota Y, Graybiel AM. 2007. Learning-related coordination of striatal and hippocampal theta rhythms during acquisition of a procedural maze task. Proc Natl Acad Sci USA 104:5644-5649.
33. Dickerson KC, Li J, Delgado MR. 2011. Parallel contributions of distinct human memory systems during probabilistic learning. NeuroImage 55:266-276.
34. Diwadkar VA, Carpenter PA, Just MA. 2000. Collaborative activity between parietal and dorso-lateral prefrontal cortex in dynamic spatial working memory revealed by fMRI. Neuroimage 12:85-99.
35. Doll BB, Simon DA, Daw ND. 2012. The ubiquity of model-based reinforcement learning. Curr Opin Neurobiol 22:1075-1081.
36. Doya K. 2008. Modulators of decision making. Nat Neurosci 11:410-416.
37. Duhamel JR, Colby CL, Goldberg ME. 1992. The updating of the representation of visual space in parietal cortex by intended eye movements. Science 255:90-92.
38. Duncan K, Ketz N, Inati SJ, Davachi L. 2012a. Evidence for area CA1 as a match/mismatch detector: A high-resolution fMRI study of the human hippocampus. Hippocampus 22:389-398.
39. Duncan K, Sadanand A, Davachi L. 2012b. Memory's penumbra: Episodic memory decisions induce lingering mnemonic biases. Science 337:485-487.
40. Dusek JA, Eichenbaum H. 1998. The hippocampus and transverse patterning guided by olfactory cues. Behav Neurosci 112:762-771.
41. Eichenbaum H, Cohen NJ. 2001. From Conditioning to Conscious Recollection: Memory Systems of the Brain. New York: Oxford University Press.
42. Eshenko O, Mizumori SJY. 2007. Memory influences on hippocampal and striatal neural codes: Effects of a shift between task rules. Neurobiol Learn Mem 87:495-509.
43. Etchamendy N, Konishi K, Pike GB, Marighetto A, Bohbot VD. 2012. Evident for a virtual human analog of a rodent relational memory task: A study of aging and fMRI in young adults. Hippocampus 22:869-880.
44. Euston DR, Gruber AJ, McNaughton BL. 2012. The role of medial prefrontal cortex in memory and decision making. Neuron 76:1057-1070.
45. Fanselow MS, Poulos AM. 2005. The neuroscience of mammalian associative learning. 56:207-234.
46. Fenton AA, Lytton WW, Barry JM, Lenck-Santini PP, Zinjuk LE, Kubik S, Bures J, Poucet B, Muller RU, Olypher AV. 2010. Attention-like modulation of hippocampus place cell discharge. J Neurosci 30:4613-4625.
47. Ferbinteanu J, Shapiro ML. 2003. Prospective and retrospective memory coding in the hippocampus. Neuron 40:1227-1239.
48. Fiorillo CD, Newsome WT, Schultz W. 2008. The temporal precision of reward prediction in dopamine neurons. Nat Neurosci 11:966-973.
49. Fiorillo CD, Tobler PN, Schultz W. 2003. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902.
50. Flagel SB, Clark JJ, Robinson TE, Mayo L, Czuj A, Willuhn I, Akers CA, Clinton SM, Phillips PE, Akil H. 2011. A selective role for dopamine in stimulus-reward learning. Nature 469:53-57.
51. Foerde K, Shohamy D. 2011. Feedback timing modulates brain systems for learning in humans. J Neurosci 31:13157-13167.
52. Foster DJ, Wilson MA. 2006. Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 440:680-683.
53. Frank LM, Brown EN, Wilson M. 2000. Trajectory encoding in the hippocampus and entorhinal cortex. Neuron 27:169-178.
54. Frank LM, Stanley GB, Brown EN. 2004. Hippocampal plasticity across multiple days of exposure to novel environments. J Neurosci 24:7681-7689.
55. Frank LM, Brown EN, Stanley GB. 2006. Hippocampal and cortical place cell plasticity: Implications for episodic memory. Hippocampus 16:775-784.
56. Froemke RC, Merzenich MM, Schreiner CE. 2007. A synaptic memory trace for cortical receptive field plasticity. Nature 450:425-429.
57. Fujisawa S, Buzsaki G. 2011. A 4 hz oscillation adaptively synchronizes prefrontal, VTA, and hippocampal activities. Neuron 72:153-165.
58. Fuster JM. 2006. The cognit: A network model of cortical representation. Int J Psychophysiol 60:125-132.
59. Fuster JM. 2008. The Prefrontal Cortex, 4th ed. London: Academic Press.
60. Fuster JM. 2009. Cortex and memory: Emergence of a new paradigm. J Cogn Neurosci 21:2047-2072.
61. Gill PR, Mizumori SJY, Smith DM. 2011. Hippocampal episode fields develop with learning. Hippocampus 21:1240-1249.
62. Gold PE. 2004. Coordination of multiple memory systems. Neurol Learn Mem 82:230-242.
63. Graybiel AM. 2008. Habits, rituals, and the evaluative brain. Annu Rev Neurosci 31:359-387.
64. Graybiel AM, Aosaki T, Flaherty AW, Kimura M. 1994. The basal ganglia and adaptive motor control. Science 265:1826-1831.
65. Groenewegen HJ, Galis-de Graaf Y, Smeets WJ. 1999. Integration and segregation of limbic cortico-striatal loops at the thalamic level: An experimental tracing study in rats. J Chem Neuroanat 16:167-185.
66. Gruber AJ, McDonald RJ. 2012. Context, emotion, and the strategic pursuit of goals: Interactions among multiple brain systems controlling motivated behavior. Front Behav Neurosci 6:50.
67. Gupta AS, van de Meer MA, Touretzky DS, Redish AD. 2010. Hippocampal replay is not a simple function of experience. Neuron 65:695-705.
68. Gupta AS, van de Meer MA, Touretzky DS, Redish AD. 2012. Segmentation of spatial experience by hippocampal theta sequences. Nat Neurosci 15:1032-1039.
69. Haber SN. 2003. The primate basal ganglia: Parallel and integrative networks. J Chem Neuroanat 26:317-330.
70. Hamani C, Diwan M, Macedo CE, Bandao ML, Shumake J, Gonzalez-Lima F, Raymond R, Lozano AM, Fletcher PJ, Nobrega JM. 2010. Antidepressant-like effects of medial prefrontal cortex deep brain stimulation in rats. Biol Psychiat 67:117-124.
71. Hassabis D, Kumaran D, Vann SD, Maguire EA. 2007. Patients with hippocampal amnesia cannot imagine new experiences. Proc Natl Acad Sci USA 104:1726-1731.
72. Haubensak, W, Kunwar PS, Cai H, Ciocchi S, Wall NR, Ponnusamy R, Biag J, Dong HW, Deisseroth K, Callaway EM, Fanselow MS, Lüthi A, Anderson DJ. 2010. Genetic dissection of an amygdala microcircuit that gates conditioned fear. Nature 468:270-276 .
73. Hetherington PA. Shapiro ML. 1997. Hippocampal place fields are altered by the removal of single visual cues in a distance-dependent manner. Behav Neurosci 111:20-34.
74. Hikosaka O, Bromberg-Martin E, Hong S, Matsumoto M. 2008. New insights on the subcortical representation of reward. Curr Opin Neurobiol 18:203-208.
75. Hirsh R. 1974. The hippocampus and contextual retrieval of information from memory: A theory. Behav Biol 12:421-444.
76. Hok V, Chah E, Save E, Poucet B. 2013. Prefrontal cortex focally modulates hippocampal place cell firing patterns. J Neurosci 33:3443-3451.
77. Holland PC, Gallagher M. 2006. Different roles for amygdala central nucleus and substantia innominate in the surprise-induced enhancement of learning. J Neurosci 26:3791-3797.
78. Hollerman JR, Schultz W. 1998. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1:304-309.
79. Hollerman JR, Tremblay L, Schultz W. 1998. Influence of reward expectation on behavior related neuronal activity in primate striatum. J Neurophysiol 80:947-963.
80. Hollup SA, Kjelstrup KG, Hoff J, Moser MB, Moser EI. 2001. Impaired recognition of the goal location during spatial navigation in rats with hippocampal lesions. J Neurosci 21:4505-4513.
81. Holroyd CB, Coles MG, Nieuwenhuis S. 2002. Medial prefrontal cortex and error potentials. Science 296:1610-1611.
82. Horvitz JC. 2002. Dopamine gating of glutamatergic sensorimotor and incentive motivational input signals to the striatum. Behav Brain Res 137:65-74.
83. Hough GE, Bingman VP. 2004. Spatial response properties of homing pigeon hippocampal neurons: Correlations with goal locations, movement between goals, and environmental context in a radial-arm arena. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 190:1047-1062.
84. Hyman JM, Zilli EA, Paley AM, Hasselmo ME. 2005. Medial prefrontal cortex cells show dynamic modulation with the hippocampal theta rhythm dependent on behavior. Hippocampus 15:739-749.
85. Hyman JM, Zilli EA, Paley AM, Hasselmo ME. 2010. Working memory performance correlates with prefrontal-hippocampal theta interactions but not with prefrontal neuron firing rates. Front Integr Neurosci 4:2.
86. Hyman JM, Ma L, Balaguer-Ballester E, Durstewitz D, Seamans JK. 2012. Contextual encoding by ensembles of medial prefrontal cortex neurons. Proc Natl Acad Sci USA 109: 5086-5091.
87. Ito M. 2013. Error detection and representation in the olivo-cerebellar system. Front Neural Circuits 7:1-8.
88. Jacobsen CF. 1936. Studies of cerebral function in primates. Comp Psychol Monogr 13:1-68.
89. Jeffery KJ, Anderson MI, Hayman R, Chakraborty S. 2004. A proposed architecture for the neural representation of spatial context. Neurosci Biobehav Rev 28:201-218.
90. Jeffery KJ, Gilbert A, Burton S, Strudwick A. 2003. Preserved performance in a hippocampal-dependent spatial task despite complete place cell remapping. Hippocampus 13:175-189.
91. Jo YS, Lee J, Mizumori SJY. 2013. Effects of prefrontal cortical inactivation on neural activity in the ventral tegmental area. J Neurosci 33:8159-8171.
92. Johansen JP, Cain CK, Ostroff LE, LeDoux JE. 2011. Molecular mechanisms of fear learning and memory. Cell 147:509-524.
93. Jones MW, Wilson MA. 2005a. Phase precession of medial prefrontal cortical activity relative to the hippocampal theta rhythm. Hippocampus 15:867-873.
94. Jones MW, Wilson MA. 2005b. Theta rhythms coordinate hippocampal-prefrontal interactions in a spatial memory task. PLoS Biol3:e402.
95. Kahn ZU, Muly EC. 2011. Molecular mechanisms of working memory. Behav Brain Res 219:329-341.
96. Kennedy PJ, Shapiro ML. 2004. Retrieving memories via internal context requires the hippocampus. J Neurosci 24:6979-6785.
97. Kesner RP. 2009. Tapestry of memory. Behav Neurosci 123:1-13.
98. Kim JJ, Fanselow MS. 1992. Modality-specific retrograde amnesia of fear. Science 256:675-677.
99. Kim JJ, Jung MW. 2006. Neural circuits and mechanisms involved in Pavlovian fear conditioning: A critical review. Neurosci Biobehav Rev 30:188-202.
100. Knill DC, Pouget A. 2004.The Bayesian brain: The role of uncertainty in neural coding and computation. Trends Neurosci 27:712-719.
101. Knowlton BJ, Mangels JA, Squire LR. 1996. A neostriatal habit learning system in humans. Science 273:1399-1402.
102. Kuhl BA, Shah AT, DuBrow S, Wagner AD. 2010. Resistance to forgetting associated with hippocampus-mediated reactivation during new learning. Nat Neurosci 13:501-506.
103. Kumaran D, Maguire EA. 2007. Match-mismatch processes underlie human hippocampal responses to associative novelty. J Neurosci 27:8517-8524.
104. Kurth-Nelson Z, Redish AD. 2009. Temporal-difference reinforcement learning with distributed representations. PLoS One 4:37362.
105. Kyd RJ, Bilkey DK. 2003. Prefrontal cortex lesions modify the spatial properties of hippocampal place cells. Cereb Cortex 13:444-451.
106. Lavoie AM, Mizumori SJY. 1994. Spatial, movement- and reward-sensitive discharge by medial ventral striatum neurons of rats. Brain Res 638:157-168.
107. Lee AK, Wilson MA. 2002. Memory of sequential experience in the hippocampus during slow wave sleep. Neuron 36:1183-1194.
108. Lee AS, Duman RS, Pittenger C. 2008. A double dissociation revealing bidirectional competition between striatum and hippocampus during learning. Proc Natl Acad Sci USA 105:17163-17168.
109. Lee H, Ghim JW, Kim H, Lee D, Jung MW. 2012. Hippocampal neural correlates for values of experienced events. J Neurosci 32:15053-15065.
110. Lee HJ, Groshek F, Petrovich GD, Cantalini JP, Gallagher M, Holland PC. 2005. Role of amygdalo-nigral circuitry in conditioning of a visual stimulus paired with food. J Neurosci 25:3881-3888.
111. Lee HJ, Youn JM, Gallagher M, Holland PC. 2008. Temporally limited role of substantia nigra-central amygdala connections in surprise-induced enhancement of learning. Eur J Neurosci 27:3043-3049.
112. Lee I, Griffin AL, Zilli EA, Eichenbaum H, Hasselmo ME. 2006. Gradual translocation of spatial correlates of neuronal firing in the hippocampus toward prospective reward locations. Neuron 51:639-650.
113. Lenck-Santini PP, Muller RU, Save E, Poucet B. 2002. Relationships between place cell firing fields and navigational decisions by rats. J Neurosci 22:9035-9047.
114. Lenck-Santini PP, Save E, Poucet B. 2001. Evidence for a relationship between place-cell spatial firing and spatial memory performance. Hippocampus 11:377-390.
115. Levy R, Friedman HR, Davachi L, Goldman-Rakic PS. 1997. Differential activation of the caudate nucleus in primates performing spatial and nonspatial working memory tasks. J Neurosci 17:3870-3882.
116. Leutgeb JK, Leutgeb S, Moser MB, Moser EI. 2007. Pattern separation in the dentate gyrus and CA3 of the hippocampus. Science 315:961-966.
117. Leutgeb S, Leutgeb JK, Treves A, Moser MB, Moser EI. 2004. Distinct ensemble codes in hippocampal areas CA3 and CA1. Science 305:1295-1298.
118. Li H, Penzo MA, Taniguchi H, Kopec CD, Huang ZJ, Li B. 2013. Experience-dependent modification of a central amygdala fear circuit. Nat Neurosci 16:332-339.
119. Lisman JE, Grace AA. 2005. The hippocampal-VTA loop: Controlling the entry of information into long-term memory. Neuron 46:703-713.
120. Lisman JE, Jensen O. 2013. The theta-gamma neural code. Neuron 77:1002-1016.
121. Lisman JE, Redish AD. 2009. Prediction, sequences and the hippocampus. Phil Trans Roy Soc B 364:1193-1201.
122. Llinas RR, Roy S. 2009. The 'predictive imperative' as the basis for self-awareness. Phil Trans R Soc Lond B Biol Sci 364:1301-1307.
123. Louie K, Wilson MA. 2001. Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep. Neuron 29:145-156.
124. Maguire EA, Burgess N, Donnett JG, Frackowiak RS, Frith CD, O'Keefe J. 1998. Knowing where and getting there: A human navigation network. Science 280:921-924.
125. Marcos E, Pani P, Brunamonti E, Deco G, Ferraina S, Verschure P. 2013. Neural variability in premotor cortex is modulated by trial history and predicts behavioral performance. Neuron 78:249-255.
126. Markus EJ, Barnes CA, McNaughton BL, Gladden VL, Skaggs WE. 1994. Spatial information content and reliability of hippocampal CA1 neurons: Effects of visual input. Hippocampus 4:410-421.
127. Markus EJ, Qin YL, Leonard B, Skaggs WE, McNaughton BL, Barnes CA. 1995. Interactions between location and task affect the spatial and directional firing of hippocampal neurons. J Neurosci 15:7079-7094.
128. Marder E, Goaillard JM. 2006. Variability, compensation and homeostasis in neuron and network function. Nat Rev Neurosci 7:563-574.
129. Marder E, Prinz AA. 2003. Current compensation in neuronal homeostasis. Neuron 37:2-4.
130. Maren S. (2001). Neurobiology of Pavlovian fear conditioning. Ann Rev Neurosci 24:897-931.
131. Martig AK, Mizumori SJY. 2011. Ventral tegmental area disruption selectively affects CA1/CA2 but not CA3 place fields during a differential reward working memory task. Hippocampus 21:172-184.
132. Mayberg HS, Liotti M, Brannan SK, McGinnis S, Mahurin RK, Jerabek PA, Silva JA, Tekell JL, Martin CC, Lancaster JL, Fox PT. 1999. Reciprocal limbic-cortical function and negative mood: Converging PET findings in depression and normal sadness. Am J Psychiat 156:675-682.
133. Mazur JE. 1988. Estimation of indifference points with an adjusting-delay procedure. J Exp Anal Behav 49:37-47.
134. McClelland JL, McNaughton BL, O'Reilly RC. 1995. Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychol Rev 102:419-457.
135. McElroy MW, Korol DL. 2005. Intrahippocampal muscimol shifts learning strategy in gonadally intact yound adult female rats. Learn Mem 12:150-158.
136. McDonald RJ, White NM. 1993. A triple dissociation of memory systems: Hippocampus, amygdala and dorsal striatum. Behav Neurosci 107:371-388.
137. Mizumori SJY. 2008a. A context for hippocampal place cells during learning. In: Mizumori SJY, editors. Hippocampal Place Fields: Relevance to Learning and Memory. New York: Oxford University Press. pp 16-43.
138. Mizumori SJY. 2008b. Hippocampal Place Fields: Relevance to Learning and Memory. New York: Oxford University Press.
139. Mizumori SJ, Cooper BG, Leutgeb S, Pratt WE. 2000. A neural systems analysis of adaptive navigation. Mol Neurobiol 21:57-82.
140. Mizumori SJ, Kalyani A. 1997. Age and experience-dependent representational reorganization during spatial learning. Neurobiol Aging 18:651-659.
141. Mizumori SJ, Puryear CB, Martig AK. 2009. Basal ganglia contributions to adaptive navigation. Behav Brain Res 199:32-42.
142. Mizumori SJ, Ragozzino KE, Cooper BG, Leutgeb S. 1999. Hippocampal representational organization and spatial context. Hippocampus 9:444-451.
143. Mizumori SJY, Smith DM, Puryear CB. 2007. A role for place representation in episodic memory. In: Martinez JL Jr, Kesner RP, editors. Neurobiology of Learning and Memory, 2nd ed. Burlington Massachusetts: A: Academic Press. pp 155-189.
144. Mizumori SJY, Yeshenko O, Gill K, Davis D. 2004. Parallel processing across neural systems: Implications for a multiple memory systems hypothesis. Neurobiol Learn Mem 82:278-298.
145. Monterosso J, Piray P, Luo S. 2012. Neuroeconomics and the study of addiction. Biol Psychiat 72:107-112.
146. Myers CE, Gluck M. 1994. Context, conditioning, and hippocampal rerepresentation in animal learning. Behav Neurosci 108:835-847.
147. Muller RU, Kubie JL. 1987. The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells. J Neurosci 7:1951-1968.
148. Nadel L, Payne JD. 2002. The hippocampus, wayfinding and episodic memory. In: Sharp PE, editor. The Neural Basis of Navigation: Evidence from Single Cell Recording. Massachusetts: Kluwer Academic.
149. Nadel L, Wilner J. 1980. Context and conditioning: A place for space. Physiol Psychol 8:218-228.
150. Nakazawa K, Quirk MC, Bhitwood RA, Watanabe M, Yeckel MF, Sun LD, Kato A, Carr CA, Johnston D, Wilson MA, Tonegawa S. 2002. Requirement for hippocampal CA3 NMDA receptors in associative memory recall. Science 297:211-218.
151. Nicola SM, Yun IA, Wakabayashi KT, Fields HL. 2004. Firing of nucleus accumbens neurons during the consummatory phase of a discriminative stimulus task depends on previous reward predictive cues. J Neurophysiol 91:1866-1882.
152. Nudo RJ. 2011. Neural bases of recovery after brain injury. J Commun Disord 44:515-520.
153. O'Keefe J. 1976. Place units in the hippocampus of the freely moving rat. Exp Neurol 51:78-109.
154. O'Keefe J, Burgess N. 1996. Geometric determinants of the place fields of hippocampal neurons. Nature 381:425-428.
155. O'Keefe J, Nadel L. 1978. The Hippocampus as a Cognitive Map. Oxford, UK: Clarendon Press.
156. O'Neill M, Schultz W. 2010. Coding of reward risk distinct from reward value by orbitofrontal neurons. Neuron 68:789-800.
157. Packard MG, Hirsh R, White NM. 1989. Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: Evidence for multiple memory systems. J Neurosci 9:1465-1472.
158. Packard MG, McGaugh JL. 1996. Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol Learn Mem 65:65-72.
159. Paz R, Pare D. 2013. Physiological basis for emotional modulation of memory circuits by the amygdala. Curr Opin Neurobiol 23:1-6.
160. Pearce JM, Hall G. 1980. A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev 87:532-552.
161. Pecina S, Cagniard B, Berridge, KC, Aldridge JW, Zhuang X. 2003. Hyperdopaminergic mutant mice have higher "wanting" but not 'liking' for sweet rewards. J Neurosci 23:9395-9402.
162. Pennartz CM, Berke JD, Graybiel AM, Ito R, Lansink CS, van der Meer M, Redish AD, Smith KS, Voorn P. 2009. Corticostriatal interactions during learning, memory processing, and decision making. J Neurosci 29:12831-12838.
163. Penner MR, Larkin J, Tryon VL, Mizumori SJY. 2012. Hippocampal pyramidal cell activity is modulated by changes in reward context on a decision-making maze. Soc Neurosci Abstr 295.
164. Penner MR, Mizumori SJY. 2012a. Age-associated changes in the hippocampal-ventral striatum-ventral tegmental loop that impact learning, prediction and context discrimination. Front Aging Neurosci 4:1-12.
165. Penner MR, Mizumori SJY. 2012b. Neural systems analysis of decision making during goal-directed navigation. Prog Neurobiol 96:96-135.
166. Pennartz CM, Uylings HB, Barnes CA, McNaughton BL. 2002. Memory reactivation and consolidation during sleep: From cellular mechanisms to human performance. Prog Brain Res 138:143-166.
167. Phillips RG, LeDoux JE. 1992. Differential contribution of amygdala and hippocampus to cued and contextual fear conditioning. Behav Neurosci 106:274-285.
168. Plenz D, Aertsen A. 1996. Neural dynamics in cortex-striatum cocultures. I. Anatomy and electrophysiology of neuronal cell types. Neuroscience 70:861-891.
169. Plenz D, Kitai ST. 1998. Up and down states in striatal medium spiny neurons simultaneously recorded with spontaneous activity in fast-spiking interneurons studied in cortex-striatum-substantia nigra organotypic cultures. J Neurosci 18:266-283.
170. Poldrack RA, Clark J, Pare-Blagoev EJ, Shohamy D, Creso Moyano J, Myers C, Gluck MA. 2001. Interactive memory systems in the human brain. Nature 414:546-550.
171. Pratt WE, Mizumori SJY. 2001. Neurons in rat medial prefrontal cortex show anticipatory rate changes to predictable differential rewards in a spatial memory task. Behav Brain Res 123:165-183.
172. Puryear CB, Kim MJ, Mizumori SJY. 2010. Conjunctive encoding of reward and movement by ventral tegmental area neurons: Contextual control during adaptive spatial navigation. Behav Neurosci 124:234-247.
173. Ragozzino ME, Wilcox C, Raso M, Kesner RP. 1999a. Involvement of rodent prefrontal cortex subregions in strategy switching. Behav Neurosci 113:32-41.
174. Ragozzino ME, Detrick S, Kesner RP. 1999b. Involvement of the prelimbic infralimbic areas of the rodent prefrontal cortex in behavioral flexibility for place and response learning. J Neurosci 19:4585-4594.
175. Redish AD. 1999. Beyond the Cognitive Map: From Place Cells to Episodic Memory. Cambridge, MA: MIT Press.
176. Rescorla RA, Wagner AR. 1972. A theory of Pavlovian conditioning: Variation in the effectiveness of reinforcement and nonreinforcement. In: Black AH, Prokasy WF, editors. Classical Conditioning. II. Current Research and Theory. New York: Appleton Century Crofts. pp 64-99.
177. Robinson TE, Kolb B. 2004. Structural plasticity associated with exposure to drugs of abuse. Neuropharmacol 47 (Suppl 1):33-46.
178. Rochefort C, Lefort JM, Rondi-Reig L (2013). The cerebellum: A new key structure in the navigation system. Front Neural Circuits 7:1-12.
179. Roitman JD, Roitman MF. 2010. Risk-preference differentiates orbitofrontal cortex responses to freely chosen reward outcomes. Eur J Neurosci 31:1492-1500.
180. Rolls ET, Miyashita Y, Cahusac PM, Kesner RP, Niki H, Geigenbaum JD, Bach L. 1989. Hippocampal neurons in the monkey with activity related to the place in which a stimulus is shown. J Neurosci 9:1835-1845.
181. Roth ED, Yu X, Rao G, Knierim JJ. 2012. Functional differences in the backward shifts of CA1 and CA3 place fields in novel and familiar environments. PLoS One 7:e36035.
182. Rowland DC, Yanovich Y, Kentros CG. 2011. A stable hippocampal representation of a space requires its direct experience. Proc Natl Acad Sci USA 108:14654-14658.
183. Rushworth MF, Behrens TE. 2008. Choice, uncertainty and value in prefrontal and cingulate cortex. Nat Neurosci 11:389-397.
184. Schacter DL, Addis DR. 2007. The cognitive neuroscience of constructive memory: Remembering the past and imagining the future. Phil Trans R Soc B 362:773-786.
185. Scheidt RA, Zimbelman JL, Salowitz NMG, Suminski AJ, Mosier KM, Houk J, Simo L. 2012. Remembering forward: Neural correlates of memory and prediction in human motor adaptation. Neuroimage 59:582-600.
186. Schultz W. 2010. Dopamine signals for reward value and risk: Basic and recent data. Behav Brain Funct 6:24.
187. Schultz W, Dayan P, Montague PR. 1997. A neural substrate of prediction and reward. Science 275:1593-1599.
188. Schultz W, Dickinson A. 2000. Neuronal coding of prediction errors. Ann Rev Neurosci 23:473-500.
189. Schultz W, O'Neill M, Tobler PN, Kobayashi S. 2011. Neuronal signals for reward risk in frontal cortex. Ann NY Acad Sci 1239:109-117.
190. Scimeca JM, Badre D. 2012. Striatal contributions to declarative memory retrieval. Neuron 75:380-392.
191. Shapiro ML, Ferbinteanu J. 2006. Relative spike timing in pairs of hippocampal neurons distinguishes the beginning and end of journeys. Proc Natl Acad Sci USA 103:4287-4292.
192. Sherry DF, Schacter DL. 1987. The evolution of multiple memory systems. Psychol Rev 94:439-454.
193. Shirvalkar PR, Rapp, PR, Shapiro ML. 2010. Bidirectional changes to hippocampal theta-gamma comodulation predict memory for recent spatial episodes. Proc Natl Acad Sci USA 107:7054-7059.
194. Siapas AG, Lubenov EV, Wilson MA. 2005. Prefrontal phase locking to hippocampal theta oscillations. Neuron 46:141-151.
195. Squire LR, Zola SM. 1996. Structure and function of declarative and nondeclarative memory systems. Proc Natl Acad Sci USA 93:13515-13522.
196. Smith DM, Barredo J, Mizumori SJY. 2012. Complimentary roles of the hippocampus and retrosplenial cortex in behavioral context discrimination. Hippocampus 22:1121-1133.
197. Smith DM, Mizumori SJY. 2006. Learning-related development of context-specific neuronal responses to places and events: the hippocampal role in context processing. J Neurosci 26:3154-3163.
198. Stalnaker TA, Calhoon GG, Ogawa M, Roesch MT, Schoenbaum G. 2012. Reward prediction error signaling in posterior dorsomedial striatum is action specific. J Neurosci 32:10296-10305.
199. Tanaka H, Sejnowski TJ, Krakauer JW. 2009. Adaptation to visuomotor rotation through interaction between posterior parietal and motor cortical areas. J Neurophysiol 102:2921-2932.
200. Taylor JA, Ivry RB. 2012. The role of strategies in motor learning. Ann NY Acad Sci 125:1-12.
201. Tse D, Langston RF, Kakeyama M, Bethus I, Spooner PA, Wood ER, Witter MP, Morris RG. 2007. Schemas and memory consolidation. Science 316: 76-82.
202. Tulving E. 2002. Episodic memory: From mind to brain. Ann Rev Psychol 53:1-25.
203. Turrigiano GG. 1999. Homeostatic plasticity in neuronal networks: The more things change, the more they stay the same. Trends Neurosci 22:221-227.
204. Turrigiano GG. 2008. The self-tuning neuron: Synaptic scaling of excitatory synapses. Cell 135:422-435.
205. Turrigiano GG. 2011. Homeostatic synaptic plasticity: Local and global mechanisms for stabilizing neuronal function. Cold Spring Harb Perspect Biol 4:a005736.
206. Turrigiano GG, Leslie KR, Desai NS, Rutherford LC, Nelson SB. 1998. Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature 391:892-896.
207. Turrigiano GG, Nelson SB. 2004. Homeostatic plasticity in the developing nervous system. Nat Rev Neurosci 5:97-107.
208. Voorn P, Vanderschuren LJ, Groenewegen HJ, Robbins TW, Pennartz CM. 2004. Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci 27:468-474.
209. Walsh MM, Anderson JR. 2012. Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice. Neurosci Biobehav Rev 36:1870-1884.
210. Warden MR, Selimbeyoglu A, Mirzabekov J, Lo M, Thompson KR, Kim SY, Adhikari A, Tye KM, Frank LM, Deisseroth K. 2012. A prefrontal cortex-brainstem neuronal projection that controls response to behavioural challenge. Nature 492:428-432.
211. Watson KK, Platt ML. 2008. Neuroethology of reward and decision making. Phil Trans Roy Soc B 363:3825-3835.
212. White NM, McDonald RJ. 2002. Multiple parallel memory systems in the brain of the rat. Neurobiol Learn Mem 77:125-184.
213. Wiener SI. 1993. Spatial and behavioral correlates of striatal neurons in rats performing a self-initiated navigation task. J Neurosci 13:3802-3817.
214. Wiener SI. 1996. Spatial, behavioral and sensory correlates of hippocampal CA1 complex spike cell activity: Implications for information processing functions. Prog Neurobiol 49:335-361.
215. Wilson CJ. 1993. The generation of natural firing patterns in neostriatal neurons. Prog Brain Res :277-298.
216. Wilson CJ, Kawaguchi Y. 1996. The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons. J Neurosci 16:2397-2410.
217. Wilson MA, McNaughton BL. 1993. Dynamics of the hippocampal ensemble code for space. Science 261:1055-1058.
218. Wilson MA, McNaughton BL. 1994. Reactivation of hippocampal ensemble memories during sleep. Science 265:676-679.
219. Wimmer GE, Shohamy D. 2012. Preference by association: How memory mechanisms in the hippocampus bias decisions. Science 338:270-273.
220. Wood ER, Dudchenko PA, Robitsek RJ, Eichenbaum H. 2000. Hippocampal neurons encode information about different types of memory episodes occurring in the same location. Neuron 27:623-633.
221. Yartsev MM, Ulanovsky N. 2013. Representation of the three-dimensional space in the hippocampus of flying bats. Science 340:367-372.
222. Yeshenko O, Guazzelli A, Mizumori SJY. 2004. Context-dependent reorganization of spatial and movement representations by simultaneously recorded hippocampal and striatal neurons during performance of allocentric and egocentric tasks. Behav Neurosci 118:751-769.
223. Yin HH, Knowlton BJ. 2006. The role of the basal ganglia in habit formation. Nat Rev Neurosci 7:464-476.
224. Yiv Y, Schoenbaum G. 2008. Dialogues on prediction errors. Trends Cogn Sci 12:265-272.
225. Young JJ, Shapiro ML. 2009. Double dissociation and hierarchical organization of strategy switches and reversals in the rat PFC. Behav Neurosci 123:1028-1035.
226. Zahm DS, Cheng AY, Lee TJ, Ghobadi CW, Schwartz ZM, Geisler S, Parsely KP, Gruber C, Veh RW. 2011. Inputs to the midbrain dopaminergic complex in the rat, with emphasis on extended amygdala-recipient sectors. J Comp Neurol 19:3159-3188.