Goal-oriented searching mediated by ventral hippocampus early in trial-and-error learning

Nature Neuroscience

Volumn 15, Issue 11, 2012, Pages 1563-1571

  Ruediger, Sarah ^a   Spirig, Dominique ^a   Donato, Flavio ^a   Caroni, Pico ^a  

^a FRIEDRICH MIESCHER INSTITUTE FOR BIOMEDICAL RESEARCH   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

8 CHLORO 2,3,4,5 TETRAHYDRO 3 METHYL 5 PHENYL 1H 3 BENZAZEPIN 7 OL HYDROGEN MALEATE;

ANIMAL EXPERIMENT; ANIMAL MODEL; ARTICLE; BRAIN REGION; CONTROLLED STUDY; GOAL ATTAINMENT; HIPPOCAMPUS; IMMUNOHISTOCHEMISTRY; LEARNING; MAZE TEST; MOUSE; NONHUMAN; PRIORITY JOURNAL; REWARD; TASK PERFORMANCE;

ANIMALS; BENZAZEPINES; BRAIN MAPPING; CONDITIONING (PSYCHOLOGY); DOPAMINE ANTAGONISTS; EXPLORATORY BEHAVIOR; FEAR; GOALS; GREEN FLUORESCENT PROTEINS; HIPPOCAMPUS; LEARNING; MALE; MAZE LEARNING; MICE; MICE, TRANSGENIC; MICROFILAMENT PROTEINS; NEURAL INHIBITION; NEURONS; PHOSPHOPYRUVATE HYDRATASE; PROTO-ONCOGENE PROTEINS C-FOS; TIME FACTORS;

EID: 84868207939     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.3224     Document Type: Article

References (38)

1. Sutton, R.S. & Barto, A.G. Reinforcement Learning: An Introduction (MIT Press, 1998).
2. Dayan, P. & Balleine, B.W. Reward, motivation and reinforcement learning. Neuron 36, 285-298 (2002).
3. Graybiel, A.M. Habits, rituals, and the evaluative brain. Annu. Rev. Neurosci. 31, 359-387 (2008).
4. Barnes, T.D., Kubota, Y., Hu, D., Jin, D.Z. & Graybiel, A.M. Activity of striatal neurons refects dynamic encoding and recoding of procedural memories. Nature 437, 1158-1161 (2005). (Pubitemid 41509353)
5. Desrochers, T.M., Jin, D.Z., Goodman, N.D. & Graybiel, A.M. Optimal habits can develop spontaneously through sensitivity to local cost. Proc. Natl. Acad. Sci. USA 107, 20512-20517 (2010).
6. Thorn, C.A., Atallah, H., Howe, M. & Graybiel, A.M. Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron 66, 781-795 (2010).
7. Amemori, K., Gibb, L.G. & Graybiel, A.M. Shifting responsibility: the importance of striatal modularity to reinforcement learning in uncertain environments. Front. Hum. Neurosci. 5, 47 (2011).
8. Botvinick, M.M., Niv, Y. & Barto, A.C. Hierarchically organized behavior and its neural foundations: a reinforcement-learning perspective. Cognition 113, 262-280 (2009).
9. O'Keefe, J. & Nadel, L. The Hippocampus as a Cognitive Map (Oxford Univ. Press, 1978).
10. Moser, E.I., Kropff, E. & Moser, M.B. Place cells, grid cells, and the brain's spatial representation system. Annu. Rev. Neurosci. 31, 69-89 (2008).
11. Bird, C.M. & Burgess, N. The hippocampus and memory: insights from spatial processing. Nat. Rev. Neurosci. 9, 182-194 (2008). (Pubitemid 351272664)
12. Morris, R.G.M., Garrud, P., Rawlins, J.N.P. & O'Keefe, J. Place navigation impaired in rats with hippocampal lesions. Nature 297, 681-683 (1982). (Pubitemid 12096189)
13. Moser, M.B. & Moser, E.I. Functional differentiation in the hippocampus. Hippocampus 8, 608-619 (1998). (Pubitemid 29010188)
14. Dong, H.W., Swanson, L.W., Chen, L., Fanselow, M.S. & Toga, A.W. Genomic-anatomic evidence for distinct functional domains in hippocampal feld CA1. Proc. Natl. Acad. Sci. USA 106, 11794-11799 (2009).
15. Fanselow, M.S. & Dong, H.-W. Are the dorsal and ventral hippocampus functionally distinct structures? Neuron 65, 7-19 (2010).
16. Moser, M.B., Moser, E.I., Forrest, E., Andersen, P. & Morris, R.G.M. Spatial learning with a minislab in the dorsal hippocampus. Proc. Natl. Acad. Sci. USA 92, 9697-9701 (1995).
17. Thompson, C.L. et al. Genomic anatomy of the hippocampus. Neuron 60, 1010-1021 (2008).
18. Viard, A., Doeller, C.F., Hartley, T., Bird, C.M. & Burgess, N. Anterior hippocampus and goal-directed spatial decision making. J. Neurosci. 31, 4613-4621 (2011).
19. Royer, S., Sirota, A., Patel, J. & Buzsaki, G. Distinct representations and theta dynamics in dorsal and ventral hippocampus. J. Neurosci. 30, 1777-1787 (2010).
20. Young, J.J. & Shapiro, M.L. Dynamic coding of goal-directed paths by orbital prefrontal cortex. J. Neurosci. 31, 5989-6000 (2011).
21. Pennartz, C.M., Ito, R., Verschure, P.F., Battaglia, F.P. & Robbins, T.W. The hippocampal-striatal axis in learning, prediction and goal-directed behavior. Trends Neurosci. 34, 548-559 (2011).
22. Ruediger, S. et al. Learning-related feedforward inhibitory connectivity growth required for memory precision. Nature 473, 514-518 (2011).
23. Bednarek, E. & Caroni, P. β-adducin is required for stable assembly of new synapses and improved memory upon environmental enrichment. Neuron 69, 1132-1146 (2011).
24. Morris, R. Development of a water-maze procedure for studying spatial learning in the rat. J. Neurosci. Methods 11, 47-60 (1984). (Pubitemid 14088970)
25. Wolfer, D.P. & Lipp, H.P. Dissecting the behaviour of transgenic mice: is it the mutation, the genetic background, or the environment? Exp. Physiol. 85, 627-634 (2000).
26. Janus, C. Search strategies used by APP transgenic mice during navigation in the Morris water maze. Learn. Mem. 11, 337-346 (2004). (Pubitemid 38697900)
27. Garthe, A., Behr, J. & Kempermann, G. Adult-generated hippocampal neurons allow the fexible use of spatially precise learning strategies. PLoS ONE 4, e5464 (2009).
28. Luo, A.H., Tahsili-Fahadan, P., Wise, R.A., Lupica, C.R. & Aston-Jones, G. Linking context with reward: a functional circuit from hippocampal CA3 to ventral tegmental area. Science 333, 353-357 (2011).
29. Wiltgen, B.J. et al. The hippocampus plays a selective role in the retrieval of detailed contextual memories. Curr. Biol. 20, 1336-1344 (2010).
30. Schultz, W., Dayan, P. & Montague, P.R. A neural substrate of prediction and reward. Science 275, 1593-1599 (1997). (Pubitemid 27120526)
31. Bethus, I., Tse, D. & Morris, R.G.M. Dopamine and memory: modulation of the persistence of memory for novel hippocampal NMDA receptor-dependent paired associates. J. Neurosci. 30, 1610-1618 (2010).
32. Rabenstein, R.L. et al. Impaired synaptic plasticity and learning in mice lacking β-adducin, an actin-regulating protein. J. Neurosci. 25, 2138-2145 (2005). (Pubitemid 40289419)
33. Bast, T., Wilson, I.A., Witter, M.P. & Morris, R.G.M. From rapid place learning to behavioral performance: a key role for intermediate hippocampus. PLoS Biol. 7, e1000089 (2009).
34. Bannerman, D.M., Good, M.A., Butcher, S.P., Ramsay, M. & Morris, R.G.M. Distinct components of spatial learning revealed by prior training and NMDA receptor blockade. Nature 378, 182-186 (1995).
35. Hoh, T., Beiko, J., Boon, S., Weiss, S. & Cain, D.P. Complex behavioral strategy and reversal learning in the water maze without NMDA receptor-dependent long-term potentiation. J. Neurosci. 19, RC2 (1999).
36. Gallistel, C.R., Fairhust, S. & Balsam, P. The learning curve: implications of a quantitative analysis. Proc. Natl. Acad. Sci. USA 101, 13124-13131 (2004). (Pubitemid 39209629)
37. Kjelstrup, K.G. et al. Reduced fear expression after lesions of the ventral hippocampus. Proc. Natl. Acad. Sci. USA 99, 10825-10830 (2002).
38. De Paola, V., Arber, S. & Caroni, P. AMPA receptors regulate dynamic equilibrium of presynaptic terminals in mature hippocampal networks. Nat. Neurosci. 6, 491-500 (2003). (Pubitemid 36514697)