Reverse replay of behavioural sequences in hippocampal place cells during the awake state

Nature

Volumn 440, Issue 7084, 2006, Pages 680-683

  Foster, David J ^a   Wilson, Matthew A ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIODIVERSITY; MATHEMATICAL MODELS; NAVIGATION; REINFORCEMENT;

HIPPOCAMPAL PLACE CELLS; REINFORCEMENT LEARNING MODELS; SEQUENCED MEMORIES;

CELL CULTURE;

BEHAVIORAL RESPONSE; CELLS AND CELL COMPONENTS; LEARNING; MEMORY; PLANT; PRIMATE;

ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; BRAIN CELL; DEPTH PERCEPTION; EXPERIENCE; HIPPOCAMPUS; HUMAN; LEARNING; MEMORY; MODEL; NONHUMAN; PLACE PREFERENCE; PRIMATE; PRIORITY JOURNAL; RAT; REINFORCEMENT; RODENT; WAKEFULNESS;

ANIMALIA; PRIMATES; RODENTIA;

EID: 33645458694     PISSN: 00280836     EISSN: 14764687     Source Type: Journal    
DOI: 10.1038/nature04587     Document Type: Article

References (24)

1. O'Keefe, J. & Nadel, L. The Hippocampus as a Cognitive Map (Clarendon, London, 1978).
2. Morris, R. G. M., Garrud, P., Rawlins, J. N. P. & O'Keefe, J. Place navigation impaired in rats with hippocampal lesions. Nature 297, 681-683 (1982).
3. Olton, D. S. & Samuelson, R. J. Remembrance of places past: spatial memory in rats. J. Exp. Psychol. Anim. Behav. Process. 2, 97-116 (1976).
4. Steele, R. J. & Morris, R. G. M. Delay-dependent impairment of a matching-to-place task with chronic and intrahippocampal infusion of the NMDA-antagonist D-AP5. Hippocampus 9, 118-136 (1999).
5. Gaffan, D. Scene-specific memory for objects: a model of episodic memory impairment in monkeys with fornix transection. J. Cogn. Neurosci. 6, 305-320 (1994).
6. Scoville, W. B. & Milner, B. Loss of recent memory after bilateral hippocampal lesions. J. Neurol. Neurosurg. Psychiatry 20, 11-21 (1957).
7. Louie, K. & Wilson, M. A. Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep. Neuron 29, 145-156 (2001).
8. Lee, A. K. & Wilson, M. A. Memory of sequential experience in the hippocampus during slow wave sleep. Neuron 36, 1183-1194 (2002).
9. Wilson, M. A. & McNaughton, B. L. Dynamics of the hippocampal ensemble code for space. Science 261, 1055-1058 (1993).
10. O'Keefe, J. & Dostrovsky, J. The hippocampus as a spatial map: preliminary evidence from unit activity in the freely moving rat. Brain Res. 34, 171-175 (1971).
11. Press, W. H., Teukolsky, S. A., Vetterling, W. T. & Flannery, B. P. Numerical Recipes in C: The Art of Scientific Computing 2nd edn (Cambridge Univ. Press, Cambridge, 1992).
12. Ranck, J. B. Jr. Studies on single neurons in dorsal hippocampal formation and in septum in unrestrained rats. I. Behavioral correlates and firing repertoires. Exp. Neurol. 42, 461-531 (1973).
13. Buzsaki, G. Hippocampal sharp waves: their origin and significance. Brain Res. 398, 242-252 (1986).
14. Buzsaki, G. A two-stage model of memory trace formation: a role for 'noisy' brain states. Neuroscience 31, 551-570 (1989).
15. Kaelbling, L. P., Littman, M. L. & Moore, A. W. Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237-285 (1996).
16. Sutton, R. S. Learning to predict by the methods of temporal differences. Mach. Learn. 3, 9-44 (1988).
17. Schultz, W., Dayan, P. & Montague, P. R. A neural subtstrate of prediction and reward. Science 275, 1593-1599 (1997).
18. Foster, D. J., Morris, R. G. M. & Dayan, P. A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus 10, 1-16 (2000).
19. Lin, L. J. Self-improving reactive agents based on reinforcement learning, planning and teaching. Mach. Learn. 8, 293-321 (1992).
20. Sutton, R. S. & Singh, S. P. in Proceedings of the Eighth Yale Workshop on Adaptive and Learning Systems 31-36 (Yale Univ., New Haven, 1994).
21. Cichosz, P. An analysis of experience replay in temporal difference learning. Cybernet. Syst. 30, 341-363 (1999).
22. Reynolds, S. Experience Stack Reinforcement Learning for Off-policy Control. Cognitive Science Technical Report CSRP-02-1 (Birmingham Univ., Birmingham, 2002).
23. Stickgold, R., Whidbee, D., Schirmer, B., Patel, V. & Hobson, J. A. Visual discrimination task improvement: a multi-step process occurring during sleep. J. Cogn. Neurosci. 12, 246-254 (2000).
24. Siapas, A. G. & Wilson, M. A. Coordinated interactions between hippocampal wripples and cortical spindles during slow-wave sleep. Neuron 21, 1123-1128 (1998).