Place cells and spatial navigation based on 2D visual feature extraction, path integration, and reinforcement learning

Advances in Neural Information Processing Systems

Volumn , Issue , 2001, Pages

  Arleo, A ^a   Smeraldi, F ^a   Hug, S ^a   Gerstner, W ^a  

^a EPFL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

CELLS; MOBILE ROBOTS; REINFORCEMENT LEARNING;

BASIS FUNCTIONS; HEAD DIRECTION CELLS; HEBBIAN LEARNING; HIPPOCAMPAL PLACE CELLS; MINIATURE ROBOTS; PATH INTEGRATION; SPATIAL NAVIGATION; VISUAL FEATURE EXTRACTION;

CYTOLOGY;

EID: 84898978557     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. J. O'Keefe and L. Nadel. The Hippocampus as a cognitive map. Clarendon Press, Oxford, 1978.
2. J.S. Taube, R.I. Muller, and J.B. Jr. Ranck. Head direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis. Journal of Neumscience, 10:420-435, 1990.
3. J. O'Keefe and N. Burgess. Geometric determinants of the place fields of hippocampal neurons. Nature, 381:425-428, 1996.
4. M.O. Franz, B. Schölkopf, H.A. Mallot, and H.H. Bülthoff. Learning View Graphs for Robot Navigation. Autonomous Robots, 5:111-125, 1998.
5. J.J. Knierim, H.S. Kudrimoti, and B.L. McNaughton. Place cells, head direction cells, and the learning of landmark stability. Journal of Neuroscience, 15:1648-1659, 1995.
6. F. Smeraldi, J. Bigiin, and W. Gerstner. On the role of dimensionality in face authentication. In Proceedings of the Symposium of the Swedish Society for Automated Image Analysis, Halmstad (Sweden), pages 87-91. Halmstad University, Sweden, 2000.
7. D. Gabor. Theory of communication. Journal of the IEE, 93:429-457, 1946.
8. J.G. Daugman. Two-dimensional spectral analysis of cortical receptive field profiles. Vision Research, 20:847-856, 1980.
9. F. Smeraldi, N. Capdevielle, and J. Bigün. Facial features detection by saccadic exploration of the Gabor decomposition and support vector machines. In Proceedings of the 11th Scandinavian Conference on Image Analysis - SCIA 99, Kangerlussuaq, Greenland, pages 39-44, 1999.
10. A. Arleo and W. Gerstner. Modeling rodent head-direction cells and place cells for spatial learning in bio-mimetic robotics. In J.-A. Meyer, A. Berthoz, D. Floreano, H. Roitblat, and S.W. Wilson, editors, From Animals to Animats VI, pages 236-245, Cambridge MA, 2000. MIT Press.
11. A. Arleo and W Gerstner. Spatial cognition and neuro-mimetic navigation: A model of hippocampal place cell activity. Biological Cybernetics, Special Issue on Navigation in Biological and Artificial Systems, 83:287-299, 2000.
12. R.A. McCallum. Hidden state and reinforcement learning with instance-based state identification. IEEE Systems, Man, and Cybernetics, 26(3):464-473, 1996.
13. A.P. Georgopoulos, A. Schwartz, and R.E. Kettner. Neuronal population coding of movement direction. Science, 233:1416-1419, 1986.
14. M.A. Wilson and B.L. McNaughton. Dynamics of the hippocampal ensemble code for space. Science, 261:1055-1058, 1993.
15. E. Salinas and L.F. Abbott. Vector reconstruction from firing rates. Journal of Computational Science, 1:89-107, 1994.
16. C.J.C.H. Watkins. Learning from delayed rewards. PhD thesis, University of Cambridge, England, 1989.
17. P. Dayan. Navigating through temporal difference. In R.P. Lippmann, J.E. Moody, and D.S. Touretzky, editors, Advances in Neural Information Processing Systems 3, pages 464-470. Morgan Kaufmann, San Mateo, CA, 1991.
18. D.J. Foster, R.G.M. Morris, and P. Dayan. A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus, 10(1): 1-16, 2000.
19. R.S. Sutton and A.G. Barto. Reinforcement learning, an introduction. MIT Press-Bradford Books, Cambridge, Massachusetts, 1998.
20. R.G.M. Morris, P. Garrud, J.N.P. Rawlins, and J. O'Keefe. Place navigation impaired in rats with hippocampal lesions. Nature, 297:681-683, 1982.