A goal-directed spatial navigation model using forward trajectory planning based on grid cells

European Journal of Neuroscience

Volumn 35, Issue 6, 2012, Pages 916-931

  Erdem, Uǧur M ^a   Hasselmo, Michael ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

Grid cell; Hippocampus; Navigation; Place cell; Prefrontal cortex

Indexed keywords

ARTICLE; BEHAVIOR; BRAIN CELL; BRAIN MAPPING; CELL STIMULATION; CONTROLLED STUDY; DECISION MAKING; EXPLORATORY BEHAVIOR; GOAL DIRECTED SPATIAL NAVIGATION MODEL; GRID CELL; MAZE TEST; MEMORY CONSOLIDATION; MOVEMENT PERCEPTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; REWARD; SIGNAL DETECTION; SIMULATION; SPATIAL DISCRIMINATION; SPATIAL MEMORY; VIRTUAL REALITY;

ANIMALS; GOALS; MAZE LEARNING; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; RATS; SPATIAL BEHAVIOR; USER-COMPUTER INTERFACE;

EID: 84858863489     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2012.08015.x     Document Type: Article

References (71)

1. Almeida, L., Idiart, M. & Lisman, J.E. (2009) The input-output transformation of the hippocampal granule cells: from grid cells to place fields. J. Neurosci., 29, 7504-7512.
2. Almeida, L., Idiart, M. & Lisman, J.E. (2010) The single place fields of CA3 cells: a two-stage transformation from grid cells. Hippocampus, 22, 200-208.
3. Alvernhe, A., Van Cauter, T., Save, E. & Poucet, B. (2008) Different CA1 and CA3 representations of novel routes in a shortcut situation. J. Neurosci., 28, 7324-7333.
4. Arleo, A. & Gerstner, W. (2000) Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity. Biol. Cybern., 83, 287-299.
5. Baeg, E.H., Kim, Y.B., Huh, K., Mook-Jung, I., Kim, H.T. & Jung, M.W. (2003) Dynamics of population code for working memory in the prefrontal cortex. Neuron, 40, 177-188.
6. Burak, Y. & Fiete, I. (2009) Accurate path integration in continuous attractor network models of grid cells. PLoS Comput. Biol., 5, e1000291+.
7. Burgess, N., Donnett, J.G., Jeffery, K.J. & O'Keefe, J. (1997) Robotic and neuronal simulation of the hippocampus and rat navigation. Philos. Trans. R. Soc. Lond., B, Biol. Sci., 352, 1535-1543.
8. Burgess, N., Donnett, J.G. & O'Keefe, J. (1998) The representation of space and the hippocampus in rats, robots and humans. J. Biosci., 53, 504-509.
9. Burgess, N., Barry, C. & O'Keefe, J. (2007) An oscillatory interference model of grid cell firing. Hippocampus, 17, 801-812.
10. Burton, B.G., Hok, V., Save, E. & Poucet, B. (2009) Lesion of the ventral and intermediate hippocampus abolishes anticipatory activity in the medial prefrontal cortex of the rat. Behav. Brain Res., 199, 222-234.
11. Derdikman, D., Whitlock, J.R., Tsao, A., Fyhn, M., Hafting, T., Moser, M.-B. & Moser, E.I. (2009) Fragmentation of grid cell maps in a multicompartment environment. Nat. Neurosci., 12, 1325-1332.
12. Duff, A., Fibla, M.S. & Verschure, P.F.M.J. (2011) A biologically based model for the integration of sensory-motor contingencies in rules and plans: a prefrontal cortex based extension of the distributed adaptive control architecture. Brain Res. Bull., 85, 289-304.
13. Eustice, R.M., Singh, H. & Leonard, J.J. (2006) Exactly sparse delayed-state filters for view-based SLAM. IEEE Trans. Robot., 22, 1100-1114.
14. Fenton, A.A., Kao, H.-Y., Neymotin, S.A., Olypher, A., Vayntrub, Y., Lytton, W.W. & Ludvig, N. (2008) Unmasking the CA1 ensemble place code by exposures to small and large environments: more place cells and multiple, irregularly arranged, and expanded place fields in the larger space. J. Neurosci., 28, 11250-11262.
15. Fibla, M.S., Bernardet, U. & Verschure, P.F.M.J. (2010) Allostatic control for robot behaviour regulation: an extension to path planning. In Institute of Electrical and Electronics Engineers (IEEE), 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2010). Taipei, Taiwan, pp. 1935-1942.
16. Foster, D.J., Morris, R.G. & Dayan, P. (2000) A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus, 10, 1-16.
17. Fox, D., Burgard, W. & Thrun, S. (1999) Markov localization for mobile robots in dynamic environments. J. Artif. Intell. Res., 11, 391-427.
18. Fuhs, M.C. & Touretzky, D.S. (2006) A spin glass model of path integration in rat medial entorhinal cortex. J. Neurosci., 26, 4266-4276.
19. Giocomo, L.M., Zilli, E.A., Fransen, E. & Hasselmo, M.E. (2007) Temporal frequency of subthreshold oscillations scales with entorhinal grid cell field spacing. Science, 315, 1719-1722.
20. Gorchetchnikov, A. & Grossberg, S. (2007) Space, time and learning in the hippocampus: how fine spatial and temporal scales are expanded into population codes for behavioral control. Neural Netw., 20, 182-193.
21. Gorchetchnikov, A. & Hasselmo, M.E. (2005) A biophysical implementation of a bidirectional graph search algorithm to solve multiple goal navigation tasks. Conn. Sci., 17, 145-164.
22. Guanella, A. & Verschure, P.F.M.J. (2007) Prediction of the position of an animal based on populations of grid and place cells: a comparative simulation study. J. Integr. Neurosci., 6, 433-446.
23. Guanella, A., Kiper, D. & Verschure, P. (2007) A model of grid cells based on a twisted torus topology. Int. J. Neural Syst., 17, 231.
24. Hafting, T., Fyhn, M., Molden, S., Moser, M.-B. & Moser, E.I. (2005) Microstructure of a spatial map in the entorhinal cortex. Nature, 436, 801-806.
25. Hasselmo, M.E. (2005) A model of prefrontal cortical mechanisms for goal-directed behavior. J. Cogn. Neurosci., 17, 1115-1129.
26. Hasselmo, M.E. (2008) Grid cell mechanisms and function: contributions of entorhinal persistent spiking and phase resetting. Hippocampus, 18, 1213-1229.
27. Hasselmo, M.E. & Brandon, M.P. (2008) Linking cellular mechanisms to behavior: entorhinal persistent spiking and membrane potential oscillations may underlie path integration, grid cell firing, and episodic memory. Neural Plasticity, Available at:
28. Hasselmo, M.E. & Eichenbaum, H. (2005) Hippocampal mechanisms for the context-dependent retrieval of episodes. Neural Netw., 18, 1172-1190.
29. Hasselmo, M.E., Giocomo, L.M. & Zilli, E.A. (2007) Grid cell firing may arise from interference of theta frequency membrane potential oscillations in single neurons. Hippocampus, 17, 1252-1271.
30. Hok, V., Save, E., Lenck- Santini, P.P. & Poucet, B. (2005) Coding for spatial goals in the prelimbic/infralimbic area of the rat frontal cortex. Proc. Natl Acad. Sci. USA, 102, 4602-4607.
31. Hok, V., Lenck- Santini, P.-P., Roux, S., Save, E., Muller, R.U. & Poucet, B. (2007) Goal-related activity in hippocampal place cells. J. Neurosci., 27, 472-482.
32. Hyman, J.M., Zilli, E.A., Paley, A.M. & Hasselmo, M.E. (2005) Medial prefrontal cortex cells show dynamic modulation with the hippocampal theta rhythm dependent on behavior. Hippocampus, 15, 739-749.
33. Johnson, A. & Redish, A.D. (2007) Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J. Neurosci., 27, 12176-12189.
34. Jones, M.W. & Wilson, M.A. (2005) Theta rhythms coordinate hippocampal-prefrontal interactions in a spatial memory task. PLoS Biol., 3, e402.
35. Knierim, J.J., Kudrimoti, H.S. & McNaughton, B.L. (1995) Place cells, head direction cells, and the learning of landmark stability. J. Neurosci., 15, 1648-1659.
36. Kollar, T. & Roy, N. (2008) Trajectory optimization using reinforcement learning for map exploration. Int. J. Rob. Res., 27, 175-196.
37. Leutgeb, J.K., Leutgeb, S., Moser, M.-B. & Moser, E.I. (2007) Pattern separation in the dentate gyrus and CA3 of the hippocampus. Science, 315, 961-966.
38. Lisman, J.E., Talamini, L.M. & Raffone, A. (2005) Recall of memory sequences by interaction of the dentate and CA3: a revised model of the phase precession. Neural Netw., 18, 1191-1201.
39. Louie, K. & Wilson, M.A. (2001) Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep. Neuron, 29, 145-156.
40. McNaughton, B.L., Barnes, C.A. & O'Keefe, J. (1983) The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats. Exp. Brain Res., 52, 41-49.
41. McNaughton, B.L., Battaglia, F.P., Jensen, O., Moser, E.I. & Moser, M.-B. (2006) Path integration and the neural basis of the "cognitive map". Nat. Rev. Neurosci., 7, 663-678.
42. Milford, M.J. (2008) Robot Navigation from Nature: Simultaneous Localisation, Mapping, and Path Planning Based on Hippocampal Models, 1st Edn. Springer, Berlin.
43. Milford, M.J., Wyeth, G.F. & Prasser, D. (2004) RatSLAM: a hippocampal model for simultaneous localization and mapping. In Institute of Electrical and Electronics Engineers (IEEE), Proceedings. ICRA '04. IEEE International Conference on Robotics and Automation, 2004. New Orleans, USA, 26 April - 04 May 2004, pp. 403-408.
44. Moravec, H. & Elfes, A. (1985) High resolution maps from wide angle sonar. In Institute of Electrical and Electronics Engineers (IEEE), 1985 IEEE International Conference on Robotics and Automation. Durham, pp. 116-121.
45. Morris, R.G., Garrud, P., Rawlins, J.N. & O'Keefe, J. (1982) Place navigation impaired in rats with hippocampal lesions. Nature, 297, 681-683.
46. Moser, E.I. & Moser, M.-B. (2008) A metric for space. Hippocampus, 18, 1142-1156.
47. Muller, R.U. & Kubie, J.L. (1987) The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells. J. Neurosci., 7, 1951-1968.
48. O'Keefe, J. (1976) Place units in the hippocampus of the freely moving rat. Exp. Neurol., 51, 78-109.
49. O'Keefe, J. & Burgess, N. (2005) Dual phase and rate coding in hippocampal place cells: theoretical significance and relationship to entorhinal grid cells. Hippocampus, 15, 853-866.
50. O'Keefe, J., Burgess, N., Donnett, J.G., Jeffery, K.J. & Maguire, E.A. (1998) Place cells, navigational accuracy, and the human hippocampus. Philos. Trans. R. Soc. B-Biol. Sci., 353, 1333-1340.
51. Redish, A.D. & Touretzky, D.S. (1998) The role of the hippocampus in solving the Morris water maze. Neural Comput., 10, 73-111.
52. Rennó-Costa, C., Lisman, J.E. & Verschure, P.F.M.J. (2010) The mechanism of rate remapping in the dentate gyrus. Neuron, 68, 1051-1058.
53. Rolls, E.T., Stringer, S.M. & Elliot, T. (2006) Entorhinal cortex grid cells can map to hippocampal place cells by competitive learning. Network (Bristol, England), 17, 447-465.
54. Sainsbury, R.S., Heynen, A. & Montoya, C.P. (1987) Behavioral correlates of hippocampal type 2 theta in the rat. Physiol. Behav., 39, 513-519.
55. Sargolini, F., Fyhn, M., Hafting, T., McNaughton, B.L., Witter, M.P., Moser, M.-B. & Moser, E.I. (2006) Conjunctive representation of position, direction, and velocity in entorhinal cortex. Science (New York, N.Y.), 312, 758-762.
56. Sharp, P.E. (1996) Multiple spatial/behavioral correlates for cells in the rat postsubiculum: multiple regression analysis and comparison to other hippocampal areas. Cereb. Cortex, 6, 238-259.
57. Sheynikhovich, D., Chavarriaga, R., Strösslin, T., Arleo, A. & Gerstner, W. (2009) Is there a geometric module for spatial orientation? Insights from a rodent navigation model Psychol. Rev., 116, 540-566.
58. Skaggs, W.E. & McNaughton, B.L. (1996) Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience. Science (New York, N.Y.), 271, 1870-1873.
59. Solstad, T., Moser, E.I. & Einevoll, G.T. (2006) From grid cells to place cells: a mathematical model. Hippocampus, 16, 1026-1031.
60. Steele, R.J. & Morris, R.G. (1999) Delay-dependent impairment of a matching-to-place task with chronic and intrahippocampal infusion of the NMDA-antagonist D-AP5. Hippocampus, 9, 118-136.
61. Steffenach, H.-A., Witter, M., Moser, M.-B. & Moser, E.I. (2005) Spatial memory in the rat requires the dorsolateral band of the entorhinal cortex. Neuron, 45, 301-313.
62. Taube, J. (1995) Head direction cells recorded in the anterior thalamic nuclei of freely moving rats. J. Neurosci., 15, 70-86.
63. Taube, J.S. & Bassett, J.P. (2003) Persistent neural activity in head direction cells. Cereb. Cortex, 13, 1162-1172.
64. Taube, J.S., Muller, R.U. & Ranck, J.B. (1990a) Head-direction cells recorded from the postsubiculum in freely moving rats. II. Effects of environmental manipulations. J. Neurosci., 10, 436-447.
65. Taube, J.S., Muller, R.U. & Ranck, J.B. (1990b) Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis. J. Neurosci., 10, 420-435.
66. Taube, J.S., Kesslak, J.P. & Cotman, C.W. (1992) Lesions of the rat postsubiculum impair performance on spatial tasks. Behav. Neural Biol., 57, 131-143.
67. Tolman, E.C., Ritchie, B.F. & Kalish, D. (1992) Studies in spatial learning: I. Orientation and the short-cut. J. Exp. Psychol. Gen., 121, 429-434.
68. Touretzky, D.S. & Redish, A.D. (1996) Theory of rodent navigation based on interacting representations of space. Hippocampus, 6, 247-270.
69. Zilli, E.A. & Hasselmo, M.E. (2008) Modeling the role of working memory and episodic memory in behavioral tasks. Hippocampus, 18, 193-209.
70. Zilli, E.A. & Hasselmo, M.E. (2010) Coupled noisy spiking neurons as velocity-controlled oscillators in a model of grid cell spatial firing. J. Neurosci., 30, 13850-13860.
71. Zilli, E.A., Yoshida, M., Tahvildari, B., Giocomo, L.M. & Hasselmo, M.E. (2009) Evaluation of the oscillatory interference model of grid cell firing through analysis and measured period variance of some biological oscillators. PLoS Comput. Biol., 5, e1000573.