Neurobiologically inspired mobile robot navigation and planning

Frontiers in Neurorobotics

Volumn 1, Issue NOV, 2007, Pages

  Cuperlier, Nicolas ^a   Quoy, Mathias ^b   Gaussier, Philippe ^b  

^a UFR 919 Laboratoire d'Informatique Pour la Mécanique et les Sciences de l'Ingénieur   (France)

^b ENSEA   (France)

Author keywords

Hippocampus; Neural networks; Place cells; Planning; Transition cells

Indexed keywords

EID: 54249168955     PISSN: None     EISSN: 16625218     Source Type: Journal    
DOI: 10.3389/neuro.12.003.2007     Document Type: Article

References (125)

1. Amaral, D. G., Bliss, T., and O'Keefe, J. (2006). The hippocampal book (Oxford, Oxford University Press)
2. Amaral, D. G., and Witter, M. P. (1995). Hippocampal formation. In The Rat Nervous System (Academic Press)
3. Amari, S. (1977). Dynamics of pattern formation in lateral-inhibition type neural fields Biol. Cybern. 27, 77-87
4. Araujo, I., Rolls, E., and Stringer, S. (2001). A view model which accounts for the spatial fields of hippocampal primate spatial view cells and rat place cells. Hippocampus 11, 699-706
5. Arbib, M. A., and Lieblich, I. (1977). Motivational learning of spatial behavior. In Systems Neuroscience (Academic Press), pp. 221-239
6. Arleo, A., and Gerstner, W. (1999). Neuro-mimetic navigation systems: a computational model of the rat hippocampus. In Intelligence Artificiel Situé: Cerveau, Corps Et Environnement (Hermès, Paris, Hermès science publications), pp. 193-211
7. Arleo, A., and Gerstner, W. (2000). Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity. Biol. Cybern. 83(3), 287-299
8. Ayache, N. and Faugeras, O. (1989). Maintaning representations of the environment of a mobile robot. IEEE Trans. Rob. Autom. 5(6), 804-819
9. Bachelder, I. A., and Waxman, A. M. (1994). Mobile robot visual mapping and localization: a view-based neurocomputationnal architecture that emulates hippocampal place learning. Neural Netw. 7, 1083-1099
10. Bachelder, I. A., and Waxman, A. M. (1995). A view-based neurocomputational system for relational map-making and navigation in visual environments. Rob. Auton. Syst 16(2-4), 267-289
11. Banquet, J. P., Gaussier, P., Dreher, J. C., Joulain, C., and Revel, A. (1997). Space-Time, Order and Hierarchy in Fronto-Hippocampal System: A Neural Basis of Personality In Cognitive Science Perpectives On Personality and Emotion, G. Matthews, ed (Amsterdam, Elsevier Science BV), Vol. 124, pp. 123-189
12. Banquet, J. P., Gaussier, P., Quoy, M., Revel, A., and Burnod, Y. (2005). A hierarchy of associations in hippocampo-cortical systems: cognitive maps and navigation strategies Neural Comput. 17(6), 1339-1384
13. Bellman, R. E. (1958). On a routing problem. In Quaterly of Applied Mathematics (Cambridge, MA, MIT Press), Vol. 16, pp. 87-90
14. Blair, H. T., and Sharp, P. E. (1995). Anticipatory head direction signals in anterior thalamus: evidence for a thalamocortical circuit that integrates angular head motion to compute head direction. J. Neurosci. 15, 6260-6270
15. Blum, K. I., and Abbott, L. F. (1996). A model of spatial map formation in the hippocampus of the rat. Neural Comput. 8, 85-93
16. Brooks, R. A. (1981). A robust layered control system for a mobile robot. IEEE J Robot Autom. 40, 201-211
17. Brown, M. A., and Sharp, P. E. (1995). Simulation of spatial learning in the morris water maze by a neural network model of the hippocampal formation and the nucleus accumbens. Hippocampus 5, 651-665
18. Brunel, N., and Trullier, O. (1998). Plasticity of directional place fields in a model of rodent ca3. Hippocampus 8, 651-665
19. Bugmann, G., Taylor, J. G., and Denham, M. J. (1995). Route finding by neural nets (Henley-on-Thames, Alfred Waller Ltd.), pp. 217-230
20. Burgess, N., Becker, S., King, J. A., and O'Keefe, J. (2001). Memory for events and their spatial context: models and experiments. Philos. Trans. R. Soc. Lond. B Biol. Sci 356(1413), 1493-1503
21. Burgess, N., Donnett, J. G., Jeffery, K. J., and O'Keefe, J. (1997). Robotic and neuronal simulation of the hippocampus and rat navigation. Philos. Trans.: Biol. Sci. 352(1360), 1535-1543
22. Burgess, N., and Hartley, T. (2002). Orientational and geometric determinents of place and head-direction. Neural Inform. Proc. Syst. 14, 165-172
23. Burgess, N., and O'Keefe, J. (1996). Neuronal computations underlying the firing of place cells and their role in navigation. Hippocampus 7, 749-762
24. Burgess, N., Recce, M., and O'Keefe, J. (1994). A model of hippocampal function. Neural Netw. 7(6/7), 1065-1081
25. Carpenter, G. A., and Grossberg, S. (1987). A massively parallel architecture for selforganizing neural pattern recognition machine. Comput. Vis., Graph., Image Process 37, 54-115
26. Carpenter, G. A., Grossberg, S., and Rosen, D. B. (1991). Art2-a: an adaptive resonance algorithm for rapid category leaning and recognition. Neural Netw. 4, 493-504
27. Cartwright, B. A., and Collett, T. S. (1983). Landmark learning in bees. J. Comp. Physiol 151, 521-543
28. *2003, Alicante, Spain
29. Chen, L. L., Lin, L. H., Green, E. J., and C. A. Barnes, B. L. M. (1994). Head-direction cells in the rat posterieur cortex. 1. anatomical distribution and behaviral modulation. Exp Brain Res. 101, 8-23
30. Corbit, L. H., and Balleine, B. W. (2000). The role of the hippocampus in instrumental conditioning. J. Neurosci. 20(11), 4233-4239
31. Cressant, A., Muller, R., and Poucet, B. (1997). Failure of centrally placed objects to control the firing fields of hippocampal place cells. J. Neurosci. 17(7), 2531-2542
32. Cuperlier, N. (2006). Apprentissage et pré diction de sé quences sensori-motrices: architecture neuromimé tique pour la navigation et la planification d'un robot mobile. PhD Thesis, Université de Cergy-Pontoise, Cergy-Pontoise, France
33. Cuperlier, N., Quoy, M., and Gaussier, P. (2006a). Navigation and planning in an unknown environment using vision and a cognitive map. In Proceedings of European Robotic Symponium'2006, pp. 129-142, Palerme
34. Cuperlier, N., Quoy, M., Giovannangeli, C., Gaussier, P., and Laroque, P. (2006b). Transition cells for navigation and planning in an unknown environment. In The Society For Adaptive Behavior SAB'2006, S. Nolfi, G. Baldassarre, R. Calabretta, J. Hallam, D Marocco, J-A. Meyer, D. Parisi, eds. (Berlin, Germany, Springer Verlag), pp. 286-297
35. Cuperlier, N., Quoy, M., Laroque, P., and Gaussier, P. (2005). Transition cells and neural fields for navigation and planning. In IWINAC05, Spain, Lecture Notes in Computer Science, J. Mira, and J. A. Meyer, eds. (Germany, Springer Verlag), pp. 346-355
36. Donnart, J. Y., and Meyer, J. A. (1996). Learning reactive and planning rules in a motivationnally autonomous animat. IEEE Trans. Syst. Man Cybern. B 26(3), 381-395
37. Ekstrom, A., Kahana, M., Caplan, J., Fields, T., Isham, E., Newman, E., and Fried, I. (2003) Cellular networks underlying human spatial navigation. Nature 425, 184-188
38. Etienne, A., and Jeffery, K. (2004). Path integration in mammals. Hippocampus 14(2), 180-192
39. Etienne, A., Maurer, R., Boulens, V., Levy, A., and Rowe, T. (2004). Resetting the path integrator: a basic condition for route-based navigation. J. Exp. Biol. 207(9), 1491- 1508
40. Floreano, D., and Mondada., F. (1996). Evolution and homing navigation in a real mobile robot. IEEE Trans. Syst. Man Cybern. B 26, 396-407
41. Frank, L., Brown, E., and Wilson, M. (2000). Trajectory encoding in the hippocampus and entorhinal cortex. Neuron 27, 169-178
42. Frank, L. M., Stanley, G. B., and Brown, E. N. (2004). Hippocampal plasticity across multiple days of exposure to novel environments. J. Neurosci. 24(35), 7681-7689
43. Franz, M. O., and Mallot., H. A. (2000). Biomimetic robot navigation. Rob. Auton. Syst 30, 133-153
44. Franz, M. O., Schölkopf, B., Georg, P., Mallot, H. A., and Bülthoff, H. H. (1997). Learning view graphs for robot navigation. In Proceedings of the First International Conference On Autonomous Agents (Agents'97), W. L. Johnson, and B. Hayes-Roth, eds. (New York, ACM Press), pp. 138-147
45. Franz, M. O., Schölkopf, B., Mallot, H. A., and Bülthoff, H. H. (1998). Where did I take that snapshot? Scene-based homing by image matching. Biol. Cybern. 79, 191-202
46. Gaussier, P., Banquet, J.-P., Sargolini, F., Giovannangeli, C., Save, E., and Poucet, B (2007). A model of grid cells involving extra hippocampal path integration and the hippocampal loop. J. Integr. Neurosci., in press
47. Gaussier, P., and Joulain, C. (1998). A model of visual navigation: How to explain "place cells" and "view cells" activities. In European Conference On Visual Perception ECVP'98 (Oxford, England)
48. Gaussier, P., Joulain, C., Banquet, J. P., Leprêtre, S., and Revel, A. (2000a). The visual homing problem: an examle of robotic/biology cross fertilization. Rob. Auton. Syst 30, 115-180
49. Gaussier, P., Joulain, C., Zrehen, S., Banquet, J. P., and Revel, A. (1997). Visual navigation in an open environement without map. In International Conference On Intelligent Robots and Systems-IROS'97, Grenoble, France, IEEE/RSJ, pp. 545-550
50. Gaussier, P., Leprêtre, S., Quoy, M., Revel, A., Joulain, C., and Banquet, J. P. (2000b) Experiments and models about cognitive map learning for motivated navigation In Robotics and Intelligent Systems Series, Singapore, World Scientific, Vol. 24, pp. 53-94
51. Gaussier, P., Revel, A., Banquet, J. P., and Babeau, V. (2001). From view cells and place cells to cognitive map learning: processing stages of the hippocampal system. Biol Cybern. 86, 15-28
52. Gaussier, P., and Zrehen, S. (1995). Perac: a neural architecture to control artificial animals. Rob. Auton. Syst. 16(2-4), 291-320
53. Gerstner, W., and Abbott, L. F. (1996). Learning navigation maps through potentiation and modulation of hippocampal cells. J. Comput. Neurosci. 4, 79-94
54. Gervet, J., and Pratte, M. (1999). Elément D'é thologie Cognitive-Du Dé terminisme Biologique Au Fonctionnement Cognitif, J. Gervet, and M. Pratte, eds. (Hermès, Paris)
55. Giovannangeli, C., Gaussier, P., and Banquet, J. P. (2006). Robustness of visual place cells in dynamic indoor and outdoor environment. Int. J. Advan Rob. Syst. 3(2), 115-124
56. Hafner, V. (2000a). Cognitive maps for navigation in open environments. In Proceedings of the 6th International Conference on Intelligent Autonomous Systems (IAS-6), Venice, Italy, pp. 801-808
57. Hafner, V. (2000b). Learning places in newly explored environments. In Proceedings of the Sixth International Conference on Simulation of Adaptive Behaviour: SAB00., pp. 111-120
58. Hafting, T., Fyhn, M., Molden, S., Moser, M., and Moser, E. (2005). Microstructure of a spatial map in the entorhinal cortex. Nature 436, 801-806
59. Healy, S., ed. (1998). Spatial representation in animals. (Oxford, Oxford University Press)
60. Hok, V., Save, E., Lenck-Santini, P.-P., and Poucet, B. (2005). Coding for spatial goals in the prelimbic - infralimbic area of the rat frontal cortex. Proc. Natl. Acad. Sci. USA, 102, 4602-4607
61. Jeffery, K., and Hayman, R. (2004). Plasticity of the hippocampal place cell representation Rev. Neurosci. 15(5), 309-331
62. Jensen, O., and Lisman, J. E. (1996). Hippocampal ca3 region predicts memory sequences: accounting for the phase precession of place cells. Learn. Mem. 3, 279-287
63. Jung, M. W., and McNaughton, B. L. (1993). Spatial selectivity of unit activity in the hippocampal granular layer. Hippocampus 3, 165-182
64. Kolb, B., and Tees, R. (1990). The cerebral cortex of the rat (Cambridge, MA, MIT Press)
65. Kubie, J., and Ranck, J. (1983). Sensory-behavioral correlates in individual hippocampus neurons in three situations: space and context. In Neurobiology of the hippocampus, W. Seifert, ed. (York, Academic Press), pp. 433-447
66. Lavenex, P., and Schenk, F. (1995). Influence of local environmental olfactory cues on place learning in rats. Physiol. Behav. 58, 1059-1066
67. Lavenex, P., and Schenk, F. (1998). Olfactory traces and spatial learning in rats. Anim Behav. 56, 1129-1136
68. Leonhard, C. L., Stackman, R. W., and Taube, J. S. (1996). Head direction cells recorded from the lateral mammillary nuclei in rats. Soc. Neurosci. Abstr. 22, 1873
69. Mallot, H. A., Bülthoff, H. H., Georg, P., Schölkopf, B., and Yasuhara., K. (1995). View-based cognitive map learning by an autonomous robot. In Proceeding ICANN 95/Neuro-Nimes 95, Vol. 2, pp. 381-386
70. Markus, E., Qin, Y., Leonard, B., Skaggs, W., McNaughton, B., and Barnes, C. (1995) Interactions between location and task affect the spatial and directional firing of hippocampal neurons. J. Neurosci. 15(11), 7079-7094
71. Markus, E. J., Barnes, C. A., McNaughton, B. L., Gladden, V. L., and Skaggs, W. E. (1994) Spatial information content and reliability of hippocampal ca1 neurons: effects of visual input. Hippocampus 4(4), 410-421
72. Marr, D. (1971). Simple memory: a theory for archicortex. Philos. Trans. R. Soc. Lond. B 262(841), 23-81
73. Mataric, M. J. (1991). Navigation with a rat brain: a neurobiologically-inspired model for robot spatial representation. In From animals to animat, J. A. Meyer, and S. W Wilson, eds. (Cambridge, MA, MIT Press), pp. 169-175
74. Mataric, M. J. (1992). Integration of representation into goal-driven behavior-based robots. IEEE Trans. Rob. Autom. 8(3), 304-312
75. McNaughton, B. L., and Nadel, L. (1996). Hebb-marr networks and the neurobiological representation of action in space. In Neuroscience and Connectionnist Theory, M. A Gluck, and D. E. Rumelhart, eds. (Erlbaum), pp. 1-63
76. Meyer, J. A., and Wilson, S. W. (1991). From animals to animats. In First International Conference On Simulation of Adaptive Behavior (Cambridge, MA, MIT Press)
77. Mizumori, S. J. Y., and Williams, J. D. (1992). Directionally sensitive mnemonic properties of neurons in the lateral dorsal nucleus of the thalamus of rats. J. Neurosci. 13, 4015-4028
78. Mondada, F., and Floreano, D. (1995). Evolution of neural control structures: some experiments on mobile robots. Rob. Auton. Syst. 16(2-4), 183-195
79. Moutarlier, P., and Chatila, R. (1990). An exerimental system for incremental environment modeling by an autonomous mobile robot. Experimental Robotics 1, 327-346
80. Muller, R., Bostock, E., Taube, J., and Kubie, J. (1994). On the directional firing properties of hippocampal place cells. J. Neurosci. 14(12), 7235-7251
81. Muller, R. U., and Kubie, J. L. (1987). The effect of change in environment of the spatial firing of hippocampal complex-spike cells. J. Neurosci. 7, 1951-1958
82. Muller, R. U., Stead, M., and Pach, J. (1996). The hippocampus as a cognitive graph. J Gen. Physiol. 107(107), 663-694
83. Nehmzow, U., and Owen, C. (2000). Robot navigation in the real world: experiments with manchester's fortytwo in unmodified, large environments. Rob. Auton. Syst. 33, 223-249
84. O'Keefe, J. (1991). The hippocampal cognitive map and navigational strategies. Brain and Space (Oxford, Oxford University Press), pp. 273-295
85. O'Keefe, J., and Dostrovski, J. (1971). The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res. 34, 171-175
86. O'Keefe, J., and Nadel, N. (1978). The hippocampus as a cognitive map (Oxford, Clarenton Press)
87. Owen, C., and Nehmzow, U. (1998). Landmark-based navigation for a mobile robot. In The Fifth International Conference On Simulation of Adaptive Behavior. From Animals to Animats 5, pp. 240-245
88. Papez, J. W. (1937). A proposed mechanism of emotion. Arch. Neurol. Psychiatry 28, 725-743
89. Poucet, B., Lenck-Santini, P. P., Hok, V. Save, E., Banquet, J. P., Gaussier, P., and Muller, R. U. (2004). Spatial navigation and hippocampal place cell firing: the problem of goal encoding. Rev. Neurosci. 15(2), 89-107
90. Quirk, G. J., Muller, R. U., and Kubie, J. L. (1990). The firing of hippocampal place cells in the dark depends on the rat's recent experience. J. Neurosci. 10, 2008-2017
91. Quirk, G. J., Muller, R. U., Kubie, J. L., and Ranck, J. B. (1992). The positional firing properties of the medial enthorinal neurons: description and comparison with hippocampal place cells. J. Neurosci. 10, 1945-1963
92. Quoy, M., Moga, S., and Gaussier, P. (2003). Dynamical neural networks for top-down robot control. IEEE Trans. Man Syst. Cybern. A 33(4), 523-532
93. Ranck, J. B. J. (1985). Head direction cells in the deep cell of doral presubiculum in freely moving rats. In Electrical Activity of Archicortex, G. Buzs.ki, and CH Vanderwolf, eds (Budapest, Akademiai Kiado), pp. 217-220
94. Recce, M., and Harris, K. D. (1996). Memory for places: a navigational model in support of marr's theory of hippocampal function. Hippocampus 6, 735-748
95. Redish, A. D. (2001). The hippocampal debate: are we asking the right questions? Behav Brain Res. 127, 81-98
96. Redish, A. D., and Touretzky, D. S. (1997). Cognitive maps beyond the hippocampus Hippocampus 7, 15-35
97. Revel, A., Gaussier, P., Lepretre, S., and Banquet, J. P. (1998). Planification versus sensory-motor conditioning: what are the issues? In The Society For Adaptive Behavior SAB'98, pp. 129-138
98. Rolls, E. (1999). Spatial view cells and the representation of place in the primate hippocampus. Hippocampus 9, 467-480
99. Rolls, E. T., and O'Mara, S. M. (1995). View-responsive neurons in the primate hippocampal complex. Hippocampus 5, 409-424
100. Samsonovich, A., and McNaughton, B. (1997). Path integration and cognitive mapping in a continuous attractor neural network model. J. Neurosci. 17(15), 5900-5920
101. Schmajuk, N. A. (1996). The psychology of robots. Proc. IEEE 84(10), 1553-1561
102. Schmajuk, N. A., and Thieme, A. D. (1992). Purposive behavior and cognitive mapping: a neural network model. Biol. Cybernetic 67, 165-174
103. Schölkopf, B., and Mallot, H. A. (1995). View-based cognitive mapping and path-finding Adapt. Behav. 3, 311-348
104. Schöner, G., Dose, M., and Engels, C. (1995). Dynamics of behavior: theory and applications for autonomous robot architectures. Rob. Auton. Syst. 16(2-4), 213-245
105. Sharp, P. (1999). Complementary roles for hippocampal versus subicular/enthorinal place cells in coding place, context, and events. Hippocampus 4, 432-443
106. Sharp, P., and Green, C. (1994). Spatial correlates of firing patterns of single cells in the subiculum of the freely moving rat. J. Neurosci. 14(4), 2339-2356
107. Sharp, P. E. (1991). Computer simulation of hippocampal place cells. Psychobiology 9(2), 103-115
108. Sharp, P. E., Blair, H. T., and Brown, M. (1996). Neural network modeling of the hippocampal formation spatial signals and their possible role in navigation: a modular approach. Hippocampus 6, 735-748
109. Skaggs, W. E., Knierim, J. J., Kudrimoti, H. S., and McNaughton, B. L. (1995). A model of the neural basis of the rat's sense of direction. In Advances in Neural Information Processing Systems, G. Tesauro, D. Touretzky, and T. Leen, eds. (Cambridge, MA, The MIT Press) Vol. 7, pp. 173-180
110. Taha, S. A., Nicola, S. M., and Fields, H. L. (2007). Cue-evoked encoding of movement planning and execution in the rat nucleus accumbens. J. Physiol., jphysiol 2007.140236
111. Taube, J. S. (1995). Place cells recorded in the anterior thalamic nuclei of freely moving rats. Hippocampus 15, 70-86
112. Thompson, L. T., and Best, P. J. (1990). Long-term stability of the place-field activity of single units recorded from the dorsal hippocampus of freely behaving rats. Brain Res. 509, 299-308
113. Thrun, S. (1998). Learning metric-topological maps for indoor mobile robot navigation Atif. Intell. 99(1), 21-71
114. Tinbergen, N. (1951). The study of instinct (London, Oxford University Press)
115. Tolman, E. C. (1948). Cognitive maps in rats and men. Psychol. Rev. 55(4), 189-208
116. Trullier, O. (1998). Elaboration Et Traitement Des Repré sentations Spatiales Servant 'A la Navigation Chez le Rat: Enregistrements Electrophysiologiques Et Modèles PhD Thesis, LIP6/AnimatLab, Université Paris 6, France. Spé cialité Sciences Cognitives
117. Trullier, O., and Meyer, J. A. (2000). Animat navigation using a cognitive graph. Biological Cybernetics 83(3), 271-285
118. Trullier, O., Wiener, S. I., Berthoz, A., and Meyer, J. A. (1997). Biologically based artificial navigation systems: review and prospects. Progr. Neurobiol. 51, 483-544
119. Wallace, D., Gorny, B., and Whishaw, I. (2002). Rats can track odors, other rats, and themselves: implications for the study of spatial behavior. Behav. Brain Res. 131, 185-192
120. Whishaw, I., Cassel, J., and Jarrad, L. (1995). Rats with fimbria-fornix lesions display a place response in a swimming pool: a dissociation between getting there and knowing where. J.f Neurosci. 15(8), 5779-5788
121. Wiener, S. I. (1993). Spatial and behavioral correlates of striatal neurons in rats performing a self-initiated navigation task. J. Neurosci. 13, 3802-3817
122. Wiener, S. I., Berthoz, A., and Zugaro, M. B. (2002). Multisensory processing in the elaboration of place and head direction responses by limbic system neurons. Cogn Brain Res. 14, 75-90
123. Wilson, M. A., and McNaughton, B. L. (1993). Plasticity of the hippocampal place cell representation. Science 261, 1055-1058
124. Zipser, D. (1985). A computational model of hippocampal place fields. Behav. Neurosci 99(5), 1006-1018
125. Zipser, D. (1986). Biolgically plausible modelsof place recognition and goal location In Parallel Distributed Processing: Explorations in the Microstructure of Cognition, J. L. McClelland, D. E. Rumelhart, eds. (Cambridge, MA, MIT Press), Vol. 2, pp. 423-470