Integration of navigation and action selection functionalities in a computational model of cortico-basal-ganglia-thalamo-cortical loops

Adaptive Behavior

Volumn 13, Issue 2, 2005, Pages 115-130

  Girard, Benoît ^a,b,d   Filliat, David ^c   Meyer, Jean Arcady ^a,d   Berthoz, Alain ^b,d,e   Guillot, Agnès ^a,f  

^a UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

^b l'alimentation et l'Environnement   (France)

^c DGA/Centre Technique d'Arcueil   (France)

^d CNRS   (France)

^e Laboratoire de Physiologie de la Perception et de l'Action (LPPA)   (France)

^f UNIVERSITÉ PARIS OUEST NANTERRE LA DÉFENSE   (France)

Author keywords

Action selection; Basal ganglia; Computational neuroscience; Navigation

Indexed keywords

VERTEBRATA;

EID: 21344465859     PISSN: 10597123     EISSN: None     Source Type: Journal    
DOI: 10.1177/105971230501300204     Document Type: Article

References (41)

1. Alexander, G. E., DeLong, M. R., & Strick., P. L. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience, 9, 357-381.
2. Arleo, A., & Gerstner, W. (2000). Spatial cognition and neuromimetic navigation: A model of hippocampal place cell activity. Biological Cybernetics, 83, 287-299.
3. Ashby, W. R. (1952). Design for a brain. London: Chapman and Hall.
4. Chevalier, G., & Deniau, M. (1990). Disinhibition as a basic process of striatal functions. Trends in Neurosciences, 13, 277-280.
5. Dayan, P. & Balleine, B.W. (2000). Reward, motivation and reinforcement learning. Neuron, 36, 285-298.
6. Dennett, D. C. (1978). Why not a whole iguana? Behavioral and Brain Sciences, 1, 103-104.
7. Filliat, D. (2001). Cartographie et estimation globale de la position pour un robot mobile autonome. Ph.D. thesis, LIP6/AnimatLab, Université Paris 6, France.
8. Filliat, D., Girard, B., Guillot, A., Khamassi, M., Lachèze, L., & Meyer, J.-A. (2004). State of the artificial rat psikharpax. In S. Schaal, A. Ijspeert, A. Billard, S. Vijayakumar, J. Hallam, & J.-A. Meyer (Eds.), From animals to animats 8 (pp. 2-12). Cambridge, MA: MIT Press.
9. Filliat, D. & Meyer, J.-A. (2003). Map-based navigation in mobile robots. I. A review of localization strategies. Journal of Cognitive Systems Research, 4(4), 243-282.
10. Gaussier, P., Leprêtre, S., Quoy, M., Revel, A., Joulain, C., & Banquet, J.-P. (2000). Experiments and models about cognitive map learning for motivated navigation. In J. Demiris & A. Birk (Eds.), Interdisciplinary approaches to robot learning, volume 24 of Robotics and intelligent systems (pp. 53-94). Singapore: World Scientific.
11. Girard, B., Cuzin, V., Guillot, A., Gurney, K. N., & Prescott, T. J. (2003). A basal ganglia inspired model of action selection evaluated in a robotic survival task. Journal of Integrative Neuroscience, 2(2), 179-200.
12. Girard, B., Filliat, D., Meyer, J.-A., Berthoz, A., & Guillot, A. (2004). An integration of two control architectures of action selection and navigation inspired by neural circuits in the vertebrate: the basal ganglia. In H. Bowman and C. Labiouse (Eds.), Connectionist models of cognition and perception II, volume 15 of Progress in neural processing (pp. 72-81). Singapore: World Scientific.
13. Guazzelli, A., Corbacho, F. J., Bota, M., & Arbib, M. A. (1998). Affordances, motivations and the world graph theory. Adaptive Behavior Special issue on biologically inspired models of spatial navigation, 6(3/4), 435-471.
14. Gurney, K., Prescott, T. J., & Redgrave, P. (2001a). A computational model of action selection in the basal ganglia: I. A new functional anatomy. Biological Cybernetics, 84, 401-410.
15. Gurney, K., Prescott, T. J., & Redgrave, P. (2001b). A computational model of action selection in the basal ganglia: II. Analysis and simulation of behaviour. Biological Cybernetics, 84, 411-423.
16. Humphries, M. D., Gurney, K., & Prescott, T. J. (2005). Is there an integrative center in the vertebrate brain-stem? A robotic evaluation of a model of the reticular formation viewed as an action selection device. Adaptive Behavior, this issue.
17. Joel, D. & Weiner, I. (1994). The organization of the basal ganglia-thalamocortical circuits: Open interconnected rather than closed segregated. Neuroscience, 63, 363-379.
18. Joel, D. & Weiner, I. (2000). The connections of the dopaminergic system with the striatum in rats and primates: An analysis with respect to the functional and compartmental organization of the striatum. Neuroscience, 96(3), 452-474.
19. Kelley, A. E. (1999). Neural integrative activities of nucleus accumbens subregions in relation to learning and motivation. Psychobiology, 27, 198-213.
20. Khamassi, M., Girard, B., Berthoz, A., & Guillot, A. (2004). Comparing three critic models of reinforcement learning in the basal ganglia connected to a detailed actor part in a S-R task. In F. Groen, N. Amato, A. Bonarini, E. Yoshida, & B. Kröse (Eds.), Proceedings of the Eighth International Conference on Intelligent Autonomous Systems (IAS8) (430-437). Amsterdam: IOS Press.
21. Kolomiets, B. P., Deniau, J. M., Glowinski, J., & Thierry, A.-M. (2003). Basal ganglia and processing of cortical information: functional interactions between trans-striatal and trans-subthalamic circuits in the substantia nigra pars reticulata. Neuroscience, 117(4), 931-938.
22. Kolomiets, B. P., Deniau, J.-M., Mailly, P., Glowinski, A. M. J., & Thierry, A.-M. (2001). Segregation and convergence of information flow through the cortico-subthalamic pathways. Journal of Neuroscience, 21(15), 5764-5772.
23. Maes, P. (1991). A bottom-up architecture for behavior selection in an artificial creature. In J.-A. Meyer, & S. Wilson (Eds.), From animals to animats 1 (pp. 478-485). Cambridge, MA: MIT Press.
24. Mailly, P., Charpier, S., Menetrey, A., & Deniau, J.-M. (2003). Three-dimensional organization of the recurrent axon collateral network of the substantia nigra pars reticulata neurons in the rat. Journal of Neuroscience, 23(12), 5247-5257.
25. Martin, P. D., & Ono, T. (2000). Effects of reward anticipation, reward presentation, and spatial parameters on the firing of single neurons recorded in the subiculum and nucleus accumbens of freely moving rats. Behavioural Brain Research, 116(1), 23-28.
26. Maurice, N., Deniau, J.-M., Glowinski, J., & Thierry, A.-M. (1999). Relationships between the prefrontal cortex and the basal ganglia in the rat: Physiology of the corticonigral circuits. Journal of Neuroscience, 19(11), 4674-4681.
27. Maurice, N., Deniau, J.-M., Menetrey, A., Glowinski, J., & Thierry, A.-M. (1997). Position of the ventral pallidum in the rat prefrontal cortex-basal ganglia circuit. Neuroscience, 80(2), 523-534.
28. Meyer, J.-A., & Filliat, D. (2003). Map-based navigation in mobile robots. II. A review of map-learning and pathplanning strategies. Journal of Cognitive Systems Research, 4(4), 283-317.
29. Montes-Gonzalez, F., Prescott, T. J., Gurney, K. N., Humphries, M., & Redgrave, P. (2000). An embodied model of action selection mechanisms in the vertebrate brain. In J.-A. Meyer, A. Berthoz, D. Floreano, H. Roitblat, & S.W. Wilson (Eds.), From animals to animats 6: Vol. I (pp. 157-166). Cambridge, MA: The MIT Press.
30. Mulder, A. B., Tabuchi, E., and Wiener, S. I. (2004). Neurons in hippocampal afferent zones of rat striatum parse routes into multi-pace segments during maze navigation. European Journal of Neuroscience, 19(7), 1923-1932.
31. O'Keefe, J., & Nadel, L. (1978). The Hippocampus as a cognitive map. Oxford: Clarendon.
32. Parent, A., & Hazrati, L.-N. (1995). Functional anatomy of the basal ganglia. II. The place of subthalamic nucleus and external pallidum in basal ganglia circuitry. Brain Research Reviews, 20, 128-154.
33. Prescott, T. J., Redgrave, P., & Gurney, K. N. (1999). Layered control architectures in robot and vertebrates. Adaptive Behavior, 7(1), 99-127.
34. Quoy, M., Laroque, P., & Gaussier, P. (2002). Learning and motivational couplings promote smarter behaviors of an animat in an unknown world. Robotics and Autonomous Systems, 38, 149-156.
35. Redgrave, P., Prescott, T. J., & Gurney, K. (1999). The basal ganglia: A vertebrate solution to the selection problem? Neuroscience, 89(4), 1009-1023.
36. Rosenblatt, J. K., & Payton, D. (1989). A fine-grained alternative to the subsumption architecture for mobile robot control. In Proceedings of the IEEE/INNS International Joint Conference on Neural Networks (Vol. 2 pp. 317-324). Washington, DC: IEEE.
37. Seamans, J. K., & Phillips, A. G. (1994). Selective memory impairments produced by transient lidocaine-induced lesions of the nucleus accumbens in rats. Behavioral Neuroscience, 108, 456-468.
38. Seth, A. K. (1998). Evolving action selection and selective attention without actions, attention, or selection. In R. Pfeifer, B. Blumberg, J.-A. Meyer, & S. W. Wilson (Eds.), From animals to animats 5 (pp. 139-147). Cambridge, MA: The MIT Press.
39. Strösslin, T. (2004). A connectionist model of spatial learning in the rat. Ph.D. thesis, EPFL-Swiss Federal Institute of Technology.
40. Thierry, A.-M., Gioanni, Y., Dégénetais, E., & Glowinski, J. (2000). Hippocampo-prefrontal cortex pathway: Anatomical and electrophysiological characteristics. Hippocampus, 10, 411-419.
41. Zahm, D. S., & Brog, J. S. (1992). Commentary: On the significance of the core-shell boundary in the rat nucleus accumbens. Neuroscience, 50, 751-767.