Where neuroscience and dynamic system theory meet autonomous robotics: A contracting basal ganglia model for action selection

Neural Networks

Volumn 21, Issue 4, 2008, Pages 628-641

  Girard, B ^a   Tabareau, N ^a   Pham, Q C ^a   Berthoz, A ^a   Slotine, J J ^b  

^a CNRS   (France)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Action selection; Autonomous robotics; Basal ganglia; Computational model; Contraction analysis

Indexed keywords

AUTONOMOUS AGENTS; COMPUTATIONAL EFFICIENCY; DYNAMICAL SYSTEMS; PROBLEM SOLVING; ROBOTS; SYSTEMS ANALYSIS;

BASAL GANGLIA; COMPUTATIONAL MODEL; CONTRACTION ANALYSIS; ENERGY SAVING PROPERTIES;

ROBOTICS;

ACCURACY; ARTICLE; BASAL GANGLION; BRAIN REGION; DYNAMICS; ENERGY CONSERVATION; NEUROANATOMY; NEUROSCIENCE; PRIORITY JOURNAL; ROBOTICS; TASK PERFORMANCE; THEORETICAL MODEL;

ALGORITHMS; ANIMALS; ARTIFICIAL INTELLIGENCE; BASAL GANGLIA; DECISION MAKING; HUMANS; MOVEMENT; NEURAL NETWORKS (COMPUTER); NEURAL PATHWAYS; NEUROSCIENCES; NONLINEAR DYNAMICS; ROBOTICS;

EID: 49949152504     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2008.03.009     Document Type: Article

References (53)

1. Alexander G.E., Crutcher M.D., and DeLong M.R. Basal ganglia-thalamocortical circuits: Parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. Progress in Brain Research 85 (1990) 119-146
2. Alexander G.E., DeLong M.R., and Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience 9 (1986) 357-381
3. Bevan M., Booth P., Eaton S., and Bolam J. Selective innervation of neostriatal interneurons by a subclass of neurons in the globus pallidus of rats. Journal of Neuroscience 18 22 (1998) 9438-9452
4. Chevalier G., and Deniau M. Disinhibition as a basic process of striatal functions. Trends in Neurosciences 13 (1990) 277-280
5. Dayan P. Motivated reinforcement learning. In: Leen T., Dietterich T., and Tresp V. (Eds). Neural information processing systems Vol. 13 (2001), The MIT Press, Cambridge, MA
6. Dayan P., and Abbott L. Theoretical neuroscience: Computational and mathematical modeling of neural systems (2001), MIT Press
7. DeLong M., Georgopoulos A., Crutcher M., Mitchell S., Richardson R., and Alexander G. Functional organization of the basal ganglia: Contributions of single-cell recording studies. Ciba Foundation Symposium 107 (1984) 64-82
8. Deniau J.-M., Kitai S., Donoghue J., and Grofova I. Neuronal interactions in the substancia nigra pars reticulata through axon collateral of the projection neurons. Experimental Brain Research 47 (1982) 105-113
9. Dupuis P., and Nagurney A. Dynamical systems and variational inequalities. Annals of Operations Research 44 1 (1993) 7-42
10. Filippov A.F. Differential equations with discontinuous righthand sides (1988), Kluwer Academic Pub
11. Frank M., Santamaria A., O'Reilly R., and Willcutt E. Testing computational models of dopamine and noradrenaline dysfunction in attention deficit/hyperactivity disorder. Neuropsychopharmacology 32 (2007) 1583-1599
12. Gerkey, B., Vaughan, R., & Howard, A. (2003). The player/stage project: Tools for multi-robot and distributed sensor systems. In 11th International conference on advanced robotics (pp. 317-323)
13. Gillies A., and Arbruthnott G. Computational models of the basal ganglia. Movement Disorders 15 5 (2000) 762-770
14. Girard B., Cuzin V., Guillot A., Gurney K.N., and Prescott T.J. A basal ganglia inspired model of action selection evaluated in a robotic survival task. Journal of Integrative Neuroscience 2 2 (2003) 179-200
15. Girard B., Filliat D., Meyer J.-A., Berthoz A., and Guillot A. Integration of navigation and action selection in a computational model of cortico-basal ganglia-thalamo-cortical loops. Adaptive Behavior 13 2 (2005) 115-130
16. Girard B., Tabareau N., Berthoz A., and Slotine J.-J. Selective amplification using a contracting model of the basal ganglia. In: Alexandre F., Boniface Y., Bougrain L., Girau B., and Rougier N. (Eds). NeuroComp (2006) 30-33
17. Girard B., Tabareau N., Slotine J.-J., and Berthoz A. Contracting model of the basal ganglia. In: Bryson J., Prescott T., and Seth A. (Eds). Modelling natural action selection: Proceedings of an international workshop (2005), AISB Press, Brighton, UK 69-76
18. Gurney K., Humphries M., Wood R., Prescott T., and Redgrave P. Testing computational hypotheses of brain systems function: A case study with the basal ganglia. Network: Computation in Neural Systems 15 (2004) 263-290
19. Gurney K., Prescott T., Wickens J., and Redgrave P. Computational models of the basal ganglia: From membranes to robots. Trends in Neurosciences 27 (2004) 453-459
20. Gurney K., Prescott T.J., and Redgrave P. A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biological Cybernetics 84 (2001) 401-410
21. Gurney K., Prescott T.J., and Redgrave P. A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour. Biological Cybernetics 84 (2001) 411-423
22. Horn R., and Johnson C. Matrix analysis (1985), Cambridge University Press
23. Houk J.C., Adams J.L., and Barto A.G. A model of how the basal ganglia generate and use neural signals that predict reinforcement. In: Houk J.C., Davis J.L., and Beiser D.G. (Eds). Models of information processing in the basal ganglia (1995), The MIT Press, Cambridge, MA 249-271
24. Humphries M., Gurney K., and Prescott T. Is there an integrative center in the vertebrate brain-stem? A robotic evaluation of a model of the reticular formation viewed as an action selection device. Adaptive Behavior 13 2 (2005) 97-113
25. Ioannou P., and Sun J. Robust adaptive control (1996), Prentice Hall, Inc, Upper Saddle River, NJ, USA
26. Joel D., Niv Y., and Ruppin E. Actor-critic models of the basal ganglia: New anatomical and computational perspectives. Neural Networks 15 4-6 (2002)
27. Juraska J., Wilson C., and Groves P. The substancia nigra of the rat: A golgi study. Journal of Comparative Neurology 172 (1977) 585-600
28. Khamassi M., Girard B., Berthoz A., and Guillot A. Comparing three critic models of reinforcement learning in the basal ganglia connected to a detailed actor part in a s-r task. In: Groen F., Amato N., Bonarini A., Yoshida E., and Krse B. (Eds). Proceedings of the eighth international conference on intelligent autonomous systems. IAS8 (2004), IOS Press, Amsterdam, The Netherlands 430-437
29. Khamassi M., Lachèze L., Girard B., Berthoz A., and Guillot A. Actor-critic models of reinforcement learning in the basal ganglia: From natural to artificial rats. Adaptive Behavior 13 2 (2005) 131-148
30. In: Kimura A., and Graybiel A. (Eds). Functions of the cortico-basal ganglia loop (1995), Springer, Tokyo, New York
31. Kita H., Tokuno H., and Nambu A. Monkey globus pallidus external segment neurons projecting to the neostriatum. Neuroreport 10 7 (1999) 1476-1472
32. Konidaris G., and Barto A. An adaptive robot motivational system. In: Nolfi S., Baldassarre G., Calabretta R., Hallam J., Marocco D., Meyer J.-A., Miglino O., and Parisi D. (Eds). From animals to animats 9: Proceedings of the 9th international conference on the simulation of adaptive behavior. LNAI Vol. 4095 (2006), Springer, Berlin, Germany 346-356
33. Krotopov J., and Etlinger S. Selection of actions in the basal ganglia thalamocortical circuits: Review and model. International Journal of Psychophysiology 31 (1999) 197-217
34. Lohmiller W., and Slotine J. Contraction analysis for nonlinear systems. Automatica 34 6 (1998) 683-696
35. Lohmiller W., and Slotine J. Nonlinear process control using contraction analysis. American Institute of Chemical Engineers Journal 46 3 (2000) 588-596
36. Middleton F.A., and Strick P.L. Anatomical evidence for cerebellar and basal ganglia involvement in higher cognitive function. Science 266 (1994) 458-461
37. Mink J.W. The basal ganglia: Focused selection and inhibition of competing motor programs. Progress in Neurobiology 50 4 (1996) 381-425
38. Montes-Gonzalez F., Prescott T.J., Gurney K.N., Humphries M., and Redgrave P. An embodied model of action selection mechanisms in the vertebrate brain. In: Meyer J.-A., Berthoz A., Floreano D., Roitblat H., and Wilson S.W. (Eds). From animals to animats 6 Vol. 1 (2000), The MIT Press, Cambridge, MA 157-166
39. Parent A., Sato F., Wu Y., Gauthier J., Lévesque M., and Parent M. Organization of the basal ganglia: The importance of the axonal collateralization. Trends in Neuroscience 23 10 (2000) S20-S27
40. Park M., Falls W., and Kitai S. An intracellular HRP study of rat globus pallidus. I. responses and light microscopic analysis. Journal of Comparative Neurology 211 (1982) 284-294
41. Pirjanian, P. (1999). Behavior coordination mechanisms - state-of-the-art. Technical report IRIS-99-375. Institute of Robotics and Intelligent Systems, School of Engineering, University of Southern California
42. Prescott T.J., Montes-Gonzalez F., Gurney K., Humphries M.D., and Redgrave P. A robot model of the basal ganglia: Behavior and intrinsic processing. Neural Networks 19 (2006) 31-61
43. Redgrave P., Prescott T.J., and Gurney K. The basal ganglia: A vertebrate solution to the selection problem?. Neuroscience 89 4 (1999) 1009-1023
44. Sato F., Lavallee P., Lévesque M., and Parent A. Single-axon tracing study of neurons of the external segment of the globus pallidus in primates. Journal of Comparative Neurology 417 (2000) 17-31
45. Slotine J., and Coetsee J. Adaptive sliding controller synthesis for nonlinear systems. International Journal of Control 43 4 (1986) 1631-1651
46. Slotine J.J.E., and Lohmiller W. Modularity, evolution, and the binding problem: A view from stability theory. Neural networks 14 2 (2001) 137-145
47. Staines W., Atmadja S., and Fibiger H. Demonstration of a pallidostriatal pathway by retrograde transport of HRP-labelled lectin. Brain Research 206 (1981) 446-450
48. Tabareau, N., & Slotine, J. (2006). Notes on contraction theory. Arxiv preprint nlin.AO/0601011
49. Tepper J., and Bolam J. Functional density and specificity of neostrital interneurons. Current Opinion in Neurobiology 14 (2004) 685-692
50. Tepper J., Koós T., and Wilson C. Gabaergic microcircuits in the neostriatum. Trends in Neuroscience 11 (2004) 662-669
51. Tyrrell T. The use of hierarchies for action selection. Adaptive Behavior 1 4 (1993) 387-420
52. Wu Y., Richard S., and Parent A. The organization of the striatal output system: A single-cell juxtacellular labeling study in the rat. Neuroscience Research 38 (2000) 49-62
53. Zhang D., and Nagurney A. On the stability of projected dynamical systems. Journal of Optimization Theory and Applications 85 1 (1995) 97-124