A biologically inspired meta-control navigation system for the Psikharpax rat robot

Bioinspiration and Biomimetics

Volumn 7, Issue 2, 2012, Pages

  Caluwaerts, K ^a,b,c   Staffa, M ^a,b,d   Nguyen, S ^a,b,e   Grand, C ^a,b   Dolle L ^a,b   Favre Felix A ^a,b   Girard, B ^a,b   Khamassi, M ^a,b  

^a UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

^b CNRS   (France)

^c GHENT UNIVERSITY   (Belgium)

^d UNIVERSITY OF NAPLES FEDERICO II   (Italy)

^e Brain Vision Systems   (France)

Author keywords

[No Author keywords available]

Indexed keywords

RATTUS;

ANIMAL; ARTICLE; BIOLOGICAL MODEL; BIOMIMETICS; COMPUTER SIMULATION; EQUIPMENT; EQUIPMENT DESIGN; INSTRUMENTATION; LOCOMOTION; PHYSIOLOGY; RAT; ROBOTICS;

ANIMALS; BIOMIMETICS; COMPUTER SIMULATION; EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; LOCOMOTION; MODELS, BIOLOGICAL; RATS; ROBOTICS;

EID: 84861409541     PISSN: 17483182     EISSN: 17483190     Source Type: Journal    
DOI: 10.1088/1748-3182/7/2/025009     Document Type: Article

References (92)

1. Meyer J-A, Guillot A, Girard B, Khamassi M, Pirim P and Berthoz A 2005 The Psikharpax project: towards building an artificial rat Robot. Auton. Syst. 50 21123 (Pubitemid 40266176)
2. NGuyen S, Pirim P and Meyer J-A 2010 Tactile texture discrimination in the robot-rat Psikharpax BIOSIGNALS 2010: 3rd Int. Conf. on Bio-Inspired Systems and Signal Processing (Valencia, Spain,) pp 7481
3. Bernard M, Nguyen S, Pirim P, Gas B and Meyer J-A 2010 Phonotaxis behavior in the artificial rat Psikharpax IRIS2010: Int. Symp. on Robotics and Intelligent Sensors (Nagoya, Japan,) pp 11822
4. NGuyen S 2010 Mise au point du système vibrissal du robot-rat Psikharpax et contribution à la fusion de ses capacités visuelle, auditive et tactile PhD Thesis Université Pierre et Marie Curie
5. NGuyen S, Pirim P, Meyer J-A and Girard B 2010 An integrated neuromimetic model of the saccadic eye movements for the Psikharpax robot SAB '10: Proc. 11th Int. Conf. on Simulation of Adaptive Behavior: From Animals to Animats (Paris, France, 2528 August 2010) ed S Doncieux (Berlin: Springer) pp 18898
6. Trullier O, Wiener S, Berthoz A and Meyer J-A 1997 Biologically-based artificial navigation systems: review and prospects Prog. Neurobiol. 51 483544 (Pubitemid 27181900)
7. Redish A D 1999 Beyond the Cognitive Map: From Place Cells to Episodic Memory (Cambridge, MA: MIT Press)
8. Khamassi M 2007 Complementary roles of the rat prefrontal cortex and striatum in reward-based learning and shifting navigation strategies PhD Thesis Université Pierre et Marie Curie
9. Arleo A and Rondi-Reig L 2007 Multimodal sensory integration and concurrent navigation strategies for spatial cognition in real and artificial organisms J. Integr. Neurosci. 6 32766 (Pubitemid 47570594)
10. Morris R 1984 Developments of a water-maze procedure for studying spatial learning in the rat J. Neurosci. Methods 11 4760 (Pubitemid 14088970)
11. Packard M G, Hirsh R and White N M 1989 Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: evidence for multiple memory systems J. Neurosci. 9 146572 (Pubitemid 19146244)
12. Burgess N 2008 Spatial cognition and the brain Annal. NY Acad. Sci. 1124 7797 (Pubitemid 351506780)
13. Alexander G E, DeLong M R and Strick P L 1986 Parallel organization of functionally segregated circuits linking basal ganglia and cortex Annu. Rev. Neurosci. 9 35781 (Pubitemid 16055790)
14. Mink J W 1996 The basal ganglia: focused selection and inhibition of competing motor programs Prog. Neurobiol. 50 381425 (Pubitemid 27028538)
15. Houk J C, Adams J L and Barto A G 1995 A model of how the basal ganglia generate and use neural signals that predict reinforcement Models of Information Processing in the Basal Ganglia ed J C Houk, J L Davis and D G Beiser (Cambridge, MA: MIT Press) pp 24971
16. Graybiel A M 1998 The basal ganglia and chunking of action repertoires Neurobiol. Learn. Memory 70 11936 (Pubitemid 28455587)
17. Yin H H and Knowlton B J 2006 The role of the basal ganglia in habit formation Nature Rev. Neurosci. 7 46476 (Pubitemid 44012286)
18. Devan B D and White N M 1999 Parallel information processing in the dorsal striatum: relation to hippocampal function J. Neurosci. 19 278998 (Pubitemid 29162425)
19. Packard M G and Knowlton B J 2002 Learning and memory functions of the basal ganglia Annu. Rev. Neurosci. 25 56393 (Pubitemid 34748029)
20. Morris R G M 1981 Spatial localization does not require the presence of local cues Learn. Motiv. 12 23960
21. OKeefe J and Nadel L 1978 The Hippocampus as a Cognitive Map (Oxford: Clarendon)
22. Yin H H and Knowlton B J 2004 Contributions of striatal subregions to place and response learning Learn. Memory 11 45963 (Pubitemid 39079705)
23. Albertin S V, Mulder A B, Tabuchi E, Zugaro M B and Wiener S I 2000 Lesions of the medial shell of the nucleus accumbens impair rats in finding larger rewards, but spare reward-seeking behavior Behav. Brain Res. 117 17383
24. Pfeifer R, Lungarella M and Iida F 2007 Self-organization, embodiment, and biologically inspired robotics Science 318 108893 (Pubitemid 350134861)
25. Arbib M, Metta G and van der Smagt P 2008 Neurorobotics: from vision to action Handbook of Robotics (Berlin: Springer) pp 145380
26. Meyer J-A and Guillot A 2008 Biologically-inspired robots Handbook of Robotics ed B Siciliano and O Khatib (Berlin: Springer) pp 1395422
27. Arleo A and Gerstner W 2000 Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity Biol. Cybern. 83 28799
28. Krichmar J L, Seth A K, Nitz D A, Fleischer J G and Edelman G M 2005 Spatial navigation and causal analysis in a brain-based device modeling corticalhippocampal interactions Neuroinformatics 3 14769 (Pubitemid 41112871)
29. Fleischer J G, Gally J A, Edelman G M and Krichmar J L 2007 Retrospective and prospective responses arising in a modeled hippocampus during maze navigation by a brain-based device Proc. Natl Acad. Sci. 104 355661 (Pubitemid 46364197)
30. Barrera A and Weitzenfeld A 2008 Biologically-inspired robot spatial cognition based on rat neurophysiological studies Auton. Robots 25 14769
31. Giovannangeli C and Gaussier P 2008 Autonomous vision-based navigation: goal-oriented action planning by transient states prediction, cognitive map building, and sensory-motor learning Proc. Int. Conf. on Intelligent Robots and Systems (Berkeley, CA: University of California Press) pp 28197
32. Milford M and Wyeth G 2010 Persistent navigation and mapping using a biologically inspired slam system Int. J. Robot. Res. 29 113153
33. Dollé L, Sheynikhovich D, Girard B, Chavarriaga R and Guillot A 2010 Path planning versus cue responding: a bioinspired model of switching between navigation strategies Biol. Cybern. 103 299317
34. Pearce J M, Roberts A D and Good M 1998 Hippocampal lesions disrupt navigation based on cognitive maps but not heading vectors Nature 396 757 (Pubitemid 28520451)
35. Ragozzino M E, Detrick S and Kesner R P 1999 Involvement of the prelimbic-infralimbic areas of the rodent prefrontal cortex in behavioral flexibility for place and response learning J. Neurosci. 19 458594 (Pubitemid 29241106)
36. Birrell J M and Brown V J 2000 Medial frontal cortex mediates perceptual attentional set shifting in the rat J. Neurosci. 20 43204 (Pubitemid 30365702)
37. Killcross S and Coutureau E 2003 Coordination of actions and habits in the medial prefrontal cortex of rats Cereb. Cortex 13 4008 (Pubitemid 36373685)
38. Ujfalussy B, Ers P, Somogyvári Z and Kiss T 2008 Episodes in space: a modeling study of hippocampal place representation SAB '08: Proc. 10th Int. Conf. on Simulation of Adaptive Behavior: From Animals to Animats (Osaka, Japan, 712 July 2008) ed M Asada (Berlin: Springer) pp 12336
39. Block M T 1969 A note on refraction and image formation of rats eye Vis. Res. 9 70511
40. Parker A J 2007 Binocular depth perception and the cerebral cortex Nature Rev. Neurosci. 8 37991 (Pubitemid 46652468)
41. Dollé L, Sheynikhovich D, Girard B, Ujfalussy B, Chavariagga R and Guillot A 2010 Analyzing interactions between cue-guided and place-based navigation with a computational model of action selection: influence of sensory cues and training SAB '10: Proc. 11th Int. Conf. on Simulation of Adaptive Behavior: From Animals to Animats (Paris, France, 2528 August 2010) ed S Doncieux (Berlin: Springer) pp 33546
42. Pearson K 1901 On lines and planes of closest fit to systems of points in space Phil. Mag. 2 55972
43. Kohonen T, Schroeder M R and Huang T S 2001 Self-Organizing Maps (Secaucus, NJ: Springer)
44. Fritzke B 1995 A growing neural gas network learns topologies Advances in Neural Information Processing Systems 7 (Cambridge, MA: MIT Press) pp 62532
45. Bishop C M 2007 Pattern Recognition and Machine Learning (Berlin: Springer)
46. Schölkopf B, Smola A and Muller K-R 1998 Nonlinear component analysis as a kernel eigenvalue problem Neural Comput. 10 1299319 (Pubitemid 128463674)
47. Kim K I, Franz M O and Schölkopf B 2003 Kernel Hebbian algorithm for iterative kernel principal component analysis Technical Report Max Planck Institute for Biological Cybernetics
48. Hasselmo M E 2005 A model of prefrontal cortical mechanisms for goal-directed behavior J. Cognitive Neurosci. 17 111529 (Pubitemid 41045582)
49. Martinet L-E, Sheynikhovich D, Benchenane K and Arleo A 2011 Spatial learning and action planning in a prefrontal cortical network model PLoS Comput. Biol. 7 e1002045
50. Banquet J P, Gaussier P, Quoy M, Revel A and Burnod Y 2005 A hierarchy of associations in hippocampo-cortical systems: cognitive maps and navigation strategies Neural Comput. 17 133984 (Pubitemid 40653141)
51. Cuperlier N, Quoy M and Gaussier P 2007 Neurobiologically inspired mobile robot navigation and planning Front. Neurorobot. 1 3
52. Floyd R W 1962 Algorithm 97: shortest path Commun. ACM 5 345
53. Sutton R S and Barto A G 1998 Reinforcement Learning: An Introduction (Cambridge, MA: MIT Press)
54. Khamassi M, Martinet L E and Guillot A 2006 Combining self-organizing maps with mixture of experts: application to an actor-critic model of reinforcement learning in the basal ganglia SAB '06: Proc. 9th Int. Conf. on Simulation of Adaptive Behavior: From Animals to Animats (Rome, Italy, 2529 September 2006) ed S Nolfi (Berlin: Springer) pp 394405 (Pubitemid 44553373)
55. Packard M and McGaugh J 1996 Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects the expression of place and response learning Neurobiol. Learn. Memory 65 6572 (Pubitemid 26112655)
56. Save E and Poucet B 2000 Hippocampalparietal cortical interactions in spatial cognition Hippocampus 10 4919
57. Eilam D and Golani I 1989 Home base behavior of rats (rattus norvegicus) exploring a novel environment Behav. Brain Res. 34 199211 (Pubitemid 19214768)
58. Doya K 2000 Complementary roles of basal ganglia and cerebellum in learning and motor control Curr. Opin. Neurobiol. 10 7329 (Pubitemid 32052539)
59. Samejima K, Ueda Y, Doya K and Kimura M 2005 Representation of action-specific reward values in the striatum Science 310 133740 (Pubitemid 41698867)
60. Roesch M R, Calu D J and Schoenbaum G 2007 Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards Nature Neurosci. 10 161524 (Pubitemid 350175882)
61. Matsumoto M, Matsumoto K, Abe H and Tanaka K 2007 Medial prefrontal cell activity signaling prediction errors of action values Nature Neurosci. 10 64756 (Pubitemid 46652446)
62. Chavarriaga R, Strösslin T, Sheynikhovich D and Gerstner W 2005 A computational model of parallel navigation systems in rodents Neuroinformatics 3 22341 (Pubitemid 41114886)
63. Daw N D, ODoherty J P, Dayan P, Seymour B and Dolan R J 2006 Cortical substrates for exploratory decisions in humans Nature 441 8769
64. Watkins C J C H and Dayan P 1992 Technical note: Q-learning Mach. Learn. 8 27992
65. Miller E K and Cohen J D 2001 An integrative theory of prefrontal cortex function Annu. Rev. Neurosci. 24 167202 (Pubitemid 32695227)
66. Peyrache A, Khamassi M, Benchenane K, Wiener S I and Battaglia F P 2009 Replay of rule-learning related neural patterns in the prefrontal cortex during sleep Nature Neurosci. 12 91926
67. Uylings H B, Groenewegen H J and Kolb B 2003 Do rats have a prefrontal cortex? Behav. Brain Res. 146 317 (Pubitemid 37476129)
68. Granon S and Poucet B 2000 Involvement of the rat prefrontal cortex in cognitive functions: a central role for the prelimbic area Psychobiology 28 22937 (Pubitemid 30480478)
69. Baeg E H, Kim Y B, Huh K, Mook-Jung I, Kim H T and Jung M W 2003 Dynamics of population code for working memory in the prefrontal cortex Neuron 40 17788 (Pubitemid 37222472)
70. Hok V, Save E, Lenck-Santini P P and Poucet B 2005 Coding for spatial goals in the prelimbic/infralimbic area of the rat frontal cortex Proc. Natl Acad Sci. USA 102 46027 (Pubitemid 40397158)
71. Mulder A B, Nordquist R E, Orgut O and Pennartz C M 2003 Learning-related changes in response patterns of prefrontal neurons during instrumental conditioning Behav. Brain Res. 146 7788 (Pubitemid 37476135)
72. Kargo W J, Szatmary B and Nitz D A 2007 Adaptation of prefrontal cortical firing patterns and their fidelity to changes in action-reward contingencies J. Neurosci. 27 354859 (Pubitemid 46515139)
73. Daw N D, Niv Y and Dayan P 2005 Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control Nature Neurosci. 8 170411 (Pubitemid 41683198)
74. Ostlund S B and Balleine B W 2005 Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning J. Neurosci. 25 776370 (Pubitemid 41208647)
75. Johnson A and Redish A D 2007 Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point J. Neurosci. 27 1217689 (Pubitemid 350085471)
76. Johnson A, van der Meer M A A and Redish A D 2007 Integrating hippocampus and striatum in decision-making Curr. Opin. Neurobiol. 17 6927
77. van der Meer M A A and Redish A D 2011 Theta phase precession in rat ventral striatum links place and reward information J. Neurosci. 31 284354
78. van der Meer M A A and Redish A D 2011 Ventral striatum: a critical look at models o learning and evaluation Curr. Opin. Neurobiol. 21 38792
79. Salazar R F, White W, Lacroix L, Feldon J and White I M 2004 NMDA lesions in the medial prefrontal cortex impair the ability to inhibit responses during reversal of a simple spatial discrimination Behav. Brain Res. 152 41324 (Pubitemid 38757913)
80. Naneix F, Marchand A R, DiScala G, Pape J R and Coutureau E 2009 A role of the medial prefrontal cortex dopaminergic innervation in instrumental conditioning J. Neurosci. 29 6599606
81. Battaglia F P, Peyrache A, Khamassi M and Wiener S I 2008 Spatial decisions and neuronal activity in hippocampal projection zones in prefrontal cortex and striatum Hippocampal Place Fields: Relevance to Learning and Memory ed S Mizumori (Oxford: Oxford University Press) chapter 18 pp 289311
82. Rich E L and Shapiro M 2009 Rat prefrontal cortical neurons selectively code strategy switches J. Neurosci. 29 720819
83. Bonasso P and Dean T 1997 A retrospective of the AAAI robot competitions AI Mag. 18 1123 (Pubitemid 127684620)
84. Gat E 1998 On three-layer architectures Artificial Intelligence and Mobile Robots: Case Studies of Successful Robot Systems ed D Kortenkamp, R P Bonnasso and R Murphy (Cambridge, MA: MIT Press) pp 195210
85. Kortenkamp D and Simmons R 2008 Robotic systems architectures and programming Handbook of Robotics ed B Siciliano and O Khatib (Berlin: Springer) pp 187206
86. Minguez J, Lamiraux F and Laumond J P 2008 Motion planning and obstacle avoidance Handbook of Robotics ed B Siciliano and O Khatib (Berlin: Springer) pp 82752
87. Dickinson A 1985 Actions and habits: The development of behavioural autonomy Phil. Trans. R. Soc. B 308 6778
88. Keramati M, Dezfouli A and Piray P 2011 Speed/accuracy trade-off between the habitual and goal-directed processes PLoS Comput. Biol. 7 125
89. Comon P 1994 Independent component analysis, a new concept? Signal Process. 36 287314
90. MacQueen J B 1967 Some methods for classification and analysis of multivariate observations Proc. 5th Berkeley Symp. on Mathematical Statistics and Probability ed L M Le Cam and J Neyman (Berkeley, CA: University of California Press) pp 28197
91. Zito T, Wilbert N, Wiskott L and Berkes P 2009 Modular toolkit for data processing (MDP): a python data processing framework Front. Neuroinform. 2 8
92. Mahalanobis P C 1936 On the generalised distance in statistics Proc. National Institute of Science (India,) pp 4955