Biologically inspired SNN for robot control

IEEE Transactions on Cybernetics

Volumn 43, Issue 1, 2013, Pages 115-128

  Nichols, Eric ^a   McDaid, Liam J ^a   Siddique, Nazmul ^a  

^a BT Exact   (United Kingdom)

Author keywords

Dynamic synapses; Self organization; Spiking neural network (SNN); Temporal difference (TD) learning rule

Indexed keywords

BIOLOGICALLY INSPIRED; CONTROL STRUCTURE; DYNAMIC SYNAPSIS; SELF ORGANIZATIONS; SHORT TERM PLASTICITY; SPIKING NEURAL NETWORK(SNN); SYNAPTIC PLASTICITY; TEMPORAL DIFFERENCE LEARNING;

NEURAL NETWORKS;

ROBOTS;

ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; COMPUTER SIMULATION; NERVE CELL PLASTICITY; PROCEDURES; ROBOTICS;

ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONAL PLASTICITY; ROBOTICS;

EID: 84890433115     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2200674     Document Type: Article

References (42)

1. J. J. Hopfield, "Pattern recognition computation using action potential timing for stimulus representation," Nature, vol. 376, no. 6535, pp. 33-36, Jul. 1995.
2. P. C. Bressloff and P. S. Coombes, "Dynamics of strongly coupled spiking neurons," Neural Comput., vol. 12, no. 1, pp. 91-129, Jan. 2000.
3. H. Markram, "The Blue Brain Project," Nat. Rev. Neurosci., vol. 7, pp. 153-160, 2006.
4. A. Tonnelier, H. Belmabrouk, and D. Martinez, "Event-driven simulations of nonlinear integrate-and-fire neurons," Neural Comput., vol. 19, no. 12, pp. 3226-3238, Dec. 2007.
5. J. J. Hopfield, "Neurodynamics of mental exploration," Proc. Nat. Acad. Sci., vol. 107, no. 4, pp. 1648-1653, Jan. 2010.
6. E. A. Di Paolo, "Spike-timing dependent plasticity for evolved robots," Adaptive Behav., vol. 10, no. 3/4, pp. 243-263, Jul. 2002.
7. G. L. Kovacs, "The endocrine brain - Pathophysiological role of neuropeptide-neurotransmitter interactions," J. Int. Fed. Clin. Chem. Lab. Med., vol. 15, no. 3, pp. 1-6, 2004.
8. F. Beck and J. C. Eccles, "Quantum processes in the brain: A scientific basis of consciousness," Cognitive Stud., vol. 5, no. 2, pp. 2.95-2.109, 1998.
9. J. Summhammer and G. Bernroider, "Quantum entanglement in the voltage dependent sodium channel can reproduce the salient features of neuronal action potential initiation," ArXiv E-Prints, Dec. 2007.
10. G. Bernroider and S. Roy, "Quantum entanglement of K ions, multiple channel states and the role of noise in the brain," in Proc. SPIE, 2005, pp. 205-213.
11. H. Hagras, A. Pounds-Cornish, M. Colley, V. Callaghan, and G. Clarke, "Evolving spiking neural network controllers for autonomous robots," in Proc. IEEE Int. Conf. Robot. Autom., Apr. 2004, vol. 5, pp. 4620-4626.
12. F. Alnajjar and K. Murase, "Self-organization of spiking neural network generating autonomous behavior in a real mobile robot," in Int. Conf. Comput. Intell. Modelling, Control, Autom., 2005, vol. 1, pp. 1134-1139.
13. N. Kubota, "A spiking neural network for behavior learning of a mobile robot in a dynamic environment," in Proc. IEEE Int. Conf. Syst., Man, Cybern., Oct. 2004, vol. 6, pp. 5783-5788.
14. X. Wang, Z. G. Hou, M. Tan, Y. Wang, and L. Hu, "The wall-following controller for the mobile robot using spiking neurons," in Proc. Int. Conf. Artif. Intell. Comput. Intell., 2009, vol. 1, pp. 194-199.
15. P. Arena, S. DeFiore, L. Patane, M. Pollino, and C. Ventura, "Insect inspired unsupervised learning for tactic and phobic behavior enhancement in a hybrid robot," in Proc. IJCNN, Jul. 2010, pp. 1-8.
16. M. Mokhtar, D. M. Halliday, and A. M. Tyrrell, "Autonomous navigational controller inspired by the hippocampus," in Proc. IJCNN, Aug. 2007, pp. 813-818.
17. J. J. Wade, L. J. McDaid, J. A. Santos, and H. M. Sayers, "SWAT: A spiking neural network training algorithm for classification problems," IEEE Trans. Neural Netw., vol. 21, no. 11, pp. 1817-1830, Nov. 2010.
18. E. Nichols, L. J. McDaid, and N. H. Siddique, "Case study on a self-organizing spiking neural network for robot navigation," Int. J. Neural Syst., vol. 20, no. 6, pp. 501-508, Dec. 2010.
19. W. Potjans, A. Morrison, and M. Diesmann, "A spiking neural network model of an actor-critic learning agent," Neural Comput., vol. 21, no. 2, pp. 301-339, Feb. 2009.
20. N. Kubota and S. Wakisaka, "Location-dependent emotional memory for natural communication of partner robots," in Proc. IEEEWorkshop Robot. Intell. Inf. Struct. Space, 2009, pp. 107-113.
21. A. L. Hodgkin and A. F. Huxley, "A quantitative description of membrane current and its application to conduction and excitation in nerve," J. Physiol., vol. 117, no. 4, pp. 500-544, Aug. 1952.
22. E. M. Izhikevich, "Simple model of spiking neurons," IEEE Trans. Neural Netw., vol. 14, no. 6, pp. 1569-1572, Nov. 2003.
23. J. Nagumo, S. Arimoto, and S. Yoshizawa, "An active pulse transmission line simulating nerve axon," Proc. IRE, vol. 50, no. 10, pp. 2061-2070, Oct. 1962.
24. V. A. Makarov, F. Panetsos, and O. de Feo, "A method for determining neural connectivity and inferring the underlying network dynamics using extracellular spike recordings," J. Neurosci. Methods, vol. 144, no. 2, pp. 265-279, Jun. 2005.
25. M. V. Tsodyks, K. Pawelzik, and H. Markram, "Neural networks with dynamic synapses," Neural Comput., vol. 10, no. 4, pp. 821-835, May 1998.
26. L. F. Abbott andW. G. Regehr, "Synaptic computation," Nature, vol. 431, no. 7010, pp. 796-803, Oct. 2004.
27. R. A. Nicoll and D. Schmitz, "Synaptic plasticity at hippocampal mossy fibre synapses," Nat. Rev. Neurosci., vol. 6, no. 11, pp. 863-876, Nov. 2005.
28. J. F. Mejias and J. J. Torres, "Improvement of spike coincidence detection with facilitating synapses," Neurocomputing, vol. 70, no. 10-12, pp. 2026-2029, Jun. 2007.
29. H. Markram, Y. Wang, and M. Tsodyks, "Differential signaling via the same axon of neocortical pyramidal neurons," Proc. Nat. Acad. Sci. USA, vol. 95, no. 9, pp. 5323-5328, Apr. 1998.
30. S. Greenfield, The Human Brain: A Guided Tour. London, U.K.: Phoenix, 1998.
31. P. R. Montague, B. King-Casas, and J. D. Cohen, "Imaging valuation models in human choice," Annu. Rev. Neurosci., vol. 29, no. 1, pp. 417-448, 2006.
32. O. Arias-Carrion and E. Poppel, "Dopamine, learning, and rewardseeking behavior," Acta Neurobiol. Experimentalis, vol. 67, no. 4, pp. 481-488, 2007.
33. J. A. Girault and P. Greengard, "The neurobiology of dopamine signaling," Arch. Neurol., vol. 61, no. 5, pp. 641-644, May 2004.
34. D. M. Egelman, C. Person, and P. R. Montague, "A computational role for dopamine delivery in human decision-making," J. Cognit. Neurosci., vol. 10, no. 5, pp. 623-630, Sep. 1998.
35. W. Schultz, "Getting formal with dopamine and reward," Neuron, vol. 36, no. 2, pp. 241-263, Oct. 2002.
36. R. E. Suri and W. E. Schultz, "Temporal difference model reproduces anticipatory neural activity," Neural Comput., vol. 13, no. 4, pp. 841-862, Apr. 2001.
37. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
38. R. E. Suri, "TD models of reward predictive responses in dopamine neurons," Neural Netw., vol. 15, no. 4-6, pp. 523-533, Jun./Jul. 2002.
39. K. Oberauer, "Access to information in working memory: Exploring the focus of attention," J. Exp. Psychol. Learn., Memory, Cognit., vol. 28, no. 3, pp. 411-421, May 2002.
40. M. R. Dimitrijevic, Y. Gerasimenko, and M. M. Pinter, "Evidence for a spinal central pattern generator in humans," Ann. New York Acad. Sci., vol. 860, no. 1, pp. 360-376, Nov. 1998.
41. S. L. Hooper, "Central pattern generators," Current Biol., vol. 10, no. 5, pp. R176-R179, Mar. 2000.
42. S. Cui, X. Su, L. Zhao, Z. Bing, and G. Yang, "Study on ultrasonic obstacle avoidance of mobile robot based on fuzzy controller," in Proc. Int. Conf. Comput. Appl. Syst. Model., 2010, vol. 4, pp. 233-237.