Temporal sequence detection with spiking neurons: Towards recognizing robot language instructions

Connection Science

Volumn 18, Issue 1, 2006, Pages 1-22

  Panchev, Christo ^a   Wermter, Stefan ^a  

^a UNIVERSITY OF SUNDERLAND   (United Kingdom)

Author keywords

Active dendrites; Dynamic synapses; Intelligent robotics; Natural language; Spiking neurons; Synaptic plasticity; Temporal sequence detection

Indexed keywords

DYNAMIC SYNAPSIS; INTELLIGENT ROBOTICS; NATURAL LANGUAGES; SPIKING NEURON; SYNAPTIC PLASTICITY; TEMPORAL SEQUENCES;

ELECTROPHYSIOLOGY; LEARNING ALGORITHMS; NEURAL NETWORKS; ROBOTICS; ROBOTS; SIGNAL DETECTION;

NEURONS;

EID: 32944461488     PISSN: 09540091     EISSN: 13600494     Source Type: Journal    
DOI: 10.1080/09540090500132385     Document Type: Review

References (66)

1. L. Abbott, J. Varela, K. Sen and S. Nelson, "Synaptic depression and cortical gain function", Science, 275, pp. 220-224, 1997.
2. I. Aradi and W. Holmes, "Active dendrites regulate spatio-temporal synaptic integration in hippocampal dentate granule cells", Neurocomputing, 26-27, pp. 45-51, 1999.
3. J.M. Beggs, J.R. Moyer, J.P. McGann and T.H. Brown "Prolonged synaptic integration in perirhinal cortical neurons", Journal of Neurophysiology, 83, pp. 3294-3298, 2000.
4. G. Bi and M. Poo, "Synaptic modifications in cultured hippocampal neurons: dependence on spike-timing, synaptic strength and postsynaptic cell type", Journal of Neumscience, 18, pp. 10464-10472, 1998.
5. G. Bi and M. Poo, "Synaptic modification by correlated activity: Hebb's postulate revised", Annual Reviews in Neuronscience, 24, pp. 139-166, 2001.
6. G.-Q. Bi, "Spatio-temporal specificity of synaptic plasticity: cellular rules and mechanisms", Biological Cybernetics, 87, pp. 319-332, 2002.
7. G. Bugmann, S. Lauria, T. Kyriacou, E. Klein, J. Bos and K. Coventry, "Using verbal instructions for route learning: Instruction analysis". Proc. TIMR 2001 UMC-01-4-1, 2001, Department of Computer Science, Manchester University.
8. G. Buzsáki and A. Kandel, "Somadendritic backpropagation of action potentials in cortical pyramidal cells of awake rat", Journal of Neumphysiology, 79, pp. 1587-1591, 1998.
9. C. Crangle, "Conversational interfaces to robots", Robotica, 15, pp. 117-127, 1997.
10. D. Debanne, B.H. Ghwiler and S.M. Thompson, "Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures", Journal of Physiology, 507.1, pp. 237-247, 1998.
11. A. Egorov, B. Hamam, E. Fransen, M. Hasselmo and A. Alonso, "Graded peristent activity in ethorhinal cortex neurons", Nature, 420, 2002.
12. D.E. Feldman, "Timing-based Itp and ltd at vertical inputs to layer ii/iii pyramidal cells in rat barrel cortex", Neuron, 27, pp. 45-56, 2000.
13. R. Froemke and Y. Dan, "Timing-based ltp and ltd at vertical inputs to layer ii/iii pyramidal cells in rat barrel cortex", Nature, 416, pp. 433-438, 2002.
14. M. Häusser and B. Clark, "Tonic synaptic inhibition modulates neuronal output pattern and spatiotemporal synaptic integration", Neuron, 19, pp. 665-678, 1997.
15. A.L. Hodgkin and A.F. Huxley, "A quantitative description of membrane current and its application to conduction and excitation in nerve", Journal of Physiology, 117, pp. 500-544, 1952.
16. J. Hopfield and C. Brody, "What is a moment? 'cortical' sensory integration over a brief interval", Proceedings of National Academy of Sciences, 97, pp. 13919-13924, 2000.
17. D. Horn, N. Levy and E. Ruppin, "The importance of nonlinear dendritic processing in multimodular memory networks", Neurocomputing, 26-27, pp. 389-394, 1999.
18. D. Johnston, D. Hoffman, C. Colbert and J. Magee, "Regulation of back-propagating action potentials in hippocampal neurons", Current Opinion, in Neurobiology, 9, pp. 288-292, 1999.
19. J. Kaas and T. Hackett, "Subdivisions of the auditory cortex and processing streams in primates", Proceedings of National Academy of Sciences, 97, pp. 11793-11799, 2000.
20. R. Kempter, W. Gerstner and J.L. van Hemmen, "Intrinsic stabilization of output rates by spike-based hebbian learning", Neural Computation, 13, pp. 2709-2741, 2001.
21. A. Kepecs, M. van Rossum, S. Song and J. Tegner, "Spike-timing- dependent palsticity : common themes and divergent vistas", Biological Cybernetics, 87, pp. 446-458, 2002.
22. W.M. Kistler, W. Gerstner and J.L. van Hemmen, "Reduction of the hodgkin-huxley equations to a single-variable threshold model", Neural Computation, 9, pp. 1015-1045, 1997.
23. T. Kyriacou, G. Bugmann and S. Lauria, "Vision-based urban navigation procedures for verbally instructed robots", In Proceedings of the 2002 IEEE/RSJ Intl. Conference on Intelligent Robots and Systems, pp. 1326-1331, 2002.
24. M. Larkum, J. Zhu and B. Sakmann, "A new cellular mechanism for coupling input arriving at different cortical layers", Nature, 398, pp. 338-341, 1999.
25. S. Lauria, G. Bugmann, T. Kyriacou and E. Klein, "Mobile robot programming using natural language", Robotics and Autonomous Systems, 38, pp. 171-181, 2002.
26. K. Lee, H. Hon and R. Reddy, "An overview of the SPHINX speech recognition system", IEEE Transactions on Acoustics, Speech, and Signal Processing, 38, pp. 35-4-5, 1990.
27. J. Liaw and T. Berger, "Dynamic synapse: A new concept of neural representation and computation", Hippocampus, 6, pp. 591-600, 1996.
28. W. Maass and C.M. Bishop, eds, Pulsed Neural Networks, MIT-Press, 1999.
29. J. Magee and D. Johnston, "A synaptically controlled, associative signal for hebbian plasticity in hippocampal neurons", Science, 275, pp. 209-213, 1997.
30. H. Markram, J. Lubke, M. Frotscher and B. Sakmann, "Regulation of synaptic efficacy by coincidence of postsynaptic aps and epsps", Science, 275, pp. 213-215, 1997.
31. B.W. Mel, D.L. Ruderman and K.A. Archie, "Translation-invariant orientation tuning in visual 'complex' cells could derive from intradendritic computations", The Journal of Neuroscience, 18, pp. 4325-4334, 1998.
32. T. Natschläger, W. Maass and A.M. Zador, "Efficient temporal processing with biologically realistic dynamic synapses", Network: Computation in Neural Systems, 12, pp. 75-87, 2001.
33. T. Natschläger and B. Ruf, "Pattern analysis with spiking neurons using delay coding", Neurocomputing, 26-27, pp. 463-469, 1999.
34. M. Nishiyama, K. Hong, K. Mikoshiba, M.-M. Poo and K. Kato, "Calcium release from internal stores regulates polarity and input specificity of synaptic modification", Nature, 408, pp. 584-588, 2000.
35. C. Panchev and S. Wermter, "Hebbian spike-timing dependent self-organization in pulsed neural networks", in Proceedings of World Congress on Neuroinformatics, 2001, pp. 378-385, Austria.
36. C. Panchev, S. Wermter and H. Chen, "Spike-timing dependent competitive learning of integrate-and-fire neurons with active dendrites", in Lecture Notes in Computer Science. Proceedings of the International Conference on Artificial Neural Networks, Madrid, Spain. Springer, 2002, pp. 896-901.
37. L. Pantic, J.J. Torres, H.J. Kappen and S.C. Gielen, "Associative memory with dynamic synapses", Neural Computation, 2002.
38. D. Paré, E. Shink, H. Gaudreau, A. Destexhe and E. Lang, "Impact of spontaneous synaptic activity on the resting properties of cat neocortial pyramidal neurons in vivo", Journal of Neurophysiology, 79, pp. 1450-1460, 1998.
39. P. Poirazi and B. Mel, "Impact of active dendrites and structural plasticity on the memory capacity of neural tissue", Neuron, 29, pp. 779-796, 2001.
40. F. Pulvermüller, "Words in the brain's language", Behavioral and Brain Sciences, 22, pp. 253-336, 1999.
41. F. Pulvermüller, "A brain perspective on language mechanisms: from discrete neuronal ensembles to serial order", Progress in Neurobiology, 67, pp. 85-111, 2002.
42. W. Rall, "Cable theory for dendritic neurons", in Methods in Neuronal Modeling, C. Koch and I. Segev, Eds, Cambridge, Massachusetts: MIT Press, 1986.
43. R.P.N. Rao and T.J. Sejnowski, "Spike-timing-dependent hebbian plasticity as temporal difference learning", Neural Computation, 13, pp. 2221-2237, 2001.
44. P. Roberts and C. Bell, "Spike timing dependent synaptic plasticity in biological systems", Biological Cybernetics, 87, pp. 392-403, 2002.
45. E.D. Schutter and J.M. Bower, "An active membrane model of the cerebellar purkinje cell. I. Simulation of current clamps in slice", Journal of Neurophysiology, 71, pp. 375-400, 1994a.
46. E.D. Schutter and J.M. Bower, "An active membrane model of the cerebellar purkinje cell: II. Simulation of synaptic responses", Journal of Neurophysiology, 71, pp. 401-419, 1994b.
47. E.D. Schutter and J.M. Bower, "Simulated responses of cerebellar purkinje cell are independent of the dendritic location of granule cell synaptic inputs", in Proceedings of National Academy of Science, USA, vol. 91, pp. 4736-4740, 1994c.
48. I. Segev, J.W. Fleshman and R.E. Burke, "Compartmental models of complex neurons", in Methods in Neuronal Modeling, C. Koch and I. Segev, Eds, chapter 3, Massachusetts, Cambridge: MIT Press, 1989, pp. 63-96.
49. W. Senn, H. Markram and M. Tsodyks, "An algorithm for modifying neurotransmitter release probability based on pre- and post-synaptic spike timing", Neural Computation, 13, pp. 35-67, 2001.
50. M.N. Shadlen and W.T. Newsome, "Noise, neural codes and cortical organization", Current Opinion in Neurobiology, 4. pp. 569-79, 1994.
51. N. Sharkey and J. Heemskerk, 'The neural mind and the robot", in Neural Network Perspectives on Cognition and Adaptive Robotics, A. Browne, Ed., London: IOP Press, 1997, pp. 169-194.
52. N. Sharkey and T. Ziemke, "Life, mind and robots: the ins and outs of embodiment", in Hybrid Neural Systems, S. Wermter and R. Sun, Ed., Heidelberg: Springer Verlag, 2000, pp. 313-332.
53. N. Sharkey and T. Ziemke, "Mechanistic vs. phenomenal embodiment: Can robot embodiment lead to strong AI", Cognitive Systems Research, 2, pp. 251-262, 2001.
54. M. Slaney and R. Lyon, "On the importance of time - a temporal representation of sound", in Visual Representations of Speech. Signals, M. Cooke, S. Beet and M. Crawford, Eds, John Wiley & Sons, 1993, pp. 95-116.
55. W.R. Softky and C. Koch, "The highly irregular firing of cortical cells is inconsistent with temporal integration of random epsps", Journal of Neumscience, 13, pp. 334-350, 1993.
56. S. Song, K.D. Miller and L.F. Abbott, "Competitive hebbian learning though spike-timing dependent synaptic plasticity", Nature Neuroscince, 3, pp. 919-926, 2000.
57. W.A. Spencer and E.R. Kandel, "Electrophysiology of hippocampal neurons. IV. Fast pre-potentials", Journal of Neurophysiology, 24, pp. 272-285, 1961.
58. N. Spruston, Y. Schiller, G. Stuart and B. Skmann, "Activity dependent action potential invasion and calcium influx into hippocampal cal dendrites", Science, 268, pp. 297-300, 1995.
59. G. Stuart, N. Spruston and M. Häusser, Eds, Dendrites. Oxford: Oxford University Press, 2001.
60. G. Stuart, N. Spruston, N. Sakmann and M. Häuser, "Action potential initiation and back-propagation in neurons of the mammalian ens", Trends in Neumsciences, 20, pp. 125-131, 1997.
61. M. Tsodyks, K. Pawelzik H. Markram, "Neural networks with dynamic synapses", Neural Computation, 10, pp. 821-835, 1998.
62. B. Webb, "Can robots make good models of biological behaviour", Behavioral and Brain Sciences, 24, pp. 1033-1050, 2001.
63. S. Wermter, M. Elshaw and S. Farrand, "A modular approach to self-organisation of robot control based on language instruction", Connection Science, 2003.
64. S. Wermter and C. Panchev, "Hybrid preference machines based on inspiration from neuroscience", Cognitive Systems Research, 3, pp. 255-270, 2002.
65. M. Yoshizaki, A. Nakamura and Y. Kuno, "Mutual assistance between speech and vision for human-robot interface", in Proceedings of the 2002 IEEE/RSJ Intl. Conference on Intelligent Robots and Systems, 2002, pp. 1308-1313.
66. R. Zucker, "Short-term synaptic plasticity", Annual Reviews in Neuroscience, 12, pp. 13-31, 1989.