Networks of spiking neurons: The third generation of neural network models

Neural Networks

Volumn 10, Issue 9, 1997, Pages 1659-1671

  Maass, Wolfgang ^a  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

Computational complexity; Integrate and fire neutron; Lower bounds; Sigmoidal neural nets; Spiking neuron

Indexed keywords

BOOLEAN FUNCTIONS; COMPUTATIONAL COMPLEXITY; LEARNING ALGORITHMS; MATHEMATICAL MODELS; PIECEWISE LINEAR TECHNIQUES;

ACTIVATION FUNCTIONS; SIGMOIDAL NEURAL NETS;

NEURAL NETWORKS;

ARTICLE; BRAIN DEPTH STIMULATION; EXCITATORY POSTSYNAPTIC POTENTIAL; INHIBITORY POSTSYNAPTIC POTENTIAL; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; MONKEY; NERVE CELL NETWORK; NERVE CONDUCTION; NONHUMAN; PRIORITY JOURNAL; STRIATE CORTEX;

EID: 0031472340     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(97)00011-7     Document Type: Article

References (74)

1. Abeles, M. (1991). Corticonics: Neural circuits of the cerebral cortex. Cambridge: Cambridge University Press.
2. Abeles, M., Bergman, H., Margalit, E., & Vaadia, E. (1993). Spatio-temporal firing patterns in the frontal cortex of behaving monkeys. Journal of Neurophilosiology, 70, 1629-1638.
3. Aertsen, A. (Ed.) (1993). Brain theory: spatio-temporal aspects of brain function. Elsevier.
4. Aityan, S. K., & Barrow, D. L. (1993). Paradigm, logical performance, and training of recurrent refractory neural networks. Neural, Parallel & Scientific Computations, 1, 3-28.
5. Arbib, M. A. (1995). The handbook of brain theory and neural networks. Cambridge: MIT Press.
6. Bair, W., Koch, C., Newsome, W., & Britten, K. (1994). Reliable temporal modulation in cortical spike trains in the awake monkey. In Proceedings of the Symposium on Dynamics of Neural Processing. Washington, DC.
7. Bialek, W., & Rieke, F. (1992). Reliability and information transmission in spiking neurons. Trends in Neuroscience, 15, 428-434.
8. Bienenstock, E. (1995). A model of neocortex. Network: Computation in Neural Systems, 6, 179-224.
9. Bower, J. M., & Beeman, D. (1995). The book of GENESIS: exploring realistic neural models with the General Neural Simulation System. New York: Springer.
10. Churchland, P. S., & Sejnowski, T. J. (1993). The computational brain. Cambridge: MIT Press.
11. Crair, M. C., & Bialek, W. (1990). Non-Boltzmann dynamics in networks of spiking neurons. In Advances in neural information processing systems, Vol. 2 (pp. 109-116). San Mateo: Morgan Kaufmann.
12. DasGupta, B., & Schnitger, G. (1993). The power of approximating: a comparison of activation functions. In Advances in neural information processing systems, Vol. 5 (pp. 615-622). San Mateo: Morgan Kaufmann.
13. DeYong, M. R., Findley, R. L., & Fields, C. (1992). The design, fabrication, and test of a new VLSI hybrid analog-digital neural processing element. IEEE Transcripts on Neural Networks, 3, 363-374.
14. Douglas, R. J., Koch, C., Mahowald, M., Martin, K. A. C., & Suarez, H. H. (1995). Recurrent excitation in neocortical circuits. Science, 269, 981-985.
15. Ferster, D., & Spruston, N. (1995). Cracking the neuronal code. Science, 270, 756-757.
16. Gerstner, W. (1991). Associative memory in a network of "biological neurons". In Advances in neural information processing systems, Vol. 3 (pp. 84-90). San Mateo: Morgan Kaufmann.
17. Gerstner, W. (1995). Time structure of the activity in neural network models. Physics Review E, 51, 738-758.
18. Gerstner, W., & van Hemmen, J. L. (1994). How to describe neuronal activity: spikes, rates, or assemblies. In Advances in neural information processing systems, Vol. 6 (pp. 463-470). San Mateo: Morgan Kaufmann.
19. Gerstner, W., Ritz, R., & van Hemmen, J. L. (1993). A biologically motivated and analytically soluble model of collective oscillations in the cortex: I. Theory of weak locking. Biological Cybernetics, 68, 363-374.
20. Goldberg, P. W., & Jerrum, M. R. (1995). Bounding the Vapnik-Chervonenkis dimension of concept classes parameterized by real numbers. Machine Learning, 18, 131-148.
21. Herrmann, M., Hertz, J. A., & Prügel-Bennett, A. (in press). Analysis of synfire chains. Nordita Preprint.
22. Hopfield, J. J. (1995). Pattern recognition computation using action potential timing for stimulus representations. Nature, 376, 33-36.
23. Hopfield, J. J., & Herz, A. V.M. (1995). Rapid local synchronization of action potentials: towards computation with coupled integrate-and-fire neurons. Proceedings of the National Academy of Science, 92, 6655-6662.
24. Horinchi, T., Lazzaro, J., Moore, A., & Koch, C. (1991). A delay-line based motion detection chip. In Advances in neural information processing systems, Vol. 3 (pp. 406-412). San Mateo: Morgan Kaufmann.
25. Jahnke, A., Roth, U., & Klar, H. (1996). A SIMD/dataflow architecture for a neurocomputer for spike-processing neural networks (NESPINN). MicroNeuro, 232-237.
26. Jiu, C. T., & Leong, P. H. W. (1996). An analog VLSI time-encoded pattern classifier. In Proceedings of the 7th Australian Conference on Neural Networks (pp. 212-215). Canberra.
27. Johnston, D., & Wu, S. M. (1995). Foundations of cellular neurophisiology. Cambridge: MIT Press.
28. Judd, K. T., & Aihara, K. (1993). Pulse propagation networks: a neural network model that uses temporal coding by action potentials. Neural Networks, 6, 203-215.
29. Karpinski, M., & Macintyre, A. (in press). Polynomial bounds for VC-dimension of sigmoidal and general Pfaffian neural networks. Journal of Computer and System Sciences.
30. Kempter, R., Gerstner, W., van Hemmen, J. L., & Wagner, H. (1996). Temporal coding in the sub-millisecond range: model of barn owl auditory pathway. In Advances in neural information processing systems. Vol. 8 (pp. 124-130). Cambridge: MIT Press.
31. Koch, C., & Poggio, T. (1992). Multiplying with synapses and neurons. In T. McKenna, J. Davis, & S. F. Zornetser (Eds.), Single neuron computation (pp. 315-346). Boston: Academic Press.
32. Koiran, P. (1996). VC-dimension in circuit complexity. In Proceedings of the Conference on Computational Complexity (pp. 81-85).
33. Krüger, J., & Aiple, F. (1988). Multielectrode investigation of monkey striate cortex: spike train correlations in the infragranular layers. Journal of Neurophysiology, 60, 798-828.
34. Lapique, L. (1907). Recherches quantitatives sur l'excitation electrique des nerfs traitee comme une polarization. Journal of Physiology and Pathololgy, 9, 620-635.
35. Leshno, M., Lin, V. Y., Pinkus, A., & Schocken, S. (1993). Multilayer feedforward networks with a nonpolynomial activation function can approximate any function. Neural Networks, 6, 861-867.
36. Lestienne, R. (1996). Determination of the precision of spike timing in the visual cortex of anaesthetised cats. Biological Cybernetics, 74, 55-61.
37. Maass, W. (1995a). Vapnik-Chervonenkis dimension of neural nets. In M. A. Arbib (Ed.), The handbook of brain theory and neural networks (pp. 1000-1003). Cambridge: MIT Press.
38. Maass, W. (1995b). On the computational complexity of networks of spiking neurons. In Advances in neural information processing systems, Vol. 7 (183-190). Cambridge: MIT Press.
39. Maass, W. (1995c). Analog computations on networks of spiking neurons. In Proceedings of the 7th Italian Workshop on Neural Nets. World Scientific Press, 99-104.
40. Maass, W. (1996a). Lower bounds for the computational power of networks of spiking neutrons. Neural Computation, 8(1), 1-40.
41. Maass, W. (1996b). On the computational power of noisy spiking neurons. In Advances in neural information processing systems, Vol. 8 (pp. 211-217). Cambridge: MIT Press.
42. Maass, W. (1997). Fast sigmoidal networks via spiking neurons. Neural Computation, 9, 279-304.
43. Maass, W., & Orponen, P. (1997). On the effect of analog noise in discrete-time analog computations. Advances in neural information processing systems, Vol. 9. Cambridge: MIT Press.
44. Maass, W., & Ruf, B. (1995). On the relevance of the shape of post-synaptic potentials for the computational power of spiking Neurons. Proceedings of the International Conference on Artificial Neural Networks, ICANN'95 (pp. 515-520). Paris: EC2&-Cie.
45. Maaas, W., & Schmitt, M. (1997). On the complexity of learning for a spiking neuron. Proc. of the 10th Conference on Computational Learning Theory 1997, ACM-Press, New York, Forthcoming.
46. Maass, W., Schnitger, G., & Sontag, E. (1991). On the computational power of sigmoid versus boolean threshold circuits. In Proceedings of the 32nd Annual IEEE Symposium on Foundations of Computer Science (pp. 767-776).
47. Mahowald, M. (1992). VLSI. Analogs of neuronal visual processing: a synthesis of form and function. Ph.D. dissertation, California Institute of Technology.
48. Mahowald, M. (1994). An analog VLSI system for stereoscopic vision. Boston: Kluwer.
49. Mainen, Z. F., & Sejnowski, T. J. (1995). Reliability of spike timing in neocortical neurons. Science, 268, 1503-1506.
50. Mead, C. (1989). Analog VLSI and neural systems. Reading: Addison-Wesley.
51. Meador, J. L., Wu, A., Cole, C., Nintunze, N., & Chintrakulchai, P. (1991). Programmable impulse neural circuits. IEEE Transcripts on Neural Networks, 2, 101-109.
52. Murray, A. and Tarassenko, L. (1994). Analogue neural VLSI: a pulse stream approach. Chapman and Hall.
53. Northmore, D. P., & Elias, J. G. (1996). Discrimination of spike patterns by dendritic processing in a network of silicon neuromorphs. In Proceedings of the 5th Annual Conference on Computational Neuroscience. San Diego: Academic Press.
54. Perrett, D. I., Rolls, E. T., & Caan, W. C. (1982). Visual neurons responsive to faces in the monkey temporal cortex. Experimental Brain Research, 47, 329-342.
55. Pratt, G. A. (1989). Pulse computation. Ph.D. thesis, MIT, Cambridge.
56. Rieke, F., Warland, D., van Stevenick, R., & Bialek, W. (1996). SPIKES: exploring the neural code. Cambridge: MIT Press.
57. Ritz, R., Gerstner, W., Fuentes, U., & van Hemmen, L. (1994). A biologically motivated and analytically soluble model of collective ascillations in the cortex: II. Applications to binding and pattern segmentation. Biological Cybernetics, 71, 49-358.
58. Rolls, E. T. (1994). Brain mechanism for invariant visual recognition and learning. Behavioural Processes, 33, 113-138.
59. Rolls, E. T., & Tovee, M. J. (1994). Processing speed in the cerebral cortex, and the neurophysiology of visual backward masking. Proceedings of the Royal Society of Britain, 257, 9-15.
60. Sejnowski, T. J. (1995). Time for a new neural code?. Nature, 376, 21-22.
61. Shastri, L., & Ajjanagadde, V. (1993). From simple associations to systematic reasoning: a connectionist representation of rules, variables and dynamic bindings using temporal synchrony. Behavioural and Brain Sciences, 16, 417-494.
62. Shawe-Taylor, J., Jeavons, P., & Van Daalen, M. (1991). Probabilistic bit stream neural chip: theory. Connection Science, 3, 317-328.
63. Shepherd, G. M. (Ed.) (1990). The synaptic organization of the brain (3rd ed.). New York: Oxford University Press.
64. Shepherd, G. M. (1994). Neurobiology (3rd ed.). New York: Oxford University Press.
65. Singer, W. (1995). Synchronization of neuronal responses as a putative binding mechanism. In M. A. Arbib (Ed.), The handbook of brain theory and neural networks (pp. 960-964). Cambridge: MIT Press.
66. Softky, W. (1994). Sub-millisecond coincidence detection in active dendritic tree. Neuroscience, 58, 13-41.
67. Sontag, E. D. (1997). Shattering all sets of k points in "general position" requires (k - 1)/2 parameters, Neural Computation, 9, 337-348.
68. C. F. Stevens, & Zador, A. (1996). Information through a spiking neuron. In Advances in neural information processing systems, Vol. 8 (pp. 75-81). Cambridge: MIT Press.
69. Taylor, J. G., & Alavi, F. N. (1993). Mathematical analysis of a competitive network for attention. In J. G. Taylor (Ed.), Mathematical approaches to neural network (pp. 341-382). Amsterdam: North Holland.
70. Thorpe, S. T., & Imbert, M. (1989). Biological constraints on connectionist modelling. In R. Pfeifer, Z. Schreter, F. Fogelman-Soulié, & L. Steels (Eds.), Connectionism in perspective (pp. 63-92). Amsterdam: Elsevier, North Holland.
71. Tuckwell, H. C. (1988). Introduction to theoretical neurobiology, Vols. 1 and 2. Cambridge: Cambridge University Press.
72. Valiant, L. G. (1994). Circuits of the mind. Oxford University Press.
73. Zaghloul, M. L., Meador, J. L., & Newcomb, R. W. (Eds.) (1994). Silicon implementations of pulse coded neural network. Kluwer.
74. Zhao, J. (1995). Stochastic bit stream neural networks: theory, simulations and applications. Ph.D. thesis, University of London, London.