Overview of facts and issues about neural coding by spikes

Journal of Physiology Paris

Volumn 104, Issue 1-2, 2010, Pages 5-18

  Cessac, Bruno ^a,c   Paugam Moisy, Hélène ^b   Viéville, Thierry ^d  

^a UNIVERSITÉ DE NICE SOPHIA ANTIPOLIS   (France)

^b UFR 919 Laboratoire d'Informatique Pour la Mécanique et les Sciences de l'Ingénieur   (France)

^c INRIA   (France)

^d INRIA   (France)

Author keywords

Neural code; Spike train metrics; Spiking neuron networks; Time constraints

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BRAIN FUNCTION; DYNAMICS; GAP JUNCTION; LEARNING; MODEL; NERVE CELL MEMBRANE POTENTIAL; NERVE CELL MEMBRANE STEADY POTENTIAL; NERVE CELL NETWORK; NERVE POTENTIAL; NEUROTRANSMISSION; PYRAMIDAL NERVE CELL; REVIEW; SIMULATION; SPIKE; SPIKE TIME PRECISION; SPIKING NEURON NETWORK; SYNAPTIC TRANSMISSION;

ACTION POTENTIALS; ANIMALS; COMPUTER SIMULATION; HUMANS; MODELS, NEUROLOGICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS; NONLINEAR DYNAMICS; TIME FACTORS;

EID: 77049083379     PISSN: 09284257     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jphysparis.2009.11.002     Document Type: Review

References (87)

1. Amitai Y., Gibson J., Beirleiner M., Patrick S., Ho A., Connors B.W., and Golomb D. The spatial dimensions of electrically coupled networks of interneurons in neocortex. Journal of Neuroscience 22 (2002) 4142-4152
2. Aronov D. Fast algorithm for the metric-space analysis of simultaneous responses of multiple single neurons. Journal of Neuroscience Methods 124 2 (2003)
3. Baudot, P., 2007. Nature is the code: high temporal precision and low noise in v1. Ph.D. Thesis.
4. Bohte S.M., and Mozer M.C. Reducing the variability of neural responses: a computational theory of spike-timing-dependent plasticity. Neural Computation 19 2 (2007) 371-403
5. Brette R., and Gerstner W. Adaptive exponential integrate-and-fire model as an effective description of neuronal activity. Journal of Neurophysiology 94 (2005) 3637-3642
6. Brette R., Rudolph M., Carnevale T., Hines M., Beeman D., Bower J.M., Diesmann M., Morrison A., Goodman Jr. P.H., Harris F.C., Zirpe M., Natschläger T., Pecevski D., Ermentrout B., Djurfeldt M., Lansner A., Rochel O., Vieville T., Muller E., Davison A.P., Boustani S.E., and Destexhe A. Simulation of networks of spiking neurons: a review of tools and strategies. Journal of Computational Neuroscience 23 3 (2007) 349-398
7. Burnod Y. An Adaptive Neural Network: The Cerebral Cortex. second ed. (1993), Masson, Paris
8. Camera G.L., Giugliano M., Senn W., and Fusi S. The response of cortical neurons to in vivo-like input current: theory and experiment. Biological Cybernetics 99 4-5 (2008) 279-301
9. Camera G.L., Giugliano M., Senn W., and Fusi S. The response of cortical neurons to in vivo-like input current: theory and experiment: II. Time-varying and spatially distributed inputs. Biological Cybernetics 99 4-5 (2008) 303-318
10. Carandini M., and Ferster D. Membrane potential and firing rate in cat primary visual cortex. The Journal of Neuroscience 20 1 (2000) 470-484
11. Carandini M., Demb J.B., Mante V., Tollhurst D.J., Dan Y., Olshausen B.A., Gallant J.L., and Rust N.C. Do we know what the early visual system does?. Journal of Neuroscience 25 46 (2005) 10577-10597
12. Cessac B. A discrete time neural network model with spiking neurons. Rigorous results on the spontaneous dynamics. Journal of Mathematical Biology 56 3 (2008) 311-345
13. Cessac B., and Viéville T. On dynamics of integrate-and-fire neural networks with adaptive conductances. Frontiers in neuroscience 2 2 (2008)
14. Cessac, B., Rochel, O., Viéville, T., 2009a. Introducing numerical bounds to improve event-based neural network simulations. Tech. Rep. RR-6924, INRIA, HAL.
15. Cessac B., Rostro-Gonzalez H., Vasquez J., and Viéville T. How gibbs distribution may naturally arise from synaptic adaptation mechanisms: a model based argumentation. Journal of Statistical Physics 136 3 (2009) 565-602
16. Chechik G. Spike-timing-dependent plasticity and relevant mutual information maximization. Neural Computation 15 7 (2003) 1481-1510
17. Cooper L., Intrator N., Blais B., and Shouval H. Theory of Cortical Plasticity (2004), World Scientific Publishing
18. Cronin J. Mathematical Aspects of Hodgkin-Huxley Theory (1987), Cambridge University Press
19. Crook S., Ermentrout G., and Bower J. Spike frequency adaptation affects the synchronization properties of networks of cortical oscillations. Neural Computation 10 4 (1998)
20. Dayan P., and Abbott L.F. Theoretical Neuroscience : Computational and Mathematical Modeling of Neural Systems (2001), MIT Press
21. Delorme A., Perrinet L., and Thorpe S. Network of integrate-and-fire neurons using rank order coding b: spike timing dependant plasticity and emergence of orientation selectivity. Neurocomputing 38 (2001) 539-545
22. Destexhe A. Conductance-based integrate and fire models. Neural Computation 9 (1997) 503-514
23. Destexhe A., Rudolph M., and Paré D. The high-conductance state of neocortical neurons in vivo. Nature Reviews Neuroscience 4 (2003) 739-751
24. Fitzgibbon W., Parrott M., and You Y. Finite dimensionality and upper semicontinuity of the global attractor of singularly perturbed Hodgkin-Huxley systems. Journal of Differential Equations 1 (1996)
25. Frégnac, Y., 2003. Association field in visual cortical neurons: from subthreshold visual synaptic integration to apparent-motion perception. In: European Conference on Visual Perception, Paris.
26. Frégnac Y. From synaptic rumours to low-level perception: an intracellular view of visual cortical dynamics. Progress in Biochemistry and Biophysics 31 (2004) 6-8
27. Galarreta M., and Hestrin S. Electrical synapses between gaba-releasing interneurons. Nature Reviews Neuroscience 2 (2001) 425-433
28. Gautrais J., and Thorpe S. Rate coding vs. temporal order coding : a theoretical approach. Biosystems 48 (1998) 57-65
29. Gerstein G.L., and Mandelbrot B. Random walk models for the spike activity of a single neuron. Biophysical Journal 4 (1964) 41-68
30. Gerstner W., and Kistler W. Spiking Neuron Models (2002), Cambridge University Press
31. Gerstner W., and Kistler W.M. Mathematical formulations of Hebbian learning. Biological Cybernetics 87 (2002) 404-415
32. Gray C.M., and Singer W. Stimulus specific neuronal oscillations in orientation columns of cat visual cortex. Proceedings of the National Academy of Sciences USA 86 (1989) 1698-1702
33. Guyonneau R., vanRullen R., and Thorpe S. Temporal codes and sparse representatives. Journal of Physiology (Paris) 98 4-8 (2004) 487-497
34. Hodgkin A., and Huxley A. A quantitative description of membrane current and its application to conduction and excitation in nerve. Journal of Physiology 117 (1952) 500-544
35. Hornik K., Stinchcombe M., and White H. Multilayer feedforward networks are universal approximators. Neural Networks 2 (1989) 359-366
36. Izhikevich E. Simple model of spiking neurons. IEEE Transactions on Neural Networks 14 6 (2003) 1569-1572
37. Izhikevich E. Which model to use for cortical spiking neurons?. IEEE Transactions on Neural Networks 15 5 (2004) 1063-1070
38. Izhikevich E.M. Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting (2007), The MIT Press
39. Jaeger H. Adaptive nonlinear system identification with Echo State Networks. In: Becker S., Thrun S., and Obermayer K. (Eds). NIPS*2002. Advances in Neural Information Processing Systems vol. 15 (2003), MIT Press 593-600
40. Katok A., and Hasselblatt B. Introduction to the Modern Theory of Dynamical Systems (1998), Kluwer
41. Kirst C., Geisel T., and Timme M. Sequential desynchronization in networks of spiking neurons with partial reset. Physical Review Letters 102 068101 (2009)
42. Koch C. Biophysics of Computation: Information Processing in Single Neurons (1999), Oxford University Press, New York
43. In: Koch C., and Segev I. (Eds). Methods in Neuronal Modeling: From Ions to Networks (1998), The MIT Press
44. Kreuz, T., Haas, J.S., Morelli, A., Abarbanel, H.D., Politi, A., 2007. Measuring spike train synchrony and reliability. In: Computational Neurosciences meeting (CNS).
45. Lazar A. Multichannel time encoding with integrate-and-fire neurons. Neurocomputing 65 (2005) 401-407
46. Lewis T.J., and Rinzel J. Dynamics of spiking neurons connected by both inhibitory and electrical coupling. Journal of Computational Neuroscience 14 3 (2003) 283-309
47. Maass W. Fast sigmoidal networks via spiking neurons. Neural Computation 9 (1997) 279-304
48. Maass W. Networks of spiking neurons: the third generation of neural network models. Neural Networks 10 (1997) 1659-1671
49. Maass W. On the relevance of time in neural computation and learning. Theoretical Computer Science 261 (2001) 157-178 (extended version of ALT'97, in LNAI 1316, 364-384)
50. Maass W. Motivation, theory, and applications of liquid state machines. In: Cooper B., and Sorbi A. (Eds). Computability in Context: Computation and Logic in the Real World (2009), Imperial College Press
51. In: Maass W., and Bishop C.M. (Eds). Pulsed Neural Networks (2003), MIT Press
52. Maass W., and Natschläger T. Networks of spiking neurons can emulate arbitrary hopfield nets in temporal coding. Neural Systems 8 4 (1997) 355-372
53. Maass W., and Schmitt M. On the complexity of learning for spiking neurons with temporal coding. Information and Computation 153 (1999) 26-46
54. Maass W., Natschläger T., and Markram H. Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Computation 14 11 (2002) 2531-2560
55. Mainen Z., and Sejnowski T. Reliability of spike timing in neocortical neurons. Science 268 5216 (1995) 1503-1506
56. Markram H., Lübke J., Frotscher M., and Sakmann B. Regulation of synaptic efficacy by coincidence of postsynaptic ap and epsp. Science 275 213 (1997)
57. Martinez, R., Paugam-Moisy, H., 2008. Les groupes polychrones pour capturer l'aspect spatio-temporel de la mémorisation. In: Perrinet, L., Daucé, E. (Eds.), Proc. of the 2nd French Conference on Computational Neuroscience, Marseille, pp. 265-268. .
58. McCormick D.A., and Bal T. Sleep and arousal: thalamocortical mechanisms. Annual Review of Neuroscience 20 (1997) 185-215
59. Meunier, D., Paugam-Moisy, H., 2008. Neural networks for computational neuroscience. In: Proc. of European Symp. On Artificial Neural Networks - ESANN'2008. Advances in Computational Intelligence and Learning, pp. 367-378.
60. Morrison A., Mehring C., Geisel T., Aerstsen A., and Diesmann M. Advancing the boundaries of high connectivity network with distributed computing. Neural Computation 17 8 (2005) 1776-1801
61. Mouraud A., Paugam-Moisy H., and Puzenat D. A distributed and multithreaded neural event-driven simulation framework. Int. Conf. on Parallel and Distributed Computing and Networks (2006), ACTA Press 393-398
62. Par D., Bouhassira D., Oakson G., and Datta S. Spontaneous and evoked activities of anterior thalamic neurons during waking and sleep states. Experimental Brain Research 80 1 (1990)
63. Paugam-Moisy H., and Bohte S. Computing with spiking neuron networks. In: Rozenberg G., Back T., and Kok J. (Eds). Handbook of Natural Computing (2010), Springer-Verlag
64. Paugam-Moisy H., Martinez R., and Bengio S. Delay learning and polychronization for reservoir computing. Neurocomputing 71 (2008) 1143-1158
65. Pfister, J.-P., Gerstner, W., 2006. Triplets of spikes in a model of spike timing-dependent plasticity. Journal of Neuroscience 26, 9673-9682. .
66. Politi, A., Torcini, A., 2009. Stable chaos. .
67. Rauch A., La Camera G., Luscher H.-R., Senn W., and Fusi S. Neocortical pyramidal cells respond as integrate-and-fire neurons to in vivo-like input currents. Journal of Neurophysiology 90 3 (2003) 1598-1612
68. Rieke F., Warland D., de Ruyter van Steveninck R., and Bialek W. Spikes, Exploring the Neural Code (1996), The MIT Press
69. Rostro-Gonzalez, H., Cessac, B., Vasquez, J.C., Viéville, T., 2009. Back-engineering of spiking neural networks parameters. In: Computational Neurosciences Meeting (CNS).
70. Rudolph M., and Destexhe A. How much can we trust neural simulation strategies?. Neurocomputing 70 10 (2007) 1966-1969
71. Schäfer, A.M., Zimmermann, H.G., 2006. Recurrent neural networks are universal approximators. Lecture Notes in Computer Science 4131, 632-640. .
72. Schrauwen, B., 2007. Towards applicable spiking neural networks. Ph.D. Thesis, Universiteit Gent, Belgium.
73. Shadlen, M.N., Newsome, W.T., 1994. Noise, neural codes and cortical organization. Current Opinion in Neurobiology 4 (4), 569-579. .
74. Šíma J., and Sgall J. On the nonlearnability of a single spiking neuron. Neural Computation 17 12 (2005) 2635-2647
75. Simoncelli E., and Olshausen B. Natural image statistics and neural representation. Annual Review of Neuroscience 24 1 (2001) 1193-1216
76. Stein R.B. A theoretical analysis of neuronal variability. Biophysics Journal 5 (1965) 173-194
77. Swadlow H. Physiological properties of individual cerebral axons studied in vivo for as long as one year. Journal of Neurophysiology 54 (1985) 1346-1362
78. Swadlow H. Monitoring the excitability of neocortical efferent neurons to direct activation by extracellular current pulses. Journal of Neurophysiology 68 (1992) 605-619
79. Thorpe S., and Fabre-Thorpe M. Seeking categories in the brain. Science 291 (2001) 260-263
80. Thorpe S., Delorme A., and VanRullen R. Spike based strategies for rapid processing. Neural Networks 14 (2001) 715-726
81. Touboul, J., Brette, R., 2008. Dynamics and bifurcations of the adaptive exponential integrate-and-fire model. Biological Cybernetics 99 (4-5), 319-334. doi:10.1007/s00422-008-0267-4. pMID:19011921, .
82. Toyoizumi T., Pfister J.-P., Aihara K., and Gerstner W. Generalized bienenstock-cooper-munro rule for spiking neurons that maximizes information transmission. Proceedings of the National Academy of Science 102 (2005) 5239-5244
83. Toyoizumi T., Pfister J.-P., Aihara K., and Gerstner W. Optimality model of unsupervised spike-timing dependent plasticity: synaptic memory and weight distribution. Neural Computation 19 (2007) 639-671
84. Verstraeten D., Schrauwen B., DHaene M., and Stroobandt D. An experimental unification of reservoir computing methods. Neural Networks 20 3 (2007) 391-403
85. Victor J. Spike train metrics. Current Opinion in Neurobiology 15 5 (2005) 585-592
86. Victor J., and Purpura K. Nature and precision of temporal coding in visual cortex: a metric-space analysis. Journal of Neurophysiology 76 (1996) 1310-1326
87. Viéville, T., Crahay, S., 2004. Using an Hebbian learning rule for multi-class svm classifiers. Journal of Computational Neuroscience 17 (3), 271-287. .