Building functional networks of spiking model neurons

Nature Neuroscience

Volumn 19, Issue 3, 2016, Pages 350-355

  Abbott, L F ^a   DePasquale, Brian ^a   Memmesheimer, Raoul Martin ^a,b  

^a Columbia University College of Physicians and Surg ^*  (United States)

^b RADBOUD UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; AUTONOMOUS NETWORK; BIOLOGICAL MODEL; CELL JUNCTION; CONNECTOME; DRIVEN NETWORK; NERVE CELL; NERVE CELL NETWORK; PRIORITY JOURNAL; REVIEW; SPIKE; SPIKE CODING; ACTION POTENTIAL; ARTIFICIAL NEURAL NETWORK; PHYSIOLOGY;

ACTION POTENTIALS; NEURAL NETWORKS (COMPUTER); NEURONS;

EID: 84975690981     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.4241     Document Type: Review

References (65)

1. Hansel, D. & Sompolinsky, H. Modeling feature selectivity in local cortical circuits. in Methods in Neuronal Modeling 2nd edn. (eds. Koch, C. & Segev, I.) 499-566 (MIT Press, Cambridge, Massachusetts, USA, 1998).
2. Seung, H.S., Lee, D.D., Reis, B.Y. & Tank, D.W. Stability of the memory of eye position in a recurrent network of conductance-based model neurons. Neuron 26, 259-271 (2000).
3. Wang, X.-J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36, 955-968 (2002).
4. Renart, A., Song, P. & Wang, X.-J. Robust spatial working memory through homeostatic synaptic scaling in heterogeneous cortical networks. Neuron 38, 473-485 (2003).
5. Song, P. & Wang, X.-J. Angular path integration by moving "hill of activity": a spiking neuron model without recurrent excitation of the head-direction system. J. Neurosci. 25, 1002-1014 (2005).
6. Eliasmith, C. A unifed approach to building and controlling spiking attractor networks. Neural Comput. 17, 1276-1314 (2005).
7. Maass, W., Joshi, P. & Sontag, E.D. Computational aspects of feedback in neural circuits. PLoS Comput. Biol. 3, e165 (2007).
8. Burak, Y. & Fiete, I.R. Accurate path integration in continuous attractor network models of grid cells. PLoS Comput. Biol. 5, e1000291 (2009).
9. Boerlin, M. & Denève, S. Spike-based population coding and working memory. PLoS Comput. Biol. 7, e1001080 (2011).
10. Boerlin, M., Machens, C.K. & Denève, S. Predictive coding of dynamical variables in balanced spiking networks. PLoS Comput. Biol. 9, e1003258 (2013).
11. Lim, S. & Goldman, M.S. Balanced cortical microcircuitry for maintaining information in working memory. Nat. Neurosci. 16, 1306-1314 (2013).
12. Schwemmer, M.A., Fairhall, A.L., Denève, S. & Shea-Brown, E.T. Constructing precisely computing networks with biophysical spiking neurons. J. Neurosci. 35, 10112-10134 (2015).
13. Buonomano, D.V. & Merzenich, M.M. Temporal information transformed into a spatial code by a neural network with realistic properties. Science 267, 1028-1030 (1995).
14. Gütig, R. & Sompolinsky, H. The tempotron: a neuron that learns spike timing-based decisions. Nat. Neurosci. 9, 420-428 (2006).
15. Pfster, J.-P., Toyoizumi, T., Barber, D. & Gerstner, W. Optimal spike-timing-dependent plasticity for precise action potential fring in supervised learning. Neural Comput. 18, 1318-1348 (2006).
16. Diesmann, M., Gewaltig, M.-O. & Aertsen, A. Stable propagation of synchronous spiking in cortical neural networks. Nature 402, 529-533 (1999).
17. Maass, W., Natschläger, T. & Markram, H. Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput. 14, 2531-2560 (2002).
18. Reutimann, J., Yakovlev, V., Fusi, S. & Senn, W. Climbing neuronal activity as an event-based cortical representation of time. J. Neurosci. 24, 3295-3303 (2004).
19. Vogels, T.P. & Abbott, L.F. Signal propagation and logic gating in networks of integrate-and-fre neurons. J. Neurosci. 25, 10786-10795 (2005).
20. Liu, J.K. & Buonomano, D.V. Embedding multiple trajectories in simulated recurrent neural networks in a self-organizing manner. J. Neurosci. 29, 13172-13181 (2009).
21. Jahnke, S., Timme, M. & Memmesheimer, R.-M. Guiding synchrony through random networks. Phys. Rev. X 2, 041016 (2012).
22. Thalmeier, D., Uhlmann, M., Kappen, H.J. & Memmesheimer, R.-M. Learning universal computations with spikes. Preprint at http://arxiv.org/abs/1505.07866 (2015).
23. DePasquale, B., Churchland, M. & Abbott, L.F. Using fring-rate dynamics to train recurrent networks of spiking model neurons. Preprint at http://arxiv.org/abs/1601.07620 (2016).
24. Memmesheimer, R.-M., Rubin, R., Ölveczky, B.P. & Sompolinsky, H. Learning precisely timed spikes. Neuron 82, 925-938 (2014).
25. Eliasmith, C. et al. A large-scale model of the functioning brain. Science 338, 1202-1205 (2012).
26. Hennequin, G., Vogels, T.P. & Gerstner, W. Optimal control of transient dynamics in balanced networks supports generation of complex movements. Neuron 82, 1394-1406 (2014).
27. Ponulak, F. & Kasiński, A. Supervised learning in spiking neural networks with ReSuMe: sequence learning, classifcation, and spike shifting. Neural Comput. 22, 467-510 (2010).
28. Florian, R.V. The chronotron: a neuron that learns to fre temporally precise spike patterns. PLoS One 7, e40233 (2012).
29. Brea, J., Senn, W. & Pfster, J.-P. Matching recall and storage in sequence learning with spiking neural networks. J. Neurosci. 33, 9565-9575 (2013).
30. LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436-444 (2015).
31. Mante, V., Sussillo, D., Shenoy, K.V. & Newsome, W.T. Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 503, 78-84 (2013).
32. Sussillo, D., Churchland, M.M., Kaufman, M.T. & Shenoy, K.V. A neural network that fnds a naturalistic solution for the production of muscle activity. Nat. Neurosci. 18, 1025-1033 (2015).
33. Bohte, S.M., Kok, J.N. & Poutré, H.L. Error-backpropagation in temporally encoded networks of spiking neurons. Neurocomputing 48, 17-37 (2002).
34. Tino, P. & Mills, A.J.S. Learning beyond fnite memory in recurrent networks of spiking neurons. Neural Comput. 18, 591-613 (2006).
35. Sporea, I. & Grüning, A. Supervised learning in multilayer spiking neural networks. Neural Comput. 25, 473-509 (2013).
36. van Vreeswijk, C. & Sompolinsky, H. Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274, 1724-1726 (1996).
37. Brunel, N. Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J. Comput. Neurosci. 8, 183-208 (2000).
38. LeCun, Y. Learning processes in an asymmetric threshold network. in Disordered Systems and Biological Organization (eds. Bienenstock, E., Fogelman, F. & Weisbuch, G.) 233-240 (Springer, Berlin, 1986).
39. Bengio, Y. How auto-encoders could provide credit assignment in deep networks via target propagation. Preprint at http://arxiv.org/abs/1407.7906 (2014).
40. Laje, R. & Buonomano, D.V. Robust timing and motor patterns by taming chaos in recurrent neural networks. Nat. Neurosci. 16, 925-933 (2013).
41. Fisher, D., Olasagasti, I., Tank, D.W., Aksay, E.R.F. & Goldman, M.S. A modeling framework for deriving the structural and functional architecture of a short-term memory microcircuit. Neuron 79, 987-1000 (2013).
42. Rajan, K., Harvey, C. & Tank, D. Recurrent network models of sequence generation and memory. Neuron (in the press).
43. Jaeger, H. & Haas, H. Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304, 78-80 (2004).
44. Sussillo, D. & Abbott, L.F. Generating coherent patterns of activity from chaotic neural networks. Neuron 63, 544-557 (2009).
45. Sussillo, D. & Abbott, L.F. Transferring learning from external to internal weights in echo-state networks with sparse connectivity. PLoS One 7, e37372 (2012).
46. Lukoševicius, M., Jaeger, H. & Schrauwen, B. Reservoir computing trends. Künstl. Intell. 26, 365-371 (2012).
47. Sussillo, D. Neural circuits as computational dynamical systems. Curr. Opin. Neurobiol. 25, 156-163 (2014).
48. Eliasmith, C. & Anderson, C. Neural Engineering: Computation, Representation and Dynamics in Neurobiological Systems (MIT Press, Cambridge, Massachusetts, USA, 2003).
49. Denève, S. & Machens, C. Effcient codes and balanced networks. Nat. Neurosci. 19, 375-382 (2016).
50. Softky, W.R. & Koch, C. The highly irregular fring of cortical cells is inconsistent with temporal integration of random EPSPs. J. Neurosci. 13, 334-350 (1993).
51. Rivkind, A. & Barak, O. Local dynamics in trained recurrent neural networks. Preprint at http://arxiv.org/abs/1511.05222 (2015).
52. Hosoya, T., Baccus, S.A. & Meister, M. Dynamic predictive coding by the retina. Nature 436, 71-77 (2005).
53. Vogels, T.P., Sprekeler, H., Zenke, F., Clopath, C. & Gerstner, W. Inhibitory plasticity balances excitation and inhibition in sensory pathways and memory networks. Science 334, 1569-1573 (2011).
54. Bourdoukan, R., Barrett, D.G.T., Machens, C.K. & Denève, S. Learning optimal spike-based representations. Adv. Neural Inf. Process. Syst. 25, 2294-2302 (2012).
55. Kennedy, A. et al. A temporal basis for predicting the sensory consequences of motor commands in an electric fsh. Nat. Neurosci. 17, 416-422 (2014).
56. Bourdoukan, R. & Denève, S. Enforcing balance allows local supervised learning in spiking recurrent networks. Adv. Neural Inf. Process. Syst. 28, 982-990 (2015).
57. Potjans, W., Morrison, A. & Diesmann, M. A spiking neural network model of an actor-critic learning agent. Neural Comput. 21, 301-339 (2009).
58. Hoerzer, G.M., Legenstein, R. & Maass, W. Emergence of complex computational structures from chaotic neural networks through reward-modulated Hebbian learning. Cereb. Cortex 24, 677-690 (2014).
59. Vasilaki, E., Frémaux, N., Urbanczik, R., Senn, W. & Gerstner, W. Spike-based reinforcement learning in continuous state and action space: when policy gradient methods fail. PLoS Comput. Biol. 5, e1000586 (2009).
60. Friedrich, J. & Senn, W. Spike-based decision learning of Nash equilibria in two-player games. PLoS Comput. Biol. 8, e1002691 (2012).
61. Kleindienst, T., Winnubst, J., Roth-Alpermann, C., Bonhoeffer, T. & Lohmann, C. Activity-dependent clustering of functional synaptic inputs on developing hippocampal dendrites. Neuron 72, 1012-1024 (2011).
62. Branco, T. & Häusser, M. Synaptic integration gradients in single cortical pyramidal cell dendrites. Neuron 69, 885-892 (2011).
63. Druckmann, S. et al. Structured synaptic connectivity between hippocampal regions. Neuron 81, 629-640 (2014).
64. London, M. & Häusser, M. Dendritic computation. Annu. Rev. Neurosci. 28, 503-532 (2005).
65. Major, G., Larkum, M.E. & Schiller, J. Active properties of neocortical pyramidal neuron dendrites. Annu. Rev. Neurosci. 36, 1-24 (2013).