The Use of Hebbian Cell Assemblies for Nonlinear Computation

Scientific Reports

Volumn 5, Issue , 2015, Pages

  Tetzlaff, Christian ^a,b,c   Dasgupta, Sakyasingha ^a,b,d   Kulvicius, Tomas ^a,b,e   Wörgötter, Florentin ^a,b  

^a UNIVERSITY OF GÖTTINGEN   (Germany)

^b BERNSTEIN CENTER FOR COMPUTATIONAL NEUROSCIENCE   (Germany)

^c MAX PLANCK INSTITUTE FOR DYNAMICS AND SELF ORGANIZATION   (Germany)

^d RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^e UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ALGORITHM; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; HUMAN; LEARNING; NERVE CELL; NERVE CELL NETWORK; NERVE CELL PLASTICITY; PHYSIOLOGY; SYNAPSE; SYNAPTIC TRANSMISSION;

ACTION POTENTIALS; ALGORITHMS; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONAL PLASTICITY; NEURONS; SYNAPSES; SYNAPTIC TRANSMISSION;

EID: 84938877260     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep12866     Document Type: Article

References (60)

1. Hebb, D. O. The Organization of Behaviour. Wiley, New York, (1949).
2. Anderson, J., Cooper, L. N., Nass, M., Freiberger, W. & Grenender, W. Some properties of a neural model for memory. In AAAS Symposium, (1972).
3. Grossberg, S. Nonlinear neural networks: principles, mechanisms, and architectures. Neural Networks 1, 17-61 (1988).
4. Tetzlaff, C., Kolodziejski, C., Markelic, I. & Wörgötter, F. Time scales of memory, learning, and plasticity. Biol. Cybern. 106(11), 715-726 (2012).
5. Schmidt, R. A. A schema theory of discrete motor skill learning. Psychol. Rev. 82(4), 225-260 (1975).
6. Tetzlaff, C., Kolodziejski, C., Timme, M., Tsodyks, M. & Wörgötter, F. Synaptic scaling enables dynamically distinct short- and long-term memory formation. PLoS Comput. Biol. 9(10), e1003307 (2013).
7. Pulvermüller, F., Garagnani, M. & Wennekers, T. Thinking in circuits: toward neurobiological explanation in cognitive neuroscience. Biol. Cybern. 108, 573-593 (2014).
8. Ashby, W. R. An introduction to Cybernetics. Wiley, New York, (1956).
9. Maass, W., Natschläger, T. & Markram, H. Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput. 14, 2531-2560 (2002).
10. Jaeger, H. & Haas, H. Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304, 78-80 (2004).
11. Buonomano, D. V. & Maass, W. State-dependent computations: spatiotemporal processing in cortical networks. Nat. Rev. Neurosci. 10, 113-125 (2009).
12. Maass, W. Computability in context: computation and logic in the real world, chapter Liquid state machines: motivation, theory, and applications, 275-296. London: Imperial College (2010).
13. Barak, O., Sussillo, D., Romo, R., Tsodyks, M. & Abbott, L. F. From fixed point to chaos: three models of delayed discrimination. Prog. Neurobiol. 103, 214-222 (2013).
14. Mante, V., Sussillo, D., Shenoy, K. V. & Newsome, W. T. Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 503, 78-84 (2013).
15. Ju, H., Dranias, M. R., Banumurthy, G. & Van Dongen, A. M. Spatiotemporal memory is an intrinsic property of networks of dissociated cortical neurons. J. Neurosci. 35(9), 4040-4051 (2015).
16. Martin, S. J., Grimwood, P. D. & Morris, R. G. M. Synaptic plasticity and memory: an evaluation of the hypothesis. Annu. Rev. Neurosci. 23, 649-711 (2000).
17. Kandel, E. R. The molecular biology of memory storage: a dialog between genes and synapses. Biosci. Rep. 21, 565-611 (2001).
18. Dudai, Y. The neurobiology of consolidation, or, how stable is the engram? Annu. Rev. Psychol. 55, 51-86 (2004).
19. Willshaw, D. J., Buneman, O. P. & Longuet-Higgins, H. C. Non-holographic associative memory. Nature 222, 960-962 (1969).
20. Hopfield, J. J. Neurons with graded response have collective computational properties like those of two-state neurons. Proc. Natl. Acad. Sci. USA 81, 3088-3092 (1984).
21. Palm, G., Knoblauch, A., Hauser, F. & Schüz, A. Cell assemblies in the cerebral cortex. Biol. Cybern. 108, 559-572 (2014).
22. Buzsaki, G. Neural syntax, cell assemblies, synapsembles, and readers. Neuron 68, 362-385 (2010).
23. Rolls, E. T. Attractor networks. WIREs Cognt. Sci. 1, 119-134 (2010).
24. Klampfl, S. & Maass, W. Emergence of dynamic memory traces in cortical microcircuit models through STDP. J. Neurosci. 33(28), 11515-11529 (2013).
25. Bienenstock, E. L., Cooper, L. N. & Munro, P. W. Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J. Neurosci. 2, 32-48 (1982).
26. Oja, E. A simplified neuron model as a principal component analyzer. J. Math. Biol. 15, 267-273 (1982).
27. Gerstner, W. & Kistler, W. M. Mathematical formulations of hebbian learning. Biol. Cybern. 87, 404-415 (2002).
28. Malenka, R. C. The long-term potential of LTP. Nat. Rev. Neurosci. 4, 923-926 (2003).
29. Feldman, D. E. Synaptic mechanisms for plasticity in neocortex. Annu. Rev. Neurosci. 32, 33-55 (2009).
30. Turrigiano, G. G., Leslie, K. R., Desai, N. S., Rutherford, L. C. & Nelson, S. B. Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature 391, 892-896 (1998).
31. Hengen, K. B., Lambo, M. E., Van Hooser, S. D., Katz, D. B. & Turrigiano, G. G. Firing rate homeostasis in visual cortex of freely behaving rodents. Neuron 80, 335-342 (2013).
32. Keck, T. et al. Synaptic scaling and homeostatic plasticity in the mouse visual cortex in vivo. Neuron 80, 327-334 (2013).
33. Bliss, T. & Lomo, T. Long-lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path. J. Physiol. 232, 331-356 (1973).
34. Tetzlaff, C., Kolodziejski, C., Timme, M. & Wörgötter, F. Synaptic scaling in combination with many generic plasticity mechanisms stabilizes circuit connectivity. Front. Comput. Neurosci. 5, 47 (2011).
35. Sussillo, D. & Abbott, L. F. Generating coherent patterns of activity from chaotic neural networks. Neuron 63, 544-557 (2009).
36. Brunel, N. Dynamics of networks of randomly connected excitatory and inhibitory spiking neurons. J. Physiol. 94, 445-463 (2000).
37. Miller, K. D. Synaptic economics: competition and cooperation in synaptic plasticity. Neuron 17, 371-374 (1996).
38. Toyoizumi, T., Kaneko, M., Stryker, M. P. & Miller, K. D. Modeling the dynamic interaction of Hebbian and homeostatic plasticity. Neuron 84, 497-510 (2014).
39. Lazar, A., Pipa, G. & Triesch, J. SORN: a self-organizing recurrent neural network. Front. Comp. Neurosci. 3, 23 (2009).
40. Toutounji, H. & Pipa, G. Spatiotemporal computations of an excitable and plastic brain: neuronal plasticity leads to noise-robust and noise-constructive computations. PLoS Comput. Biol. 10(3), e1003512 (2014).
41. Saltiel, P., Wyler-Duda, K., D'Avella, A., Tresch, M. C. & Bizzi, E. Muscle synergies encoded within the spinal cord: evidence from focal intraspinal NMDA iontophoresis in the frog. J. Neurophysiol. 85, 605-619 (2001).
42. Bizzi, E. & Cheung, V. C. K. The neural origin of muscle synergies. Front. Comp. Neurosci. 7, 51 (2013).
43. Wörgötter, F. & Porr, B. Temporal sequence learning, prediction and control - a review of different models and their relation to biological mechanisms. Neural Comput. 17, 245-319 (2005).
44. Ijspeert, J. A., Nakanishi, J. & Schaal, S. Movement imitation with nonlinear dynamical systems in humanoid robots. In IEEE Int. Conf. Robot., 1398-1403, (2002).
45. Kulvicius, T., Biehl, M., Aein, M. J., Tamosiunaite, M. & Wörgötter, F. Interaction learning for dynamic movement primitives used in cooperative robotic tasks. Robot. Auton. Syst. 61, 1450-1459 (2013).
46. Khansari-Zadeh, S. M. & Billard, A. Learning stable non-linear dynamical systems with gaussian mixture models. IEEE T. Robot. 27, 943-957 (2011).
47. Hennequin, G., Vogels, T. P. & Gerstner, W. Optimal control of transient dynamics in balanced networks supports generation of complex movements. Neuron 82, 1394-1406 (2014).
48. Kohonen, T. Correlation matrix memories. IEEE Trans. Comput. C 21, 353-359 (1972).
49. Grossberg, S. & Seitz, A. Laminar development of receptive fields, maps, and columns in visual cortex: the coordinating role of subplate. Cereb. Cortex 13, 852-863 (2003).
50. Erdem, U. M. & Hasselmo, M. A goal-directed spatial navigation model using forward trajectory planning based on grid cells. Eur. J. Neurosci. 35, 916-931 (2012).
51. Vogels, T. P., Sprekeler, H., Zenke, F., Clopath, C. & Gerstner, W. Inhibitory plasticity balances excitation and inhibition in sensory pathways and memory networks. Science 334, 1569-1573 (2011).
52. Tsodyks, M. & Markram, H. The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. Proc. Natl. Acad. Sci. USA 94, 719-723 (1997).
53. Rückert, E. & D'Avella, A. Learned parametrized dynamic movement primitives with shared synergies for controlling robotic and musculoskeletal systems. Front. Comp. Neurosci. 7, 138 (2013).
54. Aksoy, E. E. et al. Learning the semantics of object-action relations by observation. Int. J. Robot. Res. 30, 1229-1249 (2011).
55. Turrigiano, G. G. Too many cooks? Intrinsic and synaptic homeostatic mechanisms in cortical circuit refinement. Annu. Rev. Neurosci. 34, 89-103 (2011).
56. Wimmer, K., Nykamp, D. Q., Constantinidis, C. & Compte, A. Bump attractor dynamics in prefrontal cortex explains behavioral precision in spatial working memory. Nat. Neurosci. 17(3), 431-439 (2014).
57. Jahnke, S., Memmersheim, R.-M. & Timme, M. How chaotic is the balanced state? Front. Comp. Neurosci. 3, 13 (2009).
58. Deco, G., Jirsa, V. K., Robinson, P. A., Breakspear, M. & Friston, K. The dynamic brain: from spiking neurons to neural masses and cortical fields. PLoS Comput. Biol. 4, e10000092 (2008).
59. Turrigiano, G. G. & Nelson, S. B. Homeostatic plasticity in the developing nervous system. Nat. Rev. Neurosci. 5, 97-107, Feb (2004).
60. Harris, K. D. Cell assemblies of the superficial cortex. Neuron 76, 263-265 (2012).