A compositionality machine realized by a hierarchic architecture of synfire chains

Frontiers in Computational Neuroscience

Volumn 4, Issue , 2010, Pages

  Schrader, Sven ^a   Diesmann, Markus ^b,c,d   Morrison, Abigail ^b,d  

^a HONDA RESEARCH INSTITUTE EUROPE GMBH   (Germany)

^b RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^c RIKEN   (Japan)

^d UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Compositionality; Movement primitives; Simulation; Synfire chains

Indexed keywords

ACTION EXECUTION; CLOSED-LOOP; COMPLEX BEHAVIOR; COMPOSITIONALITY; CONNECTION PATTERNS; FEED-FORWARD; HIERARCHICAL ORGANIZATIONS; MOVEMENT PRIMITIVES; NETWORK MODELS; NEURAL ACTIVITY; PARAMETER RANGE; QUANTITATIVE MEASURES; SEQUENTIAL ACTIVATION; SEQUENTIALITY; SIMULATION; SYNFIRE CHAINS; TWO DIMENSIONAL SPACES;

NETWORK LAYERS; NEURONS;

CHAINS;

ARTICLE; CALCULATION; COMPOSITIONALITY; CONTROLLED STUDY; DRAWING; MATHEMATICAL COMPUTING; MENTAL FUNCTION; NERVE CELL NETWORK; NERVE CONDUCTION; NONBIOLOGICAL MODEL; SIMULATION; SPIKE WAVE;

EID: 79958144797     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (96)

1. Abeles, M. (1982). Local Cortical Circuits: An Electrophysiological Study. Studies of Brain Function. Berlin: Springer- Verlag.
2. Abeles, M. (1991). Corticonics: Neural Circuits of the Cerebral Cortex (1st Edn.). Cambridge: Cambridge University Press.
3. Abeles, M., Bergman, H., Margalit, E., and Vaadia, E. (1993). Spatiotemporal fir-ing patterns in the frontal cortex of behaving monkeys. J. Neurophysiol. 70, 1629-1638.
4. Abeles, M., and Gat, I. (2001). Detecting precise firing sequences in experi-mental data. J. Neurosci. Methods 107, 141-154.
5. Abeles, M., Hayon, G., and Lehmann, D. (2004). Modeling compositionality by dynamic binding of synfire chains. J. Comput. Neurosci. 17, 179-201.
6. Anderson, J. C., and Martin, K. A. C. (2009). The synaptic connections between cortical areas V1 and V2 in macaque monkey. J. Neurosci. 29, 11283-11293.
7. Arnoldi, H. M., and Brauer, W. (1996). Synchronization without oscillatory neurons. Biol. Cybern. 74, 209-223.
8. Baker, S. N., and Lemon, R. (2000). Precise spatiotemporal repeating patterns in monkey primary and supplementary motor areas occur at chance level. J. Neurophysiol. 84, 1770-1780.
9. Baker, S. N., Spinks, R., Jackson, A., and Lemon, R. N. (2001). Synchronization in monkey motor cortex during a pre-cision grip task. I. Task-dependent modulation in single-unit synchrony. J. Neurophysiol. 85, 869-885.
10. Ball, T., Demandt, E., Mutschler, I., Neitzel, E., Mehring, C., Vogt, K., Aertsen, A., and Schulze-Bonhage, A. (2008). Movement related activity in the high gamma range of the human EEG. Neuroimage 41, 302-310.
11. Baras, D., and Meir, R. (2007). Reinforcement learning, spike- time-dependent plasticity, and the BCM rule. Neural Comput. 19, 2245-2279.
12. Bienenstock, E. (1991a). "Notes on the growth of a 'composition machine,'" in Proceedings of the Royaumont Interdisciplinary Workshop on Compositionality in Cognition and Neural Models, eds D. Andler, E. Bienenstock, and B. Laks (Oise, France: Abbaye de Royaumont, Asniere s), 1-19.
13. Bienenstock, E. (1991b). "Suggestions for a neurobiological approach to syntax," in Proceedings of the Royaumont Interdisciplinary Workshop on Compositionality in Cognition and Neural Networks - II, eds D. Andler, E. Bienenstock, and B. Laks (Oise, France: Abbaye de Royaumont, Asniere s.), 13-21.
14. Bienenstock, E. (1995). A model of neo-cortex. Netw. Comput. Neural Syst. 6, 179-224.
15. Brovelli, A., Ding, M., Ledberg, A., Chen, Y., Nakamura, R., and Bressler, S. L. (2004). Beta oscillations in a large- scale sensorimotor cortical network: directional influences revealed by Granger causality. Proc. Natl. Acad. Sci. U.S.A. 101, 9849-9854.
16. Buonomano, D. V. (2005). A learning rule for the emergence of stable dynamics and timing in recurrent networks. J. Neurophysiol. 94, 2275-2283.
17. Date, A., Bienenstock, E., and Geman, S. (1999). A statistical technique for detection of fine temporal structure in multi neuronal spike trains. Soc. Neurosci. Abstr. 25, 1441.
18. Diesmann, M., Gewaltig, M.-O., and Aertsen, A. (1999). Stable propaga-tion of synchronous spiking in cor-tical neural networks. Nature 402, 529-533.
19. Diesmann, M., Gewaltig, M.-O., Rotter, S., and Aertsen, A. (2001). State space analysis of synchronous spiking in cor-tical neural networks. Neurocomputing 38-40, 565-571.
20. Douglas, R. J., and Martin, K. A. (2007). Recurrent neuronal circuits in the neocortex. Curr. Biol. 17, 496-500.
21. Doursat, R., and Bienenstock, E. (2006). "The self-organized growth of syn-fire patterns," in 10th International Conference on Cognitive and Neural Systems (ICCNS), Massachusetts: Boston University.
22. Dreher, J. C., and Grafman, J. (2002). The roles of the cerebellum and basal ganglia in timing and error prediction. Eur. J. Neurosci. 16, 1609-1619.
23. Eckhorn, R., Bauer, R., Jordan, W., Brosch, M., Kruse, W., Munk, M., and Reitböck, H. J. (1988). Coherent oscil-lations: a mechanism of feature linking in the visual cortex? Biol. Cybern. 60, 121-130.
24. Farries, M. A., and Fairhall, A. L. (2007). Reinforcement learning with modu-lated spike timing-dependent syn-aptic plasticity. J. Neurophysiol. 98, 3648-3665.
25. Fiete, I. R., Senn, W., Wang, C. Z. H., and Hahnloser, R. H. R. (2010). Spike- time-dependent plasticity and het-erosynaptic competition organize networks to produce long scale-free sequences of neural activity. Neuron 65, 563-576.
26. Flash, T., and Handzel, A. A. (2007). Affine differential geometry analysis of human arm movements. Biol. Cybern. 96, 577-601.
27. Georgopoulos, A., Kalaska, J., Caminiti, R., and Massey, J. T. (1982). On the relations between the direction of two- dimensional arm movements and cell discharge in primate motor cortex. J. Neurosci. 11, 1527-1537.
28. Gerstein, G. (2004). Searching for sig-nificance in spatio-temporal firing patterns. Acta Neurobiol. Exp. 2, 203-207.
29. Gewaltig, M.-O., and Diesmann, M. (2007). NEST (neural simulation tool). Scholarpedia 2, 1430.
30. Gewaltig, M.-O., Diesmann, M., and Aertsen, A. (2001). Propagation of cortical synfire activity: survival prob-ability in single trials and stability in the mean. Neural Netw. 14, 657-673.
31. Gray, C. M., and Singer, W. (1989). Stimulus-specific neuronal oscilla-tions in orientation columns of cat visual cortex. Proc. Natl. Acad. Sci. U.S.A. 86:1698-1702.
32. Hahnloser, R. H., Kozhevnikov, A. A., and Fee, M. S. (2002). An ultra-sparse code underlies the generation of neural sequences in a songbird. Nature 419, 65-70.
33. Hanuschkin, A., Diesmann, M., and Morrison, A. (2010a). A reafferent model of song syntax generation in the Bengalese finch. BMC Neurosci. 11(Suppl. 1), P33. doi: 10.1186/1471- 2202-11-S1-P33.
34. Hanuschkin, A., Herrmann, J. M., Morrison, A., and Diesmann, M. (2010b). Compositionality of arm movements can be realized by propa-gating synchrony. J. Comput. Neurosci. doi: 10.1007/s10827-010-0285-9. [Epub ahead of print].
35. Hasenstaub, A., Shu, Y., Haider, B., Kraushaar, U., Duque, A., andMcCormick, D. (2005). Inhibitory postsynaptic potentials carry synchronized frequency information in active cortical networks. Neuron 3, 423-435.
36. Hayon, G., Abeles, M., and Lehmann, D. (2005). A model for representing the dynamics of a system of synfire chains. J. Comput. Neurosci. 18, 41-53.
37. Herrmann, M., Hertz, J. A., and Prügel-Bennett, A. (1995). Analysis of synfire chains. Network 6, 403-414.
38. Ikegaya, Y., Aaron, G., Cossart, R., Aronov, D., Lampl, I., Ferster, D., and Yuste, R. (2004). Synfire chains and cortical songs: temporal modules of cortical activity. Science 5670, 559-564.
39. Ikegaya, Y., Matsumoto, W., Chiou, H. Y., Yuste, R., and Aaron, G. (2008). Statistical significance of precisely repeated intracellular synaptic pat-terns. PLoS One 3:e3983. doi: 10.1371/ journal.pone.0003983.
40. Izhikevich, E. M. (2007). Solving the dis-tal reward problem through linkage of STDP and dopamine signaling. Cereb. Cortex 17, 2443-2452.
41. Izhikevich, E. M., Gally, J. A., and Edelman, G. M. (2004). Spike-timing dynamics of neuronal groups. Cereb. Cortex 14, 933-944.
42. Jack, J. J. B., Noble, D., and Tsien, R. W. (1983). Electric Current Flow in Excitable Cells. Oxford: Oxford University Press.
43. Ji, D., and Wilson, M. A. (2007). Coordinated memory replay in the visual cortex and hippocampus dur-ing sleep. Nat. Neurosci. 10, 100-107. doi: 10.1038/nn1825.
44. Jin, D. Z. (2009). Generating variable bird-song syllable sequences with branch-ing chain networks in avian premotor nucleus HVC. Phys. Rev. E. 80, 051902.
45. Jin, D. Z., Ramazanoglu, F. M., and Seung, H. S. (2007). Intrinsic burst-ing enhances the robustness of a neural network model of sequence generation by avian brain area HVC. J. Comput. Neurosci. 23, 283-299.
46. Jun, J. K., and Jin, D. Z. (2007). Development of neural circuitry for precise temporal sequences through spontaneous activity, axon remod-eling, and synaptic plasticity. PLoS One 2(8):e723. doi: 10.1371/journal. pone.0000723
47. Kohn, A., and Smith, M. A. (2005). Stimulus dependence of neuronal correlations in primary visual cortex of the Macaque. J. Neurosci. 25, 3661-3673.
48. Kozhevnikov, A., and Fee, M. S. (2007). Singing-related activity of identified HVC neurons in the zebra finch. J. Neurophysiol. 97, 4271-4283.
49. Kunkel, S., Diesmann, M., and Morrison, A. (2010). Limits to the development of feed-forward structures in large recurrent neuronal networks. Front. Comput. Neurosci. 4:160. doi: 10.3389/ fncom.2010.00160
50. Li, M., and Greenside, H. (2006). Stable propagation of a burst through a one- dimensional homogeneous excitatory chain model of songbird nucleus HVC. Phys. Rev. E. 74, 011918.
51. Long, M. A., Jin, D. Z., and Fee, M. S. (2010). Support for a synaptic chain model of neuronal sequence genera-tion. Nature 18, 394-399.
52. Masuda, N. (2006). Simultaneous rate- synchrony codes in population of spiking neurons. Neural Comput. 18, 45-59.
53. Matsumura, M., Chen, D., Sawaguchi, T., Kubota, K., and Fetz, E. E. (1996). Synaptic interactions between primate precentral cortex neurons revealed by spike-triggered averaging of intracel-lular membrane potentials in vivo. J. Neurosci. 16, 7757-7767.
54. Miller, K. J., Schalk, G, Fetz, E. E, den Nijs, M, Ojemann, J. G, and Rao, R. P. (2010). Cortical activity during motor execution, motor imagery, and image-ry-based online feedback. Proc. Natl. Acad. Sci. U.S.A. 107, 4430-4435.
55. Mokeichev, A., Okun, M., Barak, O., Katz, Y., Ben-Shahar, O., and Lampl, I. (2007). Stochastic emergence of repeating cortical motifs in spontane-ous membrane potential fluctuations in vivo. Neuron 53, 413-425.
56. Morrison, A., Aertsen, A., and Diesmann, M. (2007). Spike-timing dependent plasticity in balanced random networks. Neural Comput. 19, 1437-1467.
57. Morrison, A., Mehring, C., Geisel, T., Aertsen, A., and Diesmann, M. (2005). Advancing the boundaries of high connectivity network simulation with distributed computing. Neural Comput. 17, 1776-1801.
58. Mussa-Ivaldi, F. A., and Bizzi, E. (2000). Motor learning through the combina-tion of primitives. Philos. Trans. R. Soc. Lond., B. 355, 1755-1769.
59. Mussa-Ivaldi, F. A., Giszter, S., and Bizzi, E. (1994). Linear combinations of primitives in vertebrate motor con-trol. Proc. Natl. Acad. Sci. U.S.A. 91, 7534-7538.
60. Nordlie, E., Gewaltig, M.-O., and Plesser, H. E. (2009). Towards reproduc-ible descriptions of neuronal net-work models. PLoS Comput. Biol. 5:e1000456. doi: 10.1371/journal. pcbi.1000456.
61. Okanoya, K. (2004). The Bengalese finch: a window on the behavioral neurobi-ology of birdsong syntax. Ann. N. Y. Acad. Sci. 1016, 724-735.
62. Oram, M. W., Wiener, M. C., Lestienne, R., and Richmond, B. J. (1999). Stochastic nature of precisely timed spike patterns in visual system neuronal responses. J. Neurophysiol. 81, 3021-3033.
63. Papoulis, A. (1991). Probability, Random Variables, and Stochastic Processes (3rd Edn.). Boston, MA: McGraw-Hill.
64. Pesaran, B., Nelson, M. J., and Andersen, R. A. (2006). Dorsal premotor neu-rons encode the relative position of the hand, eye, and goal during reach planning. Neuron 51, 125-134.
65. Pfurtscheller, G., and Lopes da Silva, F. H. (1999). Event-related EEG/MEG syn-chronization and desynchronization: basic principles. Clin. Neurophysiol. 110, 1842-1857.
66. Plamondon, R. (1995). A kinematic the-ory of rapid human movements. part I. movement representation and gen-eration. Biol. Cybern. 72, 295-307.
67. Plesser, H. E., and Diesmann, M. (2009). Simplicity and efficiency of integrate- and-fire neuron models. Neural Comput. 21, 353-359.
68. Polyakov, F., Drori, R., Ben-Shaul, Y., Abeles, M., and Flash, T. (2009a). A compact representation of drawing movements with sequences of parabolic primitives. PLoS Comput. Biol. 5: e1000427. doi: 10.1371/journal.pcbi.1000427.
69. Polyakov, F., Stark, E., Drori, R., Abeles, M., and Flash, T. (2009b). Parabolic move-ment primitives and cortical states: merging optimality with geometric invariance. Biol. Cybern. 100, 159-184.
70. Potjans, W., Morrison, A., and Diesmann, M. (2009a). A spiking neural network model of an actor-critic learning agent. Neural Comput. 21, 301-339.
71. Potjans, W., Morrison, A., and Diesmann, M. (2009b). A spiking temporal- difference learning model based on dopamine-modulated plasticity. BMC Neurosci. 10(Suppl. 1), 140. doi: 10.1186/1471-2202-10-S1-P140.
72. Prut, Y., Vaadia, E., Bergman, H., Haalman, I., Hamutal, S., and Abeles, M. (1998). Spatiotemporal structure of cortical activity: properties and behavioral relevance. J. Neurophysiol. 79, 2857-2874.
73. Pulvermüller, F. (1999). Words in the brain's language. Behav. Brain Sci. 22, 253-279.
74. Pulvermüller, F. (2002). The Neuroscience of Language: On Brain Circuits of Words and Serial Order. Cambridge: Cambridge University Press.
75. Pulvermüller, F., and Shtyrov, Y. (2009). Spatiotemporal signatures of large-scale synfire chains for speech processing as revealed by MEG. Cereb. Cortex. 19, 79-88.
76. Redgrave, P., Prescott, T., and Gurney, K. (1999). The basal ganglia: a vertebrate solution to the selection problem? Neuroscience 89, 1009-1023.
77. Rohrer, B., Fasoli, S., Krebs, H. I., Hughes, R., Volpe, B., Frontera, W. R., Stein J., and Hogan, N. (2002). Movement smoothness changes during stroke recovery. J. Neurosci. 22, 8297-8304.
78. Rotter, S., and Diesmann, M. (1999). Exact digital simulation of time-invariant linear systems with applications to neuronal modeling. Biol. Cybern. 81(5/6), 381-402.
79. Sakata, J. T., and Brainard, M. S. (2008). Online contributions of auditory feedback to neural activity in avian song control circuitry. J. Neurosci. 28, 11378-11390.
80. Salinas, E., and Abbott, L. F. (1995). Transfer of coded information from sensory to motor networks. J. Neurosci. 15, 6461-6474.
81. Schrader, S., Grün, S., Diesmann, M., and Gerstein, G. (2008). Detecting synfire chain activity using massively parallel spike train recording. J. Neurophysiol. 100, 2165-2176.
82. Schrader, S., Morrison, A., and Diesmann, M. (2007). "A composition machine for complex movements," in Proceedings of the 31st Göttingen Neurobiology Conference, Göttingen, Germany, TS18-1C.
83. Shmiel, T., Drori, R., Shmiel, O., Ben-Shaul, Y., Nadasdy, Z., Shemesh, M., Teicher, M., and Abeles, M. (2006). Temporally precise cortical firing patterns are associated with distinct action segments. J. Neurophysiol. 96, 2645-2652.
84. Shmiel, T., Drori, R., Shmiel, O., Ben-Shaul, Y., Nadasdy, Z., Shemesh, M., Teicher, M., Abeles, M., and Bass, H. (2005). Neurons of the cerebral cortex exhibit precise interspike timing in correspondence to behavior. Proc. Natl. Acad. Sci. U.S.A. 102, 18655-18657.
85. Soechting, J., and Terzuolo, C. (1987). Organization of arm movements. Motion is segmented. Neuroscience 23, 39-51.
86. Sosnik, R., Hauptmann, B., Karni, A., and Flash, T. (2004). When practice leads to co-articulation: the evolution of geo-metrically defined movement primi-tives. Exp. Brain Res. 156, 422-438.
87. Tanaka, K. (2003). Columns for complex visual object features in the inferotem-poral cortex: clustering of cells with similar but slightly different stimulus selectivities. Cereb. Cortex 13, 90-99.
88. Thoroughman, K. A., and Shadmehr, R. (2000). Learning of action through adaptive combination of motor primi-tives. Nature 407, 742-747.
89. Thorpe, S., Fize, D., and Marlot, C. (1996). Speed of processing in the human vis-ual system. Nature 381, 520-522.
90. Trengove, C. (2007). Storage capacity of a superposition of synfire chains using conductance-based integrate-and-fire neurons. BMC Neurosci. 8(Suppl. 2), P67. doi: 10.1186/1471-2202-8-S2- P67.
91. Tuckwell, H. C. (1988). "The Lapique model of the nerve cell, chapter 3," in Introduction to Theoretical Neurobiology, Vol. 1, eds C. Cannings, F. C. Hoppensteadt, and L. A. Segel (Cambridge: Cambridge University Press), 85-123.
92. Vasilaki, E., Frémaux, N., Urbanczik, R., Senn, W., and Gerstner, W. (2009). Spike-based reinforcement learning in continuous state and action space: when policy gradient methods fail. PLoS Comput. Biol. 5: e1000586. doi: 10.1371/journal.pcbi.1000586.
93. Wennekers, T. (2007). A cell assem-bly model for complex behaviour. Neurocomputation 70, 1988-1992.
94. Wennekers, T., Garagnani, M., and Pulvermüller, F. (2006). Language models based on Hebbian cell assem-blies. J. Physiol. Paris 100, 16-30.
95. Wennekers, T., and Palm, G. (1996). "Controlling the speed of synfire chains," in Artificial Neural Networks - ICANN 96, eds C. von der Malsburg, W. von Seelen, J. C. Vorbrüggen, and B. Sendhoff (Berlin: Springer-Verlag), 451-456.
96. Woolley, S. M., and Rubel, E. W. (1997). Bengalese finches Lonchura Striata Domestica depend upon auditory feedback for the maintenance of adult song. J. Neurosci. 17, 6380-6390.