A model for complex sequence learning and reproduction in neural populations

Journal of Computational Neuroscience

Volumn 32, Issue 3, 2012, Pages 403-423

  Verduzco Flores, Sergio Oscar ^a   Bodner, Mark ^b   Ermentrout, Bard ^c  

^a UNIVERSITY OF COLORADO   (United States)

^b MIND Research Institute   (United States)

^c UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Complex sequences; Firing rate models; Spike timing dependent plasticity

Indexed keywords

COMPLEX NETWORKS; MAMMALS; NEURAL NETWORKS; TIMING CIRCUITS;

COMPLEX SEQUENCES; EXCITATION PATHWAYS; FIRING RATE MODELS; HEBBIAN PLASTICITY; NEURAL POPULATIONS; SECOND LAYER; SEQUENCE LEARNING; SPIKE TIMING DEPENDENT PLASTICITIES; TEMPORAL PATTERN; TEMPORAL STRUCTURES;

NEURONS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPLEX SEQUENCE LEARNING; COMPLEX SEQUENCE REPRODUCTION; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; EXCITATORY JUNCTION POTENTIAL; EXCITATORY POSTSYNAPTIC POTENTIAL; INHIBITORY POSTSYNAPTIC POTENTIAL; MATHEMATICAL MODEL; NERVE CELL INHIBITION; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NERVE CELL STIMULATION; NERVOUS SYSTEM PARAMETERS; OSCILLATION; PRIORITY JOURNAL; SIGNAL PROCESSING; TEMPORAL LOBE; WORKING MEMORY;

EID: 84863985477     PISSN: 09295313     EISSN: 15736873     Source Type: Journal    
DOI: 10.1007/s10827-011-0360-x     Document Type: Article

References (73)

1. Abbott, L. F., & Blum, K. I.(1996). Functional significance of long-term potentiation for sequence learning and prediction. Cerebral Cortex, 6(3), 406-416. (Pubitemid 26161552)
2. Abeles, M. (1991). Corticonics: Neural circuits of the cerebral cortex. New York: Cambridge University Press.
3. Amari, S. I. (1972). Learning patterns and pattern sequences by self-organizing nets of threshold elements. IEEE Transactions on Computers, c-21(11), 1197-1206.
4. Brenowitz, E. A., Margoliash, D., & Nordeen, K. W. (1997). An introduction to birdsong and the avian song system. Journal of Neurobiology, 33(5), 495-500. (Pubitemid 27456448)
5. Buonomano, D. V. (2003). Timing of neural responses in cortical organotypic slices. Proceedings of the National Academy of Sciences of the United States of America 100(8), 4897-4902.
6. Buzsáki, G., & Draguhn A. (2004). Neuronal oscillations in cortical networks. Science, 304, 1926-1929.
7. Caianiello, E., de Luca, A., & Ricciardi, L. (1967). Reverberations and control of neural networks. Kybernetik, 4, 10-18.
8. Cariani, P. A. (2004). Temporal codes and computations for sensory representation and scene analysis. IEEE Transactions on Neural Networks/IEEE Neural Networks Council, 15(5), 1100-1111.
9. Carr, C. E. (1993). Processing of temporal information in the brain. Annual Review of Neuroscience, 16, 226-243.
10. Chang, W., & Jin, D. (2009). Spike propagation in driven chain networks with dominant global inhibition. Physical Review E, 79(5), 1-5.
11. Compte, A., Constantinidis, C., Tegner, J., Raghavachari, S., Chafee, M. V., Goldman-Rakic, P. S., et al. (2003). Temporally irregular mnemonic persistent activity in prefrontal neurons of monkeys during a delayed response task. Journal of Neurophysiology, 90(5), 3441-3454. (Pubitemid 37430036)
12. De Zeeuw, C. I., Hoebeek, F. E., Bosman, L. W. J., Schonewille, M., Witter, L., & Koekkoek, S. K. (2011). Spatiotemporal firing patterns in the cerebellum. Nature Reviews Neuroscience, 12, 327-344.
13. Diesmann, M., Gewaltig, M. O., & Aertsen, A. (1999). Stable propagation of synchronous spiking in cortical neural networks. Nature, 402(6761), 529-533.
14. Doursat, R., & Bienenstock, E.(2006). Neocortical self-structuration as a basis for learning. In 5th International Conference on Development and Learning (ICDL 2006) (pp. 1-6).
15. Durstewitz, D., Seamans, J. K., & Sejnowski, T. J. (2000). Neurocomputational models of working memory. Nature Neuroscience, 3, 1184-1191.
16. Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14(2), 179-211.
17. Fiete, I. R., Senn, W., Wang, C. Z. H., & Hahnloser, R. H. R. (2010). Spike-time-dependent plasticity and heterosynaptic competition organize networks to produce long scale-free sequences of neural activity. Neuron, 65(4), 563-576.
18. Freund, T., & Buzsáki, G. (1998). Interneurons of the hippocampus. Hippocampus, 6(4), 347-470.
19. Fries, P. (2005). A mechanism for cognitive dynamics: Neuronal communication through neuronal coherence. Trends in Cognitive Sciences, 9(10), 474-480.
20. Funahashi, S. (2006). Prefrontal cortex and working memory processes. Neuroscience, 139(1), 251-261.
21. Fuster, J. M., & Alexander, G. E. (1971). Neuron activity related to short-term memory. Science, 173(3997), 652-654.
22. Goldman, M. S. (2009). Memory without feedback in a neural network. Neuron, 61(4), 621-634.
23. Gutkin, B. S., Laing, C. R., Colby, C. L., Chow, C. C., &Ermentrout, G. B. (2001). Turning on and off with excitation: The role of spike-timing asynchrony and synchrony in sustained neural activity. Journal of Computational Neuroscience, 11, 121-134. (Pubitemid 34051482)
24. Guyon, I., Personnaz, L., Nadal, J., & Dreyfus, G. (1988). Storage and retrieval of complex sequences in neural networks. Physical Review A, 38(12), 6365-6372.
25. Hájos, N., Pálhalmi, J., Mann, E. O., Németh, B., Paulsen, O., & Freund, T. F. (2004). Spike timing of distinct types of GABAergic interneuron during hippocampal gamma oscillations in vitro. The Journal of Neuroscience: The official journal of the Society for Neuroscience, 24(41), 9127-9137.
26. Hanuschkin, A., Diesmann, M., & Morrison, A. (2010). A reafferent model of song syntax generation in the Bengalese finch. BMC Neuroscience, 11(Suppl 1), 33.
27. Horn, D., Levy, N., & Ruppin, E. (2000). Distributed synchrony in an attractor of spiking neurons. Neurocomputing, 32-33, 409-414. (Pubitemid 30459749)
28. Horn, D., & Usher, M. (1992). Oscillatory model of short term memory. In J. Moody (Ed.), Advances in neural information processing systems (Vol. 4). Morgan Kaufmann.
29. Ikegaya, Y., Aaron, G., Cossart, R., Aronov, D., Lampl, I., Ferster, D., et al. (2004). Synfire chains and cortical songs: Temporal modules of cortical activity. Science, 304(5670), 559-564. (Pubitemid 38541909)
30. Itskov, V., Curto, C., Pastalkova, E., & Buzsáki, G. (2011). Cell assembly sequences arising from spike threshold adaptation keep track of time in the hippocampus. The Journal of Neuroscience, 31(8), 2828-2834.
31. Izhikevich, E. M. (2006). Polychronization: Computation with spikes. Neural Computation, 18(2), 245-282.
32. Jensen, O. (2006). Maintenance of multiple working memory items by temporal segmentation. Neuroscience, 139(1), 237-249.
33. Jordan, M. (1986). Attractor dynamics and parallelism in a connectionist sequential machine. In: Proceedings of the eighth annual conference of the cognitive science society (pp. 531-546). Hillsdale: Lawrence Erlbaum Associates, Inc.
34. Jun, J. K. & Jin, D. Z. (2007). Development of neural circuitry for precise temporal sequences through spontaneous activity, axon remodeling, and synaptic plasticity. PLoS ONE, 2(1), e723.
35. Karbowski, J., & Ermentrout, G. (2002). Synchrony arising from a balanced synaptic plasticity in a network of heterogeneous neural oscillators. Physical Review E, 65(3), 1-5.
36. Karmarkar, U. R., & Buonomano, D. V. (2007). Timing in the absence of clocks: Encoding time in neural network states. Neuron, 53(3), 427-438. http://www.ncbi.nlm.nih.gov/pubmed/17270738. (Pubitemid 46161265)
37. Kunkel, S., Diesmann, M., & Morrison, A. (2011). Limits to the development of feed-forward structures in large recurrent neuronal networks. Front Comput Neurosci, 4, 160
38. Kleinfeld, D., & Sompolinsky, H. (1988). Associative neural network model for the generation of temporal patterns: Theory and application to central pattern generators. Biophysical Journal, 54, 1039-1051. (Pubitemid 19013922)
39. Lisman, J.,&Buzsáki,G. (2008).Aneural coding scheme formed by the combined function of gamma and theta oscillations. Schizophrenia Bulletin 34(5), 974-980.
40. Lisman, J. E., & Idiart, M.A. (1995). Storage of 7 ± 2 short-term memories in oscillatory subcycles. Science, 267(5203), 1512-1515.
41. Liu, J. K., & Buonomano, D. V. (2009). Embedding multiple trajectories in simulated recurrent neural networks in a self-organizing manner. The Journal of neuroscience: The official journal of the Society for Neuroscience, 29(42), 13,172-13,181.
42. Luczak, A., Barthó, P., & Harris, K. D. (2009). Spontaneous events outline the realm of possible sensory responses in neocortical populations. Neuron, 62(3), 413-425.
43. Luczak, A., Barthó, P., Marguet, S. L., Buzsáki, G., & Harris, K. D. (2007). Sequential structure of neocortical spontaneous activity in vivo. Proceedings of the National Academy of Sciences of the United States of America, 104(1), 347-352. (Pubitemid 46068034)
44. Mauk, M. D., & Buonomano, D. V. (2004). The neural basis of temporal processing. Annual Review of Neuroscience, 27, 307-340. (Pubitemid 39050406)
45. Meskenaite, V. (1997). Calretinin-immunoreactive local circuit neurons in area 17 of the cynomolgus monkey, Macaca fascicularis. The Journal of Comparative Neurology, 379(1), 113-32.
46. Minai, A., & Levy, W. (1993). Sequence learning in a single trial. In INNS World congress neural networks II (Vol. 2, pp. 505-508).
47. Morrison, A.,Aertsen,A.,&Diesmann, M. (2007). Spike-timing-dependent plasticity in balanced random networks. Neural Computation, 19(6), 1437-1467.
48. Mountcastle, V. B. (1997). The columnar organization of the neocortex. Brain: A Journal of Neurology, 120, 701-722.
49. Nádasdy, Z., Hirase, H., Czurkó, a., Csicsvari, J., & Buzsáki, G. (1999). Replay and time compression of recurring spike sequences in the hippocampus. The Journal of neuroscience: The Official Journal of the Society for Neuroscience, 19(21), 9497-9507.
50. Nakamura, K., Mikami, A.,&Kubota, K. (1992).Oscillatory neuronal activity related to visual short-term memory in monkey temporal pole. NeuroReport, 3(1), 117-120.
51. Pastalkova, E., Itskov, V., Amarasingham, A., & Buzsáki, G. (2008). Internally generated cell assembly sequences in the rat hippocampus. Science, 321(5894), 1322-1327.
52. Pesaran, B., Pezaris, J. S., Sahani, M., Mitra, P. P., & Andersen, R. A. (2002). Temporal structure in neuronal activity during working memory in macaque parietal cortex. Nature Neuroscience, 5(8), 805-811. (Pubitemid 34827600)
53. Prut, Y., Vaadia, E., Bergman, H., Haalman, I., Slovin, H., &Abeles, M. (1998). Spatiotemporal structure of cortical activity: Properties and behavioral relevance. Journal of Neurophysiology, 79(6), 2857-2874. (Pubitemid 28317018)
54. Romo, R., Brody, C. D., Hernández, A., & Lemus, L. (1999). Neuronal correlates of parametric working memory in the prefrontal cortex. Nature, 399(6735), 470-473.
55. van Rossum, M. C. W., Turrigiano, G. G., & Nelson, S. B. (2002). Fast propagation of firing rates through layered networks of noisy neurons.The Journal of Neuroscience: The official Journal of the Society for Neuroscience, 22(5), 1956-1966.
56. Shaw, G., Silverman, D., Pearson, J. C. (1985). Model of cortical organization embodying a basis for a theory of information processing and memory recall. Proceedings of the National Academy of Sciences of the United States of America, 82, 2364-2368.
57. Sompolinsky, H., & Kanter, I. (1986). Temporal association in asymmetric neural networks. Physical Review Letters, 57(22), 2861-2864.
58. Song, S., Sjöström, P. J., Reigl, M., Nelson, S.,&Chklovskii, D. B. (2005). Highly nonrandom features of synaptic connectivity in local cortical circuits. PLoS Biology, 3(3), e68.
59. Sun, R., & Giles, C. (2001). Sequence learning: From recognition and prediction to sequential decision making. IEEE Intelligent Systems, 16(4), 67-70. (Pubitemid 32828680)
60. Suri, R. E., & Sejnowski, T. J. (2002). Spike propagation synchronized by temporally asymmetric Hebbian learning. Biological Cybernetics, 87(5-6), 440-445. (Pubitemid 135689604)
61. Sussillo,D.,&Abbott, L. F. (2009).Generating coherent patterns of activity from chaotic neural networks. Neuron, 63(4), 544-557.
62. Szatmáry, B., & Izhikevich, E. M. (2010). Spike-timing theory of working memory. PLoS Computational Biology, 6(8), e1000,879.
63. Tallon-Baudry, C., Bertrand, O., & Fischer, C. (2001). Oscillatory synchrony between human extrastriate areas during visual short-term memory maintenance. The Journal of Neuroscience: The official Journal of the Society for Neuroscience, 21(20), Rc177.
64. Tang, A., Jackson, D., Hobbs, J., Chen, W., Smith, J. L., Patel, H., et al. (2008). A maximum entropy model applied to spatial and temporal correlations from cortical networks in vitro. The Journal of Neuroscience: The official Journal of the Society for Neuroscience, 28(2), 505-518.
65. Thiagarajan, T. C., Lebedev, M. A., Nicolelis, M. A., & Plenz, D. (2010). Coherence potentials: loss-less, all-or-none network events in the cortex. PLoS Biology 8(1), e1000,278.
66. Vogels, T. P., & Abbott, L. F. (2005). Signal propagation and logic gating in networks of integrate-and-fire neurons. The Journal of Neuroscience: The official Journal of the Society for Neuroscience, 25(46), 10,786-10,795.
67. Wang, D., & Arbib, M. (1990). Complex temporal sequence learning based on short-term memory. Proceedings of the IEEE, 78(9), 1536-1543.
68. Wang, L. (1999). Multi-associative neural networks and their applications to learning and retrieving complex spatiotemporal sequences. IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics: A Publication of the IEEE Systems, Man, and Cybernetics Society, 29(1), 73-82.
69. Wang, X. J. (2001). Synaptic reverberation underlying mnemonic persistent activity. Trends in Neurosciences, 24(8), 455-63.
70. Wilson, H. R., & Cowan, J. D. (1972). Excitatory and inhibitory interactions in localized populations of model neurons. Biophysical Journal, 12(1), 1-24.
71. Yamashita, Y., Takahasi, M., Okumura, T., Ikebuchi, M., Yamada, H., Suzuki,M., et al. (2008). Developmental learning of complex syntactical song in the Bengalese finch: A neural network model. Neural Networks: The official Journal of the International Neural Network Society, 21(9), 1224-1231.
72. Yamazaki, T., & Tanaka, S. (2007). The cerebellum as a liquid state machine. Neural Networks: The Official Journal of the International Neural Network Society, 20(3), 290-297. (Pubitemid 46856107)
73. Yoshioka, M., Scarpetta, S., & Marinaro, M. (2007). Spiketiming-dependent synaptic plasticity to learn spatiotemporal patterns in recurrent neural networks. In M. D. S. E. A. J (Ed.), ICANN 2007, Part I, LNCS 4668 (Vol. 1, pp. 757-766). Berlin Heidelberg: Springer.