Sequential activity in asymmetrically coupled winner-take-all circuits

Neural Computation

Volumn 26, Issue 9, 2014, Pages 1973-2004

  Mostafa, Hesham ^a   Indiveri, Giacomo ^a  

^a Institute of Neuroinformatics Zurich   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ARTIFICIAL NEURAL NETWORK; BRAIN CORTEX; COMPUTER SIMULATION; NERVE CELL; NERVE CELL PLASTICITY; PHYSIOLOGY; SYNAPSE;

ACTION POTENTIALS; CEREBRAL CORTEX; COMPUTER SIMULATION; NEURAL NETWORKS (COMPUTER); NEURONAL PLASTICITY; NEURONS; SYNAPSES;

EID: 84929235061     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00619     Document Type: Letter

References (51)

1. Abeles, M. (1982). Local cortical circuits: An electrophysiological study. New York: Springer-Verlag.
2. Afraimovich, V. S., Zhigulin, V. P., & Rabinovich, M. I. (2004). On the origin of reproducible sequential activity in neural circuits. Chaos, 14, 1123-1129.
3. Amari, S. (1977). Dynamics of pattern formation in lateral-inhibition type neural fields. Biological Cybernetics, 27, 77-87.
4. Amit, D. J. (1988). Neural networks counting chimes. Proc. Natl. Acad. Sci USA, 85, 2141-2145.
5. Amit, D. J. (1989). Modeling brain function: The world of attractor neural networks.Cambridge: Cambridge University Press.
6. Amit, D., & Brunel, N. (1997). Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cerebral Cortex, 7, 237-252.
7. Bienenstock, E., Cooper, L., & Munro, P. (1982). Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex. Journal of Neuroscience, 2, 32-48.
8. Binzegger, T., Douglas, R. J., & Martin, K. A. C. (2004). A quantitative map of the circuit of cat primary visual cortex. Journal of Neuroscience, 24, 8441-8453.
9. da Costa, N. M., & Martin, K. A. (2010). Whose cortical column would that be? Frontiers in Neuroanatomy, 4.
10. Deco, G., & Rolls, E. T. (2005). Sequential memory: A putative neural and synaptic dynamical mechanism. Journal of Cognitive Neuroscience, 17, 294-307.
11. Dehaene, S., Changeux, J. P., & Nadal, J. P. (1987). Neural networks that learn temporal sequences by selection. PNAS, 84, 2727-2731.
12. Douglas, R. J., & Martin, K. A. (1991). A functional microcircuit for cat visual cortex. Journal of Physiology, 440, 735-769.
13. Douglas, R. J., & Martin, K. A. (2004). Neuronal circuits of the neocortex. Annual Review of Neuroscience, 27, 419-451.
14. Douglas, R. J., Martin, K. A. C., & Whitteridge, D. (1989). A canonical microcircuit for neocortex. Neural Computation, 1, 480-488.
15. Ermentrout, B. (1992). Complex dynamics in winner-take-all neural nets with slow inhibition. Neural Networks, 5, 415-431.
16. Fiete, I. R., Senn, W., Wang, C. Z. H., & Hahnloser, R. H. R. (2010). Spike-timedependent plasticity and heterosynaptic competition organize networks to produce long scale-free sequences of neural activity. Neuron, 65, 563-576.
17. Freund, T., Martin, K., Smith, A., & Somogyi, P. (1983). Glutamate decarboxylaseimmunoreactive terminals of golgi-impregnated axoaxonic cells and of presumed basket cells in synaptic contact with pyramidal neurons of the cat's visual cortex. Journal of Comparative Neurology, 221, 263-278.
18. Fusi, S., & Mattia, M. (1999). Collective behavior of networks with linear (VLSI) integrate-and-fire neurons. Neural Computation, 11, 633-652.
19. Graupner, M., & Brunel, N. (2012). Calcium-based plasticitymodel explains sensitivity of synaptic changes to spike pattern, rate, and dendritic location. Proceedings of the National Academy of Sciences, 109, 3991-3996.
20. Hahnloser, R. H. R., Kozhevnikov, A. A., & Fee, M. S. (2002). An ultra-sparse code underlies the generation of neural sequences in a songbird. Nature, 419, 65-70.
21. Hopfield, J. J. (1982). Neural networks and physical systemswith emergent collective computational abilities. Proceedings of the National Academy of Sciences, 79, 2554-2558.
22. Hopfield, J. J. (2010).Neurodynamics ofmental exploration. Proceedings of the National Academy of Sciences, 107, 1648-1653.
23. Indiveri, G., Linares-Barranco, B., Hamilton, T., van Schaik, A., Etienne-Cummings, R., Delbruck, T., . . . Boahen, K. (2011). Neuromorphic silicon neuron circuits. Frontiers in Neuroscience, 5, 1-23.
24. Jahr, C., & Stevens, C. (1990). Voltage dependence of NMDA-activated macroscopic conductances predicted by single-channel kinetics. Journal of Neuroscience, 10, 3178-3182.
25. Kleinfeld, D., & Sompolinsky, H. (1988). Associative neural network model for the generation of temporal patterns: Theory and application to central pattern generators. Biophysical Journal, 54, 1039-1051.
26. Knight, B. W. (2000). Dynamics of encoding in neuron populations: Some general mathematical features. Neural Computation, 12, 473-518.
27. Lashley, K. S. (1951). The problem of serial order in behavior. In L. A. Jeffress (Ed.), Cerebral mechanisms in behavior: The Hixon Symposium (pp. 112-136). New York: Wiley.
28. Markram, H., Toledo-Rodriguez, M., Wang, Y., Gupta, A., Silberberg, G., & Wu, C. (2004). Interneurons of the neocortical inhibitory system. Nature Reviews Neuroscience, 5, 793-807.
29. Martin, K. A. (2011). Neuroanatomy: Uninhibited connectivity in neocortex? Current Biology, 21, R425-R427.
30. Mattia, M., & Del Giudice, P. (2002). Population dynamics of interacting spiking neurons. Physical Review E, 66, 051917.
31. McCormick, D., Connors, B., Lighthall, J., & Prince, D. (1985). Comparative electrophysiology of pyramidal and sparsely spiny stellate neurons of the neocortex. Journal of Neurophysiology, 54, 782-806.
32. McKinstry, J., & Edelman, G. (2013). Temporal sequence learning in winner-take-all networks of spiking neurons demonstrated in a brain-based device. Frontiers in Neurorobotics, 7.
33. Pulvermüller, F., & Shtyrov, Y. (2008). Spatiotemporal signatures of large-scale synfire chains for speech processing as revealed by MEG. Cerebral Cortex, 19, 79-88.
34. Rabinovich, M., Volkovskii, A., Lecanda, P., Huerta, R., Abarbanel, H. D., & Laurent, G. (2001). Dynamical encoding by networks of competing neuron groups: Winnerless competition. Physical Review Letters, 87.
35. Rabinovich, M. I., Huerta, R., Varona, P., & Afraimovich, V. S. (2008). Transient cognitive dynamics, metastability, and decision making. PLoS Comput. Biol., 4, e1000072.
36. Rotter, S., & Aertsen, A. (1998). Accurate spike synchronization in cortex. Z. Naturforsch C., 53, 686-690.
37. Rutishauser, U., & Douglas, R. J. (2009). State-dependent computation using coupled recurrent networks. Neural Comput., 21, 478-509.
38. Rutishauser, U., Douglas, R., & Slotine, J. (2011). Collective stability of networks of winner-take-all circuits. Neural Comput., 23, 735-773.
39. Rutishauser, U., Slotine, J.-J., & Douglas, R. J. (2012). Competition through selective inhibitory synchrony. Neural Comput., 24, 2033-2052.
40. Sandamirskaya, Y., & Schöner, G. (2010). An embodied account of serial order: How instabilities drive sequence generation. Neural Networks, 23, 1164-1179.
41. Schoener, G. (2008). Dynamical systems approaches to cognition. In R. Sun (Ed.), The Cambridge handbook of computational psychology (pp. 101-125). Cambridge: Cambridge University Press.
42. Sjöström, P. J., Turrigiano, G. G., & Nelson, S. B. (2001).Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron, 32, 1149-1164.
43. Soltani, A., & Wang, X.-J. J. (2006). A biophysically based neural model of matching law behavior: Melioration by stochastic synapses. Journal of Neuroscience, 26, 3731-3744.
44. Spencer, J., Perone, S., & Johnson, J. (2009). The dynamic field theory and embodied cognitive dynamics. In J. P. Spencer, M. S. C. Thomas, & J. L. McClelland (Eds.), Toward a new grand theory of development: Connectionism and dynamic systems theory re-considered (pp. 86-118). New York: Oxford University Press.
45. Tanji, J. (2001). Sequential organization of multiple movements: Involvement of cortical motor areas. Annual Review of Neuroscience, 24, 631-651.
46. Thomson, A. M., Bannister, A. P., Mercer, A., & Morris, O. T. (2002). Target and temporal pattern selection at neocortical synapses. Philos. Trans. R. Soc. Lond. B. Biol. Sci., 357, 1781-1791.
47. Thomson, A. M., West, D. C., Wang, Y., & Bannister, A. P. (2002). Synaptic connections and small circuits involving excitatory and inhibitory neurons in layers 2-5 of adult rat and cat neocortex: Triple intracellular recordings and biocytin labelling in vitro. Cerebral Cortex, 12, 936-953.
48. Verduzco-Flores, S. O., Bodner, M., & Ermentrout, B. (2012). A model for complex sequence learning and reproduction in neural populations. J. Comput. Neurosci., 32, 403-423.
49. Wang, X.-J. (2002). Probabilistic decision making by slow reverberation in cortical circuits. Neuron, 36, 955-968.
50. Wang, X.-J. (2008). Decision making in recurrent neuronal circuits. Neuron, 60, 215-234.
51. Watts, J., & Thomson, A. M. (2005). Excitatory and inhibitory connections show selectivity in the neocortex. Journal of Physiology, 562, 89-97.