Recurrent infomax generates cell assemblies, neuronal avalanches, and simple cell-like selectivity

Neural Computation

Volumn 21, Issue 4, 2009, Pages 1038-1067

  Tanaka, Takuma ^a   Kaneko, Takeshi ^a,b   Aoyagi, Toshio ^a,b  

^a KYOTO UNIVERSITY   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; ARTICLE; BIOLOGICAL MODEL; CENTRAL NERVOUS SYSTEM; CYTOLOGY; HUMAN; NERVE CELL; NERVE CELL PLASTICITY; PHYSIOLOGY;

ALGORITHMS; ANIMALS; CENTRAL NERVOUS SYSTEM; HUMANS; MODELS, NEUROLOGICAL; NEURONAL PLASTICITY; NEURONS;

EID: 65549141264     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2008.03-08-727     Document Type: Letter

References (35)

1. Abbott, L., & Rohrkemper, R. (2007). A simple growth model constructs critical avalanche networks. Prog. Brain Res., 165, 13-19.
2. Abeles, M. (1991). Corticonics. Cambridge: Cambridge University Press.
3. Atick, J. J. (1992). Could information theory provide an ecological theory of sensory processing? Network, 3, 213-251.
4. Ay, N. (2002). Locality of global stochastic interaction in directed acyclic networks. Neural Comput., 14(12), 2959-2980.
5. Bak, P., Tang, C., & Wiesenfeld, K. (1987). Self-organized criticality: An explanation of the 1/f noise. Phys. Rev. Lett., 59(4), 381-384.
6. Beggs, J. M., & Plenz, D. (2003). Neuronal avalanches in neocortical circuits. J. Neurosci., 23(35), 11167-11177.
7. Bell, A. J., & Sejnowski, T. J. (1995). An information-maximization approach to blind separation and blind deconvolution. Neural Comput., 7(6), 1129-1159.
8. Bell, A. J., & Sejnowski, T. J. (1997). The "independent components" of natural scenes are edge filters.Vision Res., 37(23), 3327-3338.
9. Buonomano, D. (2005). A learning rule for the emergence of stable dynamics and timing in recurrent networks. J. Neurophysiol., 94, 2275-2283.
10. Cossart, R., Aronov, D., & Yuste, R. (2003). Attractor dynamics of network UP states in the neocortex. Nature, 423(6937), 283-288.
11. Cover, T. M., & Thomas, J. A. (2006). Elements of information theory (2nd ed.). Hoboken, NJ: Wiley.
12. Diesmann, M., Gewaltig, M. O., & Aertsen, A. (1999). Stable propagation of synchronous spiking in cortical neural networks. Nature, 402(6761), 529-533.
13. Dragoi, G., & Buzsáki, G. (2006). Temporal encoding of place sequences by hippocampal cell assemblies. Neuron, 50, 145-157.
14. Fujisawa, S., Matsuki, N., & Ikegaya, Y. (2006). Single neurons can induce phase transitions of cortical recurrent networks with multiple internal states. Cereb. Cortex, 16(5), 639-654.
15. Harris, T. E. (1989). The theory of branching processes. New York: Dover.
16. Hebb, D. O. (1949). The organization of behavior: A neuropsychological theory. Hoboken, NJ: Wiley.
17. Hinton, G. E., & Sejnowski, T. J. (1983). Optimal perceptual inference. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 448-453). Washington, DC: IEEE Computer Society Press.
18. Hubel, D. H., & Wiesel, T. N. (1959). Receptive fields of single neurones in the cat's striate cortex. J. Physiol., 148, 574-591.
19. Ikegaya, Y., Aaron, G., Cossart, R., Aronov, D., Lampl, I., Ferster, D., & Yuste, R. (2004). Synfire chains and cortical songs: Temporal modules of cortical activity. Science, 304(5670), 559-564.
20. Lewicki, M. S. (2002). Efficient coding of natural sounds. Nat. Neurosci., 5(4), 356-363.
21. Linsker, R. (1988). Self-organization in a perceptual network. Computer, 21(3), 105- 117.
22. Louie, K., & Wilson, M. A. (2001). Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep. Neuron, 29(1), 145-156.
23. Maass, W., Natschläger, T., & Markram, H. (2002). Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural. Comput., 14, 2531-2560.
24. Nadasdy, Z., Hirase, H., Czurko, A., Csicsvari, J., & Buzsaki, G. (1999). Replay and time compression of recurring spike sequences in the hippocampus. J. Neurosci., 19(21), 9497-9507.
25. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381(6583), 607-609.
26. Olshausen, B. A., & Field, D. J. (1997). Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Res., 37(23), 3311-3325.
27. Pfister, J., Toyoizumi, T., Barber, D., & Gerstner, W. (2006). Optimal spike-timing- dependent plasticity for precise action potential firing in supervised learning. Neural Comput., 18, 1318-1348.
28. Sakurai, Y., & Takahashi, S. (2006). Dynamic synchrony of firing in the monkey prefrontal cortex during working-memory tasks. J. Neurosci., 26(40), 10141-10153.
29. Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 379-423, 623-656.
30. Skaggs, W. E., & McNaughton, B. L. (1996). Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience. Science, 271(5257), 1870-1873.
31. Teramae, J.-N., & Fukai, T. (2007). Local cortical circuit model inferred from powerlaw distributed neuronal avalanches. J. Comput. Neurosci., 22(3), 301-312.
32. Toyoizumi, T., Pfister, J., Aihara, K., & Gerstner, W. (2005). Generalized Bienenstock- Cooper-Munro rule for spiking neurons that maximizes information transmission. Proc. Natl. Acad. Sci. U.S.A., 102, 5239-5244.
33. Tsukada, M., Ishii, N., & Sato, R. (1975). Temporal pattern discrimination of impulse sequences in the computer-simulated nerve cells. Biol. Cybern., 17, 19-28.
34. Vogels, T., & Abbott, L. (2005). Signal propagation and logic gating in networks of integrate-and-fire neurons. J. Neurosci., 25, 10786-10795.
35. Yao, H., Shi, L., Han, F., Gao, H., & Dan, Y. (2007). Rapid learning in cortical coding of visual scenes. Nat. Neurosci., 10(6), 772-778.