A spiking neuron as information bottleneck

Neural Computation

Volumn 22, Issue 8, 2010, Pages 1961-1992

  Buesing, Lars ^a   Maass, Wolfgang ^a  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BIOLOGICAL MODEL; LEARNING; NERVE CELL; NERVE CELL PLASTICITY; PHYSIOLOGY;

LEARNING; MODELS, NEUROLOGICAL; NEURONAL PLASTICITY; NEURONS;

EID: 77955993539     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2010.08-09-1084     Document Type: Article

References (36)

1. Becker, S. (1996). Mutual information maximization: Models of cortical self-organization. Network: Computation in Neural Systems, 7(1), 7-31.
2. Becker, S., & Hinton, G. E. (1992). Self-organizing neural network that discovers surfaces in random-dot stereograms. Nature, 355, 161-163.
3. Bell, A. J., & Sejnowski, T. J. (1995). An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7(6), 1129-1159.
4. Bi, G., & Poo, M. (1998). Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neuroscience, 18(24), 10464-10472.
5. Bialek, W., de Ruyter van Steveninck, R. R., & Tishby, N. (2006). Efficient representation as a design principle for neural coding and computation. In IEEE International Symposium on Information Theory. Piscataway, NJ: IEEE Press.
6. Boyd, S., & Chua, L. O. (1985). Fading memory and the problem of approximating nonlinear oparators with Volterra series. IEEE Trans. on Circuits and Systems, 32, 1150-1161.
7. Buonomano, D., & Maass, W. (2009). State-dependent computations: Spatiotemporal processing in cortical networks. Nature Reviews in Neuroscience, 10(2), 113-125.
8. Caporale, N., & Dan, Y. (2008). Spike timing-dependent plasticity: A Hebbian rule. Annu. Rev. Neurosci., 31, 25-46.
9. Chechik, G. (2003). Spike-timing-dependent plasticity and relevant mutual information maximization. Neural Computation, 15(7), 1481-1510.
10. Creutzig, F., & Sprekeler, H. (2008). Predictive coding and the slowness principle: An information-theoretic approach. Neural Computation, 20(4), 1026-1041.
11. Friedman, N., Mosenzon, O., Slonim, N., & Tishby, N. (2001). Multivariate information bottleneck. In Proceedings of the 17th Conference in Uncertainty in Artificial Intelligence (pp. 152-161). San Francisco: Morgan Kaufmann.
12. Gütig, R., Aharonov, R., Rotter, S., & Sompolinsky, H. (2003). Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity. Journal Neurosci., 23, 3697-3714.
13. Harremoes, P., & Tishby, N. (2007). The information bottleneck revisited or how to choose a good distortion measure. In Proceedings of the IEEE International Symposium on Information Theory, 2007 (ISIT 2007), (pp. 566-570). Piscataway, NJ: IEEE Press.
14. Hebb, D. O. (1949). The organization of behavior. New York: Wiley.
15. Hee, S. G., Ziburkus, J., Huang, S., Song, L., Kim, I. T., Takamiya, K., et al. (2007). Neuromodulators control the polarity of spike-timing-dependent synaptic plasticity. Neuron, 55, 919-929.
16. Hinton, G. (2007). To recognize shapes, first learn to generate images. Progress in Brain Research, 165, 535-547.
17. Ince, R. A. A., Petersen, R. S., Swan, D. C., & Panzeri, S. (2009). Python for information theoretic analysis of neural data. Frontiers in Neuroinformatics, 3, 4.
18. Jäger, H. (2001). The "echo state" approach to analyzing and training recurrent neural networks (GMD Rep. 148). St. Augustin, Germany: German National Research Center for Information Technology.
19. Klampfl, S., Legenstein, R., & Maass, W. (2007). Information bottleneck optimization and independent component extraction with spiking neurons. In B. Schölkopf, J. Platt, & T. Hoffman (Eds.), Advances in neural information processing systems, 19 (pp. 713-720). Cambridge, MA: MIT Press.
20. Klampfl, S., Legenstein, R., & Maass, W. (2009). Spiking neurons can learn to solve information bottleneck problems and to extract independent components. Neural Computation, 21(4), 911-959.
21. Linsker, R. (1989). How to generate ordered maps by maximizing the mutual information between input and output signals. Neural Computation, 1(3), 402-411.
22. Maass, W., Natschlaeger, T., & Markram, H. (2002). Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation, 14(11), 2531-2560.
23. Ohad Shamir, S., Sabato, S., & Tishby, N. (2008). Learning and generalization with the information bottleneck. In International Symposium on AI and Mathematics (ISAIM)-2008. Heidelberg: Springer-Verlag.
24. Parra, L., Beck, J., & Bell, A.(2009). On the maximization of information flow between spiking neurons. Neural Computation, 21, 1-19.
25. Sjöström, P. J., & Häusser, M. (2006). A cooperative switch determines the sign of synaptic plasticity in distal dendrites of neocortical pyramidal neurons. Neuron, 51, 227-238.
26. Sjöström, P. J., Rancz, E. A., Roth, A., & Häusser, M. (2008). Dendritic excitability and synaptic plasticity. Physiol. Rev., 88, 769-840.
27. Sjöström, P. J., Turrigiano, G. G., & Nelson, S. B. (2001). Rate, timing and cooperativity jointly deterimine cortical synaptic plasticity. Neuron, 32, 1149-1164.
28. Slonim, N., & Tishby, N. (1999). Agglomerative information bottleneck. In S. A. Solla, T. K. Leen, & K.-R. Muller (Eds.), Advances in neural information processing systems, 12. Cambridge, MA: MIT Press.
29. Slonim, N., & Tishby, N. (2001). The power of word clustering for text classification. In Proceedings of the European Colloquium on IR Research, ECIR 2001. Heidelberg: Springer-Verlag.
30. Slonim, N., & Weiss, Y. (2003). Maximum likelihood and the information bottleneck. In S. Thrün, L. Saul, & B. Schölkopf (Eds.), Advances in neural information processing systems, 16 (pp. 351-358). Cambridge, MA: MIT Press.
31. Stuart, G. J., & Häusser, M. (2001). Dendritic coincidence detection of EPSPs and action potentials. Nature, 4(1), 63-71.
32. Tishby, N., Pereira, F. C., & Bialek, W. (1999). The information bottleneck method. In Proceedings of the 37th Annual Allerton Conference on Communication, Control and Computing (pp. 368-377). Piscataway, NJ: IEEE Press.
33. Tishby, N., Pereira, C. F., & Bialek, W. (2000). The information bottleneck method. Available online at http://www.citebase.org/abstract?id=oai.arXiv.org.physics/0004057.
34. Toyoizumi, T., Pfister, J.-P., Aihara, K., & Gerstner, W. (2005). Generalized Bienenstock-Cooper-Munro rule for spiking neurons that maximizes information transmission. Proc. Natl. Acad. Sci. USA, 102, 5239-5244.
35. Weiss, R. (2007). Predictive information as a criterion to linear dynamical systems reduction. Unpublished master's thesis, Racah Institute of Physics, Hebrew University, Jerusalem, Israel.
36. Wiskott, L., & Sejnowski, T. J. (2002). Slow feature analysis: Unsupervised learning of invariances. Neural Computation, 14(4), 715-770.