Information bottleneck optimization and independent component extraction with spiking neurons

Advances in Neural Information Processing Systems

Volumn , Issue , 2007, Pages 713-720

  Klampfl, Stefan ^a   Legenstein, Robert ^a   Maass, Wolfgang ^a  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

ESSENTIAL COMPONENT; HIGH-DIMENSIONAL; INDEPENDENT COMPONENTS; INFORMATION BOTTLENECK; INFORMATION SOURCES; INPUT STREAMS; INTERNAL REPRESENTATION; LEARNING RULES; OPTIMIZATION PRINCIPLE; REDUNDANT REPRESENTATION; SENSORY PROCESSING; SPIKING NEURON; STILL MISSING;

BLIND SOURCE SEPARATION; INDEPENDENT COMPONENT ANALYSIS; NEURAL NETWORKS; NEURONS;

OPTIMIZATION;

EID: 84864045847     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (7)

1. N. Tishby, F. C. Pereira, and W. Bialek. The information bottleneck method. In Proceedings of the 37-th Annual Allerton Conference on Communication, Control and Computing, pages 368-377, 1999.
2. A. Hyvärinen, J. Karhunen, and E. Oja. Independent Component Analysis. Wiley, New York, 2001.
3. T. Toyoizumi, J.-P. Pfister, K. Aihara, and W. Gerstner. Generalized Bienenstock-Cooper-Munro rule for spiking neurons that maximizes information transmission. Proc. Natl. Acad. Sci. USA, 102:5239-5244, 2005.
4. W. Gerstner and W. M. Kistler. Spiking Neuron Models. Cambridge University Press, Cambridge, 2002.
5. T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley, New York, 1991.
6. E. L. Bienenstock, L. N. Cooper, and P. W. Munro. Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J. Neurosci., 2(1):32-48, 1982.
7. R. Gütig, R. Aharonov, S. Rotter, and H. Sompolinsky. Learning input correlations through non-linear temporally asymmetric hebbian plasticity. Journal of Neurosci., 23:3697-3714, 2003.