Neural coding by redundancy reduction and correlation

Proceedings - Brazilian Symposium on Neural Networks, SBRN

Volumn 2002-January, Issue , 2002, Pages 223-226

  Kardec Barros, A ^a,b   Chichocki, A ^c  

^a FEDERAL UNIVERSITY OF MARANHÃO   (Brazil)

^b RIKEN   (Japan)

^c RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

Biological information theory; Biology computing; Data mining; Error analysis; Higher order statistics; Independent component analysis; Neurons; Redundancy; Robustness; Source separation

Indexed keywords

ALGORITHMS; BIOINFORMATICS; BIOMEDICAL ENGINEERING; CODES (SYMBOLS); COMPUTATION THEORY; DATA MINING; ERROR ANALYSIS; ERROR STATISTICS; INDEPENDENT COMPONENT ANALYSIS; INFORMATION THEORY; NEURONS; REDUNDANCY; ROBUSTNESS (CONTROL SYSTEMS); SIGNAL ANALYSIS; SOURCE SEPARATION;

BIOLOGICAL INFORMATION THEORIES; BIOLOGY COMPUTING; MUTUALLY INDEPENDENTS; NON-ORTHOGONAL SIGNALS; OUTPUT SIGNAL; REDUNDANCY REDUCTIONS; RESEARCH INTERESTS; SECOND ORDER STATISTICS;

HIGHER ORDER STATISTICS;

EID: 84948948751     PISSN: 15224899     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SBRN.2002.1181478     Document Type: Conference Paper

References (20)

1. S. Amari, A.Cichocki, H. H. Yang, "A new learning algorithm for blind signal separation", Advances in Neural Information Processing Systems, 8, MIT press, 1996.
2. S. Amari and A. Cichocki: Adaptive blind signal processing - neural network approaches, Proceedings IEEE (invited paper), Vol.86, No.10, Oct. 1998, pp. 2026-2048.
3. Y. Baram and Z. Roth, "Density shaping by neural networks with application to classification, estimation and forecasting," CIS report no. 9420, Center for Intelligent systems, Technion Israel, 1994.
4. H. B. Barlow, "Possible principles underlying the transformations of sensory messages" Sensory Communication, W. Rosenblith, e., pp. 217-234. MIT Press, Cambridge, MA, 1961.
5. H. B. Barlow, "Unsupervised learning," Neural Computation, 1, 295-311, 1989.
6. A. K. Barros and A. Cichocki, "Extraction of specific signals with temporal structure" Neural Computation, to appear.
7. A.J. Bell and T. J. Sejnowski, "An information-maximization approach to blind separation and blind deconvolution" Neural Computation, 7, pp. 1129-1159, 1995.
8. J-F. Cardoso. "Equivariant adaptive source separation," IEEE Trans. Signal Process., SP-44, pp.3017-3030, 1996.
9. A.Cichocki and L. Moszczynski. "A new learning algorithm for for blind separation of sources," Electronics Letters, vol. 28, No.21,1992, pp.1986-1987.
10. P. Comon, "Independent component analysis, a new concept?" Signal Processing, 24, pp. 287-314, 1994.
11. G. Deco and W. Brauer, "Nonlinear higher-order statistical decorrelation by volume-conserving neural architectures,". In: Computational Neuroscience, Schwartz E, ed., MIT Press. pp. 403-423. 1990.
12. J.G. Daugman, "An information-theoretic view of analog representation in striate cortex," Neural Computation, 1, 295-311, 1989.
13. A. Hyvarinen and E. Oja, "A fast fixed-point algorithm for independent component analysis". Neural Computation (9), 1483-1492, 1997.
14. Olshausen BA, Field DJ "Emergence of simple-cell receptive field properties by learning a sparse code for natural images". Nature, 381: 607-609, 1996.
15. C. Jutten and J. Hérault "Independent component analysis versus PCA" Proc. EUSIPCO, pp. 643-646, 1988.
16. S. Makeig, T-P. Jung, D. Ghahremani, A.J. Bell, T.J. Sejnowski, "Blind separation of event-related brain responses into independent components," Proc. Natl. Acad. Sci. USA, 94:10979-10984, 1997.
17. J-P. Nadal and N. Parga. "Non-linear neurons in the low noise limit: a factorial code maximises information transfer,". Network, 5, 565-581, 1994.
18. Nirenberg, S., Carcieri, S.M., Jacobs, A.L., and Latham, P.E. (2001) Retinal ganglion cells act largely as independent encoders. Nature 411:698-701.
19. Simpson, J.A. and Weiner, E.S.C. The Oxford English Dictionary. 2nd edn. Clarendon Press, Oxford, 1989.
20. A. Papoulis. Probability, random variables, and stochastic processes. McGraw-Hill, 1991.