Redundancy Reduction and Independent Component Analysis: Conditions on Cumulants and Adaptive Approaches

Neural Computation

Volumn 9, Issue 7, 1997, Pages 1421-1456

  Nadal, Jean Pierre ^a   Parga, Nestor ^b  

^a ECOLE NORMALE SUPÉRIEURE   (France)

^b UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0001210842     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/neco.1997.9.7.1421     Document Type: Article

References (43)

1. Abramowitz, M., & Stegun, I. A. (1972). Handbook of mathematical functions. New York: Dover.
2. Aldazabal, G., Gonzalez-Arroyo, A., & Parga, N. (1985). The stochastic quantization of U(N) and SU(N) lattice gauge theory and Langevin equations for the Wilson loops. Journal of Physics, A18, 2975.
3. Amari, S. I., Cichocki, A., & Yang, H. H. (1996). A new learning algorithm for blind signal separation. In D. S. Touretzky, M. C. Mozer, & M. E. Hasselmo (Eds.), Advances in neural information processing systems 8. Cambridge, MA: MIT Press.
4. Atick, J. J. (1992). Could information theory provide an ecological theory of sensory processing? NETWORK, 3, 213-251.
5. Attneave, F. (1954). Informational aspects of visual perception. Psychological Review, 61, 183-193.
6. Barlow, H. B. (1961). Possible principles underlying the transformation of sensory messages. In W. Rosenblith (ed.), Sensory communication (p. 217). Cambridge, MA: MIT Press.
7. Barlow, H. B., Kaushal, T. P., & Mitchison, G. J. (1989). Finding minimum entropy codes. Neural Comp., 1, 412-423.
8. Bar-Ness, Y. (1982, November). Bootstrapping adaptive interference cancelers: Some practical limitations. In The Globecom Conf. (pp. 1251-1255). Paper F3.7, Miami, Nov. 1982.
9. Barron, A. R. (1993). Universal approximation bounds for superpositions of a sigmoidal function. IEEE Trans. I. T., 39.
10. Bell, A., & Sejnowski, T. (1995). An information-maximisation approach to blind separation and blind deconvolution. Neural Comp., 7, 1129-1159.
11. Belouchrani, A., & M. (1993). Séparation aveugle au second ordre de sources corrélées. In GRETSI'93, Juan-Les-Pins, 1993.
12. Bienenstock, E., Cooper, L., & Munro, P. W. (1982). Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex. Journal Neurosciences, 2, 32-48.
13. Blahut, R. E. (1988). Principles and practice of information theory. Reading, MA: Addison-Wesley.
14. Burel, G. (1992). Blind separation of sources: A nonlinear neural algorithm. Neural Networks, 5, 937-947.
15. Cardoso, J.-F. (1989) Source separation using higher-order moments. In Proc. Internat. Conf. Acoust. Speech Signal Process.-89 (pp. 2109-2112). Glasgow.
16. Cardoso, J.-F., & Souloumiac, A. (1993). Blind beamforming for non Gaussian signals. IEE Proceedings-F, 140(6), 362-370.
17. Comon, P. (1994). Independent component analysis, a new concept? Signal Processing, 36, 287-314.
18. Cybenko, G. (1989). Approximations by superpositions of a sigmoidal function. Math. Contr. Signals Syst., 2, 303-314.
19. Delfosse, N., & Loubaton, Ph. (1995). Adaptive blind separation of independent sources: A deflation approach. Signal Processing, 45, 59-83.
20. Del Giudice, P., Campa, A., Parga, N., & Nadal, J.-P. (1995). Maximization of mutual information in a linear noisy network: A detailed study. NETWORK, 6, 449-468.
21. Deville, Y., & Andry, L. (1995). Application of blind source separation techniques to multi-tag contactless identification systems. Proceedings of NOLTA'95 (pp. 73-78). Las Vegas.
22. Féty, L. (1988). Méthodes de traitement d'antenne adaptée aux radio-communications. Unpublished doctoral dissertation, ENST, Paris.
23. Gaeta, M., & Lacoume, J. L. (1990). Source separation without apriori knowledge: The maximum likelihood approach. In L. Tores, E. MasGrau, & M. A. Lagunas (eds.), Signal Processing V, proceedings of EUSIPCO 90 (pp. 621-624).
24. Haft, M., Schlang, M., & Deco, G. (1995). Information theory and local learning rules in a self-organizing network of ising spins. Phys. Rev. E, 52, 2860-2871.
25. Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995). The wake-sleep algorithm for unsupervised neural networks. Science, 268, 1158-1160.
26. Hopfield, J. J. (1991). Olfactory computation and object perception. Proc. Natl. Acad. Sci. USA, 88, 6462-6466.
27. Hornik, K., Stinchcombe, M., & White, H. (1991). Multilayer feedforward networks are universal approximators. Neural Networks, 2, 359-366.
28. Intrator, N., & Cooper, L. (1992). Objective function formulation of the BCM theory of visual cortical plasticity: Statistical connections, stability conditions. Neural Networks, 5, 3-17.
29. Jutten, C., & Herault, J. (1991). Blind separation of sources, part i: An adaptive algorithm based on neuromimetic architecture. Signal Processing, 24, 1-10.
30. Laheld, B., & Cardoso, J.-F. (1994). Adaptive source separation without prewhitening. In Proc. EUSIPCO (pp. 183-186). Edinburgh.
31. Law and Cooper, L. (1994). Formation of receptive fields in realistic visual environments according to the BCM theory. Proc. Natl. Acad. Sci. USA, 91, 7797-7801.
32. Li, Z., & Atick, J. J. (1994). Efficient stereo coding in the multiscale representation. Network: Computation in Neural Systems, 5, 1-18.
33. Linsker, R. (1988). Self-organization in a perceptual network. Computer, 21, 105-117.
34. Molgedey, L., & Schuster, H. G. (1994). Separation of a mixture of independent signals using time delayed correlations. Phys. Rev. Lett., 72, 3634-3637.
35. Nadal, J.-P., & Parga, N. (1994). Nonlinear neurons in the low-noise limit: A factorial code maximizes information transfer. NETWORK, 5, 565-581.
36. Parra, L. C. (1996). Symplectic nonlinear component analysis. Preprint.
37. Pham, D.-T., Garrat, Ph. & Jutten, Ch. (1992). Separation of a mixture of independent sources through a maximum likelihood approach. In Proc. EUSIPCO (pp. 771-774).
38. Redlich, A. N. (1993). Redundancy reduction as a strategy for unsupervised learning. Neural Comp., 5, 289-304.
39. Rospars, J.-P., & Fort, J.-C. (1994). Coding of odor quality: Roles of convergence and inhibition. NETWORK, 5, 121-145.
40. Scofield, C. L., & Cooper, L. (1985). Development and properties of neural networks. Contemporary Physics, 26, 125-145.
41. Shraiman, B. (1993). Technical memomorandum (AT&T Bell Labs TM-11111-930811-36).
42. Tong, L., Soo, V., Liu, R., & Huang, Y. (1990). Amuse: A new blind identification algorithm. In Proc. ISCAS. New Orleans.
43. van Hateren, J. H. (1992). Theoretical predictions of spatiotemporal receptive fields of fly lmcs, and experimental validation. J. Comp. Physiol. A, 171, 157-170.