Some global and local convergence analysis on the information-theoretic independent component analysis approach

Neurocomputing

Volumn 30, Issue 1-4, 2000, Pages 79-102

  Cheung, Chi Chiu ^a   Xu, Lei ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Global convergence; High order statistics; Independent component analysis; Information theoretic; Nonlinearity

Indexed keywords

CONTROL NONLINEARITIES; CONVERGENCE OF NUMERICAL METHODS; INFORMATION THEORY; STATISTICAL METHODS; SYSTEM STABILITY; THEOREM PROVING;

HIGH-ORDER STATISTICS; INFORMATION-THEORETIC INDEPENDENT COMPONENT ANALYSIS METHODS;

NEURAL NETWORKS;

ANALYTIC METHOD; ARTICLE; INFORMATION; INFORMATION PROCESSING; NONLINEAR SYSTEM; PRIORITY JOURNAL; STATISTICAL ANALYSIS; THEORY;

EID: 0033991708     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0925-2312(99)00118-6     Document Type: Article

References (23)

1. S.-I. Amari, A. Cichocki, H. Yang, A new learning algorithm for blind separation of sources, in: D.S. Touretzky, M.C. Mozer, d Michael E. Hasselmo (Eds.,) Advances in Neural Information Processing 8, MIT Press, Cambridge, MA, 1996, pp. 757-763.
2. Bell A.J., Sejnowski T.J. An information-maximization approach to blind separation and blind deconvolution. Neural Comput. 7:1995;1129-1159.
3. Cardoso J.F., Laheld B. Equivariant adaptive source separation. IEEE Trans. Signal Process. 44(12):1996;3017-3030.
4. T. Chen, R. Chen, A neural network approach to blind identification of stochastic and deterministic signals, in: Proceedings of the 28th Asilomar Conference on Signals, Systems & Computers, 1994, pp. 892-896.
5. C.C. Cheung, Adaptive blind signal separation, Master's Thesis, Department of Computer Science & Engineering, The Chinese University of Hong Kong, Hong Kong, People's Republic of China, 1997.
6. Comon P. Independent component analysis - a new concept? Signal Processing. 36:1994;287-314.
7. Comon P., Jutten C., Hérault J. Blind separation of sources, Part II: problems statement. Signal Processing. 24(1):1991;11-20.
8. Delfosse N., Loubaton P. Adaptive blind separation of independent sources: a deflation approach. Signal Processing. 45:1995;59-83.
9. Y. Deville, L. Andry, Application of blind source separation techniques to multi-tag contactless identification systems, in: Proceedings of the International Symposium on Nonlinear Theory and its Applications (NOLTA 95), Las Vegas, USA, December 10-14, 1995, pp. 73-78.
10. Hyvärinen A., Oja E. A fast fixed-point algorithm for independent component analysis. Neural Comput. 9:1997;1483-1492.
11. Jutten C., Hérault J. Blind separation of sources, Part I: an adaptive algorithm based on neuromimetic architecture. Signal Processing. 24(1):1991;1-10.
12. J. Karhunen, Neural approaches to independent component analysis and source separation, invited paper, Proceedings of the 4th European Symposium on Artificial Neural Networks (ESANN'96), Bruges, Belgium, April 24-26, 1996.
13. Macchi O., Moreau E. Self-adaptive source separation, Part I: convergence analysis of a direct linear network controlled by the Herault-Jutten algorithm. IEEE Trans. Signal Process. 45:1997;918-926.
14. E. Moreau, O. Macchi, New self-adaptive algorithms for source separation based on contrast functions, in: Proceedings of the IEEE Signal Processing Workshop on Higher Order Statistics, 1993, pp. 215-219.
15. Moreau E., Macchi O. Self-adaptive source separation - Part II: comparison of the direct, feedback, and mixed linear network. IEEE Trans. Signal Process. 46:1998;39-50.
16. D.T. Pham, P. Garat, C. Jutten, Separation of a mixture of independent sources through a maximum likelihood approach, in: J. Vandewalle, R. Boite, M. Moonen, A. Oosterlinck (Eds.), Signal Processing VI: Theories and Applications, Elsevier, Amsterdam, 1992, pp. 771-774.
17. Sorouchyari E. Blind separation of sources, Part III: stability analysis. Signal Processing. 24(1):1991;21-29.
18. L. Wang, J. Karhunen, E. Oja, A bigradient optimization approach for robust PCA, MCA, and source separation, in: Proceedings of the IEEE International Conference on Neural Networks, Perth, Australia, November 1995, pp. 1684-1689.
19. L. Xu, S.-I. Amari, A general independent component analysis framework based on Bayesian-Kullback Ying-Yang Learning, in: Progress in Neural Information Processing: Proceedings of the International Conference on Neural Information Processing (ICONIP 96), Hong Kong, September 24-27, 1996; Springer-Verlag: Singapore, 1996, pp. 1235-1239.
20. Xu L., Cheung C.C., Amari S.-I. Learned parametric mixture based ICA algorithm. Neurocomputing. 22:1998;69-80.
21. L. Xu, C.C. Cheung, J. Ruan, S.-I. Amari, Nonlinearity and separation capability: Further justification for the ICA algorithm with mixture of densities, invited special session on Blind Signal Separation, in Proceedings of the 5th European Symposium on Artificial Neural Networks (ESANN 97), Bruges, Belgium, April 16-18, 1997, pp. 291-296.
22. L. Xu, C.C. Cheung, H.H. Yang, S.-I. Amari, Independent component analysis by the information-theoretic approach with mixture of densities, in: Proceedings of the 1997 International Conference on Neural Networks (ICNN 97), Houston, USA, June 9-12, 1997, pp. 1821-1826.
23. Yang H.H., Amari S.-I. Adaptive online learning algorithms for blind separation: Maximum entropy and minimum mutual information. Neural Comput. 9:1997;1457-1482.