Approximate maximum likelihood source separation using the natural gradient

IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

Volumn E86-A, Issue 1, 2003, Pages 198-205

  Choi, Seungjin ^a   Cichocki, Andrzej ^b   Zhang, Liqing ^b   Amari, Shun Ichi ^b  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

^b RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

Independent component analysis; Maximum likelihood estimation; Natural gradient; Overdetermined mixtures; Source separation

Indexed keywords

APPROXIMATION THEORY; BLIND SOURCE SEPARATION; GRADIENT METHODS; INDEPENDENT COMPONENT ANALYSIS; LAPLACE TRANSFORMS; MAXIMUM LIKELIHOOD ESTIMATION; VECTORS; WHITE ACOUSTIC NOISE;

LAPLACE APPROXIMATIONS;

GAUSSIAN NOISE (ELECTRONIC);

EID: 0042978506     PISSN: 09168508     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (23)

1. L. Tong, Y. Inouye, and R. Liu, "Waveform-preserving blind estimation of multiple independent sources," IEEE Trans. Signal Processing, vol.41, no.7, pp.2461-2470, July 1993.
2. S. Haykin, Unsupervised Adaptive Filtering: Blind Source Separation, Prentice-Hall, 2000.
3. D.T. Pham, "Blind separation of instantaneous mixtures of sources via an independent component analysis," IEEE Trans. Signal Processing, vol.44, no.11, pp.2768-2779, 1996.
4. J.F. Cardoso, "Infomax and maximum likelihood for source separation," IEEE Signal Processing Letters, vol.4, no.4, pp.112-114, April 1997.
5. S. Amari and A. Cichocki, "Adaptive blind signal processing - Neural network approaches," Proc. IEEE, Special Issue on Blind Identification and Estimation, vol.86, no.10, pp.2026-2048, Oct. 1998.
6. S. Amari, "Natural gradient works efficiently in learning," Neural Computation, vol.10, no.2, pp.251-276, 1998.
7. A. Bell and T. Sejnowski, "An information maximisation approach to blind separation and blind deconvolution," Neural Computation, vol.7, pp.1129-1159, 1995.
8. S. Amari, A. Cichocki, and H.H. Yang, "A new learning algorithm for blind signal separation," Advances in Neural Information Processing Systems, ed. D.S. Touretzky, M.C. Mozer, and M.E. Hasselmo, pp.757-763, MIT press, 1996.
9. A. Cichocki, I. Sabala, S. Choi, B. Orsier, and R. Szupiluk,"Self-adaptive independent component analysis for sub-Gaussian and super-Gaussian mixtures with unknown number of source signals," Proc. Int. Symp. Nonlinear Theory and Applications, pp.731-734, 1997.
10. M. Girolami, "An alternative perspective on adaptive independent component analysis algorithms," Neural Computation, vol.10, no.8, pp.2103-2114, Nov. 1998.
11. T.W. Lee, M. Girolami, and T. Sejnowski, "Independent component analysis using an extended infomax algorithm for mixed sub-Gaussian and super-Gaussian sources," Neural Computation, vol.11, no.2, pp.609-633, 1999.
12. S. Choi, A. Cichocki, and S. Amari, "Flexible independent component analysis," J. VLSI Signal Processing, vol.26, no. 1/2, pp.25-38, Aug. 2000.
13. J.F. Cardoso and B.H. Laheld, "Equivariant adaptive source separation," IEEE Trans. Signal Processing, vol.44, no.12, pp.3017-3030, Dec. 1996.
14. S. Amari, "Natural gradient for over- and under-complete bases in ICA," Neural Computation, vol.11, no.8, pp.1875-1883, 1999.
15. L.Q. Zhang, A. Cichocki, and S. Amari, "Natural gradient algorithm for blind separation of overdetermined mixtures with additive noise," IEEE Signal Processing Letters, vol.6, no.11, pp.293-295, Nov. 1999.
16. M.S. Lewicki and T. Sejnowski, "Learning overcomplete representation," Neural Computation, vol.12, no.2, pp.337-365, 2000.
17. J.J.K.O. Ruanaidh and W.J. Fitzgerald, Numerical Bayesian Methods Applied to Signal Processing, Springer, 1996.
18. S. Amari, T.P. Chen, and A. Cichocki, "Stability analysis of learning algorithms for blind source separation," Neural Networks, vol.10, no.8, pp.1345-1351, 1997.
19. S. Choi, A. Cichocki, and S. Amari, "Local stability analysis of flexible independent component analysis algorithm," Proc. ICASSP, Istanbul, Turkey, pp.3426-3429, 2000.
20. S. Amari, T.P. Chen, and A. Cichocki, "Nonholonomic orthogonal learning algorithms for blind source separation," Neural Computation, vol.12, no.6, pp.1463-1484, 2000.
21. S. Amari, S.C. Douglas, A. Cichocki, and H.H. Yang, "Multichannel blind deconvolution and equalization using the natural gradient," Proc. SPAWC, pp.101-104, Paris, France, 1997.
22. S. Choi, S. Amari, A. Cichocki, and R. Liu, "Natural gradient learning with a nonholonomic constraint for blind deconvolution of multiple channels," Proc. ICA'99, pp.371-376, Aussois, France, 1999.
23. S. Choi. A. Cichocki, and S. Amari, "Two spatio-temporal decorrelation algorithms and their application to blind deconvolution of multiple channels," Proc. ICASSP, Phoenix, Arizona, pp.1085-1088, 1999.