Adaptive RLS algorithm for blind source separation using a natural gradient

IEEE Signal Processing Letters

Volumn 9, Issue 12, 2002, Pages 432-435

  Zhu, Xiao Long ^a   Zhang, Xian Da ^b  

^a XIDIAN UNIVERSITY   (China)

^b TSINGHUA UNIVERSITY   (China)

Author keywords

Blind source separation; Natural gradient; Nonlinear principle component analysis; Orthogonality constraint; Recursive least squares; Stiefel manifold

Indexed keywords

ADAPTIVE ALGORITHMS; BLIND SOURCE SEPARATION; CONVERGENCE OF NUMERICAL METHODS; GRADIENT METHODS; MATRIX ALGEBRA; PRINCIPAL COMPONENT ANALYSIS;

ADAPTIVE RECURSIVE LEAST SQUARES ALGORITHM; NATURAL GRADIENT; NONLINEAR PRINCIPAL COMPONENT ANALYSIS; ORTHOGONALITY CONSTRAINT; STIEFEL MANIFOLD;

SIGNAL FILTERING AND PREDICTION;

EID: 0036964214     PISSN: 10709908     EISSN: None     Source Type: Journal    
DOI: 10.1109/LSP.2002.806047     Document Type: Letter

References (17)

1. S. Amari, A. Cichoki, and H. H. Yang, "A new learning algorithm for blind signal separation," in Advances in Neural Information Processing Systems. Boston, MA: MIT Press, 1996, vol. 8, pp. 752-763.
2. S. Amari, "Natural gradient works efficiently in learning," Neural Comput., vol. 10, pp. 251-276, 1998.
3. ____, "Natural gradient learning for over- and under-complete bases in ICA," Neural Comput., vol. 11, pp. 1875-1883, 1999.
4. J. F. Cardoso and H. Laheld, "Equivariant adaptive source separation," IEEE Trans. Signal Processing, vol. 44, pp. 3017-3029, Dec. 1996.
5. S. C. Douglas, "Self-stabilized gradient algorithms for blind source separation with orthogonality constraints," IEEE Trans. Neural Networks, vol. 11, pp. 1490-1497, Nov. 2000.
6. A. Edelman, T. Arias, and S. T. Smith, "The geometry of algorithms with orthogonality constraints," SIAM J. Matrix Anal. Appl., vol. 20, pp. 303-353, 1998.
7. X. Giannakopoulos, J. Karhunen, and E. Oja, "Experimental comparison of neural algorithms for independent component analysis and blind separation," Int. J. Neural Syst., vol. 9, pp. 99-114, Apr. 1999.
8. A. Hyvarinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.
9. S. Haykin, Unsupervised Adaptive Filtering, S. Haykin, Ed. New York: Wiley, 2000, vol. I, Blind Source Separation.
10. ____, Adaptive Filter Theory, 3rd ed. Englewood Cliffs, NJ: Prentice-Hall, 1996.
11. J. Karhunen and J. Joutsensalo, "Representation and separation of signals using nonlinear PCA type learning," Neural Networks, vol. 7, no. 1, pp. 113-127, 1994.
12. E. Oja, "The nonlinear PCA learning rule and signal separation: Mathematical analysis," Neurocomput., vol. 17, no. 1, pp. 25-46, 1997.
13. P. Pajunen and J. Karhunen. "Least-squares methods for blind source separation based on nonlinear PCA," Int. J. Neural Syst., vol. 8, pp. 601-612, Dec. 1998.
14. J. Karhunen, P. Pajunen, and E. Oja, "The nonlinear PCA criterion in blind source separation: Relations with other approaches," Neurocomput., vol. 22, pp. 5-20, 1998.
15. B. Yang, "Projection approximation subspace tracking," IEEE Trans. Signal Processing, vol. 43, pp. 95-107, Jan. 1995.
16. H. H. Yang and S. Amari, "Adaptive online learning algorithms for blind separation: Maximum entropy and minimum mutual information," Neural Comput., vol. 9, pp. 1457-1482, 1997.
17. H. H. Yang, "Serial updating rule for blind separation derived from the method of scoring," IEEE Trans. Signal Processing, vol. 47, pp. 2279-2285, Aug. 1999.