On the convergence of ICA algorithms with symmetric orthogonalization

IEEE Transactions on Signal Processing

Volumn 57, Issue 6, 2009, Pages 2209-2221

  Erdogan, Alper T ^a  

^a KOÇ UNIVERSITY   (Turkey)

Author keywords

Blind source separation; Convergence; Fixed point algorithms; Independent component analysis (ICA); Symmetric orthogonalization

Indexed keywords

CONVERGENCE; CONVERGENCE ANALYSIS; CONVERGENCE RESULTS; CONVEX OBJECTIVES; CRITICAL POINTS; FIXED POINT ALGORITHMS; GRADIENT BASED; HOUSEHOLDER REFLECTIONS; ICA ALGORITHMS; NON-CONVEX OBJECTIVE FUNCTIONS; OBJECTIVE FUNCTIONS; ORTHOGONALIZATION; PREWHITENING; SEPARATION MATRIX; STATIONARY POINTS; SYMMETRIC ORTHOGONALIZATION;

ADAPTIVE ALGORITHMS; APARTMENT HOUSES; CONSTRAINED OPTIMIZATION; CONVERGENCE OF NUMERICAL METHODS; EQUATIONS OF STATE; HEMODYNAMICS; INDEPENDENT COMPONENT ANALYSIS; OPTICAL FILTERS; PARALLEL ALGORITHMS; SIGNAL ANALYSIS;

BLIND SOURCE SEPARATION;

EID: 66849115116     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2009.2015114     Document Type: Article

References (26)

1. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. Hoboken, NJ: Wiley, 2001.
2. A. Hyvärinen and E. Oja, "A fast fixed-point algorithm for independent component analysis," Neural Comput., vol. 9, no. 7, pp. 1483-1492, Oct. 1997.
3. P. A. Regalia and E. Kofidis, "Monotonic convergence of fixed-point algorithms for ICA," IEEE Trans. Neural Netw., vol. 14, no. 4, pp. 943-949, July 2003.
4. J. H. Manton, "Optimization algorithms exploiting unitary constraints," IEEE Trans. Signal Process., vol. 50, no. 3, pp. 635-650, Mar. 2002.
5. A. T. Erdogan, "Globally convergent deflationary instantaneous blind source separation algorithm for digital communication signals," IEEE Trans. Signal Process., vol. 55, no. 5, pp. 2182-2192, May 2007.
6. H. Shen and K. Huper, "Local convergence analysis of FastICA," Lecture Notes Comput. Sci., vol. 3889, pp. 893-900, Feb. 2006.
7. E. Oja, "Convergence of the symmetrical FastICA algorithm," in Proc. 9th Int. Conf. Neural Inf. Process., Nov. 2002, vol. 3, pp. 1368-1372.
8. E. Oja and Z. Yuan, "The FastICA algorithm revisited: Convergence analysis," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1370-1381, Nov. 2006.
9. P. Tichavsky, Z. Koldovsky, and E. Oja, "Performance analysis of the FastICA algorithm and Cramer-Rao bounds for linear independent component analysis," IEEE Trans. Signal Process., vol. 54, no. 4, pp. 1189-1203, Apr. 2006.
10. A. T. Erdogan, "On the convergence of ICA algorithms with symmetric orthogonalization," in Proc. ICASSP, Mar.-Apr. 2008, pp. 1925-1928.
11. C. Papadias, "Globally convergent blind source separation based on a multiuser kurtosis maximization criterion," IEEE Trans. Signal Process., vol. 48, no. 12, pp. 3508-3519, Dec. 2000.
12. H. Li and T. Adali, "Gradient and fixed-point complex ICA algorithms based on kurtosis maximization," in Proce. 16th IEEE Signal Process. Soc. Workshop Machine Learning for Signal Process., Sep. 2006, pp. 85-90.
13. A. van den Bos, "Complex gradient and hessian," Proc. IEE Vision Image Signal Processing, vol. 141, no. 6, pp. 380-383, Dec. 1994.
14. K. Kreutz-Delgado, The Complex Gradient Operator and the Cr-Calculus: Ece275a-Lecture Supplement: Fall 2006.
15. A. Hjornungnes and D. Gesbert, "Complex-valued matrix differentiation: Techniques and key results," IEEE Trans. Signal Process., vol. 55, no. 6, pp. 2740-2746, Jun. 2007.
16. A. Hjornungnes, D. Gesbert, and D. P. Palomar, "Unified theory of complex-valued matrix differentiation," in Proc. IEEE ICASSP 2007, Apr. 2007, vol. 3, pp. 345-348.
17. H. Li and T. Adali, "Optimization in the complex domain for nonlinear adaptive filtering," in Proc. 40th Asilomar Conf. Signals Syst. Comput., 2006, pp. 263-267.
18. P. A. Absil, R. Mahony, and R. Sepulchre, Optimization Algorithms on Matrix Manifolds. Princeton, NJ: Princeton, 2008.
19. D. P. Bertsekas, A. Nedic, and A. Ozdaglar, Convex Analysis and Optimization. New York: Athena Scientific, 2003.
20. T. Söderström, "Perturbation results for singular values," Uppsala Univ., Uppsala, Sweden, Tech. Rep. 1999-001, Apr. 1999.
21. O. Shalvi and E. Weinstein, "New criteria for blind deconvolution of nonminimum phase systems (channels)," IEEE Trans. Inf. Theory, vol. 36, pp. 312-321, Mar. 1990.
22. O. Shalvi and E. Weinstein, "Super-exponential methods for blind deconvolution," IEEE Trans. Inf. Theory, vol. 39, pp. 504-519, Mar. 1993.
23. P. Regalia and M. Mboup, "Undermodeled equalization: A characterization of stationary points for a family of blind criteria," IEEE Trans. Signal Process., vol. 47, no. 3, pp. 760-770, Mar. 1999.
24. S. Boyd and L. Vandenberghe, Convex Optimization. Stanford, CA: Stanford Univ., 2001.
25. G. Gorni and H. Tutaj-Gasińska, "On the entrywice powers of matrices," Commun. Algebra, vol. 32, pp. 495-520, 2004.
26. X. Sun, X. Du, and D. Liu, "On the range of a Hadamard power of a positive semidefinite matrix," Linear Algebra Appl., vol. 416, pp. 868-871, 2006.