Joint matrices decompositions and blind source separation: A survey of methods, identification, and applications

IEEE Signal Processing Magazine

Volumn 31, Issue 3, 2014, Pages 34-43

  Chabriel, Gilles ^a   Kleinsteuber, Martin ^b   Moreau, Eric ^c   Shen, Hao ^b   Tichavsky, Petr ^d   Yeredor, Arie ^e  

^a UNIVERSITÉ DE TOULON   (France)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c University of Sud Toulon Var ISITV MAPIEM Laboratory (EA 4323)   (France)

^d INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

^e TEL AVIV UNIVERSITY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

BLIND SOURCE SEPARATION; COVARIANCE MATRIX; DECOMPOSITION; EIGENVALUES AND EIGENFUNCTIONS; HIGHER ORDER STATISTICS; INDEPENDENT COMPONENT ANALYSIS; SIGNAL ANALYSIS; SIGNAL PROCESSING; SINGULAR VALUE DECOMPOSITION; SPECTRUM ANALYSIS;

COVARIANCE MATRICES; DIMENSIONALITY REDUCTION; EIGENVALUE DECOMPOSITION; INDEPENDENT COMPONENT ANALYSIS(ICA); MATRIX DECOMPOSITION; SIGNAL PROCESSING PROBLEMS; SUBSPACE ESTIMATION; TIME FREQUENCY;

PRINCIPAL COMPONENT ANALYSIS;

EID: 85032752234     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2014.2298045     Document Type: Review

References (55)

1. B. Afsari, "Simple LU and QR based non-orthogonal matrix joint diagonalization," in Proc. 6th Int. Conf. Independent Component Analysis and Blind Source Separation, ICA 2006, LNCS 3889, Charleston, J. P. Rosca, D. Erdogmus, J. C. Prncipe, and S. Haykin, Eds. Springer Verlag: Berlin, Heidelberg, 2006, pp. 17-24.
2. B. Afsari, "Sensitivity analysis for the problem of matrix joint diagonalization," SIAM J. Matrix Anal. Applicat., vol. 30, no. 3, pp. 1148-1171, 2008.
3. A. A?ssa-El-Bey, K. Abed-Meraim, Y. Grenier, and Y. Hua, "A general framework for second-order blind separation of stationary colored sources," Signal Process., vol. 88, no. 9, pp. 2123-2137, Sept. 2008.
4. J. Antoni and S. Chauhan, "A study and extension of second-order blind source separation to operational modal analysis," J. Sound Vib., vol. 332, no. 4, pp. 1079-1106, Feb. 2013.
5. A. Belouchrani, K. Abed-Meraim, J.-F. Cardoso, and E. Moulines, "A blind source separation technique using second-order statistics," IEEE Trans. Signal Processing, vol. 45, no. 2, pp. 434-444, Feb. 1997.
6. A. Belouchrani, K. Abed-Meraim, M. G. Amin, and A. M. Zoubir, "Blind separation of non-stationary sources," IEEE Signal Processing Lett., vol. 11, no. 7, pp. 605-608, July 2004.
7. H. Bousbia-Salah, A. Belouchrani, and K. Abed-Meraim, "Jacobi-like algorithm for blind signal separation of convolutive mixtures," IEE Electron. Lett., vol. 37, no. 16, pp. 1049-1050, Aug. 2001.
8. J.-F. Cardoso and A. Souloumiac, "Blind beamforming for non-Gaussian signals," IEE Proc. Radar and Signal Processing F, vol. 140, no. 6, pp. 362-370, Dec. 1993.
9. J. D. Carroll, "Generalization of canonical correlation analysis to three or more sets of variables," in Proc. 76th Annu. Conf. American Psychological Association, vol. 3, pp. 227-228, 1968.
10. J. D. Carroll and J.-J. Chang, "Analysis of individual differences in multidimensional scaling via an N-way generalization of Eckart-Young decomposition," Psychometrika, vol. 35, no. 3, pp. 283-319, Sept. 1970.
11. G. Chabriel, J. Barr?re, N. Thirion-Moreau, and E. Moreau, "Algebraic joint zero-diagonalization and blind sources separation," IEEE Trans. Signal Processing, vol. 56, no. 3, pp. 980-989, Mar. 2008.
12. G. Chabriel and J. Barr?re, "Non-symmetrical joint zero-diagonalization and MIMO zero division multiple access," IEEE Trans. Signal Processing, vol. 59, no. 5, pp. 2296-2307, May 2011.
13. G. Chabriel and J. Barr?re, "A direct algorithm for nonorthogonal approximate joint diagonalization," IEEE Trans. Signal Processing, vol. 60, no. 1, pp. 39-47, Jan. 2012.
14. G. Chabriel and J. Barr?re, "An instantaneous formulation of mixtures for blind separation of propagating waves," IEEE Trans. Signal Processing, vol. 54, no. 1, pp. 49-58, 2006.
15. P. Comon, "Independent component analysis, a new concept," Signal Process., vol. 36, no. 3, pp. 287-314, 1994.
16. L. De Lathauwer and J. Castaing, "Blind identification of underdetermined mixtures by simultaneous matrix diagonalization," IEEE Trans. Signal Processing, vol. 56, no. 3, pp. 1096-1105, 2008.
17. L. De Lathauwer, "A link between the canonical decomposition in multilinear algebra and simultaneous matrix diagonalization," SIAM J. Matrix Anal. Applicat., vol. 28, no. 3, pp. 642-666, July 2006.
18. L. De Lathauwer, B. De Moor, and J. Vandewalle, "Computation of the canonical decomposition by means of a simultaneous generalized Schur decompositions," SIAM J. Matrix Anal. Applicat., vol. 26, no. 2, pp. 295-327, 2004.
19. S. D?gerine and E. Kane, "A comparative study of approximate joint diagonalization algorithms for blind source separation in presence of additive noise," IEEE Trans. Signal Processing, vol. 55, no. 6 (part 2), pp. 3022-3031, 2007.
20. J. Eriksson and V. Koivunen, "Complex random vectors and ICA models: Identifiability, uniqueness, and separability," IEEE Trans. Inform. Theory, vol. 52, no. 3, pp. 1017-1029, 2006.
21. E.-M. Fadaili, N. Thirion-Moreau, and E. Moreau, "Non-orthogonal joint diagonalization/zero-diagonalization for source separation based on time-frequency distributions," IEEE Trans. Signal Processing, vol. 55, no. 5, pp. 1673-1687, May 2007.
22. R. A. Harshman, "Foundations of the PARAFAC procedure: Model and conditions for an "explanatory" multimode factor analysis," UCLA Working Papers Phonet., vol. 16, pp. 1-84, 1970.
23. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1985.
24. R. Iferroudjene, K. Abed-Meraim, and A. Belouchrani, "Joint diagonalization of non defective matrices using generalized Jacobi rotations," in Proc. 10th Int. Conf. Information Science, Signal Processing and Their Applications (ISSPA 2010), pp. 345-348.
25. M. Kleinsteuber and H. Shen, "Uniqueness analysis of non-unitary matrix joint diagonalization," IEEE Trans. Signal Processing, vol. 61, no. 7, pp. 1786-1796, Apr. 2013.
26. Z. Koldovsky and P. Tichavsky, "Time-domain blind separation of audio sources based on a complete ICA decomposition of an observation space." IEEE Trans. Audio, Speech Lang. Processing, vol. 19, no. 2, pp. 406-416, 2011.
27. D. Lahat, J. Cardoso, and H. Messer, "Second-order multidimensional ICA: Performance analysis," IEEE Trans. Signal Processing, vol. 60, no. 9, pp. 4598-4610, 2012.
28. X.-L. Li and X. D. Zhang, "Nonorthogonal joint diagonalization free of degenerate solutions," IEEE Trans. Signal Processing, vol. 55, no. 5, pp. 1803-1814, May 2007.
29. E. Moreau, "A generalization of joint-diagonalization criteria for source separation," IEEE Trans. Signal Processing, vol. 49, no. 3, pp. 530-541, Mar. 2001.
30. E. Moreau and N. Thirion-Moreau, "Non symmetrical contrasts for sources separation," IEEE Trans. Signal Processing, vol. 47, no. 8, pp. 2241-2252, Aug. 1999.
31. D. Nion, "A tensor framework for nonunitary joint block diagonalization," IEEE Trans. Signal Processing, vol. 59, no. 10, pp. 4585-4594, 2011.
32. E. Ollila and V. Koivunen, "Complex ICA using generalized uncorrelating transform," Signal Process., vol. 89, no. 4, pp. 365-377, 2009.
33. L. Parra and P. Sajda, "Blind source separation via generalized eigenvalue decomposition," J. Mach. Learn. Res., vol. 4, nos. 7-8, pp. 1261-1269, 2008.
34. D.-T. Pham and Ph. Garat, "Blind separation of mixtures of independent sources through a quasi maximum likelihood approach," IEEE Trans. Signal Processing, vol. 45, no. 7, pp. 1712-1725, July 1997.
35. D.-T. Pham, "Joint approximate diagonalization of positive definite Hermitian matrices," SIAM J. Matrix Anal. Applicat., vol. 22, no. 4, pp. 1136-1152, 2001.
36. A. H. Phan, P. Tichavsky, and A. Cichocki, "Low complexity damped Gauss-Newton algorithms for parallel factor analysis," SIAM J. Linear Algebra Applicat., vol. 34, no. 1, pp. 126-147, Jan. 2013.
37. F. Roemer and M. Haardt, "A semi-algebraic framework for approximate CP decomposition via simultaneous matrix diagonalization (SECSI)," Signal Process., vol. 93, no. 9, pp. 2722-2738, Sept. 2013.
38. H. Shen and M. Kleinsteuber, "Non-unitary matrix joint diagonalization for complex independent vector analysis," EURASIP J. Adv. Signal Process., vol. 241, pp. 1-10, Nov. 2012.
39. H. Shen and M. Kleinsteuber, "Complex blind source separation via simultaneous strong uncorrelating transform," in Proc. 9th Int. Conf. Latent Variable Analysis and Signal Separation, vol. 6365. Berlin/Heidelberg: Springer-Verlag, 2010, pp. 287-294.
40. A. Souloumiac, "Nonorthogonal joint diagonalization by combining givens and hyperbolic rotations," IEEE Trans. Signal Processing, vol. 57, no. 6, pp. 2222-2231, 2009.
41. F. J. Theis, "A new concept for separability problems in blind source separation," Neural Computat., vol. 16, no. 9, pp. 1827-1850, 2004.
42. P. Tichavsky, E. Doron, A. Yeredor, and J. Nielsen, "A computationally affordable implementation of an asymptotically optimal BSS algorithm for AR sources," in Proc. EUSIPCO 2006, Florence, Italy, Sept. 2006, pp. 1-5.
43. P. Tichavsky and A. Yeredor, "Fast approximate joint diagonalization incorporating weight matrices," IEEE Trans. Signal Processing, vol. 57, no. 3, pp. 878-891, Mar. 2009.
44. P. Tichavsky and Z. Koldovsky, "Algorithms for nonorthogonal approximate joint block-diagonalization," in Proc. 20th European Signal Processing Conf. ( EUSIPCO), Bucharest, Romania, Aug. 27-31, 2012, pp. 2094-2098.
45. P. Tichavsky, and Z. Koldovsky, "Weight adjusted tensor method for blind separation of underdetermined mixtures of nonstationary sources," IEEE Trans. Signal Processing, vol. 59, no. 3, pp. 1037-1047, Mar. 2011.
46. L. Tong, V. C. Soon, Y. Huang, and R. Liu, "AMUSE: A new blind identification algorithm," in Proc. IEEE Int. Symp. Circuits and Systems (ISCAS), New Orleans, LA, 1990, vol. 3, pp. 1784-1787.
47. T. Trainini, X.-L. Li, E. Moreau, and T. Adali, "A relative gradient algorithm for joint decompositions of complex matrices," in Proc. 18th European Signal Processing Conf., 2010, pp. 1073-1076.
48. R. Vollgraf and K. Obermayer, "Quadratic optimization for simultaneous matrix diagonalization," IEEE Trans. Signal Processing, vol. 54, no. 9, pp. 3270-3278, Sept. 2006.
49. A. Yeredor, "On using exact joint-diagonalization for non-iterative approximate joint-diagonalization," IEEE Signal Processing Lett., vol. 12, no. 9, pp. 645-648, Sept. 2005.
50. A. Yeredor, "Non-orthogonal joint diagonalization in the least square sense with application in blind source separation," IEEE Trans. Signal Processing, vol. 50, no. 7, pp. 1545-1553, July 2002.
51. A. Yeredor, "Blind separation of Gaussian sources with general covariance structures: Bounds and optimal estimation," IEEE Trans. Signal Processing, vol. 58, no. 10, pp. 5057-5068, Oct. 2010.
52. A. Yeredor, "Performance analysis of the strong uncorrelating transformation in blind separation of complex-valued sources," IEEE Trans. Signal Processing, vol. 60, no. 1, pp. 478-453, Jan. 2012.
53. A. Yeredor, "Multiple-snapshots BSS with general covariance structures: A partial maximum likelihood approach involving weighted joint diagonalization," Signal Process., vol. 92, no. 8, pp. 1832-1843, Aug. 2012.
54. A. Belouchrani, M. G. Amin, and K. Abed-Meraim, "Direction finding in correlated noise fields based on joint block-diagonalization of spatio-temporal correlation matrices," IEEE Signal Processing Lett., vol. 4, no. 9, pp. 266-268, Sept. 1997.
55. A. Ziehe, P. Laskov, G. Nolte, and K.-R. M?ller, "A fast algorithm for joint diagonalization with non-orthogonal transformations and its application to blind source separation," J. Mach. Learn. Res., vol. 5, pp. 777-800, July 2004.