A link between the canonical decomposition in multilinear algebra and simultaneous matrix diagonalization

SIAM Journal on Matrix Analysis and Applications

Volumn 28, Issue 3, 2006, Pages 642-666

  De Lathauwer, Lieven ^a  

^a Centre national de la recherche scientifique   (France)

Author keywords

Canonical decomposition; Higher order tensor; Multilinear algebra; Parallel factors model; Simultaneous matrix diagonalization

Indexed keywords

ALGORITHMS; MATHEMATICAL MODELS;

CANONICAL DECOMPOSITION; HIGHER-ORDER TENSORS; MULTILINEAR ALGEBRA; PARALLEL FACTORS MODELS; SIMULTANEOUS MATRIX DIAGONALIZATION;

TENSORS;

EID: 33746356349     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/040608830     Document Type: Article

References (45)

1. C.J. APPELLOF AND E.R. DAVIDSON, Strategies for analyzing data from video fluoromatric monitoring of liquid chromatographic effluents, Analytical Chemistry, 53 (1981), pp. 2053-2056.
2. A. BELOUCHRANI, K. ABED-MERAIM, J.-F. CARDOSO, AND E. MOULINES, A blind source separation technique using second-order statistics, IEEE Trans. Signal Process., 45 (1997), pp. 434-444.
3. A. BELOUCHRANI AND M.G. AMIN, Blind source separation based on time-frequency signal representations, IEEE Trans. Signal Process., 46 (1998), pp. 2888-2897.
4. G. BEYLKIN AND M.J. MOHLENKAMP, Numerical operator calculus in higher dimensions, Proc. Natl. Acad. Sci. USA, 99 (2002), pp. 10246-10251.
5. G. BEYLKIN AND M.J. MOHLENKAMP, Algorithms for numerical analysis in high dimensions, SIAM J. Sci. Comput., 26 (2005), pp. 2133-2159.
6. R. BRO, PARAFAC. Tutorial & applications, Chemom. Intell. Lab. Syst., Special Issue 2nd Internet Conf. in Chemometrics (INCINC'96), 38 (1997), pp. 149-171.
7. J.-F. CARDOSO, Super-symmetric decomposition of the fourth-order cumulant tensor. Blind identification of more sources than sensors, in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Toronto, Canada, 1991, pp. 3109-3112.
8. J.-F. CARDOSO AND A. SOULOUMIAC, Blind beamforming for non-Gaussian signals, IEE ProcF, 140 (1994), pp. 362-370.
9. J. CARROLL AND J. CHANG, Analysis of individual differences in multidimensional scaling via an N-way generalization of "Eckart-Young" decomposition, Psychometrika, 9 (1970), pp. 267-283.
10. P. COMON, Independent component analysis, a new concept?, Signal Process., Special Issue on Higher Order Statistics, 36 (1994), pp. 287-314.
11. P. COMON AND B. MOURRAIN, Decomposition of quantics in sums of powers of linear forms, Signal Process., Special Issue on Higher Order Statistics, 53 (1996), pp. 93-108.
12. J. DEHAENE, Continuous-Time Matrix Algorithms, Systolic Algorithms and Adaptive Neural Networks, Ph.D. Thesis, Electrical Engineering Department (ESAT), K.U.Leuven, Belgium, 1995.
13. N) approximation of higher-order tensors, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1324-1342.
14. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, An introduction to independent component analysis, J. Chemometrics, Special Issue Multi-way Analysis, 14 (2000), pp. 123-149.
15. L. DE LATHAUWER, The canonical decomposition and blind identification with more inputs than outputs: Some algebraic results, in Proceedings of the Fourth International Symposium on Independent Component Analysis and Blind Signal Separation (ICA 2003), Nara, Japan, 2003, pp. 781-784.
16. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, Computation of the canonical decomposition by means of a simultaneous generalized Schur decomposition, SIAM J. Matrix Anal. Appl., 26 (2004), pp. 295-327.
17. L. DE LATHAUWER, Parallel factor analysis by means of simultaneous matrix decompositions, in Proceedings of the First IEEE International Workshop on Computational Advances in Multi-sensor Adaptive Processing (CAMSAP 2005), Puerto Vallarta, Jalisco State, Mexico, 2005, pp. 125-128.
18. L. DE LATHAUWER, J. CASTAING, AND J.-F. CARDOSO, Fourth-Order Cumulant Based Under determined Independent Component Analysis, Tech. Rep., Lab. ETIS, Cergy-Pontoise, France, 2006, submitted.
19. B. FLURY, Common Principal Components & Related Multivariate Models, John Wiley, New York, 1988.
20. A. FRANC, Etude Algébrique des Multitableaux: Apports de l'Algèbre Tensorielle, Thèse de Doctorat, Spécialité Statistiques, Univ. de Montpellier II, Montpellier, France, 1992.
21. G.H. GOLUB AND CF. VAN LOAN, Matrix Computations, 3rd ed., Johns Hopkins University Press, Baltimore, MD, 1996.
22. T. JIANG AND N.D. SIDIROPOULOS, Kruskal's permutation lemma and the identification of CANDECOMP/PARAFAC and bilinear models with constant modulus constraints, IEEE Trans. Signal Process., 52 (2004), pp. 2625-2636.
23. M. HAARDT AND J. A. NOSSEK, Simultaneous Schur decomposition of several non-symmetric matrices to achieve automatic pairing in multidimensional harmonic retrieval problems, IEEE Trans. Signal Process., 46 (1998), pp. 161-169.
24. R. HARSHMAN, Foundations of the PARAFAC procedure: Model and conditions for an "explanatory" multi-mode factor analysis, UCLA Working Papers in Phonetics, 16 (1970), pp. 1-84.
25. R.D. HILL AND S.R. WATERS, On the cone of positive semidefinite matrices, Linear Algebra Appl., 90 (1987), pp. 81-88.
26. A. HYVÄRINEN, J. KARHUNEN, AND E. OJA, Independent Component Analysis, John Wiley, New York, 2001.
27. H. KIERS, Towards a standardized notation and terminology in multiway analysis, J. Chemometrics, 14 (2000), pp. 105-122.
28. E. KOFIDIS AND P.A. REGALIA, On the best rank-1 approximation of higher-order supersymmetric tensors, SIAM J. Matrix Anal. Appl., 23 (2002), pp. 863-884.
29. T. G. KOLDA, Orthogonal tensor decompositions, SIAM J. Matrix Anal. Appl., 23 (2001), pp. 243-255.
30. T. KOLDA, A counterexample to the possibility of an extension of the Eckart-Young low-rank approximation theorem for the orthogonal rank tensor decomposition, SIAM J. Matrix Anal. Appl., 24 (2003), pp. 762-767.
31. J.B. KRUSKAL, Three-way arrays: Rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics, Linear Algebra Appl., 18 (1977), pp. 95-138.
32. S.E. LEURGANS, R.T. ROSS, AND R.B. ABEL, A decomposition for three-way arrays, SIAM J. Matrix Anal. Appl., 14 (1993), pp. 1064-1083.
33. X. LIU AND N. SIDIROPOULOS, Cramér-Rao lower bounds for low-rank decomposition of multidimensional arrays, IEEE Trans. Signal Process., 49 (2001), pp. 2074-2086.
34. P. PAATERO, The multilinear engine - A table-driven, least squares program for solving multilinear problems, including the ç-way parallel factor analysis model, J. Comput. Graphical Statist., 8 (1999), pp. 854-888.
35. D.-T. PHAM AND J.-F. CARDOSO, Blind separation of instantaneous mixtures of non-stationary sources, IEEE Trans. Signal Process., 49 (2001), pp. 1837-1848.
36. D.T. PHAM, Joint approximate diagonalization of positive definite Hermitian matrices, SIAM J. Matrix Anal. Appl., 22 (2001), pp. 1136-1152.
37. CR. RAO AND S. MITRA, Generalized Inverse of Matrices and Its Applications, John Wiley, New York, 1971.
38. N. SIDIROPOULOS, G. GIANNAKIS, AND R. BRO, Blind PARAFAC receivers for DS-CANDE-COMPMA systems, IEEE Trans. Signal Process., 48 (2000), pp. 810-823.
39. N. SIDIROPOULOS, R. BRO, AND G. GIANNAKIS, Parallel factor analysis in sensor array processing, IEEE Trans. Signal Process., 48 (2000), pp. 2377-2388.
40. N. SIDIROPOULOS AND R. BRO, On the uniqueness of multilinear decomposition of N-way arrays, J. Chemometrics, 14 (2000), pp. 229-239.
41. A. SMILDE, R. BRO, AND P. GELADI, Multi-way Analysis. Applications in the Chemical Sciences, John Wiley, Chichester, UK, 2004.
42. A.-J. VAN DER VEEN AND A. PAULRAJ, An analytical constant modulus algorithm, IEEE Trans. Signal Process., 44 (1996), pp. 1136-1155.
43. A.-J. VAN DER VEEN, Joint diagonalization via subspace fitting techniques, in Proceedings of the 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Salt Lake City, UT, 2001, pp. 2773-2776.
44. A. YEREDOR, Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation, IEEE Trans. Signal Process., 50 (2002), pp. 1545-1553.
45. T. ZHANG AND G.H. GOLUB, Rank-one approximation to high order tensors, SIAM J. Matrix Anal. Appl., 23 (2001), pp. 534-550.