Computation of the canonical decomposition by means of a simultaneous generalized Schur decomposition

SIAM Journal on Matrix Analysis and Applications

Volumn 26, Issue 2, 2005, Pages 295-327

  De Lathauwer, Lieven ^a   De Moor, Bart ^b   Vandewalle, Joos ^b  

^a Centre national de la recherche scientifique   (France)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Canonical decomposition; Generalized Schur decomposition; Higher order tensor; Multilinear algebra; Parallel factors analysis

Indexed keywords

ALGORITHMS; LEAST SQUARES APPROXIMATIONS; LINEAR ALGEBRA; MATHEMATICAL MODELS; MATRIX ALGEBRA; PERTURBATION TECHNIQUES; VECTORS;

CANONICAL DECOMPOSITION; GENERALIZED SCHUR DECOMPOSITION; HIGHER-ORDER TENSOR; MULTILINEAR ALGEBRA; PARALLEL FACTORS ANALYSIS;

TENSORS;

EID: 17444379662     PISSN: 08954798     EISSN: None     Source Type: Journal    
DOI: 10.1137/S089547980139786X     Document Type: Review

References (50)

1. C.J. APPELLOF AND E.R. DAVIDSON, Strategies for analyzing data from video fluoromatric monitoring of liquid Chromatographic effluents, Analytical Chemistry, 53 (1981), pp. 2053-2056.
2. A. BELOUCHRANI, K. ABED-MERAIM, J.-F. CARDOSO, AND E. MOULINES, A blind source separation technique using second-order statistics, IEEE Trans. Signal Process., 45 (1997), pp. 434-444.
3. R. BRO, PARAFAC. Tutorial & applications, Chemom. Intell. Lab. Syst., 38 (1997), pp. 149-171.
4. A. BUNSE-GERSTNER, R. BYERS, AND V. MEHRMANN, Numerical methods for simultaneous diagonalization, SIAM J. Matrix Anal. Appl., 14 (1993), pp. 927-949.
5. D. BURDICK, X. TU, L. MCGOWN, AND D. MILLICAN, Resolution of multicomponent fluorescent mixtures by analysis of the excitation-emission-frequency array, J. Chemometrics, 4 (1990), pp. 15-28.
6. J.-F. CARDOSO, Super-symmetric decomposition of the fourth-order cumulant tensor. Blind identification of more sources than sensors, in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Toronto, Canada, 1991, pp. 3109-3112.
7. J.-F. CARDOSO, Iterative techniques for blind source separation using only fourth-order cumulants, in Signal Processing VI: Theories and Applications, Proc. EUSIPCO-92, Brussels, Belgium, 1992, pp. 739-742.
8. J.-F. CARDOSO AND A. SOULOUMIAC, Blind beamfarming for non-Gaussian signals, IEE Proc.-F, 140 (1994), pp. 362-370.
9. J.-F. CARDOSO AND A. SOULOUMIAC, Jacobi angles for simultaneous diagonalization, SIAM J. Matrix Anal. Appl., 17 (1996), pp. 161-164.
10. J. CARROLL AND J. CHANG, Analysis of individual differences in multidimensional scaling via an N-way generalization of "Eckart-Young" decomposition, Psychometrika, 9 (1970), pp. 267-283.
11. J. CARROLL, G. DESOETE, AND S. PRUZANSKY, An evaluation of five algorithms for generating an initial configuration for SINDSCAL, J. Classification, 6 (1989), pp. 105-119.
12. M.T. CHU, A continuous Jacobi-like approach to the simultaneous reduction of real matrices, Linear Algebra Appl., 147 (1991), pp. 75-96.
13. P. COMON, Independent component analysis, a new concept? Signal Process., 36 (1994), pp. 287-314.
14. P. COMON AND B. MOURRAIN, Decomposition of quantics in sums of powers of linear forms, Signal Process., 53 (1996), pp. 93-108.
15. J. DEHAENE, Continuous-Time Matrix Algorithms, Systolic Algorithms and Adaptive Neural Networks, Ph.D. Thesis, E.E. Dept. (ESAT), K.U.Leuven, Belgium, 1995.
16. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, Independent component analysis based on higher-order statistics only, in Proceedings of the IEEE Signal Processing Workshop on Statistical Signal and Array Processing, Corfu, Greece, 1996, pp. 356-359.
17. L. DE LATHAUWER, Signal Processing Based on Multilinear Algebra, Ph.D. thesis, K.U. Leuven, E.E. Dept. (ESAT), Belgium, 1997.
18. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, Jacobi-algorithm for simultaneous generalized Schur decomposition in higher-order-only ICA, in Proceedings of the IEEE Benelux Signal Processing Chapter Signal Processing Symposium (SPS'98), Leuven, Belgium, 1998, pp. 67-70.
19. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, A multilinear singular value decomposition, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1253-1278.
20. N) approximation of higher-order tensors, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1324-1342.
21. B. DE MOOR, ED., Database for the Identification of Systems (DAISY), E.E. Dept., ESAT/SCD, K.U.Leuven, Belgium, http://www.esat.kuleuven.ac.be/sista/daisy/.
22. A. EDELMAN, T.A. ARIAS, AND S.T. SMITH, The geometry of algorithms with orthogonality constraints, SIAM J. Matrix Anal. Appl., 20 (1998), pp. 303-353.
23. B. FLURY, Common Principal Components & Related Multivariate Models, John Wiley & Sons, New York, 1988.
24. G.H. GOLUB AND C.F. VAN LOAN, Matrix Computations, 3rd ed., Johns Hopkins University Press, Baltimore, MD, 1996.
25. M. HAARDT, K. HÜPER, J. MOORE, AND J. NOSSEK, Simultaneous Schur Decomposition of several matrices to achieve automatic pairing in multidimensional harmonic retrieval problems, in Signal Processing VIII: Theories and Applications, Proceedings of EUSIPCO-96, Trieste, Italy, 1996, Vol. 1, pp. 531-534.
26. R. HARSHMAN, Foundations of the PARAFAC procedure: Model and conditions for an "explanatory" multi-mode factor analysis, UCLA Working Papers in Phonetics, 16 (1970), pp. 1-84.
27. R.A. HARSHMAN AND M.E. LUNDY, The PARAFAC model for three-way factor analysis and multidimensional scaling, in Research Methods for Multimode Data Analysis, H.G. Law, C.W. Snyder, J.A. Hattie, and R.P. McDonald, eds., Praeger, NY, 1984, pp. 122-215.
28. R.A. HARSHMAN AND M.E. LUNDY, PARAFAC: Parallel factor analysis, Comput. Statist. Data Anal., 18 (1994), pp. 39-72.
29. R. HARSHMAN, P. LADEFOGED, AND L. GOLDSTEIN, Factor analysis of tongue shapes, J. Acoust. Soc. Am., 62 (1977), pp. 693-707.
30. T. KATO, A Short Introduction to Perturbation Theory for Linear Operators, Springer-Verlag, New York, 1982.
31. H. KIERS AND W. KRIJNEN, An efficient algorithm for PARAFAC of three-way data with large numbers of observational units, Psychometrika, 56 (1991), pp. 147-152.
32. E. KOFIDIS AND P.A. REGALIA, On the best rank-1 approximation of higher-order supersymmetric tensors, SIAM J. Matrix Anal. Appl., 23 (2002), pp. 863-884.
33. T. KOLDA, A counterexample to the possibility of an extension of the Eckart-Young low-rank approximation theorem for the orthogonal rank tensor decomposition, SIAM J. Matrix Anal. Appl., 24 (2003), pp. 762-767.
34. J.B. KRUSKAL, Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics, Linear Algebra Appl., 18 (1977), pp. 95-138.
35. J.B. KRUSKAL, Rank, decomposition, and uniqueness for 3-way and N-way arrays, in Multiway Data Analysis, R. Coppi and S. Bolasco, eds., North-Holland, Amsterdam, 1989, pp. 7-18.
36. J.B. KRUSKAL, R.A. HARSHMAN, AND M.E. LUNDY, How 3-MFA data can cause degenerate PARAFAC solutions, among other relationships, in Multiway Data Analysis, R. Coppi and S. Bolasco, eds., North-Holland, Amsterdam, 1989, pp. 115-122.
37. P. LADEFOGED, personal communication, Linguistics Dept., UCLA, Los Angeles, CA, 1996.
38. S.E. LEURGANS, R.T. Ross, AND R.B. ABEL, A decomposition for three-way arrays, SIAM J. Matrix Anal. Appl., 14 (1993), pp. 1064-1083.
39. J.J. MORE, The Levenberg-Marquardt algorithm: implementation and theory, in Numerical Analysis, Lecture Notes in Math. 630, G.A. Watson, ed., Springer-Verlag, Berlin, 1977, pp. 105-116.
40. P. PAATERO, A weighted non-negative least squares algorithm for three-way "PARAFAC" factor analysis, Chemom. Intell. Lab. Syst., 38 (1997), pp. 223-242.
41. W.S. RAVENS AND B.C. MITCHELL, Two-factor degeneracies and a stabilization of PARAFAC, Chemom. Intell. Lab. Syst., 38 (1997), pp. 173-181.
42. E. SANCHEZ AND B.R. KOWALSKI, Tensorial resolution: A direct trilinear decomposition, J. Chemometrics, 4 (1990), pp. 29-45.
43. R. SANDS AND F. YOUNG, Component models for three-way data: An alternating least squares algorithm with optimal scaling features, Psychometrika, 45 (1980), pp. 39-67.
44. R. SCHMIDT, A Signal Subspace Approach to Multiple Emitter Location and Spectral Estimation, Ph.D. thesis, Stanford University, 1981.
45. N. SIDIROPOULOS, G. GIANNAKIS, AND R. BRO, Blind PARAFAC receivers for DS-CDMA systems, IEEE Trans. Signal Process., 48 (2000), pp. 810-823.
46. N. SIDIROPOULOS, R. BRO, AND G. GIANNAKIS, Parallel factor analysis in sensor array processing, IEEE Trans. Signal Process., 48 (2000), pp. 2377-2388.
47. N. SIDIROPOULOS AND R. BRO, On the uniqueness of multilinear decomposition of N-way arrays, J. Chemometrics, 14 (2000), pp. 229-239.
48. A.-J. VAN DER VEEN AND A. PAULRAJ, An analytical constant modulus algorithm, IEEE Trans. Signal Process., 44 (1996), pp. 1136-1155.
49. A. YEREDOR, Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation, IEEE Trans. Signal Process., 50 (2002), pp. 1545-1553.
50. T. ZHANG AND G.H. GOLUB, Rank-one approximation to high order tensors, SIAM J. Matrix Anal. Appl., 23 (2001), pp. 534-550.