Decompositions of a higher-order tensor in block terms - Part II: Definitions and uniqueness

SIAM Journal on Matrix Analysis and Applications

Volumn 30, Issue 3, 2008, Pages 1033-1066

  De Lathauwer, Lieven ^a,b  

^a Subfaculty Science and Technology   (Belgium)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Canonical decomposition; Higher order tensor; Multilinear algebra; Parallel factors model; Tucker decomposition

Indexed keywords

CANONICAL DECOMPOSITION; HIGHER-ORDER TENSOR; MULTILINEAR ALGEBRA; PARALLEL FACTORS MODEL; TUCKER DECOMPOSITION;

ALGEBRA; DECOMPOSITION;

TENSORS;

EID: 67349118082     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/070690729     Document Type: Article

References (61)

1. C.J. APPELLOF AND E.R. DAVIDSON, Strategies for analyzing data from video fiuoromatric monitoring of liquid chromatographic effluents, Anal. Chemistry, 53 (1981), pp. 2053-2056.
2. G. BEYLKIN AND M.J. MOHLENKAMP, Numerical operator calculus in higher dimensions, Proc. Natl. Acad. Sci. USA, 99 (2002), pp. 10246-10251.
3. G. BEYLKIN AND M.J. MOHLENKAMP, Algorithms for numerical analysis in high dimensions, SIAM J. Sci. Comput., 26 (2005), pp. 2133-2159.
4. G. BOUTRY, M. ELAD, G.H. GOLUB, AND P. MILANFAR, The generalized eigenvalue problem for nonsquare pencils using a minimal perturbation approach, SIAM J. Matrix Anal. Appl., 27 (2005), pp. 582-601.
5. R. BRO, PARAFAC. Tutorial and Applications, Chemom. Intell. Lab. Syst., 38 (1997), pp. 149-171.
6. D. BURDICK, X. TU, L. MCGOWN, AND D. MILLICAN, Resolution of multicomponent fluorescent mixtures by analysis of the excitation-emission-frequency array, J. Chemometrics, 4 (1990), pp. 15-28.
7. J. CARROLL AND J. CHANG, Analysis of individual differences in multidimensional scaling via an N-way generalization of "Eckart-Young" decomposition, Psychometrika, 9 (1970), pp. 267-283.
8. P. COMON, Independent component analysis, a new concept? Signal Process., 36 (1994), pp. 287-314.
9. P. COMON AND B. MOURRAIN, Decomposition of quantics in sums of powers of linear forms, Signal Process., 53 (1996), pp. 93-108.
10. P. COMON, G. GOLUB, L.-H. LIM, AND B. MOURRAIN, Symmetric tensors and symmetric tensor rank, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1254-1279.
11. L. DE LATHAUWER, Signal Processing Based on Multilinear Algebra, Ph.D. thesis, K.U.Leuven, Belgium, 1997.
12. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, A multilinear singular value decomposition, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1253-1278.
13. N) approximation of higher-order tensors, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1324-1342.
14. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, An introduction to independent component analysis, J. Chemometrics, 14 (2000), pp. 123-149.
15. N) reduction in multilinear algebra, Linear Algebra Appl., 391 (2004), pp. 31-55.
16. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, Computation of the Canonical Decomposition by means of a simultaneous generalized Schur decompositition, SIAM J. Matrix Anal. Appl., 26 (2004), pp. 295-327.
17. L. DE LATHAUWER, A link between the Canonical Decomposition in multilinear algebra and simultaneous matrix diagonalization, SIAM J. Matrix Anal. Appl., 28 (2006), pp. 642-666.
18. L. DE LATHAUWER AND J. CASTAING, Tensor-based techniques for the blind separation of DS-CDMA signals, Signal Process., 87 (2007), pp. 322-336.
19. L. DE LATHAUWER, Decompositions of a higher-order tensor in block terms-Part I: Lemmas for partitioned matrices, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1022-1032.
20. L. DE LATHAUWER AND D. NION, Decompositions of a higher-order tensor in block terms-Part III: Alternating Least Squares algorithms, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1067-1083.
21. L. DE LATHAUWER AND A. DE BAYNAST, Blind deconvolution of DS-CDMA Signals by means of decomposition in rank-(l, L, L) terms, IEEE Trans. Signal Process., 56 (2008), pp. 1562-1571.
22. M. ELAD, P. MILANFAR, AND G.H. GOLUB, Shape from moments-an estimation theory perspective, IEEE Trans. Signal Process., 52 (2004), pp. 1814-1829.
23. G.H. GOLUB AND C.F. VAN LOAN, Matrix Computations, 3rd ed., Johns Hopkins University Press, Baltimore, MD, 1996.
24. W. HACKBUSH, B.N. KHOROMSKIJ, AND E. TYRTYSHNIKOV, Hierarchical Kronecker tensor-product approximations, J. Numer. Math., 13 (2005), pp. 119-156.
25. W. HACKBUSH AND B.N. KHOROMSKIJ, Tensor-product approximation to operators and functions in high dimension, J. Complexity, 23 (2007), pp. 697-714.
26. R.A. HARSHMAN, Foundations of the PARAFAC procedure: Model and conditions for an "explanatory" multi-mode factor analysis, UCLA Working Papers in Phonetics, 16 (1970), pp. 1-84.
27. F.L. HITCHCOCK, The expression of a tensor or a polyadic as a sum of products, J. Math. Phys., 6 (1927), pp. 164-189.
28. F.L. HITCHCOCK, Multiple invariants and generalized rank of a p-way matrix or tensor, J. Math. Phys., 7 (1927), pp. 39-79.
29. A. HYVÄRINEN, J. KARHUNEN, AND E. OJA, Independent Component Analysis, John Wiley, New York, 2001.
30. J. JA'JA', An addendum to Kronecker's theory of pencils, SIAM J. Appl. Math. 37 (1979), pp. 700-712.
31. T. JIANG AND N.D. SIDIROPOULOS, Kruskal's permutation lemma and the identification of CANDECOMP/PARAFAC and bilinear models with constant modulus constraints, IEEE Trans. Signal Process., 52 (2004), pp. 2625-2636.
32. T. KATO, A Short Introduction to Perturbation theory for Linear Operators, Springer-Verlag, New York, 1982.
33. B.N. KHOROMSKIJ AND V. KHOROMSKAIA, LOW rank Tucker-type tensor approximation to classical potentials, Central European J. Math., 5 (2007), pp. 523-550.
34. H. KIERS, Towards a standardized notation and terminology in multiway analysis, J. Chemo-metrics, 14 (2000), pp. 105-122.
35. T.G. KOLDA, Orthogonal tensor decompositions, SIAM J. Matrix Anal. Appl., 23 (2001), pp. 243-255.
36. T.G. KOLDA, A counterexample to the possibility of an extension of the Eckart-Young low-rank approximation theorem for the orthogonal rank tensor decomposition, SIAM J. Matrix Analysis, 24 (2003), pp. 762-767.
37. P.M. KROONENBERG, Applied Multiway Data Analysis, John Wiley, New York, 2008.
38. J.B. KRUSKAL, Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics, Linear Algebra Appl., 18 (1977), pp. 95-138.
39. J.B. KRUSKAL, Rank, decomposition, and uniqueness for Z-way and N-way arrays, in Multiway Data Analysis, R. Coppi and S. Bolasco, eds., North-Holland, Amsterdam, 1989, pp. 7-18.
40. S.E. LEURGANS, R.T. ROSS, AND R.B. ABEL, A decomposition for three-way arrays, SIAM J. Matrix Anal. Appl., 14 (1993), pp. 1064-1083.
41. L.-H. LIM, Singular values and eigenvalues of tensors: a variational approach, Proceedings of the First IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP 2005), Puerto Vallarta, Jalisco State, Mexico, 2005, pp. 129-132.
42. C.D. MORAVITZ MARTIN AND C.F. VAN LOAN, A Jacobi-type method for computing orthogonal tensor decompositions, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1219-1232.
43. D. NION AND L. DE LATHAUWER, A block factor analysis based receiver for blind multi-user access in wireless communications, in Proceedings of the 2006 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2006), Toulouse, France, 2006, pp. 825-828.
44. D. NION AND L. DE LATHAUWER, A tensor-based blind DS-CDMA receiver using simultaneous matrix diagonalization, Proceedings of the Eighth IEEE Workshop on Signal Processing Advances in Wireless Communications (SPAWC 2007), Helsinki, Finland, 2007.
45. D. NION AND L. DE LATHAUWER, Block component model based blind DS-CDMA receivers, IEEE Trans. Signal Process., to appear.
46. C.R. RAO AND S.K. MITRA, Generalized Inverse of Matrices and Its Applications, John Wiley, New York, 1971.
47. E. SANCHEZ AND B.R. KOWALSKI, Tensorial resolution: A direct trilinear decomposition, 3. Chemometrics, 4 (1990), pp. 29-45.
48. R. SANDS AND F. YOUNG, Component models for three-way data: An alternating least squares algorithm with optimal scaling features, Psychometrika, 45 (1980), pp. 39-67.
49. N. SIDIROPOULOS, G. GIANNAKIS, AND R. BRO, Blind PARAFAC receivers for DS-CDMA systems, IEEE Trans. Signal Process., 48 (2000), pp. 810-823.
50. N. SIDIROPOULOS, R. BRO, AND G. GIANNAKIS, Parallel factor analysis in sensor array processing, IEEE Trans. Signal Process., 48 (2000), pp. 2377-2388.
51. N. SIDIROPOULOS AND R. BRO, On the uniqueness of multilinear decomposition of N-way arrays, J. Chemometrics, 14 (2000), pp. 229-239.
52. N. SIDIROPOULOS AND G.Z. DIMIĆ, Blind multiuser detection in W-CDMA systems with large delay spread, IEEE Signal Process. Letters, 8 (2001), pp. 87-89.
53. A. SMILDE, R. BRO, AND P. GELADI, Multi-way Analysis. Applications in the Chemical Sciences, John Wiley, Chichester, UK, 2004.
54. A. STEGEMAN AND N.D. SIDIROPOULOS, On Kruskal's uniqueness condition for the Cande-comp/Parafac decomposition, Linear Algebra Appl., 420 (2007), pp. 540-552.
55. J.M.F. TEN BERGE AND H.A.L. KIERS, Simplicity of core arrays in three-way principal component analysis and the typical rank of p × q × 2 arrays, Linear Algebra Appl., 294 (1999), pp. 169-179.
56. J.M.F. TEN BERGE, The typical rank of tall three-way arrays, Psychometrika, 65 (2000), pp. 525-532.
57. J.M.F. TEN BERGE, N.D. SIDIROPOULOS, AND R. ROCCI, Typical rank and indscal dimensionality for symmetric three-way arrays of order I × 2 × 2 or I × 3 × 3, Linear Algebra Appl., 388 (2004), pp. 363-377.
58. J.M.F. TEN BERGE, Simplicity and typical rank of three-way arrays, with applications to Tucker-Z analysis with simple cores, J. Chem., 18 (2004), pp. 17-21.
59. L.R. TUCKER, The extension of factor analysis to three-dimensional matrices, in Contributions to Mathematical Psychology, H. Gulliksen and N. Frederiksen, eds., Holt, Rinehart & Winston, New York, 1964, pp. 109-127.
60. L.R. TUCKER, Some mathematical notes on three-mode factor analysis, Psychometrika, 31 (1966), pp. 279-311.
61. T. ZHANG AND G.H. GOLUB, Rank-one approximation to high order tensors, SIAM J. Matrix Anal. Appl., 23 (2001), pp. 534-550.