Decompositions of a higher-order tensor in block terms - Part III: Alternating least squares algorithms

SIAM Journal on Matrix Analysis and Applications

Volumn 30, Issue 3, 2008, Pages 1067-1083

  De Lathauwer, Libven ^a,b   Nion, Dimitri ^c  

^a Subfaculty Science and Technology   (Belgium)

^b UNIVERSITY OF LEUVEN   (Belgium)

^c TECHNICAL UNIVERSITY OF CRETE   (Greece)

Author keywords

Canonical decomposition; Higher order tensor; Multilinear algebra; Parallel factors model; Tucker decomposition

Indexed keywords

CANONICAL DECOMPOSITION; HIGHER-ORDER TENSOR; MULTILINEAR ALGEBRA; PARALLEL FACTORS MODEL; TUCKER DECOMPOSITION;

ALGEBRA; COMPUTATION THEORY; DECOMPOSITION;

TENSORS;

EID: 54949129274     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/070690730     Document Type: Article

References (44)

1. G. BOUTRY, M. ELAD, G.H. GOLUB, AND P. MILANFAR, The generalized eigenvalue problem for nonsquare pencils using a minimal perturbation approach, SIAM J. Matrix Anal. Appl., 27 (2005), pp. 582-601.
2. D. BURDICK, X. TU, L. MCGOWN, AND D. MILLICAN, Resolution of multicomponent fluorescent mixtures by analysis of the excitation-emission-frequency array, J. Chemometrics, 4 (1990), pp. 15-28.
3. J. CARROLL AND J. CHANG, Analysis of individual differences in multidimensional scaling via an N-way generalization of "Eckart-Young" decomposition, Psychometrika, 9 (1970), pp. 267-283.
4. P. COMON, G. GOLUB, L.-H. LIM, AND B. MOURRAIN, Symmetric tensors and symmetric tensor rank, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1254-1279.
5. L. DE LATHAUWER, Signal Processing Based on Multilinear Algebra, Ph.D. thesis, K.U.Leuven, Belgium, 1997.
6. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, A multilinear singular value decomposition, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1253-1278.
7. N) approximation of higher-order tensors, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1324-1342.
8. N) reduction in multilinear algebra, Linear Algebra Appl., 391 (2004), pp. 31-55.
9. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, Computation of the Canonical Decomposition by means of a simultaneous generalized Schur decompositition, SIAM J. Matrix Anal. Appl., 26 (2004), pp. 295-327.
10. L. DE LATHAUWER, A link between the Canonical Decomposition in multilinear algebra and simultaneous matrix diagonalization, SIAM J. Matrix Anal. Appl., 28 (2006), pp. 642-666.
11. L. DE LATHAUWER, Decompositions of a higher-order tensor in block terms-Part II: Definitions and uniqueness, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1033-1066.
12. V. DE SILVA AND L.-H. LIM, Tensor rank and the ill-posedness of the best low-rank approximation problem, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1084-1127.
13. M. ELAD, P. MILANFAR, AND G.H. GOLUB, Shape from moments-an estimation theory perspective, IEEE Trans. Signal Process., 52 (2004), pp. 1814-1829.
14. 3) Approximation of a Tensor, Tech. report LITH-MAT-R-2007-6-SE, Department of Mathematics, Linköping University, 2007.
15. R. A. HARSHMAN, Foundations of the PARAFAC Procedure: Model and Conditions for an "Explanatory" Multi-Mode Factor Analysis, UCLA Working Papers in Phonetics, 16 (1970), pp. 1-84.
16. R.A. HARSHMAN AND M.E. LUNDY, Data preprocessing and the extended Parafac model, in Research Methods for Multimode Data Analysis, H.G. Law, C.W. Snyder, J.A. Hattie, and R.P. McDonald, eds., Praeger, New York, 1984, pp. 216-284.
17. M. ISHTEVA, L. DE LATHAUWER, P.-A. ABSIL, AND S. VAN HUFFEL, Dimensionality reduction for higher-order tensors: algorithms and applications, Int. J. Pure Appl. Math., 42 (2008), pp. 337-343.
18. J. JA'JA', Optimal evaluation of bilinear forms, SIAM J. Comput. 8 (1979), pp. 443-462.
19. H. KlERS, Towards a standardized notation and terminology in multiway analysis, J. Chemo-metrics, 14 (2000), pp. 105-122.
20. E. KOFIDIS AND P. A. REGALIA, On the best rank-1 approximation of higher-order supersym-metric tensors, SIAM J. Matrix Anal. Appl., 23 (2002), pp. 863-884.
21. P.M. KROONENBERG AND J. DE LEEUW, Principal component analysis of three-mode data by means of alternating least squares algorithms, Psychometrika, 45 (1980), pp. 69-97.
22. P.M. KROONENBERG, Three-mode principal component analysis: illustrated with an example from attachment theory, in Research Methods for Multimode Data Analysis, H.G. Law, C.W. Snyder, J.A. Hattie, and R.P. McDonald, eds., Praeger, New York, 1984, pp. 64-103.
23. P.M. KROONENBERG, Applied Multiway Data Analysis, Wiley, New York, 2008.
24. J.B. KRUSKAL, Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics, Linear Algebra Appl., 18 (1977), pp. 95-138.
25. J.B. KRUSKAL, R.A. HARSHMAN, AND M.E. LUNDY, HOW 3-MFA data can cause degenerate PARAFAC solutions, among other relationships, in Multiway Data Analysis, R. Coppi and S. Bolasco, eds., North-Holland, Amsterdam, 1989, pp. 115-122.
26. S.E. LEURGANS, R.T. ROSS, AND R.B. ABEL, A decomposition for three-way arrays, SIAM J. Matrix Anal. Appl., 14 (1993), pp. 1064-1083.
27. B.C. MITCHELL AND D.S. BURDICK, Slowly converging Parafac sequences: Swamps and two-factor degeneracies, J. Chem., 8 (1994), pp. 155-168.
28. D. NION AND L. DE LATHAUWER, Levenberg-Marquardt computation of the block factor model for blind multi-user access in wireless communications, Proceedings of the 14th European Signal Processing Conference (Eusipco 2006), Florence, Italy, 2006.
29. D. NION AND L. DE LATHAUWER, A tensor-based blind DS-CDMA receiver using simultaneous matrix diagonalization, Proceedings of the VIII IEEE Workshop on Signal Processing Advances in Wireless Communications (SPAWC 2007), Helsinki, Finland, 2007.
30. D. NION AND L. DE LATHAUWER, Block component model based blind DS-CDMA receivers, IEEE Trans. Signal. Process., to appear.
31. D. NION AND L. DE LATHAUWER, An enhanced line search scheme for complex-valued tensor decompositions. Application in DS-CDMA., Signal Process., 88 (2008), pp. 749-755.
32. P. PAATERO, The multilinear engine-A table-driven, least squares program for solving multilinear problems, including the n-way parallel factor analysis model, J. Comput. Graphical Statist., 8 (1999), pp. 854-888.
33. M. RAJIH, P. COMON, AND R.A. HARSHMAN, Enhanced line search: a novel method to accelerate parafac, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1128-1147.
34. C.R. RAO AND S.K. MITRA, Generalized Inverse of Matrices and Its Applications, Wiley, New York, 1971.
35. E. SANCHEZ AND B.R. KOWALSKI, Tensorial resolution: A direct trilinear decomposition, J. Chemometrics, 4 (1990), pp. 29-45.
36. R. SANDS AND F. YOUNG, Component models for three-way data: An alternating least squares algorithm with optimal scaling features, Psychometrika, 45 (1980), pp. 39-67.
37. A. SMILDE, R. BRO, AND P. GELADI, Multi-way Analysis. Applications in the Chemical Sciences, Wiley, Chichester, UK, 2004.
38. A. STEGEMAN, Low-rank approximation of generic p × q × 2 arrays and diverging components in the Candecomp/Parafac model, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 988-1007.
39. G. TOMASI AND R. BRO, A comparison of algorithms for fitting the PARAFAC model, Comp. Stat. Data Anal., 50 (2006), pp. 1700-1734.
40. L.R. TUCKER, The extension of factor analysis to three-dimensional matrices, in Contributions to Mathematical Psychology, H. Gulliksen and N. Frederiksen, eds., Holt, Rinehart & Winston, New York, 1964, pp. 109-127.
41. L.R. TUCKER, Some mathematical notes on three-mode factor analysis, Psychometrika, 31 (1966), pp. 279-311.
42. S.A. VOROBYOV, Y. RONG, N.D. SIDIROPOULOS, AND A.B. GERSHMAN, Robust iterative fitting of multilinear models, IEEE Trans. Signal Process., 53 (2005), pp. 2678-2689.
43. J. WEESIE AND H. VAN HOUWELINGEN, GEPCAM Users' Manual: Generalized Principal Components Analysis with Missing Values, Tech. report, Institute of Mathematical Statistics, University of Utrecht, Netherlands, 1983.
44. T. ZHANG AND G.H. GOLUB, Rank-one approximation to high order tensors, SIAM J. Matrix Anal. Appl., 23 (2001), pp. 534-550.