A newton-grassmann method for computing the best multilinear rank-(r 1,r2,r3) approximation of a tensor

SIAM Journal on Matrix Analysis and Applications

Volumn 31, Issue 2, 2009, Pages 248-271

  Eld́en, Lars ^a   Savas, Berkant ^a  

^a LINKÖPING UNIVERSITY   (Sweden)

Author keywords

Approximation; Grassmann manifold; Multilinear; Newton; Rank; Tensor

Indexed keywords

ALGEBRAIC MANIPULATIONS; APPROXIMATION; APPROXIMATION PROBLEMS; GRASSMANN MANIFOLD; NEWTON EQUATION; NEWTON METHODS; NEWTON'S METHODS; QUADRATIC CONVERGENCE; TENSOR PRODUCTS;

COMPUTER SCIENCE; CONVERGENCE OF NUMERICAL METHODS; NEWTON-RAPHSON METHOD;

TENSORS;

EID: 68149125583     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/070688316     Document Type: Article

References (27)

1. P.-A. ABSIL, R. MAHONY, AND R. SEPULCHRE, Optimization Algorithms on Matrix Manifolds, Princeton University Press, Princeton, NJ, 2007.
2. B. BADER AND T. KOLDA, Algorithm 862: MATLAB tensor classes for fast algorithm prototyping, ACM Trans. Math. Software, 32 (2006), pp. 635-653.
3. B. W. BADER AND T. G. KOLDA, Efficient MATLAB computations with sparse and factored tensors, SIAM J. Sci. Comput., 30 (2007), pp. 205-231.
4. L. DE LATHAUWER, L. HOEGAERTS, AND J. VANDEWALLE, A Grassmann-Rayleigh quotient iteration for dimensionality reduction in ICA, in Proceedings of the 5th International Workshop on Independent Component Analysis and Blind Signal Separation (ICA 2004), Granada, Spain, 2004, pp. 335-342.
5. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, A multilinear singular value decomposition, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1253-1278.
6. n) approximation of higher-order tensors, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1324-1342.
7. V. DE SILVA AND L.-H. LIM, Tensor rank and the ill-posedness of the best low-rank approximation problem, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1084-1127.
8. A. EDELMAN, T. ARIAS, AND S. T. SMITH, The geometry of algorithms with orthogonality constraints, SIAM J. Matrix Anal. Appl., 20 (1998), pp. 303-353.
9. L. ELDEN, Matrix Methods in Data Mining and Pattern Recognition, SIAM, Philadelphia, 2007.
10. G. H. GOLUB AND C. F. VAN Loan, Matrix Computations, 3rd ed., Johns Hopkins Press, Baltimore, MD, 1996.
11. R. A. HARSHMAN, An index formalism that generalizes the capabilities of matrix notation and algebra to n-way arrays, J. Chemometrics, 15 (2001), pp. 689-714.
12. F. L. HITCHCOCK, Multiple invariants and generalized rank of a p-way matrix or tensor, J. Math. Phys. Camb., 7 (1927), pp. 39-70.
13. R. J. HORN AND C. R. JOHNSON, Topics in Matrix Analysis, Cambridge University Press, Cambridge, 1991.
14. M. ISHTEVA, L. DE LATHAUWER, P.-A. ABSIL, AND S. VAN HUFFEL, Dimensionality reduction for higher-order tensors: Algorithms and applications, Int. J. Pure Appl. Math., 42 (2008), pp. 337-343.
15. H. A. L. KIERS, Towards a standardized notation and terminology in multiway analysis, J. Chemometrics, 14 (2000), pp. 106-125.
16. S. KOBAYASHI AND K. NOMIZU, Foundations of Differential Geometry, Interscience, New York, 1963.
17. T. G. KOLDA, Multilinear Operators for Higher-order Decompositions, Technical report SAND2006-2081, Sandia National Laboratories, Albuquerque, NM, 2006.
18. P. M. KROONENBERG, Principal component analysis of three-mode data by means of alternating least squares algorithms, Psychometrika, 45 (1980), pp. 69-97.
19. E. LUNDSTRÖM AND L. ELDÉN, Adaptive eigenvalue computations using Newton's method on the Grassmann manifold, SIAM J. Matrix Anal. Appl., 23 (2002), pp. 819-839.
20. J. NOCEDAL AND S. J. WRIGHT, Numerical Optimization, Springer Ser. Oper. Res., Springer, New York, 1999.
21. M. J. D. POWELL, On search directions for minimization algorithms, Math. Program., 4 (1973), pp. 193-201.
22. A. RUHE AND P.-A WEDIN, Algorithms for separable nonlinear least squares problems, SIAM Rev., 22 (1980), pp. 318-337.
23. B. SAVAS AND L.-H. LIM, Best Multilinear Rank Approximation of Tensors with Quasi-Newton Methods on Grassmannians, Technical report, Department of Mathematics, Linkooping University, Linkooping, Sweden 2008.
24. L. R. TUCKER, The extension of factor analysis to three-dimensional matrices, in Contributions to Mathematical Psychology, H. Gulliksen and N. Frederiksen, eds., Holt, Rinehart and Winston, New York, 1964, pp. 109-127.
25. L. R. TUCKER, Some mathematical notes on three-mode factor analysis, Psychometrika, 31 (1966), pp. 279-311.
26. M. A. O. VASILESCU AND D. TERZOPOULOS, Multilinear analysis of image ensembles: Tensor- faces, in Proceedings of the 7th European Conference on Computer Vision (ECCV'02), Lect. Notes Comput. Sci. 2350, Springer, New York, 2002, pp. 447-460.
27. M. A. O. VASILESCU AND D. TERZOPOULOS, Multilinear subspace analysis of image ensembles, in IEEE Conference on Computer Vision and Pattern Recognition (CVPR'03), Madison WI, 2003, pp. 93-99.