Tensors : A brief introduction

IEEE Signal Processing Magazine

Volumn 31, Issue 3, 2014, Pages 44-53

  Comon, Pierre ^a  

^a CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

BLIND SOURCE SEPARATION; SINGULAR VALUE DECOMPOSITION;

TENSOR DECOMPOSITION; UNDER-DETERMINED MIXTURES;

TENSORS;

EID: 85032750838     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2014.2298533     Document Type: Article

References (95)

1. H. Abo, G. Ottaviani, and C. Peterson, "Induction for secant varieties of Segre varieties," Trans. Amer. Math. Soc., vol. 361, pp. 767-792, 2009.
2. L. Albera, A. Ferreol, P. Chevalier, and P. Comon, "ICAR, a tool for blind source separation using fourth order statistics only," IEEE Trans. Signal Processing, vol. 53, no. 10, pp. 3633-3643, Oct. 2005.
3. J. Alexander and A. Hirschowitz, "Polynomial interpolation in several variables," J. Algebr. Geom., vol. 4, no. 2, pp. 201-222, 1995.
4. J. M. F. Ten Berge, "Kruskal's polynomial for 2 # 2 # 2 arrays and a generalization to 2 # n # n arrays," Psychometrika, vol. 56, no. 4, pp. 631-636, 1991.
5. J. M. F. Ten Berge, "Simplicity and typical rank of three-way arrays," J. Chemomet., vol. 18, no. 1, pp. 17-21, 2004.
6. A. Bernardi, A. Gimigliano, and M. Ida, "Computing symmetric rank for symmetric tensors," J. Symb. Computat., vol. 46, no. 1, pp. 34-53, 2011.
7. D. Bini, M. Capovani, F. Romani, and G. Lotti, "O(n2.77) complexity for nxn approximate matrix multiplication," Inform. Process. Lett., vol. 8, no. 5, pp. 234-235, 1979.
8. G. Blekherman, "Typical real ranks of binary forms," Found. Computat. Math., to be published. DOI 10.1007/s10208-013-9174-8. arXiv:1205.3257
9. M. M. Boizard, G. Ginolhac, F. Pascal, S. Miron, and P. Forster, "Numerical performance of a tensor MUSIC algorithm based on HOSVD," in Proc. European Signal Processing Conf. (EUSIPCO), Marrakech, Morocco, Dec. 13-15, 2013.
10. J. Brachat, P. Comon, B. Mourrain, and E. Tsigaridas, "Symmetric tensor decomposition," Linear Algebr. Applicat., vol. 433, nos. 11-12, pp. 1851-1872, Dec. 2010.
11. R. Bro and C. A. Andersson, "Improving the speed of multiway algorithms. Part II: Compression," Chemomet. Intell. Lab. Syst., vol. 42, nos. 1-2, pp. 105-113, 1998.
12. J. D. Carroll and J. J. Chang, "Analysis of individual differences in multidimensional scaling via n-way generalization of Eckart-Young decomposition," Psychometrika, vol. 35, no. 3, pp. 283-319, Sept. 1970.
13. A. Causa and R. Re, "On the maximum rank of a real binary form," Annali di Matematica Pura e Applicata, vol. 190, no. 1, pp. 55-59, 2011.
14. G. Chabriel, M. Kleinstauber, E. Moreau, H. Shen, P. Tichavsky, and A. Yeredor, "Joint matrices decompositions and blind source separation," IEEE Signal. Processing Mag., vol. 31, no. 3, pp. 34-43, May 2014.
15. L. Chiantini and G. Ottaviani, "On generic identifiability of 3-tensors of small rank," SIAM J. Matrix Anal. Appl., vol. 33, no. 3, pp. 1018-1037, 2012.
16. A. Cichocki, D. Mandic, A-H. Phan, C. Caiafa, G. Zhou, Q. Zhao, and L. De Lathauwer, "Tensor decompositions for signal processing applications," IEEE Signal. Processing Mag., to be published.
17. P. Comon, "Tensor decompositions, state of the art and applications," in Mathematics in Signal Processing V, J. G. McWhirter and I. K. Proudler, Eds. Oxford, U.K.: Clarendon Press, 2002, pp. 1-24.
18. P. Comon, "Tensors, usefulness and unexpected properties," in Proc. 15th IEEE Workshop on Statistical Signal Processing (SSP'09), Cardiff, U.K., 31 Aug.-3 Sept., 2009, pp. 781-788.
19. P. Comon, G. Golub, L.-H. Lim, and B. Mourrain, "Symmetric tensors and symmetric tensor rank," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1254-1279, Sept. 2008.
20. P. Comon and C. Jutten, Eds., Handbook of Blind Source Separation, Independent Component Analysis and Applications. Oxford U.K.: Academic, 2010.
21. P. Comon, X. Luciani, and A. L. F. De Almeida, "Tensor decompositions, alternating least squares and other tales," J. Chemomet., vol. 23, pp. 393-405, Aug. 2009.
22. P. Comon and G. Ottaviani, "On the typical rank of real binary forms," Linear Multilinear Algebr., vol. 60, no. 6, pp. 657-667, May 2012.
23. P. Comon and G. Ottaviani, "Tensor decompositions, a geometric viewpoint," submitted for publication.
24. P. Comon, J. M. F. Ten Berge, L. De Lathauwer, and J. Castaing, "Generic and typical ranks of multi-way arrays," Linear Algebr. Applicat., vol. 430, nos. 11-12, pp. 2997-3007, June 2009.
25. L. De Lathauwer, "A link between canonical decomposition in multilinear algebra and simultaneous matrix diagonalization," SIAM J. Matrix Anal. Appl., vol. 28, no. 3, pp. 642-666, 2006.
26. L. De Lathauwer, "Blind separation of exponential polynomials and the decomposition of a tensor in rank-(Lr,Lr,1) terms," SIAM J. Matrix Anal. Appl., vol. 32, no. 4, pp. 145-1474, 2011.
27. L. De Lathauwer, B. De Moor, and J. Vandewalle, "A multilinear singular value decomposition," SIAM J. Matrix Anal. Appl., vol. 21, no. 4, pp. 1253-1278, Apr. 2000.
28. L. De Lathauwer, B. De Moor, and J. Vandewalle, "On the best rank-1 and rank-(R1,R2,... RN) approximation of high-order tensors," SIAM J. Matrix Anal. Appl., vol. 21, no. 4, pp. 1324-1342, Apr. 2000.
29. L. De Lathauwer, B. De Moor, and J. Vandewalle, "Independent component analysis and (simultaneous) third-order tensor diagonalization," IEEE Trans. Signal Processing, vol. 49, no. 10, pp. 2262-2271, Oct. 2001.
30. L. De Lathauwer, B. De Moor, and J. Vandewalle, "Computation of the canonical decomposition by means of a simultaneous generalized Schur decomposition," SIAM J. Matrix Anal. Appl., vol. 26, no. 2, pp. 295-327, 2004.
31. I. Domanov and L. De Lathauwer, "On the uniqueness of the canonical polyadic decomposition of third-order tensors-Part I: Basic results and uniqueness of one factor matrix," SIAM J. Matrix Anal. Appl., vol. 34, no. 3, pp. 855-875, 2013.
32. I. Domanov and L. De Lathauwer, "On the uniqueness of the canonical polyadic decomposition of third-order tensors-Part II: Overall uniqueness," SIAM J. Matrix Anal. Appl., vol. 34, no. 3, pp. 876-903, 2013.
33. R. Ehrenborg and G. C. Rota, "Apolarity and canonical forms for homogeneous polynomials," Eur. J. Combinatorics, vol. 14, no. 3, pp. 157-181, May 1993.
34. S. Friedland, "Best rank one approximation of real symmetric tensors can be chosen symmetric," Front. Math. China, vol. 8, no. 1, pp. 19-40, 2013.
35. S. Friedland and G. Ottaviani, "The number of singular vector tuples and uniqueness of best rank one approximation of tensors," submitted for publication. arXiv:1210.8316.
36. R. A. Harshman, "Foundations of the Parafac procedure: Models and conditions for an explanatory multimodal factor analysis," UCLA Working Pap. Phonet., vol. 16, pp. 1-84, Dec. 1970.
37. C. J. Hillar and L.-H. Lim, "Most tensor problems are NP-hard," submitted for publication. arXiv:0911.1393.
38. F. L. Hitchcock, "The expression of a tensor or a polyadic as a sum of products," J. Math. Phys., vol. 6, no. 1, pp. 165-189, 1927.
39. T. D. Howell, "Global properties of tensor rank," Linear. Algebr. Applicat., vol. 22, pp. 9-23, Dec. 1978.
40. A. Iarrobino, "Inverse system of a symbolic power. II. The Waring problem for forms," J. Algebr., vol. 174, no. 3, pp. 1091-1110, June 1995.
41. T. Jiang and N. Sidiropoulos, "Kruskal's permutation lemma and the identification of CANDECOMP/PARAFAC and bilinear models," IEEE Trans. Signal Processing, vol. 52, no. 9, pp. 2625-2636, Sept. 2004.
42. H. A. L. Kiers, "Towards a standardized notation and terminology in multiway analysis," J. Chemomet., vol. 14, no. 3, pp. 105-122, June 2000.
43. E. Kofidis and P. Regalia, "One the best rank-1 approximation of higher-order symmetric tensors," SIAM J. Matrix Anal. Appl., vol. 23, no. 3, pp. 863-884, 2002.
44. E. Kofidis and P. A. Regalia, "Tensor approximation and signal processing applications," in Structured Matrices in Mathematics, Computer Science, and Engineering, V. Olshevsky, Ed. American Math. Soc.: Providence, RI, 2001.
45. T. G. Kolda, "Orthogonal tensor decomposition," SIAM J. Matrix Anal. Appl., vol. 23, no. 1, pp. 243-255, 2001.
46. T. G. Kolda and B. W. Bader, "Tensor decompositions and applications," SIAM Rev., vol. 51, no. 3, pp. 455-500, Sept. 2009.
47. J. B. Kruskal, "Three-way arrays: Rank and uniqueness of trilinear decompositions," Linear Algebr. Applicat., vol. 18, no. 2, pp. 95-138, 1977.
48. J. B. Kruskal, "Rank of N-way arrays and the geometry of 2#2#2 arrays," Tech. Rep., AT&T Bell Labs, Feb. 1985.
49. J. M. Landsberg, "Tensors: Geometry and applications," in Graduate Studies in Mathematics. American Math. Soc.: Providence, RI, 2012, vol. 128.
50. S. Leurgans, R. T. Ross, and R. B. Abel, "A decomposition for three-way arrays," SIAM J. Matrix Anal. Appl., vol. 14, no. 4, pp. 1064-1083, Oct. 1993.
51. X. L. Li and X. D. Zhang, "Nonorthogonal joint diagonalization free of degenerate solution," IEEE Trans. Signal Processing, vol. 55, no. 5, pp. 1803-1814, 2007.
52. T. Lickteig, "Typical tensorial rank," Linear Algebr. Applicat., vol. 69, pp. 95-120, Aug. 1985.
53. L.-H. Lim, "Singular values and eigenvalues of tensors: A variational approach," in Proc. IEEE Int. Workshop on Computational Advances Multi-Sensor Adaptive Processing, Puerto Vallarta, Mexico, Dec. 13-15, 2005, pp. 129-132.
54. L.-H. Lim and P. Comon, "Nonnegative approximations of nonnegative tensors," J. Chemomet., vol. 23, pp. 432-441, Aug. 2009.
55. L.-H. Lim and P. Comon, "Blind multilinear identification," IEEE Trans. Inform. Theory, vol. 60, no. 2, 2014, pp. 1260-1280.
56. X. Luciani and L. Albera, "Semi-algebraic canonical decomposition of multiway arrays and joint eigenvalue decomposition," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP'2011), Prague, Mar. 12-15, 2011, pp. 4104-4107.
57. P. Mccullagh, Tensor Methods in Statistics, Monographs on Statistics and Applied Probability. London, U.K.: Chapman & Hall, 1987.
58. R. Miranda, "Linear systems of plane curves," Not. AMS, vol. 46, no. 2, pp. 192-202, Feb. 1999.
59. G. Ni and Y. Wang, "On the best rank-1 approximation to higher-order symmetric tensors," Math. Comput. Modell., vol. 46, no. 9-10, pp. 1345-1352, Nov. 2007.
60. L. Oeding and G. Ottaviani, "Eigenvectors of tensors and algorithms for Waring decomposition," J. Symb. Comput., vol. 54, pp. 9-35, July 2013.
61. P. Paatero, "Construction and analysis of degenerate Parafac models," J. Chemomet., vol. 14, no. 3, pp. 285-299, May/June 2000.
62. D. T. Pham, "Joint approximate diagonalization of positive definite Hermitian matrices," SIAM J. Matrix Anal. Appl., vol. 22, no. 4, pp. 1136-1152, 2001.
63. A. H. Phan, A. Cichocki, P. Tichavsky, G. Luta, and A. Brockmeier, "Tensor completion through multiple Kronecker product decomposition," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP'2013), Vancouver, Canada, May 26-31, pp. 3233-3237.
64. A. H. Phan, P. Tichavsky, and A. Cichocki, "Candecomp/Parafac decomposition of high-order tensors through tensor reshaping," IEEE Trans. Signal Processing, vol. 61, pp. 4847-4860, Oct. 2013.
65. M. Rajih, P. Comon, and R. Harshman, "Enhanced line search: A novel method to accelerate Parafac," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1148-1171, Sept. 2008.
66. B. Reznick, "Sums of even powers of real linear forms," Mem. AMS, vol. 96, no. 463, pp. 1-155, Mar. 1992.
67. B. Reznick, "Laws of inertia in higher degree binary forms," Proc. Amer. Math. Soc., vol. 138, no. 3, pp. 815-826, June 2010.
68. J. A. Rhodes, "A concise proof of Kruskal's theorem on tensor decomposition," Linear Algebr. Applicat., vol. 432, no. 7, pp. 1818-1824, Mar. 2010.
69. F. Roemer and M. Haardt, "A semi-algebraic framework for approximate CP decompositions via simultaneous matrix diagonalizations (secsi)," Signal Process., vol. 93, no. 9, pp. 2722-2738, Sept. 2013.
70. J-P. Royer, N. Thirion-Moreau, and P. Comon, "Computing the polyadic decomposition of nonnegative third order tensors," Signal Process., vol. 91, no. 9, pp. 2159-2171, Sept. 2011.
71. J. R. Ruiz-Tolosa and E. Castillo, From Vectors to Tensors, Universitext. Berlin, Heidelberg: Springer, 2005.
72. A. Schönhage, "Partial and total matrix multiplication," SIAM J. Computat., vol. 10, no. 3, pp. 434-455, 1981.
73. N. D. Sidiropoulos and R. Bro, "On the uniqueness of multilinear decomposition of N-way arrays," J. Chemomet., vol. 14, no. 3, pp. 229-239, May/June 2000.
74. N. D. Sidiropoulos, R. Bro, and G. B. Giannakis, "Parallel factor analysis in sensor array processing," IEEE Trans. Signal Processing, vol. 48, no. 8, pp. 2377-2388, Aug. 2000.
75. V. De Silva and L-H. Lim, "Tensor rank and the ill-posedness of the best low-rank approximation problem," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1084-1127, 2008.
76. A. Smilde, R. Bro, and P. Geladi, Multi-Way Analysis. Chichester, U.K.: Wiley, 2004.
77. L. Sorber, M. Van Barel, and L. De Lathauwer, "Optimization-based algorithms for tensor decompositions: Canonical polyadic decomposition, decomposition in rank-s terms and a new generalization," SIAM J. Optim., vol. 23, no. 2, pp. 695-720, Apr. 2013.
78. M. Sorensen and P. Comon, "Tensor decompositions with banded matrix factors," Linear Algeb. Applicat., vol. 438, no. 1, pp. 919-941, Jan. 2013.
79. A. Stegeman and L. De Lathauwer, "A method to avoid diverging components in the Candecomp/Parafac model for generic IxJx2 arrays," SIAM J. Matrix Anal. Appl., vol. 30, no. 4, pp. 1614-1638, 2009.
80. A. Stegeman and P. Comon, "Subtracting a best rank-1 approximation does not necessarily decrease tensor rank," Linear Algebr. Applicat., vol. 433, no. 7, pp. 1276-1300, Dec. 2010.
81. A. Stegeman and N. D. Sidiropoulos, "On Kruskal's uniqueness condition for the Candecomp/Parafac decomposition," Linear Algebr. Applicat., vol. 420, no. 2-3, pp. 540-552, Jan. 2007.
82. V. Strassen, "Rank and optimal computation of generic tensors," Linear Algebr. Applicat., vol. 52, pp. 645-685, July 1983.
83. P. Tichavsky and Z. Koldovsky, "Weight adjusted tensor method for blind separation of underdetermined mixtures of nonstationary sources," IEEE Trans. Signal Processing, vol. 59, no. 3, pp. 1037-1047, Mar. 2011.
84. G. Tomasi and R. Bro, "A comparison of algorithms for fitting the Parafac model," Comp. Stat. Data Anal., vol. 50, pp. 1700-1734, 2006.
85. L. R. Tucker, "Some mathematical notes for three-mode factor analysis," Psychometrika, vol. 31, no. 3, pp. 279-311, Sept. 1966.
86. R. Vollgraf and K. Obermayer, "Quadratic optimization for simultaneous matrix diagonalization," IEEE Trans. Signal Processing, vol. 54, pp. 3270-3278, Sept. 2006.
87. A. Yeredor, "Non-orthogonal joint diagoinalization in the LS sense with application in blind source separation," IEEE Trans. Signal Processing, vol. 50, no. 7, pp. 1545-1553, 2002.
88. X. Zhang, C. Ling, and L. Qi, "The best rank-1 approximation of a symmetric tensor and related spherical optimization problems," SIAM J. Matrix Anal. Appl., vol. 33, no. 3, pp. 806-821, 2012.
89. R. Ziehe, G. Nolte, and K. R. Müller, "A fast algorithm for joint diagonalization with non orthogonal transformations and its application to blind source separation," J. Mach. Learn. Res., vol. 5, pp. 777-800, Dec. 2004.
90. R. Bro. Home Page. [Online]. Available: http://www.models.life.ku.dk/ users/rasmus
91. L. De Lathauwer. Home Page. [Online]. Available: http://homes.esat. kuleuven. be/~delathau
92. T. Kolda. Home Page. [Online]. Available: http://www.sandia.gov/~tgkolda
93. A. H. Phan. Home Page. [Online]. Available: http://www.bsp.brain.riken. jp/~phan
94. P. Comon. Home Page. [Online]. Available: http://www.gipsa-lab. grenobleinp. fr/~pierre.comon
95. P. Kroonenberg. Three-Mode Company. [Online]. Available: http://www. gipsa-lab.grenoble-inp.fr/~pierre.comon