Tensors versus matrices usefulness and unexpected properties

IEEE Workshop on Statistical Signal Processing Proceedings

Volumn , Issue , 2009, Pages 781-788

  Comon, Pierre ^a  

^a UNIVERSITY OF NICE SOPHIA ANTIPOLIS   (France)

Author keywords

Blind identification; Canonical decomposition; Deflation; Factor analysis; High order statistics; Low rank approximation; Parafac; Separation of variables; Tensor rank

Indexed keywords

BLIND IDENTIFICATIONS; CANONICAL DECOMPOSITION; FACTOR ANALYSIS; HIGH ORDER STATISTICS; LOW RANK APPROXIMATIONS; PARAFAC; SEPARATION OF VARIABLES;

BLIND EQUALIZATION; COMMUNICATION CHANNELS (INFORMATION THEORY); DATA PROCESSING; SIGNAL PROCESSING;

TENSORS;

EID: 72349095077     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SSP.2009.5278471     Document Type: Conference Paper

References (56)

1. G. M. BERGMAN, "Ranks of tensors and change of base field," Journal of Algebra, vol. 11, pp. 613-621, 1969.
2. P. McCULLAGH, Tensor Methods in Statistics, Monographs on Statistics and Applied Probability. Chapman and Hall, 1987.
3. T. LICKTEIG, "Typical tensorial rank," Linear Algebra Appl., vol. 69, pp. 95-120, 1985.
4. P. COMON, G. GOLUB, L-H. LIM, and B. MOURRAIN, "Symmetric tensors and symmetric tensor rank," SIAM Jour. Matrix Ana. Appl., vol. 30, no. 3, pp. 1254-1279, 2008.
5. F. L. HITCHCOCK, "Multiple invariants and generalized rank of a p-way matrix or tensor," J. Math. and Phys., vol. 7, no. 1, pp. 40-79, 1927.
6. T. D. HOWELL, "Global properties of tensor rank," Linear Algebra and Applications, vol. 22, pp. 9-23, 1978.
7. D. A. WEINSTEIN, "Canonical forms for symmetric tensors," Linear Algebra Appl., pp. 271-282, 1984.
8. J. BRACHAT, P. COMON, B. MOURRAIN, and E. TSI-GARIDAS, "Symmetric tensor decomposition," Linear Algebra and its Applications, 2009, submitted. hal:inria-00355713, arXiv:0901.3706.
9. P. COMON, "Tensor decompositions, state of the art and applications," in Mathematics in Signal Processing V, J. G. McWhirter and I. K. Proudler, Eds., pp. 1-24. Clarendon Press, Oxford, UK, 2002, arXiv:0905.0454v1.
10. L-H. LIM, "Singular values and eigenvalues of tensors: a variational approach," in IEEE Int. Workshop on Comput. Adv. Multi-Sensor Adapt. Proc., Puerto Vallarta, Mexico, 13-15 Dec. 2005.
11. P. COMON, "Blind channel identification and extraction of more sources than sensors," keynote address. in SPIE Conference, San Diego, July 19-24 1998, pp. 2-13,
12. L. QI, "Rank and eigenvalues of a symmetric tensor, the multivariate homogeneous polynomial and the algebraic hyper-surface it defines," Jour.Symbolic Computation, vol. 41, pp. 1309-1327, 2006.
13. R. EHRENBORG and G. C. ROTA, "Apolarity and canonical forms for homogeneous polynomials," European Jour. Combinatorics, vol. 14, pp. 157-181, 1993.
14. A. IARROBINO, "Inverse system of a symbolic power. II. the Waring problem for forms," J. Algebra, vol. 174, pp. 1091-1110, 1995.
15. J. M. F. ten BERGE, "The typical rank of tall three-way arrays," Psychometrika, vol. 65, no. 5, pp. 525-532, Sept. 2000.
16. P. COMON, J. M. F. ten BERGE, L. De LATHAUWER, and J. CASTAING, "Generic and typical ranks of multi-way arrays," Linear Algebra Appl., vol. 430, no. 11-12, pp. 2997-3007, June 2009.
17. P. COMON and B. MOURRAIN, "Decomposition of quantics in sums of powers of linear forms," Signal Processing, Elsevier, vol. 53, no. 2, pp. 93-107, Sept. 1996, special issue on High-Order Statistics.
18. P. COMON, X. LUCIANI, and A. L. F. de ALMEIDA, "Tensor decompositions, alternating least squares and other tales," Jour. Chemometrics, 2009.
19. N. D. SIDIROPOULOS and R. BRO, "On the uniqueness of multilinear decomposition of N-way arrays," Jour. Chemo., vol. 14, pp. 229-239, 2000.
20. J. B. KRUSKAL, "Three-way arrays: Rank and uniqueness of trilinear decompositions," Linear Algebra and Applications, vol. 18, pp. 95-138, 1977.
21. L. De LATHAUWER, "A link between canonical decomposition in multilinear algebra and simultaneous matrix diagonalization," SIAM Jour. Matrix Ana. Appl., vol. 28, no. 3, pp. 642-666, 2006.
22. G. SALMON, Lessons introductory to the Modern Higher Algebra, Chesla publ., New York, 1885.
23. I. A. KOGAN and M. M. MAZA, "Computation of canonical forms for ternary cubics," in ISSAC. 2000, pp. 151-160, ACM.
24. A. STEGEMAN and P. COMON, "Subtracting a best rank-1 approximation does not necessarily decrease tensor rank," in EUSIPCO'09, Glasgow, Scotland, Aug. 24-28 2009.
25. V. De SILVA and L-H. LIM, "Tensor rank and the ill-posedness of the best low-rank approximation problem," SIAM Jour. Matrix Ana. Appl., vol. 30, no. 3, pp. 1084-1127, 2008.
26. J. HARRIS, Algebraic Geometry, a first course, vol. 133 of Graduate Texts in Math., Springer, 1992.
27. O. GRELLIER and P. COMON, "Analytical blind discrete source separation," in Eusipco, Tampere, Finland, 5-8 sept. 2000.
28. L. de LATHAUWER, P. COMON, et al., "Higher-order power method, application in Independent Component Analysis," in NOLTA Conference, Las Vegas, 10-14 Dec 1995, vol. 1, pp. 91-96.
29. E. KOFIDIS and P. REGALIA, "One the best rank-1 approximation of higher-order supersymmetric tensors," SIAM Jour. Matrix Ana. Appl., vol. 23, pp. 863-884, 2002.
30. L. de LATHAUWER, B. de MOOR, and J. VANDEWALLE, "On the best rank-1 and rank-(R1,R2,⋯RN) approximation of high-order tensors," SIAM Jour. Matrix Ana. Appl., vol. 21, no. 4, pp. 1324-1342, Apr. 2000.
31. L-H. LIM and P. COMON, "Nonnegative approximations of nonnegative tensors," Jour. Chemometrics, 2009, to appear.
32. P. PAATERO, "Construction and analysis of degenerate Parafac models," Jour. Chemometrics, vol. 14, pp. 285-299, 2000.
33. D. BINI, G. LOTTI, and F. ROMANI, "Approximate solutions for the bilinear form computational problem," SIAM Jour. Comput., pp. 692-697, 1980.
34. P. PAATERO, "The multilinear engine: A table-driven, least squares program for solving multilinear problems, including the n-way parallel factor analysis model," Journal of Computational and Graphical Statistics, vol. 8, no. 4, pp. 854-888, Dec. 1999.
35. G. TOMASI and R. BRO, "A comparison of algorithms for fitting the Parafac model," Comp. Stat. Data Anal., vol. 50, pp. 1700-1734, 2006.
36. R. BRO and C. A. ANDERSSON, "Improving the speed of multiway algorithms. Part II: Compression," Chemometrics and Intelligent Laboratory Systems, vol. 42, no. 1-2, pp. 105-113, 1998.
37. P. KROONENBERG, Applied Multiway Data Analysis, Wiley, 2008.
38. A. SMILDE, R. BRO, and P. GELADI, Multi-Way Analysis, Wiley, 2004.
39. M. RAJIH, P. COMON, and R. HARSHMAN, "Enhanced line search: A novel method to accelerate Parafac," SIAM Jour. Matrix Ana. Appl., vol. 30, no. 3, pp. 1148-1171, Sept. 2008.
40. D. NION and L. DeLATHAUWER, "An enhanced line search scheme for complex-valued tensor decompositions. application in ds-cdma," Signal Processing, vol. 88, no. 3, pp. 749-755, Mar. 2008.
41. A. STEGEMAN and L. De LATHAUWER, "A method to avoid diverging components in the Candecomp/Parafac model for generic IxJx2 arrays," SIAM J. Matrix Ana. Appl., vol. 30, pp. 1614-1638, 2009.
42. L. De LATHAUWER,B. De MOOR, and J. VANDEWALLE, "Computation of the canonical decomposition by means of a simultaneous generalized Schur decomposition," SIAM Jour. Matrix Ana. Appl., vol. 26, no. 2, pp. 295-327, 2004.
43. W. HACKBUSCH, B. N. KHOROMSKIJ, and E. E. TYRTYSHNIKOV, "Hierarchical Kronecker tensor-product approximation," Jour. Numer. Math., vol. 13, pp. 119-156, 2005.
44. V. STRASSEN, "Rank and optimal computation of generic tensors," Linear Algebra Appl., vol. 52, pp. 645-685, July 1983.
45. P.BÜRGISSER,M.CLAUSEN, and M. A. SHOKROLLAHI, Algebraic Complexity Theory, vol. 315, Springer, 1997.
46. A. IARROBINO and V. KANEV, Power sums, Gorenstein algebras and determinantal loci, Springer, 1999.
47. B. W. BADER and T. KOLDA, "Algorithm 862: Matlab tensor classes for fast algorithm prototyping," ACM Trans. Math. Soft., vol. 32, pp. 635-653, 2006.
48. M. MORUP and L. K. HANSEN et alterae, "Parallel factor analysis as an exploratory tool for wavelet transformed event-related EEG," NeuroImage, vol. 29, pp. 938-947, 2006.
49. J. D. CARROLL and J. J. CHANG, "Analysis of individual differences in multidimensional scaling via n-way generalization of Eckart-Young decomposition," Psychometrika, vol. 35, no. 3, pp. 283-319, Sept. 1970.
50. A. CICHOCKI, R. ZDUNEK, and S-I. AMARI, "Nonnegative matrix and tensor factorization," IEEE Sig. Proc. Mag., pp. 142-145, 2008.
51. M. WELLING and M. WEBER, "Positive tensor factorization," Pattern Recognition Letters, vol. 22, no. 12, pp. 1255-1261, 2001.
52. M. PLUMBLEY, "Conditions for nonnegative independent component analysis," Sig. Proc. Letters, vol. 9, pp. 177-180, June 2002.
53. D. D. LEE and H. S. SEUNG, "Learning the parts of objects by non-negative matrix factorization.," Nature, vol. 401, pp. 788-791, Oct. 1999.
54. N. D. SIDIROPOULOS, R. BRO, and G. B. GIANNAKIS, "Parallel factor analysis in sensor array processing," IEEE Trans. Sig. Proc., vol. 48, no. 8, pp. 2377-2388, Aug. 2000.
55. N. D. SIDIROPOULOS, G. B. GIANNAKIS, and R. BRO, "Blind PARAFAC receivers for DS-CDMA systems," IEEE Trans. on Sig. Proc., vol. 48, no. 3, pp. 810-823, Mar. 2000.
56. P. COMON and M. RAJIH, "Blind identification of under-determined mixtures based on the characteristic function," Signal Processing, vol. 86, no. 9, pp. 2271-2281, Sept. 2006.