A survey of tensor methods

Proceedings - IEEE International Symposium on Circuits and Systems

Volumn , Issue , 2009, Pages 2773-2776

  De Lathauwer, Lieven ^a,b  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b EE Depart   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

HIGHER-ORDER TENSOR; MATRIX DECOMPOSITION; NONNEGATIVE MATRIX FACTORIZATION; NONNEGATIVE TENSOR FACTORIZATIONS; RESEARCH EFFORTS; STUDY AND APPLICATIONS; TENSOR METHOD;

DECOMPOSITION; FACTORIZATION; SURVEYS; TENSORS;

SINGULAR VALUE DECOMPOSITION;

EID: 70350180836     PISSN: 02714310     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISCAS.2009.5118377     Document Type: Conference Paper

References (83)

1. E. Acar, S.A. Ca̧mtepe, and B. Yener, "Collective sampling and analysis of high-order tensors for chatroom communications," Proc. IEEE Int. Conf. on Intelligence and Security Informatics, Lecture Notes in Computer Science, vol. 3975, pp. 213-224, 2006.
2. E. Acar, C. A. Bingol, H. Bingol, R. Bro, and B. Yener, "Multiway analysis of epilepsy tensors," Bioinformatics, vol. 23, no. 13, pp. i10-i18, 2007.
3. E. Acar and B. Yener, "Unsupervised multiway data analysis: a literature survey," IEEE Trans. Knowledge and Data Engineering, to appear.
4. A.H. Andersen and W.S. Rayens, "Structure-seeking multilinear methods for the analysis of fMRI data," NeuroImage, vol. 22, 2004, pp. 728-739.
5. P. Baranyi, Y. Yam, D. Tikk, and R.J. Patton, "Trade-off between approximation accuracy and complexity: TS controller design via HOSVD based complexity minimization," Studies in fuzziness and soft computing, vol. 128, 2003, pp. 249-277.
6. A. Belouchrani, K. Abed-Meraim, J.-F. Cardoso, and E. Moulines, "A blind source separation technique using second order statistics," IEEE Trans. Signal Processing, vol. 45, no. 2, pp. 434-444, Feb. 1997.
7. M. Berry, M. Browne, A. Langville, P. Pauca, R. Plemmons, "Algorithms and applications for approximate nonnegative matrix factorization," Comp. Stat. and Data Anal., vol. 52, 2007, pp. 155-173.
8. R. Bro, H.A.L. Kiers, "A new efficient method for determining the number of components in PARAFAC models," J. Chemometrics, vol. 17, no. 5, 2003, pp. 274-286.
9. J.-F. Cardoso and A. Souloumiac, "Blind beamforming for non-Gaussian signals," IEE Proc.-F, vol. 140, 1994, pp. 362-370.
10. J. Carroll and J. Chang, "Analysis of individual differences in multidimensional scaling via an N-way generalization of "Eckart-Young" decomposition," Psychometrika, vol. 35, pp. 283-319, 1970.
11. D. Chen and R. Plemmons, "Nonnegativity constraints in numerical analysis," in: A. Bultheel and R. Cools, Eds., Proc. Symposium on the Birth of Numerical Analysis, Leuven, Belgium, Oct. 2007, World Scientific Press, to appear.
12. A. Cichocki, R. Zdunek and S. Amari, "Nonnegative matrix and tensor factorization," IEEE Signal Processing Magazine, Jan. 2008, pp. 142-145.
13. A. Cichocki, A.H. Phan, and C. Caiafa, "Flexible HALS algorithms for sparse non-negative matrix/tensor factorization," Proc. Conf. for Machine Learning for Signal Processing, Oct. 16-19, 2008, Cancun, Mexico.
14. P. Comon, "Independent component analysis, a new concept?" Signal Process., vol. 36, no. 3, pp. 287-314, April 1994.
15. P. Comon and B. Mourrain, "Decomposition of quantics in sums of powers of linear forms," Signal Process., vol. 53, 1996, pp. 93-108.
16. A.L.F. de Almeida, G. Favier and J.C.M. Mota, "PARAFAC-based unified tensor modeling for wireless communication systems with application to blind multiuser equalization," Signal Proc., vol. 87, 2007, pp. 337-351.
17. S. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman, "Indexing by latent semantic analysis," Journal of the American Society for Information Science, vol. 41, no. 6, Jan. 1999, pp. 391-407.
18. B. De Moor, M. Moonen, Eds., SVD and Signal Processing, III. Algorithms, Applications and Architectures, Elsevier, Amsterdam, 1995.
19. L. De Lathauwer, B. De Moor, and J. Vandewalle, "A multilinear singular value decomposition," SIAM J. Matrix Anal. Appl., vol. 21, No. 4, April 2000, pp. 1253-1278.
20. N) approximation of higher-order tensors," SIAM J. Matrix Anal. Appl., vol. 21, No. 4, April 2000, pp. 1324-1342.
21. L. De Lathauwer, B. De Moor, and J. Vandewalle, , "An introduction to independent component analysis," J. Chemometrics, vol. 14, 2000, pp. 123-149.
22. L. De Lathauwer, B. De Moor, J. Vandewalle, "Independent Component Analysis and (Simultaneous) Third-Order Tensor Diagonalization", IEEE Trans. Signal Processing, vol. 49, no. 10, Oct. 2001, pp. 2262-2271.
23. N) reduction in multilinear algebra", Lin. Alg. Appl., vol. 391, Nov. 2004, pp. 31-55.
24. L. De Lathauwer, B. De Moor, and J. Vandewalle, "Computation of the canonical decomposition by means of a simultaneous generalized Schur decomposition," SIAM J. Matrix Anal. Appl., vol. 26, pp. 295-327, 2004.
25. L. De Lathauwer, "A link between the canonical decomposition in multilinear algebra and simultaneous matrix diagonalization," SIAM J. Matrix Anal. Appl., vol. 28, no. 3, pp. 642-666, 2006.
26. L. De Lathauwer and A. de Baynast, "Blind deconvolution of DS-CDMA signals by means of decomposition in rank-(1, L, L) terms," IEEE Trans. Signal Processing, vol. 56, no. 4, April 2008, pp. 1562-1571.
27. L. De Lathauwer, "Decompositions of a higher-order tensor in block terms - Part I: Lemmas for partitioned matrices," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, 2008, pp. 1022-1032.
28. L. De Lathauwer, "Decompositions of a higher-order tensor in block terms - Part II: Definitions and uniqueness," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, 2008, pp. 1033-1066.
29. L. De Lathauwer and D. Nion, "Decompositions of a higher-order tensor in block terms - Part III: Alternating least squares algorithms," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, 2008, pp. 1067-1083.
30. B. De Moor and M. Moonen, Eds., SVD and Signal Processing, III. Algorithms, Applications and Architectures, Elsevier, Amsterdam, 1995.
31. E.F. Deprettere, Ed., SVD and Signal Processing. Algorithms, Applications and Architectures, North-Holland, Amsterdam, 1988.
32. V. de Silva and L.-H. Lim, "Tensor rank and the ill-posedness of the best low-rank approximation problem," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, 2008, pp. 1084-1127.
33. M. De Vos, A. Vergult, L. De Lathauwer, W. De Clercq, S. Van Huffel, P. Dupont, A. Palmini, and W. Van Paesschen, "Canonical decomposition of ictal EEG reliably detects the seizure onset zone", Neuroimage, vol. 37, no. 3, Sep. 2007, pp. 844-854.
34. D. Donoho and V. Stodden, "When does non-negative matrix factorization give a correct decomposition into parts?," Proc. 17th Annual Conf. on Neural Information Processing Systems (NIPS 2003), Vancouver, Whistler, Canada.
35. D.M. Dunlavy, T.G. Kolda, and and W.P. Kegelmeyer, "Multilinear algebra for analyzing data with multiple linkages,". Tech. Rep. SAND2006-2079, Sandia National Laboratories, Albuquerque, NM and Livermore, CA, April 2006.
36. 3) approximation of a tensor, SIAM J. Matrix Anal. Appl, to appear.
37. R.A. Harshman, "Foundations of the PARAFAC procedure: model and conditions for an "explanatory" multi-mode factor analysis," UCLA Working Papers in Phonetics, vol. 16, pp. 1-84, 1970.
38. F.L. Hitchcock, "The expression of a tensor or a polyadic as a sum of products," J. Math. Phys., vol. 6, no. 1, 1927, pp. 164-189.
39. F.L. Hitchcock, "Multiple invariants and generalized rank of a p-way matrix or tensor," J. Math. Phys., vol. 7, no. 1, 1927, pp. 39-79.
40. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis, John Wiley & Sons, 2001.
41. M. Ishteva, L. De Lathauwer, P.-A. Absil, and S. Van Huffel, "Dimensionality reduction for higher-order tensors: algorithms and applications," Int. Journal of Pure and Applied Mathematics, vol. 42, No. 3, 2008, pp. 337-343.
42. 3) approximation of tensors," Numerical Algorithms, to appear.
43. I. Joliffe, Principal Component Analysis, John Wiley & Sons, 2005.
44. H. Kiers and I. Van Mechelen, "Three-way component analysis: principles and illustrative application," Psychological Methods, vol. 6, 2001, pp. 84-110.
45. D. Kim, S. Sra, and I.S. Dhillon, "Fast projection-based methods for the least squares nonnegative matrix approximation problem," Statistical Analysis and Data Mining, vol. 1, no. 1, Feb. 2008, pp. 38-51.
46. E. Kofidis and P.A. Regalia, "On the best rank-1 approximation of higher-order supersymmetric tensors," SIAM J. Matrix Anal. Appl., vol. 23, 2002, pp. 863-884.
47. T.G. Kolda, "Orthogonal tensor decompositions," SIAM J. Matrix Anal. Appl., vol. 23, 2001, pp. 243-255.
48. T.G. Kolda, B.W. Bader, and J.P. Kenny, "Higher-order web link analysis using multilinear algebra," ICDM 2005: Proc. 5th IEEE Int. Conf. on Data Mining (ICDM 2005), Nov. 2005, pp. 242-249.
49. T.G. Kolda and B.W. Bader, "Tensor decompositions and applications," SIAM Rev., to appear.
50. P.M. Kroonenberg, Applied Multiway Data Analysis, Wiley, 2008.
51. J.B. Kruskal, "Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics," Lin. Alg. Appl., vol. 18, 1977, pp. 95-138.
52. D.D. Lee and H. Seung, "Learning the parts of objects by non-negative matrix factorization," Nature, vol. 401, 1999, pp. 788-791.
53. D.D. Lee and H. Seung, "Algorithms for non-negative matrix factorization," Advances in Neural Information Processing Systems, vol. 13, 2001, pp. 556-562.
54. C.D. Moravitz Martin and C.F. Van Loan, "A Jacobi-type method for computing orthogonal tensor decompositions," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, 2008, pp. 1219-1232.
55. M. Mørup, L.K. Hansen, S.M. Arnfred, "Algorithms for sparse non-negative Tucker," Neural Computation, vol. 20, no. 8, 2008, pp. 2112-2131.
56. C. Navasca, L. De Lathauwer, and S. Kindermann, "Swamp reducing technique for tensor decomposition," Proc. 16th European Signal Processing Conference (EUSIPCO 2008), Aug. 25-29, 2008, Lausanne, Switzerland.
57. D. Nion and L. De Lathauwer, "A tensor-based blind DS-CDMA receiver using simultaneous matrix diagonalization," Proc. VIII IEEE Workshop on Signal Processing Advances in Wireless Communications (SPAWC 2007), June 17-20, 2007, Helsinki, Finland.
58. D. Nion and L. De Lathauwer, "An enhanced line search scheme for complex-valued tensor decompositions. Application in DS-CDMA." Signal Processing, vol. 88, No. 3, March 2008, pp. 749-755.
59. D. Nion and L. De Lathauwer, "Block Component Model Based Blind DS-CDMA Receivers," IEEE Trans. Signal Processing, to appear.
60. P. Paatero and U. Tapper, "Positive matrix factorization: a non-negative factor model with optimal utilization of error estimates of data values," Environmetrics, vol. 5, no. 2, 1994, pp. 111-126.
61. P. Paatero, "The multilinear engine - A table-driven, least squares program for solving multilinear problems, including the n-way parallel factor analysis model," Journal of Computational and Graphical Statistics, vol. 8, pp. 854-888, 1999.
62. J.-M. Papy, L. De Lathauwer, and S. Van Huffel, "Exponential data fitting using multilinear algebra. The single-channel and multichannel case." Num. Lin. Alg. Appl., vol. 12, no. 8, Oct. 2005, pp. 809-826.
63. J.-M. Papy, L. De Lathauwer, and S. Van Huffel, "Exponential data fitting using multilinear algebra: the decimative case." J. Chemometrics, to appear.
64. A.H. Phan and A. Cichocki, "Fast and efficient algorithms for nonnegative Tucker decomposition," ISNN-2008, Sept. 21-26, 2008, Beijing, China, Springer LNCS 2008.
65. M. Rajih, P. Comon, R.A. Harshman, "Enhanced line search: a novel method to accelerate parafac," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, 2008, pp. 1128-1147.
66. B. Savas and L. Eldén, "Handwritten digit classification using higher order singular value decomposition," Pattern Recognition, vol. 40, no. 3, March 2007, pp. 993-1003.
67. B. Savas and L.-H. Lim, Best multilinear rank approximation of tensors with quasi-Newton methods on Grassmannians, Tech. Rep. LITH-MAT-R-2008-01-SE, Dept. Mathematics, Linköpings Universitet, 2008.
68. N.D. Sidiropoulos, G.B. Giannakis, and R. Bro, "Blind PARAFAC receivers for DS-CDMA systems," IEEE Trans. on Signal Processing, vol. 48, no. 3, pp. 810-823, March 2000.
69. N. Sidiropoulos, R. Bro, and G. Giannakis, "Parallel factor analysis in sensor array processing," IEEE Trans. Signal Processing, vol. 48, 2000, pp. 2377-2388.
70. N. Sidiropoulos and R. Bro, "On the uniqueness of multilinear decomposition of N-way arrays," Journal of Chemometrics, vol. 14, 2000, pp. 229-239.
71. A. Smilde, R. Bro, and P. Geladi, Multi-way Analysis. Applications in the Chemical Sciences. Chichester, U.K.: John Wiley and Sons, 2004.
72. A. Stegeman, J.M.F. ten Berge, and L. De Lathauwer, "Sufficient conditions for uniqueness in candecomp/parafac and indscal with random component matrices," Psychometrika, vol. 71, no. 2, June 2006, pp. 219-229.
73. A. Stegeman and N.D. Sidiropoulos, "On Kruskal's uniqueness condition for the candecomp/parafac decomposition," Lin. Alg. Appl., vol. 420, 2007, pp. 540-552.
74. A. Stegeman, "Low-rank approximation of generic p x q x 2 arrays and diverging components in the Candecomp/Parafac model," SIAM J. Matris Anal. Appl., vol. 30, no. 3, 2008, pp. 988-1007.
75. A. Stegeman and L. De Lathauwer, "A method to avoid diverging components in the Candecomp/Parafac model for generic I x J x 2 arrays," SIAM J. Matrix Anal. Appl., to appear.
76. G. Tomasi and R. Bro, "A comparison of algorithms for fitting the PARAFAC model," Comp. Stat. & Data Anal., vol. 50, 2006, pp. 1700-1734.
77. L.R. Tucker, "The extension of factor analysis to three-dimensional matrices", in: H. Gulliksen and N. Frederiksen, Eds., Contributions to mathematical psychology, Holt, Rinehart & Winston, NY, 1964, pp. 109-127.
78. L.R. Tucker, "Some mathematical notes on three-mode factor analysis", Psychometrika, vol. 31, 1966, pp. 279-311.
79. R. Vaccaro, Ed., SVD and Signal Processing, II. Algorithms, Applications and Architectures, Elsevier, Amsterdam, 1991.
80. M.A.O. Vasilescu, D. Terzopoulos, "Multilinear subspace analysis for image ensembles," Proc. Computer Vision and Pattern Recognition Conf. (CVPR '03), vol.2, Madison, WI, June 2003, pp. 93-99.
81. M.A.O. Vasilescu, D. Terzopoulos, "TensorTextures: multilinear image-based rendering," Proc. ACM SIGGRAPH 2004, Los Angeles, CA, August 2004, pp. 336-342.
82. S.A. Vorobyov, Y. Rong, N.D. Sidiropoulos, A.B. Gershman, "Robust iterative fitting of multilinear models," IEEE Trans. on Signal Processing, vol. 53, no. 8, pp. 2678-2689, Aug. 2005.
83. M. Welling and M. Weber, "Positive tensor factorization," Pattern Recogn. Lett., vol. 22, no. 12, pp. 1255-1261, 2001.