A short introduction to tensor-based methods for factor analysis and blind source separation

ISPA 2011 - 7th International Symposium on Image and Signal Processing and Analysis

Volumn , Issue , 2011, Pages 558-563

  Lathauwer, Lieven De ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

FACTOR ANALYSIS; HIGHER-ORDER TENSOR;

MULTIVARIANT ANALYSIS; SEPARATION; SIGNAL PROCESSING; TENSORS;

BLIND SOURCE SEPARATION;

EID: 83455230847     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (58)

1. A. Cichocki, R. Zdunek, A. H. Phan, and S.-I. Amari, Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multiway Data Analysis and Blind Source Separation. John Wiley & Sons, 2009.
2. P. Comon and C. Jutten, Eds., Handbook of Blind Source Separation, Independent Component Analysis and Applications. Academic Press, 2010.
3. L. De Lathauwer, "A survey of tensor methods," in Proc. 2009 IEEE Int. Symp. on Circuits and Systems (ISCAS 2009), May 24-27, 2009, pp. 2773-2776.
4. T. G. Kolda and B. W. Bader, "Tensor decompositions and applications,"SIAM Rev., vol. 51, no. 3, pp. 455-500, Sep. 2009.
5. P. M. Kroonenberg, Applied Multiway Data Analysis. Wiley, 2008.
6. J. M. Landsberg, Tensors: Geometry and Applications. AMS, 2011, in press.
7. A. Smilde, R. Bro, and P. Geladi, Multi-way Analysis with Applications in the Chemical Sciences. Chichester, U.K.: John Wiley & Sons, 2004.
8. I. Joliffe, Principal Component Analysis. John Wiley & Sons, 2005.
9. P. Comon and B. Mourrain, "Decomposition of quantics in sums of powers of linear forms," Signal Processing, vol. 53, no. 2, pp. 93-107, Sep. 1996. (Pubitemid 126370899)
10. F. L. Hitchcock, "The expression of a tensor or a polyadic as a sum of products," J. Math. and Phys., vol. 6, no. 1, pp. 165-189, 1927.
11. -, "Multiple invariants and generalized rank of a p-way matrix or tensor," J. Math. and Phys., vol. 7, no. 1, pp. 40-79, 1927.
12. J. D. Carroll and J.-J. Chang, "Analysis of individual differences in multidimensional scaling via an n-way generalization of "Eckart- Young"decomposition," Psychometrika, vol. 35, no. 3, pp. 283-319, Sep. 1970.
13. R. A. Harshman, "Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-modal factor analysis," UCLA Working Papers in Phonetics, vol. 16, 1970.
14. L. Chiantini and G. Ottaviani. (2011) On generic identifiability of 3-tensors of small rank. [Online]. Available: arXiv:1103.2696v1
15. L. De Lathauwer, "A link between the canonical decomposition in multilinear algebra and simultaneous matrix diagonalization," SIAM J. Matrix Anal. Appl., vol. 28, no. 3, pp. 642-666, 2006. (Pubitemid 47109355)
16. T. Jiang and N. D. Sidiropoulos, "Kruskal's permutation lemma and the identification of CANDECOMP/PARAFAC and bilinear models," IEEE Trans. Signal Processing, vol. 52, no. 9, pp. 2625-2636, Sep. 2004.
17. J. B. Kruskal, "Three-way arrays: Rank and uniqueness of trilinear decompositions, with applications to arithmetic complexity and statistics,"Linear Alg. Appl., vol. 18, no. 2, pp. 95-138, 1977.
18. A. Stegeman, "On uniqueness of the canonical tensor decomposition with some form of symmetry," SIAM J. Matrix Anal. Appl., 2011, in press.
19. N. M. Faber, L. M. C. Buydens, and G. Kateman, "Generalized rank annihilation method: I. derivation of eigenvalue problems," J. Chemometrics, vol. 8, no. 2, pp. 147-154, Mar. 1994.
20. S. Leurgans, R. T. Ross, and R. B. Abel, "A decomposition for three-way arrays," SIAM J. Matrix Anal. Appl., vol. 14, no. 4, pp. 1064-1083, Oct. 1993.
21. E. Sanchez and B. R. Kowalski, "Tensorial resolution: a direct trilinear decomposition," J. Chemometrics, vol. 4, no. 1, pp. 29-45, Jan. 1990.
22. L. De Lathauwer, J. Castaing, and J.-F. Cardoso, "Fourth-order cumulant-based identification of underdetermined mixtures," IEEE Trans. Signal Processing, vol. 55, no. 6, pp. 2965-2973, Jun. 2007. (Pubitemid 46845686)
23. M. Rajih, P. Comon, and R. A. Harshman, "Enhanced line search: A novel method to accelerate PARAFAC," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1148-1171, Sep. 2008.
24. A. Karfoul, L. Albera, and L. De Lathauwer, "Iterative methods for the canonical decomposition of multi-way arrays: Application to blind underdetermined mixture identification," Signal Processing, vol. 91, no. 8, pp. 1789-1802, Aug. 2011.
25. M. De Vos, D. Nion, S. Van Huffel, and L. De Lathauwer, "A combination of parallel factor and independent component analysis," ESATSISTA, K.U.Leuven (Leuven, Belgium), Tech. Rep. 2009-04, 2009.
26. E. Acar, D. M. Dunlavy, and T. G. Kolda, "A scalable optimization approach for fitting canonical tensor decompositions," J. Chemometrics, vol. 25, no. 2, pp. 67-86, Feb. 2011.
27. P. Paatero, "The multilinear engine: A table-driven, least squares program for solving multilinear problems, including the n-way parallel factor analysis model," J. Comput. Graphical Statist., vol. 8, no. 4, pp. 854-888, Dec. 1999.
28. G. Tomasi and R. Bro, "A comparison of algorithms for fitting the PARAFAC model," Comp. Stat. & Data Anal., vol. 50, no. 7, pp. 1700-1734, 2006. (Pubitemid 43052351)
29. L. De Lathauwer, B. De Moor, and J. Vandewalle, "Computation of the canonical decomposition by means of a simultaneous generalized Schur decomposition," SIAM J. Matrix Anal. Appl., vol. 26, no. 2, pp. 295-327, 2004. (Pubitemid 40541662)
30. S. A. Vorobyov, Y. Rong, N. D. Sidiropoulos, and A. B. Gershman, "Robust iterative fitting of multilinear models," IEEE Trans. Signal Processing, vol. 53, no. 8, pp. 2678-2689, Aug. 2005.
31. M. Sørensen, L. De Lathauwer, P. Comon, S. Icart, and L. Deneire, "Computation of a canonical polyadic decomposition with a semiunitary matrix factor," ESAT-SISTA, K.U.Leuven (Leuven, Belgium), Tech. Rep. 2011-95, May 2011.
32. V. De Silva and L.-H. Lim, "Tensor rank and the ill-posedness of the best low-rank approximation problem," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1084-1127, 2008.
33. W. P. Krijnen, T. K. Dijkstra, and A. Stegeman, "On the non-existence of optimal solutions and the occurrence of "degeneracy" in the Candecomp/Parafac model," Psychometrika, vol. 73, pp. 431-439, 2008.
34. L.-H. Lim and P. Comon, "Nonnegative approximations of nonnegative tensors," J. Chemometrics, vol. 23, no. 7-8, pp. 432-441, Jul. 2009.
35. L. De Lathauwer, "On avoiding diverging components in the computation of the best low rank approximation of higher-order tensors," ESATSISTA, K.U.Leuven (Leuven, Belgium), Tech. Rep. 2005-269, 2005.
36. L. De Lathauwer, "Decompositions of a higher-order tensor in block terms - Part I: Lemmas for partitioned matrices," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1022-1032, 2008.
37. -, "Decompositions of a higher-order tensor in block terms - Part II: Definitions and uniqueness," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1033-1066, 2008.
38. L. De Lathauwer and D. Nion, "Decompositions of a higher-order tensor in block terms - Part III: Alternating least squares algorithms," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1067-1083, 2008.
39. A. Stegeman and L. De Lathauwer, "A method to avoid diverging components in the Candecomp/Parafac model for generic I x J x 2 arrays," SIAM J. Matrix Anal. Appl., vol. 30, no. 4, pp. 1614-1638, 2009.
40. E. Acar, C. Aykut-Bingol, H. Bingol, R. Bro, and B. Yener, "Multiway analysis of epilepsy tensors," Bioinformatics, vol. 23, no. 13, pp. i10-i18, Jul. 2007.
41. M. De Vos, A. Vergult, L. De Lathauwer, W. De Clercq, S. Van Huffel, P. Dupont, A. Palmini, andW. Van Paesschen, "Canonical decomposition of ictal scalp EEG reliably detects the seizure onset zone," Neuroimage, vol. 37, no. 3, pp. 844-854, Sep. 2007. (Pubitemid 47248306)
42. P. McCullagh, Tensor Methods in Statistics, ser. Monographs on Statistics and Applied Probability. London: Chapman and Hall, 1987.
43. C. L. Nikias and A. P. Petropulu, Higher-Order Spectra Analysis. A Nonlinear Signal Processing Framework. Englewood Cliffs, New Jersey: Prentice Hall, 1993.
44. L. Albera, A. Ferréol, P. Comon, and P. Chevalier, "Blind identification of overcomplete mixtures of sources (BIOME)," Linear Alg. Appl., vol. 391, pp. 3-30, Nov. 2004.
45. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. John Wiley & Sons, 2001.
46. J. Eriksson and V. Koivunen, "Identifiability, separability, and uniqueness of linear ICA models," IEEE Signal Process. Lett., vol. 11, no. 7, pp. 601-604, Jul. 2004.
47. A. Yeredor, "Blind source separation via the second characteristic function," Signal Processing, vol. 80, no. 5, pp. 897-902, May 2000.
48. A. Taleb, "An algorithm for the blind identification of N independent signals with 2 sensors," in Sixth Int. Symp. on Signal Processing and its Applications (ISSPA'01), Aug. 13-16, 2001, pp. 5-8.
49. A. Belouchrani, K. Abed-Meraim, J.-F. Cardoso, and E. Moulines, "A blind source separation technique using second order statistics," IEEE Trans. Signal Processing, vol. 45, no. 2, pp. 434-444, Feb. 1997. (Pubitemid 127765906)
50. D.-T. Pham and J.-F. Cardoso, "Blind separation of instantaneous mixtures of non-stationary sources," IEEE Trans. Signal Processing, vol. 49, no. 9, pp. 1837-1848, Sep. 2001. (Pubitemid 32866193)
51. L. De Lathauwer and J. Castaing, "Blind identification of underdetermined mixtures by simultaneous matrix diagonalization," IEEE Trans. Signal Processing, vol. 56, no. 3, pp. 1096-1105, Mar. 2008. (Pubitemid 351386270)
52. P. Comon, "Independent Component Analysis, a new concept?" Signal Processing, vol. 36, no. 3, pp. 287-314, Apr. 1994.
53. J.-F. Cardoso and A. Souloumiac, "Blind beamforming for non-Gaussian signals," IEE Proc.-F, vol. 140, no. 6, pp. 362-370, Dec. 1993.
54. P. Comon and E. Moreau, "Improved contrast dedicated to blind separation in communications," in Proc. ICASSP, Munich, Germany, Apr. 1997, pp. 3453-3456.
55. L. De Lathauwer, B. De Moor, and J. Vandewalle, "Independent component analysis and (simultaneous) third-order tensor diagonalization, "IEEE Trans. Signal Processing, vol. 49, no. 10, pp. 2262-2271, Oct. 2001. (Pubitemid 33147597)
56. J.-F. Cardoso, S. Bose, and B. Friedlander, "Output cumulant matching for source separation," in Proc. IEEE Signal Processing / ATHOS Workshop on Higher-Order Statistics, Girona, Spain, Jun. 12-14, 1995, pp. 44-48.
57. P. Tichavský and A. Yeredor, "Fast approximate joint diagonalization incorporating weight matrices," IEEE Trans. Signal Processing, vol. 57, no. 3, pp. 878-891, Mar. 2009.
58. A. Yeredor, "Blind separation of Gaussian sources via second-order statistics with asymptotically optimal weighting," IEEE Signal Process. Lett., vol. 7, no. 7, pp. 197-200, Jul. 2000.