CANDECOMP/PARAFAC decomposition of high-order tensors through tensor reshaping

IEEE Transactions on Signal Processing

Volumn 61, Issue 19, 2013, Pages 4847-4860

  Phan, Anh Huy ^a   Tichavský, Petr ^b   Cichocki, Andrzej ^a,c  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

^c SYSTEMS RESEARCH INSTITUTE   (Poland)

Author keywords

ALS; Canonical decomposition; Cram r Rao induced bound (CRIB); Cram r Rao lower bound (CRLB); PARAFAC; Structured CPD; Tensor factorization; Tensor unfolding

Indexed keywords

ALS; CANONICAL DECOMPOSITION; LOWER BOUNDS; PARAFAC; STRUCTURED CPD; TENSOR FACTORIZATION;

ALGORITHMS;

TENSORS;

EID: 84883747673     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2013.2269046     Document Type: Article

References (63)

1. R. A. Harshman, "Foundations of the PARAFAC procedure: Models and conditions for an explanatory multimodal factor analysis," UCLA Work. Papers Phonet., vol. 16, pp. 1-84, 1970
2. J. D. Carroll and J. J. Chang, "Analysis of individual differences in multidimensional scaling via an -way generalization of Eckart-Young decomposition," Psychometrika, vol. 35, no. 3, pp. 283-319, 1970
3. A. Smilde, R. Bro, and P. Geladi, Multi-Way Analysis: Applications in the Chemical Sciences. New York, NY, USA: Wiley, 2004
4. G. Tomasi, "Practical and computational aspects in chemometric data analysis," Ph.D. dissertation, Food Sci., Quality and Technol. section, The Royal Veterinary and Agricultural Univ., Frederiksberg, Denmark, 2006
5. L. De Lathauwer and J. Castaing, "Tensor-based techniques for the blind separation of DS-CDMA signals," Signal Process., vol. 87, no. 2, pp. 322-336, Feb. 2007 (Pubitemid 44602255)
6. N. D. Sidiropoulos and R. Bro, "PARAFAC techniques for signal separation," in Signal Processing Advances in Communications, P. Stoica, G. Giannakis, Y. Hua, and L. Tong, Eds. Upper Saddle River, NJ, USA: Prentice-Hall, 2000, vol. 2, ch. 4
7. A. L. F. de Almeida, X. Luciani, A. Stegeman, and P. Comon, "CONFAC decomposition approach to blind identification of underdetermined mixtures based on generating function derivatives," IEEE Trans. Signal Process., vol. 60, no. 11, pp. 5698-5713, 2012
8. L.-H. Lim and P. Comon, "Blind multilinear identification," IEEE Trans. Inf. Theory, to be published
9. M.Morup, L. K. Hansen, C. S. Herrmann, J. Parnas, and S. M. Arnfred, "Parallel factor analysis as an exploratory tool for wavelet transformed event-related EEG," NeuroImage, vol. 29, no. 3, pp. 938-947, 2006 (Pubitemid 43121218)
10. H. Becker, P. Comon, L. Albera, M. Haardt, and I. Merlet, "Multi- way space-time-wave-vector analysis for EEG source separation," Signal Process., vol. 92, no. 4, pp. 1021-1031, 2012
11. B. W. Bader, M. W. Berry, and M. Browne, "Discussion tracking in Enron email using PARAFAC," in Survey of Text Mining II, M. W. Berry and M. Castellanos, Eds. London, U.K.: Springer, 2008, pp. 147-163
12. D. Gonzlez, A. Ammar, F. Chinesta, and E. Cueto, "Recent advances on the use of separated representations," Int. J. Numer. Methods Eng., vol. 81, no. 5, pp. 637-659, 2010
13. P. Constantine, A. Doostan, Q. Wang, and G. Iaccarino, "A surrogate accelerated Bayesian inverse analysis of the HyShot II supersonic combustion data," in Proc. 13th AIAA Non-Deterministic Approaches Conf., Denver, CO, USA, 2010, vol. 6, pp. 4867-4875, AIAA-2011- 2037
14. X. Luciani, A. L. F. de Almeida, and P. Comon, "Blind identification of underdetermined mixtures based on the characteristic function: The complex case," IEEE Trans. Signal Process., vol. 59, no. 2, pp. 540-553, 2011
15. A.-H. Phan and A. Cichocki, "Tensor decompositions for feature extraction and classification of high dimensional datasets," IEICE Nonlin. Theory Appl., vol. 1, pp. 37-68, 2010, invited paper
16. P. Comon, "Tensors, usefulness and unexpected properties," in Proc. IEEE Workshop Statist. Signal Process. (SSP'09), 2009, pp. 781-788 [Online]. Available: http://hal.archives-ouvertes.fr/hal-00417258/
17. C. A. Andersson and R. Bro, "The N-way toolbox for MATLAB," Chemometr. Intell. Lab. Syst. , vol. 52, no. 1, pp. 1-4, 2000 (Pubitemid 30621552)
18. M. Rajih, P. Comon, and R. A. Harshman, "Enhanced line search: A novel method to accelerate PARAFAC," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1128-1147, 2008
19. Y. Chen, D. Han, and L. Qi, "New ALS methods with extrapolating search directions and optimal step size for complex-valued tensor decompositions," IEEE Trans. Signal Process., vol. 59, no. 12, pp. 5888-5898, 2011
20. P. Paatero, C. Navasca, and P. Hopke, "Fast rotationally enhanced alternating-least-squares," presented at the Proc. SIAM Workshop Tensor Decomposit. Appl., 2010
21. P. Comon, X. Luciani, and A. L. F. de Almeida, "Tensor decompositions, alternating least squares and other tales," J. Chemometr., vol. 23, no. 7-8, pp. 393-405, 2009
22. E. Acar, D. M. Dunlavy, and T. G. Kolda, "A scalable optimization approach for fitting canonical tensor decompositions," J. Chemometr., vol. 25, no. 2, pp. 67-86, Feb. 2011
23. J.-P. Royer, N. T. Moreau, and P. Comon, "Computing the polyadic decomposition of nonnegative third order tensors," Signal Process., vol. 91, no. 9, pp. 2159-2171, 2011
24. P. Paatero, "A weighted non-negative least squares algorithm for three-way PARAFAC factor analysis," Chemometr. Intell. Lab. Syst., vol. 38, no. 2, pp. 223-242, 1997 (Pubitemid 27512497)
25. P. Tichavský and Z. Koldovský, "Simultaneous search for all modes in multilinear models," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP10), 2010, pp. 4114-4117
26. A.-H. Phan, P. Tichavský, and A. Cichocki, "Low complexity damped Gauss-Newton algorithms for CANDECOMP/PARAFAC," SIAM J. Matrix Anal. Appl., vol. 34, no. 1, pp. 126-147, 2013
27. L. De Lathauwer, "A link between the canonical decomposition inmultilinear algebra and simultaneousmatrix diagonalization," SIAMJ. Matrix Anal. Appl., vol. 28, pp. 642-666, 2006 (Pubitemid 47109355)
28. L. De Lathauwer and J. Castaing, "Blind identification of underdetermined mixtures by simultaneous matrix diagonalization," IEEE Trans. Signal Process., vol. 56, no. 3, pp. 1096-1105, 2008 (Pubitemid 351386270)
29. A. Franc, "Etude Algebrique des Multitableaux: Apports de L'algebrique Tensorielle," Ph.D. Thesis, Université de Montpellier II-Science et Techniques du Languedoc, Montpellier, France, 1992
30. W. P. Krijnen, T. K. Dijkstra, and A. Stegeman, "On the non-existence of optimal solutions and the occurrence of degeneracy in the CANDECOMP/ PARAFAC model," Psychometrika, vol. 73, pp. 431-439, 2008
31. V. de Silva and L.-H. Lim, "Tensor rank and the ill-posedness of the best low-rank approximation problem," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1084-1127, Sep. 2008
32. A. Stegeman, "Candecomp/Parafac: From diverging components to a decomposition in block terms," SIAM J. Matrix Anal. Appl., vol. 33, no. 2, pp. 291-316, 2012
33. J. B. Kruskal, "Three-way arrays: Rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics," Linear Algebra Appl., vol. 18, pp. 95-138, 1977
34. A. Stegeman and N. D. Sidiropoulos, "On Kruskal's uniqueness condition for the Candecomp/Parafac decomposition," Linear Algebra Appl., vol. 420, no. 23, pp. 540-552, 2007 (Pubitemid 44751783)
35. A. Stegeman, "On uniqueness of the nth order tensor decomposition into rank-1 terms with linear independence in one mode," SIAM J. Matrix Anal. Appl., vol. 31, no. 5, pp. 2498-2516, 2010
36. A. Stegeman, "On uniqueness of the canonical tensor decomposition with some form of symmetry," SIAM J. Matrix Anal. Appl., vol. 32, no. 2, pp. 561-583, 2011
37. N. D. Sidiropoulos and R. Bro, "On the uniqueness of multilinear decomposition of N-way arrays," J. Chemometr., vol. 14, no. 3, pp. 229-239, 2000
38. T. G. Kolda and B. W. Bader, "Tensor decompositions and applications," SIAM Rev., vol. 51, no. 3, pp. 455-500, Sept. 2009
39. A. Karfoul, L. Albera, and L. De Lathauwer, "Canonical decomposition of even higher order cumulant arrays for blind underdetermined mixture identification," in Proc. Sens. Array Multichannel Signal Process. Workshop, Jul. 2008, pp. 501-505
40. M. Sorensen, L. Lathauwer, P. Comon, S. Icart, and L. Deneire, "Canonical polyadic decomposition with a columnwise orthonormal factor matrix," SIAM J. Matrix Anal. Appl., vol. 33, no. 4, pp. 1190-1213, 2012
41. P. Tichavský, A.-H. Phan, and Z. Koldovský, "Cramér-Rao-induced bounds for CANDECOMP/PARAFAC tensor decomposition," IEEE Trans. Signal Process., vol. 61, no. 8, pp. 1986-1997, 2013
42. A. Cichocki, R. Zdunek, A.-H. Phan, and S. Amari, Nonnegative Matrix and Tensor Factorizations: Applications to ExploratoryMulti-Way Data Analysis and Blind Source Separation. Chichester, U.K.:Wiley, 2009
43. P. Paatero, "Construction and analysis of degenerate PARAFAC models," J. Chemometr., vol. 14, no. 3, pp. 285-299, 2000
44. C. A. Andersson and R. Bro, "Improving the speed of multi-way algorithms: Part I. Tucker3," Chemometr. Intell. Lab. Syst., vol. 42, pp. 93-103, 1998 (Pubitemid 28440364)
45. L. De Lathauwer, B. De Moor, and J. Vandewalle, "On the best rank-1 and rank- approximation of higher-order tensors," SIAM J. Matrix Anal. Appl., vol. 21, no. 4, pp. 1324-1342, 2000
46. L. R. Tucker, "The extension of factor analysis to three-dimensional matrices," in Contributions to Mathematical Psychology, H. Gulliksen and N. Frederiksen, Eds. New York, NY, USA: Holt, Rinehart,Winston, 1964, pp. 110-127
47. A.-H. Phan, P. Tichavský, and A. Cichocki, "Fast alternating LS algorithms for high order CANDECOMP/PARAFAC tensor factorizations," IEEE Trans. Signal Process., vol. 61, no. 19, pp. 4834-4846, 2013
48. G. Tomasi, "Recent developments in fast algorithms for fitting the PARAFAC model," in Proc. TRICAP, Crete, Greece, 2006 [Online]. Available: http://www.telecom.tuc.gr/~nikos/TRICAP2006main/ TomasiTRICAP2006.ppt
49. P. Tichavský, A.-H. Phan, and A. Cichocki, "A further improvement of a fast damped GAUSS-NEWTON algorithm for CANDECOMPPARAFAC tensor decomposition," in Proc. of IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2013, pp. 5964-5968
50. H. A. L. Kiers and R. A. Harshman, "Relating two proposed methods for speedup of algorithms for fitting two- and three-way principal component and related multilinear models," Chemometr. Intell. Lab. Syst., vol. 36, pp. 31-40, 1997 (Pubitemid 27095228)
51. L. De Lathauwer, B. De Moor, and J. Vandewalle, "A multilinear singular value decomposition," SIAM J. Matrix Anal. Appl., vol. 21, no. 4, pp. 1253-1278, 2000 (Pubitemid 33217068)
52. S. Ragnarsson and C. F. Van Loan, "Block tensor unfoldings," SIAM J. Matrix Anal. Appl. , vol. 33, no. 1, pp. 149-169, 2012
53. P. Tichavský and Z. Koldovský, "Stability of CANDECOMPPARAFAC tensor decomposition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2011, pp. 4164-4167
54. P. Tichavský and Z. Koldovský, "Weight adjusted tensor method for blind separation of underdetermined mixtures of nonstationary sources," IEEE Trans. Signal Process., vol. 59, no. 3, pp. 1037-1047, 2011
55. X. Q. Liu and N. D. Sidiropoulos, "Cramer-Rao lower bounds for lowrank decomposition of multidimensional arrays," IEEE Trans. Signal Process., vol. 49, no. 9, pp. 2074-2086, 2001 (Pubitemid 32866214)
56. P. K. Hopke, P. Paatero, H. Jia, R. T. Ross, and R. A. Harshman, "Three-way (PARAFAC) factor analysis: Examination and comparison of alternative computational methods as applied to ill-conditioned data," Chemometr. Intell. Lab. Syst., vol. 43, no. 1-2, pp. 25-42, 1998 (Pubitemid 28481344)
57. A. Stegeman, "Using the simultaneous generalized Schur decomposition as a CANDECOMP/PARAFAC algorithm for ill-conditioned data," J. Chemometr., vol. 23, no. 7-8, pp. 385-392, 2009
58. H. A. L. Kiers and R. A. Harshman, "An efficient algorithm for Parafac with uncorrelated mode-A components applied to large data sets with ," J. Chemometr., vol. 23, no. 7-8, pp. 442-447, 2009
59. M. B. Dosse, J. M. F. Berge, and J. N. Tendeiro, "Some new results on orthogonally constrained Candecomp," J. Classification, vol. 28, pp. 144-155, 2011
60. K. Numpacharoen and A. Atsawarungruangkit, "Generating correlationmatrices based on the boundaries of their coefficients," PLoSONE, vol. 7, pp. 489-502, Nov. 2012
61. K. S. Booksh and B. R. Kowalski, "Error analysis of the generalized rank annihilation method," J. Chemometr., vol. 8, no. 1, pp. 45-63, 1994
62. E. Sanchez and B. R. Kowalski, "Tensorial resolution: A direct trilinear decomposition," J. Chemometr., vol. 4, no. 1, pp. 29-45, 1990
63. M. Morup, L. K. Hansen, and S. M. Arnfred, "ERPWAVELAB a toolbox for multi-channel analysis of time-frequency transformed event related potentials," J. Neurosci. Methods, vol. 161, no. 2, pp. 361-368, 2006.