Candecomp/parafac: From diverging components to a decomposition in block terms

SIAM Journal on Matrix Analysis and Applications

Volumn 33, Issue 2, 2012, Pages 291-316

  Stegeman, Alwin ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Block decomposition; Candecomp; Diverging components; Low rank approximation; Parafac; Schur decomposition; Tensor decomposition

Indexed keywords

BLOCK DECOMPOSITION; CANDECOMP; DIVERGING COMPONENTS; LOW RANK APPROXIMATIONS; PARAFAC; SCHUR DECOMPOSITION; TENSOR DECOMPOSITION;

MATRIX ALGEBRA;

TENSORS;

EID: 84865483773     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/110825327     Document Type: Article

References (61)

1. E. Acar and B. Yener, Unsupervised multiway data analysis: A literature survey, IEEE Transactions on Knowledge and Data Engineering, 21 (2009), pp. 1-15.
2. G. Beylkin and M. J. Mohlenkamp, Algorithms for numerical analysis in high dimensions, SIAM J. Sci. Comput., 26 (2005), pp. 2133-2159. (Pubitemid 41641365)
3. D. Bini, G. Lotti, and F. Romani, Approximate solutions for the bilinear form computational problem, SIAM J. Comput., 9 (1980), pp. 692-697.
4. J. D. Carroll and J. J. Chang, Analysis of individual differences in multidimensional scaling via an n-way generalization of Eckart-Young decomposition, Psychometrika, 35 (1970), pp. 283-319.
5. P. Comon, Independent component analysis, a new concept?, Signal Processing, 36 (1994), pp. 287-314.
6. P. Comon, X. Luciani, and A. L. F. de Almeida, Tensor decompositions, alternating least squares and other tales, J. Chemometrics, 23 (2009), pp. 393-405.
7. P. Comon and L. De Lathauwer, Algebraic identification of under-determined mixtures, in Handbook of Blind Source Separation: Independent Component Analysis and Applications, P. Comon and C. Jutten, eds., Academic Press, Oxford, UK, 2010, pp. 325-366.
8. L. De Lathauwer, A link between the canonical decomposition in multilinear algebra and simultaneous matrix diagonalization, SIAM J. Matrix Anal. Appl., 28 (2006), pp. 642-666. (Pubitemid 47109355)
9. L. De Lathauwer, Decompositions of a higher-order tensor in block terms-Part I: Lemmas for partitioned matrices, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1022-1032.
10. L. De Lathauwer, Decompositions of a higher-order tensor in block terms-Part II: Definitions and uniqueness, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1033-1066.
11. L. De Lathauwer, Decompositions of a higher-order tensor in block terms-Part III: Alternating least squares algorithms, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1067-1083.
12. L. De Lathauwer, Algebraic methods after prewhitening, in Handbook of Blind Source Separation: Independent Component Analysis and Applications, P. Comon and C. Jutten, eds., Academic Press, Oxford, UK, 2010, pp. 155-178.
13. L. De Lathauwer, B. De Moor, and J. Vandewalle, An introduction to independent component analysis, J. Chemometrics, 14 (2000), pp. 123-149.
14. L. De Lathauwer, B. De Moor, and J. Vandewalle, Computation of the canconical decomposition by means of a simultaneous generalized Schur decomposition, SIAMJ. Matrix Anal. Appl., 26 (2004), pp. 295-327. (Pubitemid 40541662)
15. L. De Lathauwer and J. Castaing, Tensor-based techniques for the blind separation of DSCDMA signals, Signal Processing, 87 (2007), pp. 322-336. (Pubitemid 44602255)
16. V. De Silva and L.-H. Lim, Tensor rank and the ill-posedness of the best low-rank approximation problem, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1084-1127.
17. G. H. Golub and C. F. Van Loan, Matrix Computations, 3rd edition, John Hopkins University Press, Baltimore, 1996.
18. W. Hackbusch and B. N. Khoromskij, Tensor-product approximation to operators and functions in high dimensions, J. Complexity, 23 (2007), pp. 697-714. (Pubitemid 350122963)
19. R. A. Harshman, Foundations of the Parafac procedure: Models and conditions for an "explanatory" multimodal factor analysis, UCLA Working Papers in Phonetics, 16 (1970), pp. 1-84.
20. R. A. Harshman and M. E. Lundy, Data preprocessing and the extended Parafac model, in Research Methods for Multimode Data Analysis, H. G. Law et al., eds., Praeger, New York, 1984, pp. 216-284.
21. R. A. Harshman, The problem and nature of degenerate solutions or decompositions of 3- way arrays, Talk at the Tensor Decompositions Workshop, Palo Alto, CA, 2004. Available online at http://www.psychology.uwo.ca/faculty/ harshman/aim2004.pdf.
22. F. L. Hitchcock, The expression of a tensor or a polyadic as a sum of products, J. Math. Phys., 6 (1927), pp. 164-189.
23. F. L. Hitchcock, Multiple invariants and generalized rank of a p-way matrix or tensor, J. Math. Phys., 7 (1927), pp. 39-70.
24. P. K. Hopke, P. Paatero, H. Jia, R. T. Ross, and R. A. Harshman, Three-way (Parafac) factor analysis: Examination and comparison of alternative computational methods as applied to ill-conditioned data, Chemometrics and Intelligent Laboratory Systems, 43 (1998), pp. 25-42. (Pubitemid 28481344)
25. J. Ja' Ja', Optimal evaluation of pairs of bilinear forms, SIAM J. Comput., 8 (1979), pp. 443- 462.
26. J. Ja' Ja' and J. Takche, On the validity of the direct sum conjecture, SIAM J. Comput., 15 (1986), pp. 1004-1020.
27. T. Jiang and N. D. Sidiropoulos, Kruskal's permutation lemma and the identification of Candecomp/Parafac and bilinear models with constant modulus constraints, IEEE Trans. Signal Process., 52 (2004), pp. 2625-2636.
28. H. A. L. Kiers and A. K. Smilde, Constrained three-mode factor analysis as a tool for parameter estimation with second-order instrumental data, J. Chemometrics, 12 (1998), pp. 125-147. (Pubitemid 128477555)
29. H. A. L. Kiers and I. Van Mechelen, I. Three-way component analysis: Principles and illustrative application, Psychological Methods, 6 (2001), pp. 84-110. (Pubitemid 33610297)
30. T. G. Kolda and B. W. Bader, Tensor decompositions and applications, SIAM Rev., 51 (2009), pp. 455-500.
31. W. P. Krijnen, The Analysis of Three-way Arrays by Constrained Parafac Methods, DSWO Press, Leiden, The Netherlands, 1993.
32. W. P. Krijnen, T. K. Dijkstra, and A. Stegeman, On the non-existence of optimal solutions and the occurrence of "degeneracy" in the Candecomp/Parafac model, Psychometrika, 73 (2008), pp. 431-439.
33. P. M. Kroonenberg, Applied Multiway Data Analysis, Wiley Ser. Probab. Stat., John Wiley & Sons, Hoboken, NJ, 2008.
34. J. B. Kruskal, Three-way arrays: rank and uniqueness of trilinear decompositions, with applications to arithmetic complexity and statistics, Linear Algebra Appl., 18 (1977), pp. 95- 138.
35. J. B. Kruskal, R. A. Harshman, and M. E. Lundy, How 3-MFA data can cause degenerate Parafac solutions, among other relationships, in Multiway Data Analysis, R. Coppi and S. Bolasco, eds., North-Holland, Amsterdam, 1989, pp. 115-122.
36. L.-H. Lim and P. Comon, Nonnegative approximations of nonnegative tensors, J. Chemometrics, 23 (2009), pp. 432-441.
37. L.-H. Lim and P. Comon, Multiarray signal processing: Tensor decomposition meets compressed sensing, Comptes-Rendus de l'Acade'mie des Sciences, Me'canique, 338 (2010), pp. 311-320.
38. B. C. Mitchell and D. S. Burdick, Slowly converging Parafac sequences: Swamps and twofactor degeneracies, J. Chemometrics, 8 (1994), pp. 155-168.
39. P. Paatero, Construction and analysis of degenerate Parafac models, J. Chemometrics, 14 (2000), pp. 285-299.
40. J. A. Rhodes, A concise proof of Kruskal's theorem on tensor decomposition, Linear Algebra Appl., 432 (2010), pp. 1818-1824.
41. R. Rocci and P. Giordani, A weak degeneracy revealing decomposition for the Candecomp/Parafac model, J. Chemometrics, 24 (2010), pp. 57-66.
42. A. Schönhage, Partial and total matrix multiplication, SIAM J. Comput., 10 (1981), pp. 434-455.
43. N. D. Sidiropoulos and R. Bro, On the uniqueness of multilinear decomposition of N-way arrays, J. Chemometrics, 14 (2000), pp. 229-239.
44. N. D. Sidiropoulos, G. Giannakis, and R. Bro, Blind Parafac receivers for DS-CDMA systems, IEEE Trans. Signal Process., 48 (2000), pp. 810-823. (Pubitemid 30576249)
45. N. D. Sidiropoulos, R. Bro, and G. Giannakis, Parallel factor analysis in sensor array processing, IEEE Trans. Signal Process., 48 (2000), pp. 2377-2388.
46. A. Smilde, R. Bro, and P. Geladi, Multi-way Analysis: Applications in the Chemical Sciences, Wiley, Chichester, 2004.
47. A. Stegeman, Degeneracy in Candecomp/Parafac explained for p×p×2 arrays of rank p+1 or higher, Psychometrika, 71 (2006), pp. 483-501. (Pubitemid 44788544)
48. A. Stegeman, Degeneracy in Candecomp/Parafac explained for several three-sliced arrays with a two-valued typical rank, Psychometrika, 72 (2007), pp. 601-619.
49. A. Stegeman, Low-rank approximation of generic p × q × 2 arrays and diverging components in the Candecomp/Parafac model, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 988-1007.
50. A. Stegeman, Using the simultaneous generalized Schur decomposition as a Candecomp/Parafac algorithm for ill-conditioned data, J. Chemometrics, 23 (2009), pp. 385-392.
51. A. Stegeman, On uniqueness of the nth order tensor decomposition into rank-1 terms with linear independence in one mode, SIAM J. Matrix Anal. Appl., 31 (2010), pp. 2498-2516.
52. A. Stegeman, The Generalized Schur Decomposition and the rank-R set of Real I × J × 2 Arrays, Technical report, 2010; available online at arXiv:1011.3432.
53. A. Stegeman and N. D. Sidiropoulos, On Kruskal's uniqueness condition for the Candecomp/Parafac decomposition, Linear Algebra Appl., 420 (2007), pp. 540-552. (Pubitemid 44751783)
54. A. Stegeman and L. De Lathauwer, A method to avoid diverging components in the Candecomp/Parafac model for generic I ×J ×2 arrays, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1614-1638.
55. A. Stegeman and A. L. F. de Almeida, Uniqueness conditions for constrained three-way factor decompositions with linearly dependent loadings, SIAM J. Matrix Anal. Appl., 31 (2009), pp. 1469-1490.
56. A. Stegeman and L. De Lathauwer, Are Diverging CP Components Always Nearly Propotional?, 2011, Technical report; available online at arXiv:1110.1988.
57. V. Strassen, Vermeidung von divisionen, J. Reine Angew. Math., 246 (1973), pp. 184-202.
58. J. M. F. Ten Berge and N. D. Sidiropoulos, On uniqueness in Candecomp/Parafac, Psychometrika, 67 (2002), pp. 399-409.
59. G. Tomasi and R. Bro, A comparison of algorithms for fitting the Parafac model, Comput. Statist. Data Anal., 50 (2006), pp. 1700-1734. (Pubitemid 43052351)
60. L. R. Tucker, Some mathematical notes on three-mode factor analysis, Psychometrika, 31 (1966), pp. 279-311.
61. A.-J. Van der Veen and A. Paulraj, An analytical constant modulus algorithm, IEEE Trans. Signal Process., 44 (1996), pp. 1136-1155. (Pubitemid 126776461)