A method to avoid diverging components in the candecomp/parafac model for generic i × J × 2 arrays

SIAM Journal on Matrix Analysis and Applications

Volumn 30, Issue 4, 2008, Pages 1614-1638

  Stegeman, Alwin ^a   Lathauwer, Lieven De ^b  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Canonical decomposition; Degenerate Parafac solutions; Diverging components; Low rank tensor approximations; Parallel factors analysis

Indexed keywords

CANONICAL DECOMPOSITION; DEGENERATE PARAFAC SOLUTIONS; DIVERGING COMPONENTS; LOW-RANK TENSOR APPROXIMATIONS; PARALLEL FACTORS ANALYSIS;

TENSORS;

EID: 68649114427     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/070692121     Document Type: Article

References (47)

1. R. Bro, Parafac. Tutorial & applications, Chemometrics Intell. Lab. Syst., 38 (1997), pp. 149-171.
2. Y.Z. Cao, Z.P. Chen, C.Y. Mo, H.L. Wu, and R.Q. Yu, A Parafac algorithm using penalty diagonalization error (PDE) for three-way data array resolution, The Analyst, 125 (2000), pp. 2303-2310.
3. J.D. Carroll and J.J. Chang, Analysis of individual differences in multidimensional scaling via an n-way generalization of Eckart-Young decomposition, Psychometrika, 35 (1970), pp. 283-319.
4. P. Comon, Independent component analysis, a new concept?, Signal Process., 36 (1994), pp. 287-314.
5. L. De Lathauwer, B. De Moor, and J. Vandewalle, An introduction to independent component analysis, J. Chemometrics, 14 (2000), pp. 123-149.
6. L. De Lathauwer, B. De Moor, and J. Vandewalle, Computation of the canconical decomposition by means of a simultaneous generalized Schur decomposition, SIAMJ.Matrix Anal. Appl., 26 (2004), pp. 295-327.
7. L. De Lathauwer, A link between the canonical decomposition in multilinear algebra and simultaneous matrix diagonalization, SIAM J. Matrix Anal. Appl., 28 (2006), pp. 642-666.
8. L. De Lathauwer, Decompositions of a higher-order tensor in block terms - Part II: Definitions and uniqueness, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1033-1066.
9. L. De Lathauwer and J. Castaing, Tensor-based techniques for the blind separation of DSCDMA signals, Signal Process., 87 (2007), pp. 322-336.
10. V. De Silva and L.-H. Lim, Tensor rank and the ill-posedness of the best low-rank approximation problem, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 1084-1127.
11. G.H. Golub and J.H. Wilkinson, Ill-conditioned eigensystems and the computation of the Jordan canonical form, SIAM Rev., 18 (1976), pp. 578-619.
12. G.H. Golub and C.F. Van Loan, Matrix Computations, 3rd ed., John Hopkins University Press, Baltimore, MD, 1996.
13. R.A. Harshman, Foundations of the Parafac procedure: Models and conditions for an "explanatory" multimodal factor analysis, UCLA Working Papers in Phonetics, 16 (1970), pp. 1-84.
14. R.A. Harshman and M.E. Lundy, Data preprocessing and the extended Parafac model, in Research Methods for Multimode Data Analysis, H.G. Law, C.W. Snyder Jr., J.A. Hattie, and R.P. McDonald, eds., Praeger, New York, 1984, pp. 216-284.
15. R.A. Harshman, The problem and nature of degenerate solutions or decompositions of 3- way arrays, in a talk at the Tensor Decompositions Workshop, Palo Alto, CA, American Institute of Mathematics, 2004.
16. F.L. Hitchcock, The expression of a tensor or a polyadic as a sum of products, J. Math. Phys., 6 (1927), pp. 164-189.
17. F.L. Hitchcock, Multilple invariants and generalized rank of a p-way matrix or tensor, J. Math. Phys., 7 (1927), pp. 39-70.
18. P.K. Hopke, P. Paatero, H. Jia, R.T. Ross, and R.A. Harshman, Three-way (Parafac) factor analysis: Examination and comparison of alternative computational methods as applied to ill-conditioned data, Chemometrics Intell. Labor. Syst., 43 (1998), pp. 25-42.
19. R.A. Horn and C.R. Johnson, Matrix Analysis, Cambridge University Press, Cambridge, MA, 1993.
20. A. Hyv̈rinen, J. Karhunen, and E. Oja, Independent Component Analysis, Wiley, New York, 2001.
21. J. Ja' Ja', Optimal evaluation of pairs of bilinear forms, SIAM J. Comput., 8 (1979), pp. 443-462.
22. T. Jiang and N.D. Sidiropoulos, Kruskal's permutation lemma and the identification of Candecomp/Parafac and bilinear models with constant modulus constraints, IEEE Trans. Signal Process., 52 (2004), pp. 2625-2636.
23. W.P. Krijnen, Convergence of the sequence of parameters generated by alternating least squares algorithms, Comput. Statist. Data Anal., 51 (2006), pp. 481-489.
24. W.P. Krijnen, T.K. Dijkstra, and A. Stegeman, On the non-existence of optimal solutions and the occurrence of "degeneracy" in the Candecomp/Parafac model, Psychometrika, 73 (2008), pp. 431-439.
25. P.M. Kroonenberg, Applied Multiway Data Analysis, Wiley Ser. Probab. Stat., Wiley Interscience, New York, 2008.
26. J.B. Kruskal, Three-way arrays: Rank and uniqueness of trilinear decompositions, with applications to arithmetic complexity and statistics, Linear Algebra Appl., 18 (1977), pp. 95-138.
27. J.B. Kruskal, R.A. Harshman, and M.E. Lundy, How 3-MFA data can cause degenerate Parafac solutions, among other relationships, in Multiway Data Analysis, R. Coppi and S. Bolasco, eds., North-Holland, Amsterdam, 1989, pp. 115-121.
28. S.E. Leurgans, R.T. Ross, and R.B. Abel, A decomposition for three-way arrays, SIAM J. Matrix Anal. Appl., 14 (1993), pp. 1064-1083.
29. L.-H. Lim, Optimal solutions to non-negative Parafac/multilinear NMF always exist, in a talk at the Workshop on Tensor Decompositions and Applications, CIRM, Luminy, Marseille, France, 2005.
30. B.C. Mitchell and D.S. Burdick, Slowly converging Parafac sequences: Swamps and twofactor degeneracies, J. Chemometrics, 8 (1994), pp. 155-168.
31. J.M. Ortega and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, San Diego, 1970.
32. P. Paatero, The multilinear engine-A table-driven least squares program for solving multilinear problems, including the n-way parallel factor analysis model, J. Comput. Graph. Statist., 8 (1999), pp. 854-888.
33. P. Paatero, Construction and analysis of degenerate Parafac models, J. Chemometrics, 14 (2000), pp. 285-299.
34. W.S. Rayens and B.C. Mitchell, Two-factor degeneracies and a stabilization of Parafac, Chemometrics Intell. Labor. Syst., 38 (1997), pp. 173-181.
35. N. Sidiropoulos, G. Giannakis, and R. Bro, Blind Parafac receivers for DS-CDMA systems, IEEE Trans. Signal Process., 48 (2000), pp. 810-823.
36. N. Sidiropoulos, R. Bro, and G. Giannakis, Parallel factor analysis in sensor array processing, IEEE Trans. Signal Process., 48 (2000), pp. 2377-2388.
37. A. Smilde, R. Bro, and P. Geladi, Multi-way Analysis: Applications in the Chemical Sciences, Wiley, New York, 2004.
38. A. Stegeman, Degeneracy in Candecomp/Parafac explained for p?p×2 arrays of rank p+1 or higher, Psychometrika, 71 (2006), pp. 483-501.
39. A. Stegeman, Degeneracy in Candecomp/Parafac explained for several three-sliced arrays with a two-valued typical rank, Psychometrika, 72 (2007), pp. 601-619.
40. A. Stegeman, Low-rank approximation of generic p ?q ?2 arrays and diverging components in the Candecomp/Parafac model, SIAM J. Matrix Anal. Appl., 30 (2008), pp. 988-1007.
41. A. Stegeman, J.M.F. Ten Berge, and L. De Lathauwer, Sufficient conditions for uniqueness in Candecomp/Parafac and Indscal with random component matrices, Psychometrika, 71 (2006), pp. 219-229.
42. A. Stegeman and N.D. Sidiropoulos, On Kruskal's uniqueness condition for the Candecomp Parafac decomposition, Linear Algebra Appl., 420 (2007), pp. 540-552.
43. J.M.F Ten Berge, H.A.L. Kiers, and J. De Leeuw, Explicit Candecomp/Parafac solutions for a contrived 2 ×2 ×2 array of rank three, Psychometrika, 53 (1988), pp. 579-584.
44. J.M.F. Ten Berge and H.A.L. Kiers, Simplicity of core arrays in three-way principal component analysis and the typical rank of p?q×2 arrays, Linear Algebra Appl., 294 (1999), pp. 169-179.
45. G. Tomasi and R. Bro, A comparison of algorithms for fitting the Parafac model, Comput. Statist. Data Anal., 50 (2006), pp. 1700-1734.
46. L.R. Tucker, Some mathematical notes on three-mode factor analysis, Psychometrika, 31 (1966), pp. 279-311.
47. A.-J. Van der Veen and A. Paulraj, An analytical constant modulus algorithm, IEEE Trans. Signal Process., 44 (1996), pp. 1136-1155.