Iterative methods for the canonical decomposition of multi-way arrays: Application to blind underdetermined mixture identification

Signal Processing

Volumn 91, Issue 8, 2011, Pages 1789-1802

  Karfoul, Ahmad ^a   Albera, Laurent ^b,c   De Lathauwer, Lieven ^d  

^a AL BAATH UNIVERSITY   (Syrian Arab Republic)

^b INSERM   (France)

^c UNIVERSITÉ DE RENNES 1   (France)

^d UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Alternating least squares (ALS); Blind underdetermined mixture identification (BUMI); Canonical decomposition (CAND); Hermitian multi way arrays; Multi way data analysis; Parallel factor analysis (PARAFAC)

Indexed keywords

APPROXIMATION ALGORITHMS; MATRIX ALGEBRA; MIXTURES; PROBLEM SOLVING;

ALTERNATING LEAST SQUARES; CANONICAL DECOMPOSITION; HERMITIANS; MULTI-WAY DATA ANALYSIS; PARALLEL FACTOR ANALYSIS; UNDER-DETERMINED MIXTURES;

ITERATIVE METHODS;

EID: 79955473170     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2011.02.003     Document Type: Article

References (54)

1. L.R. Tucker The extension of factor analysis to three-dimensional matrices Psychometrika 31 1966 279 311
2. L. De Lathauwer, B. De Moor, and J. Vandewalle A multilinear singular value decomposition SIAM Journal on Matrix Analysis and its Applications 21 4 2000 1253 1278 (Pubitemid 33217068)
3. K. Yadani, K. Kondo, and M. Iwasaki A singular value decomposition algorithm based on solving hyperplane constrained nonlinear systems Applied Mathematics and Computation 216 3 2010 779 790
4. P. Comon, and B. Mourrain Decomposition of quantics in sums of powers of linear forms Signal Processing 53 2 1996 93 107 special issue on High-order statistics (Pubitemid 126370899)
5. F.L. Hitchcock The expression of a tensor or a polydiac as a sum of products Journal of Mathematical Physics 6 1 1927 164 189
6. F.L. Hitchcock Multiple invariants and generalized rank of a p-way matrix or tensor Journal of Mathematical Physics 7 1 1927 39 79
7. J. Carroll, and J. Chang Analysis of individual differences in multidimensional scaling via an n-way generalization of EckartYoung decomposition Psychometrika 9 1970 267 283
8. A. Smilde, R. Bro, and P. Geladi Multi-way Analysis 2004 Wiley
9. P. Kroonenberg, Applied Multiway Data Analysis, in: Probability and Statistics, 2008, Wiley, New York.
10. C.S. Hermann, J. Parnas, M. Morup, L.K. Hansen, and S.M. Arnfred Parallel factor analysis as an exploratory tool for wavelet transformed event related EEG NeuroImage 29 3 2006 938 947 (Pubitemid 43121218)
11. P. Comon, and M. Rajih Blind identification of underdetermined mixtures based on the characteristic function Signal Processing 86 9 2006 2271 2281 (Pubitemid 44040948)
12. B. Chen, and A.P. Petropulu Frequency domain blind MIMO system identification based on second- and higher-order statistics IEEE Transactions on Signal Processing 49 8 2001 1677 1688 (Pubitemid 32732609)
13. L. Albera, A. Ferreol, P. Comon, and P. Chevalier Blind identification of overcomplete mixtures of sources (BIOME) Linear Algebra and its Applications 391C 2004 3 30
14. C.E.R. Fernandes, G. Favier, and J.C.M. Mota Blind channel identification algorithms based on the PARAFAC decomposition of cumulant tensors: the single and multiuser cases Signal Processing 88 6 2008 1382 1401
15. L. De Lathauwer A link between the canonical decomposition in multilinear algebra and simultaneous matrix diagonalization SIAM Journal on Matrix Analysis and its Applications 28 3 2006 642 666 (Pubitemid 47109355)
16. J.B. Kruskal Three-way arrays: rank and uniqueness of trilinear decompositions Linear Algebra and its Applications 18 1977 95 138
17. E. Sanchez, and B.R. Kowalski Generalized rank annihilation factor-analysis Analytical Chemistry 58 2 1986 496 499
18. L. De Lathauwer, B. De Moor, and J. Vandewalle Computation of the canonical decomposition by means of a simultaneous generalized schur decomposition SIAM Journal on Matrix Analysis and Applications 26 2004 295 327 (Pubitemid 40541662)
19. E. Acar, D.M. Dunlavy, T.G. Kolda, A scalable optimization approach for fitting canonical tensor decompositions, Journal of Chemometrics 25 (2) (2011) 6786
20. R. Bro, and C.A. Andersson Improving the speed of multiway algorithms. Part II: compression Chemometrics and Intelligent Laboratory Systems 42 12 1998 105 113 (Pubitemid 28440365)
21. G. Tomasi, and R. Bro PARAFAC and missing values Chemometrics and Intelligent Laboratory Systems 75 2004 163 180 (Pubitemid 40164340)
22. G. Tomasi, and R. Bro A comparison of algorithms for fitting the parafac model Computational Statistics and Data Analysis 50 7 2006 1700 1734 (Pubitemid 43052351)
23. P. Comon, X. Luciani, A.L.F. De Almeida, Tensor decomposition, alternating least squares and other tales, Journal of Chemometrics 23 (78) (2009) 393405
24. R.A. Harshman, and M.E. Lundy PARAFAC: parallel factor analysis Computational Statistics & Data Analysis 18 1 1994 39 72
25. J.H. Jiang, H.L. Wu, Y. Li, and R.Q. Yu Three-way data resolution by alternating slice-wise diagonalization (ASD) method Journal of Chemometrics 1 14 2000 15 36
26. Z.P. Chen, H.L. Wu, H.J. Jiang, Y. Li, and R.Q. Yu A novel trilinear decomposition algorithm for second-order linear calibration Chemometrics and Intelligent Laboratory Systems 52 1 2000 75 86 (Pubitemid 30621558)
27. M. Rajih, P. Comon, and R.A. Harshman Enhanced line search: a novel method to accelerate PARAFAC Journal on Matrix Analysis and its Applications 30 3 2008 1148 1171
28. R. Bro, Multi-way analysis in the food industry: models, algorithms, and applications, Ph.D. Thesis, University of Amsterdam, 1998.
29. R.A. Harshman, Foundation of PARAFAC procedure: models and conditions for an 'explanatory' multi-mode factor analysis, UCLA Working Papers in Phonetics, 16, 1970, pp. 184.
30. D. Nion, and L. De Lathauwer An enhanced line search scheme for complex-valued tensor decompositions Application in DS-CDMA Signal Processing 88 2008 749 755 (Pubitemid 350088165)
31. M. De Vos, D. Nion, S. Van Huffel, L. De Lathauwer, A combination of parallel factor and independent component analysis, Internal Report 09-04, ESAT-SISTA, K.U.Leuven, Lirias number: 253441.
32. G.H. Golub, and C.F. Van Loan Matrix Computations second ed. 1989 The Johns Hopkins University Press Baltimore, MD
33. A. Karfoul, L. Albera, L. De Lathauwer, Canonical decomposition of even higher order cumulant arrays for blind underdetermined mixture identification, in: SAM 2008, The fifth IEEE Sensor Array and Multichannel Signal Processing workshop, Darmstatdt, Germany, 2008, pp. 501505.
34. L. Albera, A. Karfoul, L. De Lathauwer, Décomposition canonique de tableaux hermitiens semi-définis positifs d'ordre pair par rotation procustéenne: application à l'ICA, in: 22ième Colloque GRETSI sur le Traitement du Signal et des Images (GRETSI 2009), Dijon, France, 2009.
35. A. Ferreol, L. Albera, and P. Chevalier Fourth order blind identification of underdetermined mixtures of sources (FOBIUM) IEEE Transactions on Signal Processing 53 2005 1254 1271
36. L. De Lathauwer, J. Castaing, and J.-F. Cardoso Fourth-order cumulant-based blind identification of underdetermined mixtures IEEE Transactions on Signal Processing 55 6 2007 2965 2973 (Pubitemid 46845686)
37. L. De Lathauwer, B. De Moor, and J. Vandewalle On the best rank-1 and rank-(R1,R2,...,RN) approximation of high-order tensors Journal of Matrix Analysis and its Applications 21 4 2000 1324 1342 (Pubitemid 33217072)
38. P. Comon, J.M.F. Ten Berge, L. De Lathauwer, and J. Castaing Generic and typical ranks of multi-way arrays Linear Algebra and its Applications 430 1112 2009 2997 3007
39. A. Stegeman, and N.D. Sidiropoulos On Kruskal's uniqueness condition for the CANDECOMP/PARAFAC decomposition Linear Algebra and its Applications 420 23 2007 540 552 (Pubitemid 44751783)
40. R. Cattell Parallel proportional profiles and other priciples for determining the choice of factors by rotation Psychometrika 9 4 1944 267 283
41. N.D. Sidiropoulos, and R. Bro On the uniqueness of multilinear decomposition of N-way arrays Journal of Chemometrics 14 2000 229 239
42. N.D. Sidiropoulos, and R. Bro On the uniqueness of the multilinear decomposition of n-way arrays Journal of Chemometrics 14 2000 229 239
43. N.D. Sidiropoulos, R. Bro, and G.B. Giannakis Parallel factor analysis in sensor array processing IEEE Transactions on Signal Processing 48 8 2000 2377 2388
44. T. Jiang, and N.D. Sidiropoulos Kruskal's permutation lemma and the identification of CANDECOMP/PARAFAC and bilinear models with constant modulus constraints IEEE Transaction on Signal Processing 52 9 2004 2625 2636
45. M. Mella Singularities of linear systems and the waring problem Transactions of the American Mathematical Society 358 12 2006 5523 5538 (Pubitemid 44972098)
46. T. Lickteig Typical tensorial rank Linear Algebra and its Applications 69 1985 95 120
47. C. Nikias, and A.P. Petropulu Higher Order Spectra Analysis: A Non-Linear Signal Processing Framework facsimile ed. 1993 Prentice Hall, PTR
48. J. Ten Berge Least Squares Optimization in Multivariate Analysis notes ed. 1993 M&T, DSWO Press Leiden, The Netherlands
49. J.-F. Cardoso, and A. Souloumiac Jacobi angles for simultaneous diagonalization SIAM Journal on Matrix Analysis and Applications 17 1 1996 161 164
50. E.M. Fadaili, N. Thirion-Moreau, and E. MOREAU Non-orthogonal joint diagonalization/zero-diagonalization for source separation based on time-frequency distributions IEEE Transactions on Signal Processing 55 5 2007 1673 1687 (Pubitemid 46691621)
51. A. Yeredor Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation IEEE Transactions on Signal Processing 50 7 2002 1545 1553
52. R.A. Harshman, and M.E. Lundy Data preprocessing and the extended PARAFAC model H.G. Law, C.W. Snyder, J.A. Hattie, R.P. Mcdonald, Research Methods for Multi-mode Data Analysis 1984 Praeger New York 216 284
53. W. Krijnen, T. Dijkstra, and A. Stegeman On the non-existence of optimal solutions and the occurrence of degeneracy in the CANDECOMP/PARAFAC model Psychometrika 73 2008 431 439
54. A. Stegeman, J.M.F. Ten Berge, and L. De Lathauwer Sufficient conditions for uniqueness in CANDECOMP/PARAFAC and INDSCAL with random component matrices Psychometrika 71 2 2006 219 229 (Pubitemid 44116380)