Dimensionality reduction in higher-order signal processing and rank- (R1,R2,⋯,RN) reduction in multilinear algebra

Linear Algebra and Its Applications

Volumn 391, Issue 1-3 SPEC. ISS., 2004, Pages 31-55

  De Lathauwer, Lieven ^a   Vandewalle, Joos ^b  

^a Centre national de la recherche scientifique   (France)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Higher order statistics; Higher order tensors; Independent component analysis; Multilinear algebra; Rank reduction; Singular value decomposition; Source separation

Indexed keywords

ALGORITHMS; BLIND SOURCE SEPARATION; INDEPENDENT COMPONENT ANALYSIS; SIGNAL PROCESSING; STATISTICAL METHODS; TENSORS; VECTORS;

HIGHER ORDER STATISTICS; HIGHER ORDER TENSORS; MULTILINEAR ALGEBRA; RANK REDUCTION; SINGULAR VALUE DECOMPOSITION; SOURCE SEPARATION;

LINEAR ALGEBRA;

EID: 4644268396     PISSN: 00243795     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.laa.2004.01.016     Document Type: Article

References (49)

1. S.-I. Amari, A. Cichocki, S. Makino, N. Murata, in: Proc. Fourth Int. Symp. on Independent Component Analysis and Blind Signal Separation, Nara, Japan, 2003.
2. André T.F., Nowak R.D., Van Veen B.D. Low-rank estimation of higher order statistics. IEEE Trans. Signal Process. 45:1997;673-685.
3. Belouchrani A., Abed-Meraim K., Cardoso J.-F., Moulines E. A blind source separation technique using second order statistics. IEEE Trans. Signal Process. 45(2):1997;434-444.
4. Belouchrani A., Amin M.G. Blind source separation based on time-frequency signal representations. IEEE Trans. Signal Process. 46(11):1998;2888-2897.
5. R. Bro, PARAFAC: Tutorial & applications, in: 2nd Internet Conf. in Chemometrics (INCINC'96), Chemom. Intell. Lab. Syst., vol. 38, 1997, pp. 149-171 (special issue).
6. J.-F. Cardoso, Iterative techniques for blind source separation using only fourth-order cumulants, in: Proc. EUSIPCO-92, Brussels, Belgium, 1992, pp. 739-742.
7. Cardoso J.-F., Souloumiac A. Blind beamforming for non-Gaussian signals. IEE Proc.-F. 140:1994;362-370.
8. J.-F. Cardoso, On the performance of orthogonal source separation algorithms, in: Proc. EUSIPCO-94, Edinburgh, Scotland, UK, vol. 2, 1994, pp. 776-779.
9. Cardoso J.-F., Souloumiac A. Jacobi angles for simultaneous diagonalization. SIAM J. Matrix Anal. Appl. 17(1):1996;161-164.
10. Comon P. Independent component analysis, a new concept. Higher Order Statistics, Signal Process. 36:1994;287-314. (special issue).
11. Comon P., Mourrain B. Decomposition of quantics in sums of powers of linear forms. Higher Order Statistics, Signal Process. 53(2-3):1996;93-108. (special issue).
12. Comon P. Tensor decompositions. McWhirter J.G., Proudler I.K. Mathematics in Signal Processing V. 2002;Clarendon Press, Oxford, UK.
13. K. De Cock, Principal angles in system theory, information theory and signal processing, Ph.D. Thesis, K.U.Leuven, E.E. Dept. (ESAT), Belgium, 2002.
14. L. De Lathauwer, B. De Moor, J. Vandewalle, Independent component analysis based on higher-order statistics only, in: Proc. 8th IEEE SP Workshop on Statistical Signal and Array Processing (SSAP-96), Corfu, Greece, 1996, pp. 356-359.
15. L. De Lathauwer, B. De Moor, J. Vandewalle, Dimensionality reduction in higher-order-only ICA, in: Proc. IEEE Signal Processing Workshop on Higher-Order Statistics, Banff, Alta., Canada, 1997, pp. 316-320.
16. L. De Lathauwer, Signal processing based on multilinear algebra, Ph.D. Thesis, K.U.Leuven, E.E. Dept. (ESAT), Belgium, 1997.
17. L. De Lathauwer, J. Vandewalle, A residual bound for the mixing matrix in ICA, in: Proc. EUSIPCO-98, Rhodos, Greece, 1998, pp. 2065-2068.
18. De Lathauwer L., De Moor B., Vandewalle J. A multilinear singular value decomposition. SIAM J. Matrix Anal. Appl. 21:2000;1253-1278.
19. N) approximation of higher-order tensors SIAM J. Matrix Anal. Appl. 21:2000;1324-1342.
20. De Lathauwer L., De Moor B., Vandewalle J. An introduction to independent component analysis. Multi-way Analysis, J. Chemom. 14:2000;123-149. (special issue).
21. De Lathauwer L., De Moor B., Vandewalle J. Independent component analysis and (simultaneous) third-order tensor diagonalization. IEEE Trans. Signal Process. 49:2001;2262-2271.
22. L. De Lathauwer, B. De Moor, J. Vandewalle, Computation of the canonical decomposition by means of a simultaneous generalized Schur decompositition, SIAM J. Matrix Anal. Appl., in press.
23. L. De Lathauwer, B. De Moor, J. Vandewalle, A prewhitening-induced bound on the identification error in independent component analysis, Tech. Report 01-12, K.U.Leuven, E.E. Dept. (ESAT), SCD-SISTA, Belgium, 2001.
24. Golub G.H., Van Loan C.F. Matrix Computations. 1996;Johns Hopkins University Press, Baltimore, MD.
25. R.A. Harshman, Foundations of the PARAFAC procedure: model and conditions for an "explanatory" multi-mode factor analysis, UCLA Working Papers in Phonetics 16(1) (1970).
26. Hyvärinen A., Karhunen J., Oja E. Independent Component Analysis. 2001;John Wiley & Sons.
27. Kofidis E., Regalia P. On the best rank-1 approximation of higher order supersymmetric tensors. SIAM J. Matrix Anal. Appl. 23:2002;863-884.
28. Kolda T. Orthogonal tensor decompositions. SIAM J. Matrix Anal. Appl. 23:2001;243-255.
29. Kroonenberg P.M., de Leeuw J. Principal component analysis of three-mode data by means of alternating least squares algorithms. Psychometrika. 45:1980;69-97.
30. Kroonenberg P.M. Three-Mode Principal Component Analysis. 1983;DSWO Press, Leiden.
31. Kruskal J.B. Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics. Linear Algebra Appl. 18:1977;95-138.
32. Leurgans S.E., Ross R.T., Abel R.B. A decomposition for three-way arrays. SIAM J. Matrix Anal. Appl. 14:1993;1064-1083.
33. Nikias C., Mendel J. Signal processing with higher-order spectra. IEEE Signal Proc. Mag. 1993;10-37.
34. Nikias C.L., Petropulu A.P. Higher-Order Spectra Analysis. A Nonlinear Signal Processing Framework. 1993;Prentice-Hall, Englewood Cliffs, NJ.
35. Pham D.-T., Cardoso J.-F. Blind separation of instantaneous mixtures of non-stationary sources. IEEE Trans. Signal Process. 49(9):2001;1837-1848.
36. Pham D.-T. Joint approximate diagonalization of positive definite Hermitian matrices. SIAM J. Matrix Anal. Appl. 22(4):2001;1136-1152.
37. Sidiropoulos N., Giannakis G., Bro R. Blind PARAFAC receivers for DS-CDMA systems. IEEE Trans. Signal Process. 48:2000;810-823.
38. ten Berghe J., de Leeuw J., Kroonenberg P.M. Some additional results on principal components analysis of three-mode data by means of alternating least squares algorithms. Psychometrika. 52:1987;183-191.
39. Tong L., et al. Indeterminacy and identifiability of blind identification. IEEE Trans. Circuits Systems. 38:1991;499-509.
40. Tucker L.R. The extension of factor analysis to three-dimensional matrices. Gulliksen H., Frederiksen N. Contributions to Mathematical Psychology. 1964;109-127 Holt, Rinehart & Winston, NY.
41. Tucker L.R. Some mathematical notes on three-mode factor analysis. Psychometrika. 31:1966;279-311.
42. van der Veen A.-J., Paulraj A. An analytical constant modulus algorithm. IEEE Trans. Signal Process. 44:1996;1136-1155.
43. A.-J. van der Veen, Joint diagonalization via subspace fitting techniques, in: Proc. IEEE ICASSP, Salt Lake City, UT, 2001.
44. Vandewalle J., Callaerts D. Singular value decomposition: a powerful concept and tool in signal processing. Mathematics in Signal Processing II. 1990;Clarendon Press, Oxford.
45. Vandewalle J., De Moor B. On the use of the singular value decomposition in identification and signal processing. in: Numerical Linear Algebra, Digital Signal Processing and Parallel Algorithms. NATO ASI Series. vol. F70:1991;321-360.
46. Van Huffel S., Vandewalle J. The Total Least Squares Problem: Computational Aspects and Analysis. Frontiers in Applied Mathematics Series. vol. 9:1991;SIAM, Philadelphia, PA.
47. Van Veen B.D., Buckley K.M. Beamforming: a versatile approach to spatial filtering. IEEE ASSP Mag. 1988;4-24.
48. Wax M., Kailath T. Detection of signals by information theoretic criteria. IEEE Trans. Acoust. Speech Signal Process. 33:1986;387-392.
49. Yeredor A. Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation. IEEE Trans. Signal Process. 50(7):2002;1545-1553.