Joint low-rank approximation for extracting non-Gaussian subspaces

Signal Processing

Volumn 87, Issue 8, 2007, Pages 1890-1903

  Kawanabe, Motoaki ^a   Theis, Fabian J ^b  

^a Fraunhofer FIRSTIDA ^*  (Germany)

^b Bernstein Center for Computational Neuroscience   (Germany)

Author keywords

Characteristic function; Fourth order cumulant tensor; Joint low rank approximation; Linear dimension reduction; Non Gaussian subspace

Indexed keywords

ALGORITHMS; EIGENVALUES AND EIGENFUNCTIONS; GAUSSIAN NOISE (ELECTRONIC); MATRIX ALGEBRA; TENSORS;

CHARACTERISTIC FUNCTIONS; FOURTH ORDER CUMULANT TENSORS; JOINT LOW-RANK APPROXIMATION; LINEAR DIMENSION REDUCTION; NON-GAUSSIAN SUBSPACES;

FEATURE EXTRACTION;

EID: 34247165067     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2007.01.033     Document Type: Article

References (34)

1. Jutten C., and Hérault J. Blind separation of sources, part I: an adaptive algorithm based on neuromimetic architecture. Signal Process. 25 (1991) 1-10
2. Comon P. Independent component analysis-a new concept?. Signal Process. 36 (1994) 287-314
3. Cardoso J.-F., and Souloumiac A. Blind beamforming for non Gaussian signals. IEE Proc. F 140 6 (1993) 362-370
4. Bell A.J., and Sejnowski T.J. An information-maximization approach to blind separation and blind deconvolution. Neural Computation 7 (1995) 1129-1159
5. Hyvärinen A., Karhunen J., and Oja E. Independent Component Analysis (2001), Wiley, New York
6. Hyvärinen A., Särelä J., and Vigário R. Spikes and bumps: artefacts generated by independent component analysis with insufficient sample size. Proceedings of ICA'99 (1999) 425-429
7. Asano F., Motomura Y., Asho H., and Matsui T. Effect of PCA filter in blind source separation. Proceedings of ICA 2000 (2000) 57-62
8. Vigário R., Jousmäki V., Hämäläinen M., Hari R., and Oja E. Independent component analysis for identification of artefacts in magnetoencephalographic recordings. Advances in Neural Information Processing Systems vol. 10 (1998), MIT Press, Cambridge, MA 229-235
9. Blanchard G., Kawanabe M., Sugiyama M., Spokoiny V., and Müller K.-R. In search of non-Gaussian components of a high-dimensional distribution. J. Mach. Learning Res. 7 (2006) 247-282
10. Hyvärinen A., and Hoyer P. Emergence of phase and shift invariant features by decomposition of natural images into independent feature subspaces. Neural Computation 12 7 (2000) 1705-1720
11. Tenenbaum J.B., de Silva V., and Langford J.C. A global geometric framework for nonlinear dimensionality reduction. Science 290 5500 (2000) 2319-2323
12. Roweis S., and Saul L. Nonlinear dimensionality reduction by locally linear embedding. Science 290 5500 (2000) 2323-2326
13. Friedman J.H., and Tukey J.W. A projection pursuit algorithm for exploratory data analysis. IEEE Trans. Comput. 23 9 (1975) 881-890
14. Huber P.J. Projection pursuit. Ann. Statist. 13 (1985) 435-475
15. Hyvärinen A., and Oja E. A fast fixed-point algorithm for independent component analysis. Neural Computation 9 7 (1997) 1483-1492
16. Hyvärinen A. Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Networks 10 3 (1999) 626-634
17. M. Kawanabe, G. Blanchard, M. Sugiyama, K.-R. Müller, A new algorithm of non-Gaussian component analysis with radial kernel functions, Ann. Inst. Statist. Math. 59(1) (2007) 57-75.
18. Theis F.J., and Kawanabe M. Uniqueness of non-Gaussian subspace analysis. Proceedings of ICA 2006 (2006) 917-924
19. Ziehe A., and Müller K.-R. TDSEP-an efficient algorithm for blind separation using time structure. In: Niklasson L., Bodén M., and Ziemke T. (Eds). Proceedings of the Eighth International Conference on Artificial Neural Networks, ICANN'98 (1998), Springer, Berlin 675-680 (Perspectives in Neural Computing)
20. Belouchrani A., Abed Meraim K., Cardoso J.-F., and Moulines E. A blind source separation technique based on second order statistics. IEEE Trans. Signal Process. 45 2 (1997) 434-444
21. Theis F.J., and Inouye Y. On the use of joint diagonalization in blind signal processing. Proceedings of ISCAS 2006 (2006), Kos, Greece
22. M. Kawanabe, Linear dimension reduction based on the fourth-order cumulant tensor, in: Proceedings of ICANN 2005, Lecture Notes in Computer Science, vol. 3697, 2005, pp. 151-156.
23. M. Kawanabe, F.J. Theis, Estimating non-Gaussian subspaces by characteristic functions, in: J. Rosca, D. Erdogmus, J.C. Príncipe, S. Haykin (Eds.), Independent Component Analysis and Blind Signal Separation, Lecture Notes in Computer Science, vol. 3889, Springer, Berlin, 2006, pp. 157-164, ISBN 3-540-32630-8.
24. Yeredor A. Blind source separation via the second characteristic function. Signal Process. 80 5 (2000) 897-902
25. Theis F.J. A new concept for separability problems in blind source separation. Neural Computation 16 (2004) 1827-1850
26. Theis F.J. Multidimensional independent component analysis using characteristic functions. Proceedings of EUSIPCO 2005 (2005)
27. Lin J.K. Factorizing multivariate function classes. Advances in Neural Information Processing Systems vol. 10 (1998), MIT Press, Cambridge, MA 563-569
28. Amari S., and Cardoso J.-F. Blind source separation-semiparametric statistical approach. IEEE Trans. Signal Process. 45 11 (1997) 2692-2700
29. Yeredor A. Non-orthogonal joint diagonalization in the leastsquares sense with application in blind source separation. IEEE Trans. Signal Process. 50 7 (2002) 1545-1553
30. Pham D.T., and Garrat P. Blind separation of mixture of independent sources through a quasi-maximum likelihood approach. IEEE Trans. Signal Process. 45 7 (1997) 1712-1725
31. Kawanabe M., and Müller K.-R. Estimating functions for blind separation when sources have variance dependencies. J. Mach. Learning Res. 6 (2005) 453-482
32. Lee T.-W., Girolami M., and Sejnowski T.J. Independent component analysis using an extended infomax algorithm for mixed sub-Gaussian and super-Gaussian sources. Neural Computation 11 2 (1999) 417-441
33. Z. Szabó, B. Póczos, A.L. Horincz, Cross-entropy optimization for independent process analysis, in: J. Rosca, D. Erdogmus, J.C. Príncipe, S. Haykin (Eds.), Independent Component Analysis and Blind Signal Separation, Lecture Notes in Computer Science, vol. 3889, Springer, Berlin, 2006, pp. 909-916, ISBN 3-540-32630-8.
34. Theis F.J. Towards a general independent subspace analysis. Advances in Neural Information Processing Systems (2006)