Blind separation of post-nonlinear mixtures using linearizing transformations and temporal decorrelation

Journal of Machine Learning Research

Volumn 4, Issue 7-8, 2004, Pages 1319-1338

  Ziehe, Andreas ^a   Kawanabe, Motoaki ^a   Harmeling, Stefan ^a   Müller, Klaus Robert ^a,b  

^a FRAUNHOFER FIRST   (Germany)

^b UNIVERSITY OF POTSDAM   (Germany)

Author keywords

Blind Source Separation; Gaussianization; Maximal Correlation; Post nonlinear Mixture; Temporal Decorrelation

Indexed keywords

ALGORITHMS; CORRELATION METHODS; DATA COMMUNICATION SYSTEMS; DATA RECORDING; FUNCTIONS; MATHEMATICAL MODELS;

GAUSSIANIZATION; POST-NONLINEAR MIXTURE; TEMPORAL DECORRELATION;

BLIND SOURCE SEPARATION;

EID: 8344255796     PISSN: 15324435     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (54)

1. S. Achard, D.-T. Pham, and C. Jutten. Blind source separation in post nonlinear mixtures. In T.-W. Lee, editor, Proc. Int. Workshop on Independent Component Analysis and Blind Signal Separation (ICA2001), pages 295-300, San Diego, California, 2001.
2. S. Amari, A. Cichocki, and H.-H. Yang. A new learning algorithm for blind source separation. In D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, editors, Advances in Neural Information Processing Systems, volume 8, pages 757-763. MIT Press, Cambridge, MA, 1996.
3. A.J. Bell and T.J. Sejnowski. An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7:1129-1159, 1995.
4. A. Belouchrani, K. Abed Meraim, J.-F. Cardoso, and E. Moulines. A blind source separation technique based on second order statistics. IEEE Trans. on Signal Processing, 45(2):434-444, 1997.
5. P. Billingsley. Probability and Measure. John Wiley & Sons, New York, 1995.
6. L. Breiman and J.H. Friedman. Estimating optimal transformations for multiple regression and correlation. Journal of the American Statistical Association, 80(391):580-598, 1985.
7. J.-F. Cardoso and A. Souloumiac. Blind beamforming for non Gaussian signals. IEE Proceedings-F, 140(6):362-370, 1993.
8. J.-F. Cardoso and A. Souloumiac. Jacobi angles for simultaneous diagonalization. SIAM J. Mat.Anal.Appl. 17(1):161-164, 1996.
9. P. Comon. Independent component analysis - a new concept? Signal Processing, 36:287-314, 1994.
10. G. Deco and D. Obradovic. Linear redundancy reduction learning. Neural Networks, 8(5):751-755, 1995.
11. W. Härdle. Applied Nonparametric Regression. Cambridge University Press, Cambridge, 1990.
12. S. Harmeling, A. Ziehe, M. Kawanabe, and K.-R. Müller. Kernel feature spaces and nonlinear blind source separation. In T.G. Dietterich, S. Becker, and Z. Ghahramani, editors, Advances in Neural Information Processing Systems, volume 14, pages 761-768. MIT Press, 2002.
13. S. Harmeling, A. Ziehe, M. Kawanabe, and K.-R. Müller. Kernel-based nonlinear blind source separation. Neural Computation, 15:1089-1124, 2003.
14. T.J. Hastie and R.J. Tibshirani. Generalized Additive Models, volume 43 of Monographs on Statistics and Applied Probability. Chapman & Hall, London, 1990.
15. A. Hyvärinen, J. Karhunen, and E. Oja. Independent Component Analysis. Wiley, 2001.
16. A. Hyvärinen and E. Oja. A fast fixed-point algorithm for independent component analysis. Neural Computation, 9(7):1483-1492, 1997.
17. C. Jutten and J. Hérault. Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture. Signal Processing, 24:1-10, 1991.
18. C. Jutten and J. Karhunen. Advances in nonlinear blind source separation. In Proc. of the 4th Int. Symp. on Independent Component Analysis and Blind Signal Separation (ICA2003), pages 245-256, Nara, Japan, April 1-4 2003. Invited paper in the special session on nonlinear ICA and BSS.
19. H. Kantz and T. Schreiber. Nonlinear time series analysis. Cambridge University Press, Cambridge, UK, 1997.
20. M. Kawamoto, K. Matsuoka, and M. Oya. Blind separation of sources using temporal correlation of the observed signals. IEICE Trans. Fundamentals, E80-A(4):695-704, 1997.
21. A, Koutras. Blind separation of nonlinear convolved speech mixtures. In Proc. ICASSP 2002, pages 913-919, Orlando, Florida, 2002.
22. L. E. Larson. Radio frequency integrated circuit technology low-power wireless communications. IEEE Personal Communications, 5(3):11-19, 1998.
23. T.-W. Lee, B.U. Koehler, and R. Orglmeister. Blind source separation of nonlinear mixing models. IEEE International Workshop on Neural Networks for Signal Processing, pages 406-415, 1997.
24. T.-W. Lee, A. Ziehe, R.Orglmeister, and T.J. Sejnowski. Combining time-delayed decorrelation and ICA: Towards solving the cocktail party problem. In Proc. ICASSP98, volume 2, pages 1249-1252, Seattle, 1998.
25. J. K. Lin, D. G. Grier, and J. D. Cowan. Faithful representation of separable distributions. Neural Computation, 9(6):1305-1320, 1997.
26. G. Marques and Luis B. Almeida. Separation of nonlinear mixtures using pattern repulsion. In Proc. Int. Workshop on Independent Component Analysis and Signal Separation (ICA '99), pages 277-282, Aussois, France, 1999.
27. L. Molgedey and H. G. Schuster. Separation of a mixture of independent signals using time delayed correlations. Physical Review Letters, 72(23):3634-3637, 1994.
28. K.-R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf. An introduction to kernel-based learning algorithms. IEEE Transactions on Neural Networks, 12(2):181-201, 2001.
29. TD: Combining higher-order statistics and temporal information for blind source separation (with noise). In Proc. Int. Workshop on Independent Component Analysis and Signal Separation (ICA'99), pages 87-92, Aussois, France, 1999.
30. N. Murata, S. Ikeda, and A. Ziehe. An approach to blind source separation based on temporal structure of speech signals. Neurocomputing, 41(1-4):1-24, 2001.
31. P. Pajunen, A. Hyvärinen, and J. Karhunen. Nonlinear blind source separation by self-organizing maps. In Proc. Int. Conf. on Neural Information Processing, pages 1207-1210, Hong Kong, 1996.
32. P. Pajunen and J. Karhunen. A maximum likelihood approach to nonlinear blind source separation. In Proceedings of the 1997 Int. Conf. on Artificial Neural Networks (ICANN'97), pages 541-546, Lausanne, Switzerland, 1997.
33. P. Pajunen and J. Karhunen, editors. Proc. of the 2nd Int. Workshop on Independent Component Analysis and Blind Signal Separation (ICA200). Otamedia, Helsinki, Finland, 2000.
34. L.C. Parra and C. Spence. Convolutive blind source separation of non-stationary sources. IEEE Trans. on Speech and Audio Processing, 8(3):320-327, 2000. US Patent US6167417.
35. D.-T. Pham. Joint approximate diagonalization of positive definite matrices. SIAM J. on Matrix Anal. and Appl., 22(4):1136-1152, 2001.
36. D.-T. Pham and P. Garrat. Blind separation of mixture of independent sources through a quasi-maximum likelihood approach. IEEE Trans. on Signal Processing, 45(7):1712-1725, 1997.
37. B. Pompe. Measuring statistical dependences in a time series. J. Stat. Phys., 73:587-610, 1993.
38. D.-T. Pham S. Achard and C. Jutten. Quadratic dependence measure for nonlinear blind sources separation. In Proc. 4th Intern. Symp. on Independent Component Analysis and Blind Signal Separation (ICA2003), pages 263-268, Nara, Japan, 2003.
39. B. Schölkopf and A.J. Smola. Learning with Kernels. MIT Press, Cambridge, MA, 2002.
40. B. Schölkopf, A.J. Smola, and K.-R. Müller. Nonlinear component analysis as a kernel Eigenvalue problem. Neural Computation, 10:1299-1319, 1998.
41. J. Solé, M. Babaie-Zadeh, C. Jutten, and D.-T. Pham. Improving algorithm speed in PNL mixture separation and Wiener system inversion. In Proc. Int. Conf. on Independent Component Analysis and Signal Separation (ICA2003), Nara, Japan, April 2003.
42. A. Taleb. A generic framework for blind source separation in structured nonlinear models. IEEE Trans. on Signal Processing, 50(8):1819-1830, 2002.
43. A. Taleb and C. Jutten. Nonlinear source separation: The post-nonlinear mixtures. In Proc. European Symposium on Artificial Neural Networks, pages 279-284, Bruges, Belgium, 1997.
44. A, Taleb and C. Jutten. Source separation in post-nonlinear mixtures. IEEE Trans. on Signal Processing, 47(10):2807-2820, 1999.
45. H. Valpola, X. Giannakopoulos, A. Honkela, and J. Karhunen. Nonlinear independent component analysis using ensemble learning: Experiments and discussion. In Proc. Int. Workshop on Independent Component Analysis and Blind Signal Separation (ICA2000), pages 351-356, Helsinki, Finland, 2000.
46. H. Valpola, E. Oja, A. Ilin, A. Honkela, and J. Karhunen. Nonlinear blind source separation by variational Bayesian learning. IEICE Transactions (Japan), E86-A(3), March 2003. To appear in a Special Section on Blind Signal Processing (Invited paper).
47. V. N. Vapnik. Statistical Learning Theory. Wiley, New York, 1998.
48. H.-H. Yang, S. Amari, and A. Cichocki. Information-theoretic approach to blind separation of sources in non-linear mixture. Signal Processing, 64(3):291-300, 1998.
49. A. Yeredor. Blind separation of gaussian sources via second-order statistics with asymptotically optimal weighting. IEEE Signal Processing Letters, 7(7):197-200, 2000.
50. A. Ziehe. M. Kawanabe, S. Harmeling, and K.-R. Müller. Separation of post-nonlinear mixtures using ACE and temporal decorrelation. In T.-W. Lee, editor, Proc. Int. Workshop on Independent Component Analysis and Blind Signal Separation (ICA2001), pages 433-438, San Diego, California, 2001.
51. A. Ziehe, M. Kawanabe, S. Harmeling, and K.-R. Müller. Blind separation of post-nonlinear mixtures using gaussianizing transformations and temporal decorrelation. In Proc. 4th Intern. Symp. on Independent Component Analysis and Blind Signal Separation (ICA2003), pages 269-274, Nara, Japan, April 2003a.
52. A. Ziehe, P. Laskov, K.-R. Müller, and G. Nolte. A linear least-squares algorithm for joint diagonalization. In Proc. 4th Intern. Symp. on Independent Component Analysis and Blind Signal Separation (ICA2003), pages 469-474, Nara, Japan, 2003b.
53. A. Ziehe and K.-R, Müller. TDSEP-an efficient algorithm for blind separation using time structure. In Proc. Int. Conf. on Artificial Neural Networks (ICANN'98), pages 675-680, Skövde, Sweden, 1998.
54. A. Ziehe, K.-R. Müller, G. Nolte, B.-M. Mackert, and G. Curio. Artifact reduction in magnetoneurography based on time-delayed second-order correlations. IEEE Trans. Biomed. Eng., 47(1): 75-87, 2000.