Robust techniques for independent component analysis (ICA) with noisy data

Neurocomputing

Volumn 22, Issue 1-3, 1998, Pages 113-129

  Cichocki, A ^a   Douglas, S C ^b   Amari, S ^a  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b University of Utah   (United States)

Author keywords

Bias removal; Blind source separation; Independent component analysis (ICA); Maximum likelihood; Natural gradient; Noise cancellation

Indexed keywords

ADAPTIVE ALGORITHMS; COMPUTER SIMULATION; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; SIGNAL THEORY; SPURIOUS SIGNAL NOISE; STATISTICAL METHODS;

BLIND SOURCE SEPARATIONS; INDEPENDENT COMPONENT ANALYSIS (ICA); NATURAL GRADIENTS;

NEURAL NETWORKS;

ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; DATA ANALYSIS; MATHEMATICAL ANALYSIS; NOISE; PRIORITY JOURNAL; REVIEW; STATISTICAL ANALYSIS;

EID: 0032212795     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0925-2312(98)00052-6     Document Type: Article

References (31)

1. S. Amari, A. Cichocki, H.H. Yang, Recurrent neural networks for blind separation of sources, Proc. Int. Symp. on Nonlinear Theory and its Applications, NOLTA-95, Las Vegas, NV, 1995, pp. 37-42.
2. S. Amari, A. Cichocki, H.H. Yang, A new learning algorithm for blind signal separation, in: D.S. Touretzky, M.C. Mozer, M.E. Hasselmo (Eds.), Advances in Neural Information Processing Systems, MIT Press, Cambridge, MA, 1996, pp. 757-763.
3. Atick J.J., Redlich A.N. Convergent algorithm for sensory receptive field development. Neural Comput. 5:1993;45-60.
4. Bell A.J., Sejnowski T.J. An information-maximization approach to blind separation and blind deconvolution. Neural Comput. 7:1995;1129-1159.
5. Cardoso J.F., Laheld B. Equivariant adaptive source separation. IEEE Trans. Signal Process. 44:1996;3017-3030.
6. A. Cichocki, S.C. Douglas, S. Amari, P. Mierzejewski, Independent component analysis for noisy data, in: C. Fyfe (Ed.), Proc. Int. Workshop on Independence and artificial Neural Networks, Tenerife, Spain, 9-10 February 1998, pp. 52-58.
7. A. Cichocki, W. Kasprzak, S. Amari, Adaptive approach to blind source separation with cancellation of additive and convolutional noise, ICSP'96, 3rd Int. Conf. on Signal Processing, Proc. IEEE Press/PHEI Beijing, vol. I, September 1996, pp. 412-415.
8. A. Cichocki, I. Sabala, S. Choi, B. Orsier, R. Szupiluk, Self-adaptive independent component analysis for sub-Gaussian and super-Gaussian mixtures with an unknown number of sources, Int. Symp. on Nonlinear Theory and Applications NOLTA'97, Honolulu, USA, 1997, pp. 731-734.
9. A. Cichocki, I. Sabala, S. Amari, Intelligent neural networks for blind signal separation with unknown number of sources, Proc. Int. Conf. Engineering of Intelligent Systems, Tenerife, Spain, 11-13 February 1988, pp. 148-154.
10. Cichocki A., Unbehauen R. Robust estimation of principal components in real time. Electron. Lett. 29:1993;1869-1870.
11. Cichocki A., Unbehauen R., Rummert E. Robust learning algorithm for blind separation of signals. Electron. Lett. 30:1994;1386-1387.
12. A. Cichocki, R. Unbehauen, L. Moszczyński, E. Rummert, A new on-line adaptive learning algorithm for blind separation of source signals, Proc. Int. Symp. Artificial Neural Networks, ISANN-94, Tainan, Taiwan, 1994, pp. 406-411.
13. Cichocki A., Unbehauen R. Robust neural networks with on-line learning for blind identification and blind separation of sources. IEEE Trans. Circuits Systems - I. 43:1996;894-906.
14. Comon P. Independent component analysis. a new concept? Signal Process. 36:1994;287-314.
15. Douglas S.C., Cichocki A. Neural networks for blind decorrelation of signals. IEEE Trans. Signal Process. 45:1997;2829-2842.
16. S.C. Douglas, A. Cichocki, S. Amari, Multichannel blind separation and deconvolution of sources with arbitrary distributions, Proc. IEEE Workshop on Neural Networks for Signal Processing, Amelia Island, FL, 1987, pp. 436-444.
17. S.C. Douglas, A. Cichocki, S. Amari, Bias removal for blind source separation with noisy measurements, Electron. Lett. 34 (14) (1988) 1379-1380.
18. M. Girolami, C. Fyfe, Stochastic ICA contrast maximization using Oja's nonlinear PCA algorithm, Int. J. Neural Systems (1997), in press.
19. M. Girolami, C. Fyfe, Extraction of independent signals sources using a deflationary exploratory projection pursuit network with lateral inhibition, IEE Proc. Vision, Image Signal Process. (1997), in press.
20. W.C. Gray, Variable norm deconvolution, Ph.D. Dissertation, Stanford Univ., Stanford, CA, 1979.
21. A. Hyvarinen, Independent component analysis in the presence of noise: a maximum likelihood approach, in: C. Fyfe (Ed.), Proc. Int. Workshop on Independence and Artificial Neural Networks, Tenerife, Spain, 9-10 February 1998, pp. 32-38.
22. J. Karhunen, Neural approaches to independent component analysis and source separation, Proc. European Symp. on Artificial Neural Networks, ESANN-96, Bruges, Belgium, 1996, pp. 249-266.
23. Karhunen J., Cichocki A., Kasprzak W., Pajunen P. On neural blind separation with noise suppression and redundancy reduction. Int. J. Neural Systems. 8(2):1997;219-237.
24. D.J.C. MacKay, Maximum likelihood and covariant algorithms for independent component analysis, Internal Report, Cavendish Laboratory, Cambridge Univ., 1996.
25. Z. Maluche, O. Macchi, Adaptive separation of unknown number of sources, Proc. IEEE Workshop on Higher Order Statistics, Los Alamitos, CA, 1997, pp. 295-299.
26. Matsuoka K., Ohya M., Kawamoto M. A neural net for blind separation of non-stationary signals. Neural Networks. 8:1995;411-419.
27. E. Moulines, J.F. Cardoso, E. Gassiat, Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models, Proc. Int. Conf. Acoust. Speech, Signal Processing, ICASSP-97, Munich, Germany, 1997, pp. 3617-3620.
28. E. Oja, J. Karhunen, Signal separation by nonlinear Hebbian learning, in: M. Palaniswami et al. (Eds.), Computational Intelligence - A Dynamic System Perspective, IEEE Press, New York, 1995, pp. 83-97.
29. Oja E. The nonlinear PCA learning rule in independent component analysis. Neurocomputing. 17:1997;25-45.
30. L. Xu, C.-C. Cheung, J. Ruan, S. Amari, Nonlinearity and separation capability: further justification for the ICA algorithm with a learned mixture of parametric densities, Proc. European Symp. on Artificial Neural Networks, ESANN'97, Bruges, Belgium, 1997, pp. 291-296.
31. L. Xu, C.C. Chung, H.H. Yang, S. Amari, Independent component analysis by the information-theoretic approach with mixture of parametric densities, Proc. IEEE Int. Conf. on Nural Networks, vol. III, Houston, TX, USA, 9-12 June, 1997, pp. 1821-1826.