On the entropy minimization of a linear mixture of variables for source separation

Signal Processing

Volumn 85, Issue 5 SPEC. ISS., 2005, Pages 1029-1044

  Vrins, Frédéric ^a   Verleysen, Michel ^a  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

Blind source separation; Entropy; ICA; Local minima

Indexed keywords

COMPUTER SIMULATION; ENTROPY; FUNCTIONS; INDEPENDENT COMPONENT ANALYSIS; MATRIX ALGEBRA; MAXIMUM LIKELIHOOD ESTIMATION; MODAL ANALYSIS; OPTIMIZATION; RANDOM PROCESSES; SIGNAL PROCESSING; VECTORS;

COST FUNCTIONS; KULLBACK-LEIBLER DISTANCE; LOCAL MINIMA; PERMUTATIONS;

BLIND SOURCE SEPARATION;

EID: 14844347566     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2004.11.026     Document Type: Article

References (21)

1. M. Babaie-Zadeh, C. Jutten, A general approach for mutual information minimization and its application to blind source separation, Signal Processing, this issue.
2. A.J. Bell, and T.J. Sejnowski An information-maximisation approach to blind separation and blind deconvolution Neural Comput. 7 6 1995 1129 1159
3. R. Boscolo, H. Pan, and V. Roychowdhury Independent component analysis based on nonparametric density estimation IEEE Trans. Neural Networks 15 1 2004 55 65
4. R. Boscolo, V. Roychowdhury, On the uniqueness of the minimum of the information-theoretic cost function for the separation of mixtures of nearly Gaussian signals, in: Proceedings of the International Conference on Independent Component Analysis and Blind Signal Separation (ICA'03), 2003, pp. 137-141.
5. J.-F. Cardoso, Source separation using higher order moments, in: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'89). Glasgow (England), 1989.
6. J.-F. Cardoso, Blind signal separation: statistical principles, special issue on blind identification and estimation, in: R.-W. Liu, L. Tong (Eds.), Proceedings of the IEEE, 1998, pp. 2009-2025.
7. J.-F. Cardoso Dependence, correlation and gaussianity in independent component analysis J. Mach. Learning Res. 4 2003 1177 1203
8. P. Comon Independent component analysis a new concept?, Signal Processing 36 3 1994 287 314
9. T.M. Cover, and J.A. Thomas Elements of Information Theory 1991 Wiley New York
10. S. Cruces, A. Cichocki, S. Amari, The minimum entropy and cumulants based contrast functions for blind source extraction, in: J. Mira, A. Prieto (Eds.), Proceedings of the International Workshop on Artificial Neural Networks (IWANN'01), Lecture Notes in Computer Science, vol. 2085, Springer, Berlin, 2001, pp. 786-793.
11. S. Cruces, A. Cichocki, and S. Amari From blind signal extraction to blind instantaneous signal separation criteria, algorithms and stability IEEE Trans. Neural Networks 15 4 2004 859 873
12. G. Darmois Analyse générale des liaisons stochastiques Rev. Inst. Int. Stat. 21 1953 2 18
13. N. Delfosse, and P. Loubaton Adaptibe blind separation of sources a deflation approach Signal Processing 45 1995 59 83
14. D. Donoho On minimum entropy deconvolution D. Findley Applied Time Series Analysis II 1981 Academic Press New York 565 608
15. B. Godfery, An information theory approach to deconvolution, Technical Report 15, Stanford Exploration project, 1978.
16. S. Haykin (Ed.), Unsupervised Adaptive Filtering, vol. 1, Blind Source Separation, Wiley, New York, 2000.
17. A. Hyvärinen, J. Karhunen, and E. Oja Independent Component Analysis 2001 Wiley New York
18. E. Parzen On estimation of a probability density function and mode Ann. Math. Stat. 33 1962 1065 1076
19. D.-T. Pham Blind separation of instantaneous mixtures of sources based on order statistics IEEE Trans. Signal Process. 48 2 2000 363 375
20. J. Rice (Ed.), Mathematical Statistics and Data Analysis, Duxurby Press, Belmont, CA, 1995.
21. C.E. Shannon, The Mathematical Theory of Communication The Board of Trustees, University of Illinois, Urbana, IL, 1949.