ICA using spacings estimates of entropy

Journal of Machine Learning Research

Volumn 4, Issue 7-8, 2004, Pages 1271-1295

  Learned Miller, Erik G ^a   Fisher III, John W ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BLIND SOURCE SEPARATION; COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; ESTIMATION; PROBABILITY; PROBLEM SOLVING;

PROBABILITY DENSITY; SOURCE CODES;

INDEPENDENT COMPONENT ANALYSIS;

EID: 8344261659     PISSN: 15324435     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (29)

1. S. Amari, A. Cichocki, and H. H. Yang. A new learning algorithm for blind signal separation. In D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, editors, Advances in Neural Information Processing Systems, 8. MIT Press, 1996.
2. B. C. Arnold, N. Balakrishnan, and H.N. Nagaraja. A First Course in Order Statistics. John Wiley & Sons, 1992.
3. F. R. Bach and M. I. Jordan. Kernel independent component analysis. Journal of Machine Learning Research, 3:1-48, 2002.
4. J. Beirlant, E. J. Dudewicz, L. Györfi, and E. C. van der Meulen. Nonparametric entropy estimation: An overview. International Journal of Mathematical and Statistical Sciences, 6(1): 17-39, June 1997.
5. A. Bell and T. Sejnowski. An information maximization approach to blind separation and blind deconvolution. Neural Computation, 7:1129-1159, 1995.
6. A. Benveniste, M. Goursat, and G. Ruget. Robust identification of a nonminimum phase system: blind adjustment of a linear equalizer in data communications. IEEE Transactions on Automatic Control, 25(3):385-99, 1980.
7. J.-F. Bercher and C. Vignat. Estimating the entropy of a signal with applications. IEEE Transactions on Signal Processing, 48(6): 1687-1694, 2000.
8. J.-F. Cardoso. High-order contrasts for independent component analysis. Neural Computation, 11 (1):157-192, 1999a.
9. J.-F. Cardoso. High-order contrasts for independent component analysis. Neural Computation, 11 (1): 157-192, 1999b.
10. J.-F. Cardoso and A. Souloumiac. Jacobi angles for simultaneous diagonalization, SIAM Journal on Matrix Analysis and Applications, 17(1):161-164, January 1996. ISSN 0895-4798 (print), 1095-7162 (electronic). URL http://epubs.siam.org/sam-bin/dbq/article/25954.
11. P. Comon. Independent component analysis - a new concept? Signal Processing, 36:287-314, 1994.
12. Thomas M. Cover and Joy A. Thomas. Elements of Information Theory. John Wiley & Sons, Inc., 1991.
13. G. H. Golub and C. F. Van Loan. Matrix Computations. Johns Hopkins University Press, 1996.
14. P. Hall. Limit theorems for sums of general functions of m-spacings. Mathematical Proceedings of the Cambridge Philosophical Society, 96:517-532, 1984.
15. A. Hyvärinen. New approximations of differential entropy for independent component analysis and projection pursuit, In Advances in Neural Information Processing Systems 10, pages 273-279, 1997.
16. A. Hyvärinen. Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks, 10(3):626-634, May 1999.
17. A. Hyvärinen. Blind source separation by nonstationarity of variance: A cumulant-based approach. IEEE Transactions on Neural Networks, 12(6):1471-1474, Nov 2001.
18. A. Hyvärinen and E. Oja. A fast fixed point algorithm for independent component analysis. Neural Computation, 9(7): 1483-1492, 1997.
19. C. Jutten and J. Herault. Blind separation of sources, Part I: An adaptive algorithm based on neuromimetic architecture. Signal Processing, 24(1):1-10, 1991.
20. S. Kullback. Information Theory and Statistics. John Wiley and Sons, 1959.
21. T. Lee, M. Girolami, A. Bell, and T. Sejnowski. A unifying information-theoretic framework for independent component analysis. International Journal on Mathematical and Computer Modeling, 1999a.
22. T.-W. Lee, M. Girolami, and T. J. Sejnowski. Independent component analysis using an extended Infomax algorithm for mixed sub-gaussian and super-gaussian sources. Neural Computation, 11 (2):417-441, 1999b.
23. B. Ya Levit. Asymptotically optimal estimation of nonlinear functional. Problems of Information Transmission, 14:65-72, 1978.
24. E. B. Manoukian. Modern Concepts and Theorems of Mathematical Statistics. Springer-Verlag, 1986.
25. B.A. Pearlmutter and L.C. Parra. A context-sensitive generalization of ica. In International Conference on Neural Information Processing, Sep 1996.
26. D.-T. Pham. Blind separation of instantaneous mixture of sources based on order statistics. IEEE Transactions on Signal Processing, 48(2):363-375, 2000.
27. D.-T. Pham, P. Garrat, and C. Jutten. Separation of a mixture of independent sources through a maximum likelihood approach. In Proceedings of EUSIPCO, pages pages 771-774, 1992.
28. C. E. Shannon. The mathematical theory of communication. The Bell System Technical Journal, 27:379-423, 623-656, Jul,Oct 1948.
29. O. Vasicek. A test for normality based on sample entropy. Journal of the Royal Statistical Society, Series B, 38(1):54-59, 1976.