ICA based on a smooth estimation of the differential entropy

Advances in Neural Information Processing Systems 21 - Proceedings of the 2008 Conference

Volumn , Issue , 2009, Pages 433-440

  Faivishevsky, Lev ^a   Goldberger, Jacob ^a  

^a BAR ILAN UNIVERSITY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION THEORY;

DATA SAMPLE; DIFFERENTIABLE FUNCTIONS; DIFFERENTIAL ENTROPY; GEOMETRICAL INTERPRETATION; GRADIENT DESCENT METHOD; ICA ALGORITHMS; INFORMATION THEORETIC MEASURE; MUTUAL INFORMATIONS; NONPARAMETRIC APPROACHES; PERFORMANCE;

ENTROPY;

EID: 77956512390     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. S. Amari, A. Cichoki, and H.H.Yang. A new learning algorithm for blind signal separation. Advances in Neural Information Processing Systems, 8, 1996.
2. F. Bach and M. Jordan. Kernel independent component analysis. Journal of Machine Learning Research, 3, 2002.
3. A. J. Bell and T. J. Sejnowski. An information-maximization approach to blind separation and blind deconvolution. Neural Computatiuon, 7, 1995.
4. J.-F. Cardoso. Multidimensional independent component analysis. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP'98), 1998.
5. C.Jutten and J.Herault. Blind separation of sources, part 1: An adaptive algorithm based on neuromimetic architecture. Signal Processing, 1991.
6. P. Comon. Independent component analysis, a new concept? Signal Processing, 36(3), 1994.
7. Thomas M. Cover and Joy A. Thomas. Elements of Information Theory. Wiley-Interscience, August 1991.
8. D.T.Pham and P.Garat. Blind separation of mixtures of independent signals through a quasi-maximum likelihood approach. IEEE transactions on Signal Processing 45(7), 1997.
9. A. Hyvarinen and E.Oja. A fast fixed point algorithm for independent component analysis. Neural computation, 9(7), 1997.
10. A. Hyvarinen, J. Karhunen, and E. Oja. Independent component analysis. 2001.
11. L. Kozachenko and N. Leonenko. On statistical estimation of entropy of random vector. Problems Infor. Transmiss., 23 (2), 1987.
12. A. Kraskov, H. Stögbauer, and P. Grassberger. Estimating mutual information. Physical Review E, 69:066138, 2004.
13. E. Miller and J. Fisher. Ica using spacing estimates of entropy. Proc. Fourth International Symposium on Independent Component Analysis and Blind Signal Separation, Nara, Japan, Apr. 2003, pp. 1047-1052., 2003.
14. J. Peltonen and S. Kaski. Discriminative components of data. IEEE Transactions on Neural Networks, 16(1), 2005.
15. H. Singh, N. Misra, V. Hnizdo, A. Fedorowicz, and Eugene Demchuk. Nearest neighbor estimates of entropy. American Journal of Mathematical and Management Sciences, 2003.
16. H. Stögbauer, A. Kraskov, S. Astakhov, and P. Grassberger. Least-dependent-component analysis based on mutual information. Phys. Rev. E, 70(6):066123, Dec 2004.
17. O. Vasicek. A test for normality based on sample entropy. J. Royal Stat. Soc. B, 38 (1):54-59, 1976.
18. J. D. Victor. Binless strategies for estimation of information from neural data. Physical Review, 2002.
19. Q. Wang, S. R. Kulkarni, and S. Verdu. A nearest-neighbor approach to estimating divergence between continuous random vectors. IEEE Int. Symp. Information Theory, Seattle, WA, 2006.