Rényi entropy based divergence measures for ICA

IEEE Workshop on Statistical Signal Processing Proceedings

Volumn 2003-January, Issue , 2003, Pages 565-568

  Bao, Y ^a   Krim, H ^b  

^a UNIVERSITY OF MIAMI MILLER SCHOOL OF MEDICINE   (United States)

^b North Carolina State University   (United States)

Author keywords

Additive noise; Data analysis; Density measurement; Entropy; Independent component analysis; Mutual information; Probability; Radiology; Random variables; Statistical analysis

Indexed keywords

DATA REDUCTION; DENSITY MEASUREMENT (SPECIFIC GRAVITY); ENTROPY; INDEPENDENT COMPONENT ANALYSIS; PROBABILITY; RADIOLOGY; RANDOM VARIABLES; SIGNAL PROCESSING; STATISTICAL METHODS;

COMPUTATIONALLY EFFICIENT; DISTANCE MEASURE; DIVERGENCE MEASURES; ENTROPY-BASED; INFORMATION MEASURES; MUTUAL INFORMATIONS; PROBABILITY DENSITIES;

ADDITIVE NOISE;

EID: 68349127686     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SSP.2003.1289531     Document Type: Conference Paper

References (17)

1. C. Jutten and J. Herault, "Blind separation of sources, part I: An adaptive algorithm based on neuromimatic architecture," Signal processing, vol. 24, pp. 1-10, July 1991.
2. P. Comon, "Independent component analysis, a new concept?," Signal Processing, vol. 36, no. 3, pp. 287-314, 1994.
3. J-F. Cardoso and A. Souloumiac, "Blind beamforming for non-Gaussian signals," IEEE Proc. F, vol. 140, no. 6, pp. 362-370, 1993.
4. J-F. Cardoso, "Infomax and maximum likelihood for source separation," IEEE Letters on signal processing, vol. 4, pp. 112-114, 1997.
5. J-F. Cardoso, "Blind signal separation: statistical principles," Proc. IEEE, vol. 10, pp. 2009-2025, 1998, special issue on blind identification and estimation.
6. A. Hyvärinen, "Survey on independent component analysis," Neural Computing Surveys, vol. 2, pp. 94-128, 1999.
7. A. J. Bell and T. J. Sejnowski, "An information-maximization approach to blind separation and blind deconvolution," Neural computation, vol. 7, no. 6, pp. 1129-1159, 1995.
8. D. T. Pham and P. Garrat, "Blind separation of mixture of independent sources a quasi-maximum likelihood approach," IEEE Trans. Signal Processing, vol. 45, no. 7, pp. 1712-1725, 1997.
9. S. I. Amari and A. Cichocki, "Adaptive blind signal processing - neural network approaches," Proc. IEEE, vol. 86, no. 10, pp. 2026-2048, 1998.
10. A. Rényi, "On measures of dependence," Acta Math. Acad. Sc. Hungar., vol. 10, pp. 441-451, 1959.
11. A. Rényi, "On measures of entropy and information," Selected Papers of Alfred Rényi, vol. 2, pp, 525-580, 1976.
12. Y. He, A. B. Hamza, and H. Krim, "An information divergence measure for isar image registration," IEEE workshop Statistcal Signal Processing, Singapore, August 2001.
13. A. O. Hero, B. Ma, O. Michel, and J. D. Gorman, "Alpha-divergence for classification, indexing and retrieval," Commuications and Signal Processing Laboratory Technical report CSPL-328, 2001.
14. G. A. Darbellay and I. Vajda, "Estimation of the mutual information by an adaptive partitioning of the observation space," IEEE Trans. Information Theory, vol. 45, no. 5, pp. 1315-1321, 1999.
15. J. Lin, "Divergence measures based on the Shannon entropy," IEEE Trans. on Information Theory, vol. 37, pp. 145-151, 1991.
16. A. O. Hero and O. Michel, "Asymptotic theory of greedy approximations to minimal k-point random graphs," in IEEE Trans. Information Theory, vol. IT-45, no. 6, pp. 1921-1939, Sept, 1999.
17. Y. Bao, Ph. D. Dissertation, North Carolina State University, May 2002.