Nonparametric divergence estimators for independent subspace analysis

European Signal Processing Conference

Volumn , Issue , 2011, Pages 1718-1722

  Póczos, Barnabás ^a   Szabó, Zoltán ^b   Schneider, Jeff ^a  

^a Carnegie Mellon University ^*  (United States)

^b EÖTVÖS LORÁND UNIVERSITY   (Hungary)

Author keywords

[No Author keywords available]

Indexed keywords

CONSISTENT ESTIMATION; DIVERGENCE ESTIMATION; INDEPENDENT SUBSPACE ANALYSIS; MUTUAL INFORMATIONS; NON-PARAMETRIC; NUMERICAL EXPERIMENTS;

SIGNAL PROCESSING;

ESTIMATION;

EID: 84863731365     PISSN: 22195491     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. E. Learned-Miller and J. Fisher. ICA using spacings estimates of entropy. Journal of Machine Learning Research, 4:1271-1295, 2003.
2. Z. Szabó B. Póczos, and A. Lo″rincz. Undercomplete blind subspace deconvolution. Journal of Machine Learning Research, 8:1063-1095, 2007.
3. N. Leonenko, L. Pronzato, and V. Savani. A class of Rényi information estimators for multidimensional densities. Annals of Statistics, 36(5):2153-2182, 2008.
4. Q. Wang, S. Kulkarni, and S. Verdú. Divergence estimation for multidimensional densities via k-nearest-neighbor distances. IEEE Transactions on Information Theory, 55(5), 2009.
5. F. Pérez-Cruz. Estimation of information theoretic measures for continuous random variables. In NIPS-2008, volume 21, pages 1257-1264.
6. A. Hero, B. Ma, O. Michel, and J. Gorman. Alpha-divergence for classification, indexing and retrieval, 2002. Communications and Signal Processing Laboratory Technical Report CSPL-328.
7. A. Hero, B. Ma, O. Michel, and J. Gorman. Applications of entropic spanning graphs. IEEE Signal Processing Magazine, 19(5):85-95, 2002.
8. M. Gupta and S. Srivastava. Parametric Bayesian estimation of differential entropy and relative entropy. Entropy, 12:818-843, 2010.
9. X. Nguyen, M. Wainwright, and M. Jordan. Estimating divergence functionals and the likelihood ratio by convex risk minimization. IEEE T INFORM THEORY, To appear., 56:5847-5861, 2010.
10. M. Goria, N. Leonenko, V. Mergel, and N. Inverardi. A new class of random vector entropy estimators and its applications in testing statistical hypotheses. Journal of Nonparametric Statistics, 17:277-297, 2005.
11. B. Póczos, S. Kirshner, and Cs. Szepesvári. REGO: Rank-based estimation of Rényi information using Euclidean graph optimization. AISTATS 2010, pages 605-612.
12. D. Pál, B. Póczos, and Cs. Szepesvári. Estimation of Rényi entropy and mutual information based on generalized nearest-neighbor graphs. In NIPS 2010, pages 1849-1857.
13. A. Rényi. On measures of entropy and information. In Fourth Berkeley Symposium on Mathematical Statistics and Probability. University of California Press, 1961.
14. T. Villmann and S. Haase. Mathematical aspects of divergence based vector quantization using Frechetderivatives, 2010. University of Applied Sciences Mittweida.
15. A. van der Wart. Asymptotic Statistics. Cambridge University Press, 2007.
16. D. Loftsgaarden and C. Quesenberry. A nonparametric estimate of a multivariate density function. Annals of Mathematical Statistics, 36:1049-1051, 1965.
17. J. Cardoso. Multidimensional independent component analysis. In ICASSP'98, volume 4, pages 1941-1944.
18. P. Comon. Independent component analysis: a new concept? Signal Processing, 36:287-314, 1994.
19. H. Gutch and F. Theis. Independent subspace analysis is unique, given irreducibility. In ICA07, pages 49-56.
20. S. Amari, A. Cichocki, and H. Yang. A new learning algorithm for blind signal separation. NIPS'96, 8:757-763.
21. A. Hyvärinen. Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks, 10:626-634, 1999.