Nonparametric estimation of the likelihood ratio and divergence functionals

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2007, Pages 2016-2020

  Nguyen, Xuan Long ^a   Wainwright, Martin J ^a,b   Jordan, Michael I ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FUNCTIONALS; INTERNATIONAL SYMPOSIUM;

CYBERNETICS; INFORMATION THEORY; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMIZATION; RISK PERCEPTION; TECHNICAL PRESENTATIONS;

PROBABILITY DISTRIBUTIONS;

EID: 51649085815     PISSN: 21578101     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2007.4557517     Document Type: Conference Paper

References (21)

1. S. M. Ali and S. D. Silvey. A general class of coefficients of divergence of one distribution from another. J. Royal Stat. Soc. Series B, 28:131-142, 1966.
2. P. Bickel and Y. Ritov, Estimating integrated squared density derivatives: Sharp best order of convergence estimates. Sankhyā Ser. A, 50:381-393, 1988.
3. L. Birgé and P. Massart. Estimation of integral functionals of a density. Annals of Statistics, 23(1)11-29, 1995.
4. α. Math. USSR-Sbornik, 2(3):295-317, 1967.
5. T. Cover and J. Thomas. Elements of Information Theory. John Wiley and Sons, New York, 1991.
6. I. Csiszár. Information-type measures of difference of probability distributions and indirect observation. Studia Sci. Math. Hungar, 2:299-318, 1967.
7. L. Gyorfi and E.C. van der Meulen. Density-free convergence properties of various estimators of entropy. Computational Statistics and Data Analysis, 5:425-436, 1987.
8. P. Hall and S. Morton. On estimation of entropy. Ann. Inst. Statist. Math., 45(1):69-88, 1993.
9. I. A. Ibragimov and R. Z. Khasminskii. On the nonparametric estimation of functionals. In Symposium in Asymptotic Statistics, pages 41-52, 1978.
10. H. Joe. Estimation of entropy and other functionals of a multivariate density. Ann. Inst. Statist. Math., 41:683-697, 1989.
11. T. Kailath. The divergence and Bhattacharyya distance measures in signal selection. IEEE Trans. on Communication Technology, 15(l):52-60, 1967.
12. B. Laurent. Efficient estimation of integral functionals of a density. Annals of Statistics, 24(2):659-681, 1996.
13. B. Ya. Levit. Asymptotically efficient estimation of nonlinear functionals. Problems Inform. Transmission, 14:204-209, 1978.
14. X. Nguyen, M. J. Wainwright, and M. I. Jordan. On divergences, surrogate losses and decentralized detection. Technical Report 695, Department of Statistics, UC Berkeley, October 2005.
15. X. Nguyen, M. J. Wainwright, and M. I. Jordan. Estimating divergence functionals and the likelihood ratio by convex risk minimization. Technical report, Department of Statistics, UC Berkeley, January 2007.
16. G. Rockafellar. Convex Analysis. Princeton University Press, Princeton, 1970.
17. F. Topsoe. Some inequalities for information divergence and related measures of discrimination. IEEE Transactions on Information Theory, 46:1602-1609, 2000.
18. S. van de Geer. Empirical Processes in M-Estimation. Cambridge University Press, 2000.
19. A. W. van der Vaart. Asymptotic Statistics. Cambridge University Press, 1998.
20. A. W. van der Vaart and J. Wellner. Weak Convergence and Empirical Processes. Springer-Verlag, New York, NY, 1996.
21. Q. Wang, S. R. Kulkarni, and S. Verdú. Divergence estimation of continuous distributions based on data-dependent partitions. IEEE Transactions on Information Theory, 51(9): 3064-3074, 2005.