Estimating divergence functionals and the likelihood ratio by penalized convex risk minimization

Advances in Neural Information Processing Systems 20 - Proceedings of the 2007 Conference

Volumn , Issue , 2008, Pages

  Nguyen, Xuan Long ^a   Wainwright, Martin J ^b   Jordan, Michael I ^b  

^a DUKE UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ESTIMATION; RISK PERCEPTION;

CONVERGENCE BEHAVIORS; CONVERGENCE RATES; DENSITY RATIO; ESTIMATION ALGORITHM; FUNCTIONALS; LIKELIHOOD RATIOS; MINIMIZATION PROBLEMS; NON-PARAMETRIC ESTIMATIONS; PROBABILITY: DISTRIBUTIONS; RISK MINIMIZATION;

PROBABILITY DISTRIBUTIONS;

EID: 85161959021     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. S. M. Ali and S. D. Silvey. A general class of coefficients of divergence of one distribution from another. J. Royal Stat. Soc. Series B, 28:131-142, 1966.
2. P. L. Bartlett, M. I. Jordan, and J. D. McAuliffe. Convexity, classification, and risk bounds. Journal of the American Statistical Association, 101:138-156, 2006. (Pubitemid 43500031)
3. P. Bickel and Y. Ritov. Estimating integrated squared density derivatives: Sharp best order of convergence estimates. Sankhyā Ser. A, 50:381-393, 1988.
4. L. Birgé and P. Massart. Estimation of integral functionals of a density. Ann. Statist., 23(1):11-29, 1995.
5. M. Broniatowski and A. Keziou. Parametric estimation and tests through divergences. Technical report, LSTA, Université Pierre et Marie Curie, 2004.
6. I. Csiszár. Information-type measures of difference of probability distributions and indirect observation. Studia Sci. Math. Hungar, 2:299-318, 1967.
7. L. Gyorfi and E.C. van der Meulen. Density-free convergence properties of various estimators of entropy. Computational Statistics and Data Analysis, 5:425-436, 1987.
8. P. Hall and S. Morton. On estimation of entropy. Ann. Inst. Statist. Math., 45(1):69-88, 1993.
9. I. A. Ibragimov and R. Z. Khasminskii. On the nonparametric estimation of functionals. In Symposium in Asymptotic Statistics, pages 41-52, 1978.
10. H. Joe. Estimation of entropy and other functionals of a multivariate density. Ann. Inst. Statist. Math., 41:683-697, 1989.
11. A. Keziou. Dual representation of Á-divergences and applications. C. R. Acad. Sci. Paris, Ser. I 336, pages 857-862, 2003.
12. B. Laurent. Efficient estimation of integral functionals of a density. Ann. Statist., 24(2):659-681, 1996.
13. B. Ya. Levit. Asymptotically efficient estimation of nonlinear functionals. Problems Inform. Transmission, 14:204-209, 1978. (Pubitemid 9463875)
14. X. Nguyen, M. J. Wainwright, and M. I. Jordan. On divergences, surrogate losses and decentralized detection. Technical Report 695, Dept of Statistics, UC Berkeley, October 2005.
15. X. Nguyen, M. J. Wainwright, and M. I. Jordan. Nonparametric estimation of the likelihood ratio and divergence functionals. In International Symposium on Information Theory (ISIT), 2007.
16. G. Rockafellar. Convex Analysis. Princeton University Press, Princeton, 1970.
17. S. Saitoh. Theory of Reproducing Kernels and its Applications. Longman, Harlow, UK, 1988.
18. B. Schölkopf and A. Smola. Learning with Kernels. MIT Press, Cambridge, MA, 2002.
19. F. Topsoe. Some inequalities for information divergence and related measures of discrimination. IEEE Transactions on Information Theory, 46:1602-1609, 2000.
20. S. van de Geer. Empirical Processes in M-Estimation. Cambridge University Press, 2000.
21. A. W. van der Vaart and J. Wellner. Weak Convergence and Empirical Processes. Springer-Verlag, New York, NY, 1996.
22. Q. Wang, S. R. Kulkarni, and S. Verdú. Divergence estimation of continuous distributions based on data-dependent partitions. IEEE Transactions on Information Theory, 51(9):3064-3074, 2005. (Pubitemid 41430975)
23. D. X. Zhou. The covering number in learning theory. Journal of Complexity, 18:739-767, 2002.