Lower bounds for the minimax risk using f-divergences, and applications

IEEE Transactions on Information Theory

Volumn 57, Issue 4, 2011, Pages 2386-2399

  Guntuboyina, Adityanand ^a  

^a YALE UNIVERSITY   (United States)

Author keywords

f Divergences; Fano's inequality; minimax lower bounds; Pinsker's inequality; reconstruction from support functions

Indexed keywords

F-DIVERGENCES; FANO'S INEQUALITY; MINIMAX; PINSKER'S INEQUALITY; RECONSTRUCTION FROM SUPPORT FUNCTIONS;

COVARIANCE MATRIX;

RISK PERCEPTION;

EID: 79952844965     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2011.2110791     Document Type: Article

References (28)

1. Y. Yang and A. Barron, "Information-theoretic determination of minimax rates of convergence," Ann. Stat., vol. 27, pp. 1564-1599, 1999.
2. S. M. Ali and S. D. Silvey, "A general class of coefficients of divergence of one distribution from another," J. Roy. Stat. Soc. B, vol. 28, pp. 131-142, 1996.
3. I. Csiszar, "A note on Jensen's inequality," Studia Scientarium Mathematicarum Hungarica, vol. 1, pp. 185-188, 1966.
4. I. Csiszar, "Information-type measures of difference of probability distributions and indirect observations," Studia Scientarium Mathematicarum Hungarica, vol. 2, pp. 299-318, 1967.
5. I. Csiszar, "On topological properties of f-divergences," Studia Scientarium Mathematicarum Hungarica, vol. 2, pp. 329-339, 1967.
6. I. Ibragimov and R. Z. Has'minskii, "A problem of statistical estimation in Gaussian white noise," Dokl. Akad. Nauk SSSR, vol. 236, pp. 1053-1055, 1977.
7. I. Ibragimov and R. Z. Has'minskii, "On estimate of the density function," Zap. Nauchn. Semin. LOMI, pp. 61-85, 1980.
8. I. A. Ibragimov and R. Z. Has'minskii, Statistical Estimation: Asymptotic Theory. New York: Springer-Verlag, 1981.
9. R. Z. Has'minskii, "A lower bound on the risk of nonparametric estimates of densities in the uniform metric," Theory Probab. Its Appl., vol. 23, pp. 794-798, 1978.
10. L. Birgé, "Approximation dans les espaces metriques et theorie de l'estimation," Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete, vol. 65, pp. 181-237, 1983.
11. L. Birgé, "On estimating a density using Hellinger distance and some other strange facts," Probab. Theory Related Fields, vol. 71, pp. 271-291, 1986.
12. F. Topsøe, "Some inequalities for information divergence and related measures of discrimination," IEEE Trans. Inf. Theory, vol. 46, pp. 1602-1609, 2000.
13. T. T. Cai, C.-H. Zhang, and H. H. Zhou, "Optimal rates of convergence for covariance matrix estimation," Ann. Stat., vol. 38, pp. 2118-2144, 2010.
14. A. A. Gushchin, "On Fano's lemma and similar inequalities for the minimax risk," Theor. Probab. Math. Stat., vol. 67, pp. 29-41, 2003.
15. M. D. Reid and R. C. Williamson, "Generalized Pinsker inequalities," in Proc. 22nd Annu. Conf. Learn. Theory, 2009.
16. T. Cover and J. Thomas, Elements of Information Theory, 2nd ed. Hoboken, NJ: Wiley, 2006.
17. T. S. Han and S. Verdú, "Generalizing the Fano inequality," IEEE Trans. Inf. Theory, vol. 40, pp. 1247-1251, 1994.
18. L. Birgé, "A new bound for multiple hypothesis testing," IEEE Trans. Inf. Theory, vol. 51, pp. 1611-1615, 2005. (Pubitemid 40555903)
19. L. Le Cam, Asymptotic Methods in Statistical Decision Theory. New York: Springer-Verlag, 1986.
20. A. Tsybakov, Introduction to Nonparametric Estimation. New York: Springer-Verlag, 2009.
21. A. S. Nemirovski, "Topics in nonparametric statistics," in Lecture on Probability Theory and Statistics, École d'Été de Probabilitiés de Saint-flour XXVIII-1998. Berlin, Germany: Springer-Verlag, 2000, vol. 1738, Lecture Notes in Mathematics.
22. L. Le Cam, "Convergence of estimates under dimensionality restrictions," Ann. Stat., vol. 1, pp. 38-53, 1973.
23. R. Schneider, Convex Bodies: The Brunn-Minkowski Theory. Cambridge, U.K.: Cambridge Univ. Press, 1993.
24. R. T. Rockafellar, Convex Analysis. Princeton, NJ: Princeton Univ. Press, 1970.
25. R. Gardner,M. Kiderlen, and P. Milanfar, "Convergence of algorithms for reconstructing convex bodies and directional measures," Ann. Stat., vol. 34, pp. 1331-1374, 2006. (Pubitemid 44231165)
26. E. M. Bronshtein, "ε-Entropy of convex sets and functions," Siberian Math. J., vol. 17, pp. 393-398, 1976.
27. P. Massart, Concentration Inequalities and Model Selection. Lecture Notes in Mathematics. Berlin, Germany: Springer, 2007, vol. 1896.
28. B. Yu, "Assouad, Fano, and Le Cam," in Festschrift for Lucien Le Cam: Research Papers in Probability and Statistics, D. Pollard, E. Torgersen, and G. L. Yang, Eds. New York: Springer-Verlag, 1997, pp. 423-435.