Mixing Strategies for Density Estimation

Annals of Statistics

Volumn 28, Issue 1, 2000, Pages 75-87

  Yang, Yuhong ^a  

^a Department of Statistics Center for Statistics and Applications in Forensic Evidence Iowa State University 2438 Osborn Dr Ames   (United States)

Author keywords

Adaptation with respect to estimation strategies; Density estimation; Minimax adaptation; Rates of convergence

Indexed keywords

EID: 0034410225     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/aos/1016120365     Document Type: Article

References (32)

1. BARRON, A. R. (1987). Are Bayes rules consistent in information? In Open Problems in Communication and Computation (T. M. Cover and B. Gopinath, eds.) 85-91. Springer, New York.
2. BARRON, A. R. (1988). The convergence in information of probability density estimators. Presented at the IEEE International Symposium on Information Theory, Kobe, Japan.
3. BARRON, A. R. and COVER, T. M. (1991), Minimum complexity density estimation. IEEE Trans. Inform. Theory 37 1034-1054.
4. BARRON, A. R., BIRGÉ, L. and MASSART, P. (1999) Risk bounds for model selection via penalization. Probability Theory and Related Fields 113 301-413.
5. BARRON, A. R., GYÖRFI, L. and VAN DE MEULEN, E. C. (1992). Distribution estimation consistent in total variation and in two types of information divergence. IEEE Trans. Inform. Theory 38 1437-1454.
6. BARRON, A. R. and XIE, Q. (1996). Asymptotic minimax regret for data compression, gambling, and prediction. Preprint.
7. BERGER, J. O. and PERICCHI, L. R. (1996). The intrinsic Bayes factor for model selection and prediction. J. Amer. Statist. Assoc. 91 109-122.
8. BIRGÉ, L. and MASSART, P. (1996). From model selection to adaptive estimation. In Research Papers in Probability and Statistics: Festschrift for Lucien Le Cam (D. Pollard, E. Torgersen and G. Yang, eds.) 55-91. Springer, New York.
9. BROWN, L. D. and LOW, M. G. (1996). A constrained risk inequality with applications to nonparametric functional estimation. Ann. Statis. 24 2524-2535.
10. CATONI, O. (1997). The mixture approach to universal model selection. Technical Report, LIENS-97-22, Ecole Normale Superieure, Paris, France.
11. CLARKE, B. and BARRON, A. R. (1990). Information-theoretic asymptotics of Bayes methods. IEEE Trans. Inform. Theory 36 453-471.
12. DEVORE, R. A. and LORENTZ, G. G. (1993). Constructive Approximation. Springer, New York.
13. DEVROYE, L., GYÖRFI, L. and LUGOSI, G. (1996). A Probabilistic Theory of Pattern Recognition. Springer, New York.
14. DONOHO, D. L., JOHNSTONE, I. M., KERKYACHARIAN, G. and PICARD, D. (1996). Density estimation by wavelet thresholding. Ann. Statist. 24 508-539.
15. EFROIMOVICH, S. YU. (1995). Nonparametric estimation of a density of unknown smoothness. Theory Probab. Appl. 30 557-568.
16. EFROIMOVICH, S. YU. and PINSKER, M. S. (1984). A self-educating nonparametric filtration algorithm. Automat. Remote Control 45 58-65.
17. FEDER, M. and MERHAV, M. (1996). Hierarchical universal coding. IEEE Trans. Inform. Theory 42 1354-1364.
18. HARDLE, W. and MARRON, J. S. (1985). Optimal bandwidth selection in nonparametric regression function estimation. Ann. Statist. 13 1465-1481.
19. HAUSSLER, D. and OPPER, M (1997). Mutual information, metric entropy and cumulative relative entropy risk. Ann. Statist. 25 2451-2492.
20. HUBER, P. J. (1985). Projection pursuit. Ann. Statist. 13 435-475.
21. JUDITSKY, A. (1997). Wavelet estimators: adapting to unknown smoothness. Math. Methods Statist. 6 1-25.
22. JUDITSKY, A. and NEMIROVSKI, A. (1996). Functional aggregation for nonparametric estimation. Publication Interne, IRISA 993.
23. KASS, R. E. and RAFTERY, A. E. (1995). Bayes factors. J. Amer. Statist. Assoc. 90 773-795.
24. LEPSKII, O. V. (1991). Asymptotically minimax adaptive estimation I: upper bounds. Optimally adaptive estimates. Theory Probab. Appl. 36 682-697.
25. LUGOSI, G. and NOBEL, A. (1999). Adaptive model selection using empirical complexities. Ann. Statist. 27 1830-1864.
26. TRIEBEL, H. (1975). Interpolation properties of ∈ -entropy and diameters. Geometric characteristics of embedding for function spaces of Sobolev-Besov type. Mat. Sbornik 98 27-41.
27. WILLEMS, F. M. J., SHTARKOV, Y. M. and TJALKENS, T. J. (1998). The context-tree weighting method: basic properties. IEEE Trans. Inform. Theory 41 653-664.
28. YANG, Y. (1996). Minimax optimal density estimation. Ph.D. dissertation, Dept. Statistics, Yale Univ.
29. YANG, Y. (1997). On adaptive function estimation. Technical Report 30, Dept. Statistics, Iowa State Univ.
30. YANG, Y. (1999). Model selection for nonparametric regression. Statist. Sinica 9 475-499.
31. YANG, Y. and BARRON, A. R. (1998). An asymptotic property of model selection criteria. IEEE Trans. Inform. Theory 44 95-116.
32. YANG, Y. and BARRON, A. R. (1999). Information-theoretic determination of minimax rates of convergence. Ann. Statist. 27 1564-1599.