Safe learning: Bridging the gap between Bayes, MDL and statistical learning theory via empirical convexity

Journal of Machine Learning Research

Volumn 19, Issue , 2011, Pages 397-419

  Grünwald, Peter ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

REGRESSION ANALYSIS;

BAYESIAN MAP; LEARNING RATES; MINIMUM DESCRIPTION LENGTH; OPTIMAL RATE; REGRESSION MODEL; STATISTICAL LEARNING THEORY;

STATISTICAL TESTS;

EID: 84877737581     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (16)

1. J.Y. Audibert. PAC-Bayesian statistical learning theory. PhD thesis, Université Paris VI, 2004.
2. A.R. Barron and T.M. Cover. Minimum complexity density estimation. IEEE Transactions on Information Theory, 37(4):1034-1054, 1991.
3. A. Blumer, A. Ehrenfeucht, D. Haussier, and M. Warmuth. Occam's razor. Information Processing Letters, 24:377-380, 1987.
4. L. Breiman. Statistical modeling: the two cultures (with discussion). Statistical Science, 16(3):199 -215, 2001.
5. O. Catoni. PAC-Bayesian Supervised Classification. Lecture Notes-Monograph Series. IMS, 2007.
6. A.P. Dawid. The well-calibrated Bayesian. Journal of the American Statistical Association, 77:605-611, 1982. Discussion: pages 611-613.
7. J.L. Doob. Application of the theory of martingales. In Le Calcul de Probabilités et ses Applications. Colloques Internationaux du Centre National de la Recherche Scientifique, pages 23-27, Paris, 1949.
8. P. Grünwald. The Minimum Description Length Principle. MIT Press, Cambridge, MA, 2007.
9. P. Grünwald and J. Langford. Suboptimal behavior of Bayes and MDL in classification under misspecification. Machine Learning, 66(2-3):119-149, 2007. DOI 10.1007/s10994007-0716-7. (Pubitemid 46360609)
10. P. D. Grünwald. Viewing all models as "probabilistic". In Proceedings of the Twelfth ACM Conference on Computational Learning Theory (COLT' 99), pages 171-182, 1999.
11. B. Kleijn and A. van der Vaart. Misspecification in infinite-dimensional Bayesian statistics. Annals of Statistics, 34(2), 2006.
12. J.Q. Li. Estimation of Mixture Models. PhD thesis, Yale University, New Haven, CT, 1999.
13. E. Mammen and A.B. Tsybakov. Smooth discrimination analysis. Annals of Statistics, 27: 1808-1829, 1999.
14. D. McAllester. PAC-Bayesian stochastic model selection. Machine Learning, 51(1):5-21, 2003.
15. A.B. Tsybakov. Optimal aggregation of classifiers in statistical learning. Annals of Statistics, 32:135-166, 2004. (Pubitemid 41449306)
16. Tong Zhang. From ε-entropy to KL entropy: analysis of minimum information complexity density estimation. Annals of Statistics, 34(5):2180-2210, 2006.