From stochastic mixability to fast rates

Advances in Neural Information Processing Systems

Volumn 2, Issue January, 2014, Pages 1197-1205

  Mehta, Nishant A ^a   Williamson, Robert C ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION SCIENCE; STOCHASTIC MODELS;

EMPIRICAL RISK MINIMIZATION; JOINT PROPERTY; LEARNING RULES; MODELS OF LEARNING; MOMENT PROBLEMS; RATES OF CONVERGENCE; STATISTICAL LEARNING; STATISTICAL PREDICTION;

STOCHASTIC SYSTEMS;

EID: 84937879849     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Jacob Abernethy, Alekh Agarwal, Peter L. Bartlett, and Alexander Rakhlin. A stochastic view of optimal regret through minimax duality. In Proceedings of the 22nd Annual Conference on Learning Theory (COLT 2009), 2009.
2. Jean-Yves Audibert. Fast learning rates in statistical inference through aggregation. The Annals of Statistics, 37(4): 1591-1646, 2009.
3. Peter L. Bartlett, Olivier Bousquet, and Shahar Mendelson. Local Rademacher complexities. The Annals of Statistics, 33(4): 1497-1537, 2005.
4. Peter L. Bartlett and Shahar Mendelson. Empirical minimization. Probability Theory and Related Fields, 135(3): 311-334, 2006.
5. Stéphane Boucheron, Gábor Lugosi, and Pascal Massart. Concentration inequalities: A nonasymptotic theory of independence. Oxford University Press, 2013.
6. Peter Grünwald. Safe learning: bridging the gap between Bayes, MDL and statistical learning theory via empirical convexity. In Proceedings of the 24th International Conference on Learning Theory (COLT 2011), pages 397-419, 2011.
7. Peter Grünwald. The safe Bayesian. In Proceedings of the 23rd International Conference on Algorithmic Learning Theory (ALT 2012), pages 169-183. Springer, 2012.
8. Yuri Kalnishkan and Michael V. Vyugin. The weak aggregating algorithm and weak mixability. In Proceedings of the 18th Annual Conference on Learning Theory (COLT 2005), pages 188-203. Springer, 2005.
9. Johannes H.B. Kemperman. The general moment problem, a geometric approach. The Annals of Mathematical Statistics, 39(1): 93-122, 1968.
10. Vladimir Koltchinskii. Local Rademacher complexities and oracle inequalities in risk minimization. The Annals of Statistics, 34(6): 2593-2656, 2006.
11. Vladimir Koltchinskii. Oracle Inequalities in Empirical Risk Minimization and Sparse Recovery Problems: Ecole d'Eté de Probabilités de Saint-Flour XXXVIII-2008, Volume 2033. Springer, 2011.
12. Guillaume Lecué. Interplay between concentration, complexity and geometry in learning theory with applications to high dimensional data analysis. Habilitation à diriger des recherches, Université Paris-Est, 2011.
13. Wee Sun Lee, Peter L. Bartlett, and Robert C. Williamson. The importance of convexity in learning with squared loss. IEEE Transactions on Information Theory, 44(5): 1974-1980, 1998.
14. Jonathan Qiang Li. Estimation of mixture models. PhD thesis, Yale University, 1999.
15. Enno Mammen and Alexandre B. Tsybakov. Smooth discrimination analysis. The Annals of Statistics, 27(6): 1808-1829, 1999.
16. Pascal Massart and Élodie Nédélec. Risk bounds for statistical learning. The Annals of Statistics, 34(5): 2326-2366, 2006.
17. Shahar Mendelson. Lower bounds for the empirical minimization algorithm. IEEE Transactions on Information Theory, 54(8): 3797-3803, 2008.
18. Shahar Mendelson. Obtaining fast error rates in nonconvex situations. Journal of Complexity, 24(3): 380-397, 2008.
19. Shahar Mendelson and Robert C. Williamson. Agnostic learning nonconvex function classes. In Proceedings of the 15th Annual Conference on Computational Learning Theory (COLT 2002), pages 1-13. Springer, 2002.
20. Alexander B. Tsybakov. Optimal aggregation of classifiers in statistical learning. The Annals of Statistics, 32(1): 135-166, 2004.
21. Tim Van Erven, Peter D. Grünwald, Mark D. Reid, and Robert C. Williamson. Mixability in statistical learning. In Advances in Neural Information Processing Systems 25 (NIPS 2012), pages 1700-1708, 2012.
22. Mathukumalli Vidyasagar. Learning and Generalization with Applications to Neural Networks. Springer, 2002.
23. Volodya Vovk. A game of prediction with expert advice. Journal of Computer and System Sciences, 56(2): 153-173, 1998.
24. Volodya Vovk. Competitive on-line statistics. International Statistical Review, 69(2): 213-248, 2001.