Local rademacher complexities

Annals of Statistics

Volumn 33, Issue 4, 2005, Pages 1497-1537

  Bartlett, Peter L ^a   Bousquet, Olivier ^b   Mendelson, Shahar ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^c AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Concentration inequalities; Data dependent complexity; Error bounds; Rademacher averages

Indexed keywords

EID: 26444592981     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/009053605000000282     Document Type: Article

References (35)

1. BARTLETT, P. L., BOUCHERON, S. and LUGOSI, G. (2002). Model selection and error estimation. Machine Learning 48 85-113.
2. BARTLETT, P. L., JORDAN, M. I. and MCAULIFFE, J. D. (2005). Convexity, classification, and risk bounds. J. Amer. Statist. Assoc. To appear.
3. BARTLETT, P. L. and MENDELSON, S. (2002). Rademacher and Gaussian complexities: Risk bounds and structural results. J. Mach. Learn. Res. 3 463-482.
4. BARTLETT, P. L. and MENDELSON, S. (2003). Empirical minimization. Probab. Theory Related Fields. To appear. Available at www.stat.berkeley.edu/~bartlett/ papers/bm-em-03.pdf.
5. BOUCHERON, S., LUGOSI, G. and MASSART, P. (2000). A sharp concentration inequality with applications. Random Structures Algorithms 16 277-292.
6. BOUCHERON, S., LUGOSI, G. and MASSART, P. (2003). Concentration inequalities using the entropy method. Ann. Probab. 31 1583-1614.
7. BOUSQUET, O. (2002). A Bennett concentration inequality and its application to suprema of empirical processes. C. R. Math. Acad. Sci. Paris 334 495-500.
8. BOUSQUET, O. (2003). Concentration inequalities for sub-additive functions using the entropy method. In Stochastic Inequalities and Applications (E. Giné, C. Houdré and D. Nualart, eds.) 213-247. Birkhäuser, Boston.
9. BOUSQUET, O., KOLTCHINSKII, V. and PANCHENKO, D. (2002). Some local measures of complexity of convex hulls and generalization bounds. Computational Learning Theory. Lecture Notes in Artificial Intelligence 2375 59-73. Springer, Berlin.
10. DEVROYE, L., GYÖRFI, L. and LUGOSI, G. (1996). A Probabilistic Theory of Pattern Recognition. Springer, New York.
11. DUDLEY, R. M. (1999). Uniform Central Limit Theorems. Cambridge Univ. Press.
12. GYÖRFI, L., KOHLER, M., KRZYŻAK, A. and WALK, H. (2002). A Distribution-Free Theory of Nonparametric Regression. Springer, New York.
13. HAUSSLER, D. (1992). Decision theoretic generalizations of the PAC model for neural net and other learning applications. Inform, and Comput. 100 78-150.
14. HAUSSLER, D. (1995). Sphere packing numbers for subsets of the Boolean n-cube with bounded Vapnik-Chervonenkis dimension. J. Combin. Theory Ser. A 69 217-232.
15. KOLTCHINSKII, V. (2001). Rademacher penalties and structural risk minimization. IEEE Trans. Inform. Theory 47 1902-1914.
16. KOLTCHINSKII, V. and PANCHENKO, D. (2000). Rademacher processes and bounding the risk of function learning. In High Dimensional Probability II (E. Giné, D. M. Mason and J. A. Wellner, eds.) 443-459. Birkhäuser, Boston.
17. LEDOUX, M. and TALAGRAND, M. (1991). Probability in Banach Spaces: Isoperimetry and Processes. Springer, New York.
18. LEE, W. S., BARTLETT, P. L. and WILLIAMSON, R. C. (1998). The importance of convexity in learning with squared loss. IEEE Trans. Inform. Theory 44 1974-1980.
19. LUGOSI, G. and WEGKAMP, M. (2004). Complexity regularization via localized random penalties. Ann. Statist. 32 1679-1697.
20. MAMMEN, E. and TSYBAKOV, A. B. (1999). Smooth discrimination analysis. Ann. Statist. 27 1808-1829.
21. MASSART, P. (2000). About the constants in Talagrand's concentration inequalities for empirical processes. Ann. Probab. 28 863-884.
22. MASSART, P. (2000). Some applications of concentration inequalities to statistics. Probability theory. Ann. Fac. Sci. Toulouse Math. (6) 9 245-303.
23. MCDIARMID, C. (1998). Concentration. In Probabilistic Methods for Algorithmic Discrete Mathematics (M. Habib, C. McDiarmid, J. Ramirez-Alfonsin and B. Reed, eds.) 195-248. Springer, New York.
24. MENDELSON, S. (2002). Geometric parameters of kernel machines. Computational Learning Theory. Lecture Notes in Artificial Intelligence 2375 29-43. Springer, Berlin.
25. MENDELSON, S. (2002). Rademacher averages and phase transitions in Glivenko-Cantelli classes. IEEE Trans. Inform. Theory 48 251-263.
26. MENDELSON, S. (2002). Improving the sample complexity using global data. IEEE Trans. Inform. Theory 48 1977-1991.
27. MENDELSON, S. (2003). A few notes on statistical learning theory. Advanced Lectures on Machine Learning. Lecture Notes in Comput. Sci. 2600 1-40. Springer, New York.
28. POLLARD, D. (1984). Convergence of Stochastic Processes. Springer, Berlin.
29. RIO, E. (2001). Une inégalité de Bennett pour les maxima de processus empiriques. Ann. Inst. H. Poincaré Probab. Statist. 38 1053-1057.
30. TALAGRAND, M. (1994). Sharper bounds for Gaussian and empirical processes. Ann. Probab. 22 28-76.
31. VAN DE GEER, S. (1987). A new approach to least-squares estimation, with applications. Ann. Statist. 15 587-602.
32. VAN DE GEER, S. (2000). Empirical Processes in M-Estimation. Cambridge Univ. Press.
33. VAN DER VAART, A. (1998). Asymptotic Statistics. Cambridge Univ. Press.
34. VAN DER VAART, A. and WELLNER, J. A. (1996). Weak Convergence and Empirical Processes. With Applications of Statistics. Springer, New York.
35. VAPNIK, V. N. and CHERVONENKIS, A. Y. (1971). On the uniform convergence of relative frequencies of events to their probabilities. Theory Probab. Appl. 16 264-280.