On the uniform convergence of empirical norms and inner products, with application to causal inference

Electronic Journal of Statistics

Volumn 8, Issue 1, 2014, Pages 543-574

  van de Geer, Sara ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Additive model; Causal inference; Empirical measure; Uniform convergence

Indexed keywords

EID: 84902481901     PISSN: 19357524     EISSN: None     Source Type: Journal    
DOI: 10.1214/14-EJS894     Document Type: Article

References (35)

1. Adamczak, R., Litvak, A. E., Pajor, A., and Tomczak-Jaegermann, N., Sharp bounds on the rate of convergence of the empirical covariance matrix. Comptes Rendus Mathematique, 349(3): 195-200, 2011. MR2769907.
2. Agmon, S. and Jones, F., Lectures on elliptic boundary value problems Elliptic boundary value problems Van Nostrand mathematical studies. Van Nostrand, 1965. MR0178246.
3. Ahlswede, R. and Winter, A., Strong converse for identification via quantum channels. Information Theory, IEEE Transactions on, 48(3): 569-579, 2002. MR1889969.
4. Bartlett, P., Bousquet, O., and Mendelson, S., Local rademacher complexities. The Annals of Statistics, 33(4): 1497-1537, 2005. MR2166554.
5. Bartlett, P. L., Mendelson, S., and Neeman, J., ℓ1-regularized linear regression: persistence and oracle inequalities. Probability Theory and Related Fields, 154(1-2): 193-224, 2012. MR2981422.
6. Bickel, P., Ritov, Y., and Tsybakov, A., Simultaneous analysis of Lasso and Dantzig selector. Annals of Statistics, 37: 1705-1732, 2009. MR2533469.
7. Birman, M. Š. and Solomjak, M. Z., Piecewise-polynomial approximations of functions of the classes Wα p. Mathematics of the USSR-Sbornik, 2: 295-317, 1967. MR0217487.
8. Bühlmann, P., Peters, J., and Ernest, J., CAM: Causal Additive Models, high-dimensional order search and penalized regression, 2013. ArXiv: 1310. 1533. MR3072790.
9. Chen, S. S., Donoho, D. L., and Saunders, M. A., Atomic decomposition by basis pursuit. SIAM Journal on Scientific Computing, 20(1): 33-61, 1998. MR1639094.
10. Dudley, R. M., The sizes of compact subsets of hilbert space and continuity of Gaussian processes. Journal of Functional Analysis, 1(3): 290-330, 1967. MR0220340.
11. Giné, E. and Koltchinskii, V., Concentration inequalities and asymptotic results for ratio type empirical processes. The Annals of Probability, 34(3): 1143-1216, 2006. MR2243881.
12. Guédon, O., Mendelson, S., Pajor, A., and Tomczak-Jaegermann, N., Subspaces and orthogonal decompositions generated by bounded orthogonal systems. Positivity, 11(2): 269-283, 2007. MR2321621.
13. Koltchinskii, V., A remark on low rank matrix recovery and noncommutative Bernstein type inequalities. In IMS Collections From Probabil-ity to Statistics and Back: High-Dimensional Models and Processes, volume 9, pages 213-226. Institute of Mathematical Statistics, Beachwood, Ohio, 2013. Banerjee, M., Bunea, F., Huang, J., Koltchinskii, V., and Maathuis, M. H., eds.
14. Lecué, G. and Mendelson, S., Performance of empirical risk minimization in linear aggregation, 2014. ArXiv: 1402. 5763.
15. Ledoux, M. and Talagrand, M., Probability in Banach Spaces: Isoperimetry and Processes. Springer Verlag, New York, 1991. MR1102015.
16. Loh, P.-L. and Wainwright, M. J., High-dimensional regression with noisy and missing data: Provable guarantees with non-convexity. Annals of Statistics, 40: 1637-1664, 2012. MR3015038.
17. Lugosi, G. and Nobel, A., Adaptive model selection using empirical complexities. Annals of Statistics, 27: 1830-1864, 1999. MR1765619.
18. Massart, P., About the constants in Talagrand's concentration inequalities for empirical processes. Annals of Probability, 28: 863-884, 2000. MR1782276.
19. Meier, L., Van de Geer, S., and Bühlmann, P., High-dimensional additive modeling. The Annals of Statistics, 37(6B): 3779-3821, 2009. MR2572443.
20. Müller, P. and van de Geer, S. A., The partial linear model in high dimensions, 2013. Submitted. ArXiv: 1307. 1067.
21. Nickl, R. and Pötscher, B., Bracketing metric entropy rates and empirical central limit theorems for function classes of Besov-and Sobolev-type. Journal of Theoretical Probability, 20(2): 177-199, 2007. MR2324525.
22. Nickl, R. and van de Geer, S. A., Confidence sets in sparse regression. The Annals of Statistics, 41: 2852-2876, 2013. MR3161450.
23. Pollard, D., Convergence of Stochastic Processes. Springer, 1984. MR0762984.
24. Raskutti, G., Wainwright, M. J., and Yu, B., Restricted eigenvalue properties for correlated Gaussian designs. Journal of Machine Learning Research, 11: 2241-2259, 2010. MR2719855.
25. Rudelson, M. and Vershynin, R., On sparse reconstruction from Fourier and Gaussian measurements. Communications on Pure and Ap-plied Mathematics, 61(8): 1025-1045, 2008. MR2417886.
26. Rudelson, M. and Zhou, S., Reconstruction from anisotropic random measurements. IEEE Transactions on Information Theory, 59: 3434-3447, 2013. MR3061256.
27. Talagrand, M., Concentration of measure and isoperimetric inequalities in product spaces. Publications Mathématiques de l'IHES, 81: 73-205, 1995. MR1361756.
28. van de Geer, S., Empirical Processes in M-Estimation. Cambridge University Press, 2000. MR1739079.
29. van de Geer, S., The deterministic Lasso. The JSM Proceedings, 2007.
30. van de Geer, S. and Bühlmann, P., On the conditions used to prove oracle results for the Lasso. Electronic Journal of Statistics, pages 1360-1392, 2009. MR2576316.
31. van de Geer, S. A., Empirical Processes in M-Estimation. Cambridge, 2000.
32. van de Geer, S. A. and Bühlmann, P., ℓ0-penalized maximum likelihood for sparse directed acyclic graphs. The Annals of Statistics, 41: 536-567, 2013. MR3099113.
33. van de Geer, S. A. and Muro, A., The additive model with different smoothness for the components, 2014. In progress.
34. van de Geer, S. A., Bühlmann, P., Ritov, Y., and Dezeure, R., On asymptotically optimal confidence regions and tests for high-dimensional models. The Annals of Statistics, 2014. To appear.
35. van der Vaart, A. W. and Wellner, J. A., Weak Convergence and Empirical Processes. Springer Series in Statistics. Springer-Verlag, New York, 1996. ISBN 0-387-94640-3. MR1385671.