High-dimensional additive modeling

Annals of Statistics

Volumn 37, Issue 6 B, 2009, Pages 3779-3821

  Meier, Lukas ^a   Van De Geer, Sara ^a   Bühlmann, Peter ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Group lasso; Model selection; Nonparametric regression; Oracle inequality; Penalized likelihood; Sparsity

Indexed keywords

EID: 73949083829     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/09-AOS692     Document Type: Article

References (34)

1. AGMON, S. (1965). Lectures on Elliptic Boundary Value Problems. Van Nostrand, Princeton, NJ. MR0178246
2. BARAUD, Y. (2002). Model selection for regression on a random design. ESAIM Probab. Stat. 6 127-146. MR1918295
3. BICKEL, P., RITOV, Y. and TSYBAKOV, A. (2009). Simultaneous analysis of lasso and Dantzig selector. Ann. Statist. 37 1705-1732. MR1056344
4. BOUSQUET, O. (2002). A Bennet concentration inequality and its application to suprema of empirical processes. C. R. Math. Acad. Sci. Paris 334 495-550. MR1890640
5. BÜHLMANN, P. and HOTHORN, T. (2007). Boosting algorithms: Regularization, prediction and model fitting. Statist. Sci. 22 477-505.
6. BÜHLMANN, P., KALISCH, M. and MAATHUIS, M. (2009). Variable selection for highdimensional models: Partially faithful distributions and the PC-simple algorithm. Technical report, ETH Zürich.
7. BÜHLMANN, P. and YU, B. (2003). Boosting with the L2 loss: Regression and classification. J. Amer. Statist. Assoc. 98 324-339. MR1995709
8. 1- penalized least squares. In Learning Theory. Lecture Notes in Computer Science 4005 379-391. Springer, Berlin. MR2280619
9. BUNEA, F., TSYBAKOV, A. and WEGKAMP, M. H. (2007). Sparsity oracle inequalities for the lasso. Electron. J. Stat. 1 169-194. MR2312149
10. CANDES, E. and TAO, T. (2007). The Dantzig selector: Statistical estimation when p is much larger than n. Ann. Statist. 35 2313-2351. MR2382644
11. CONLON, E. M., LIU, X. S., LIEB, J. D. and LIU, J. S. (2003). Integrating regulatory motif discovery and genome-wide expression analysis. Proc. Nat. Acad. Sci. U. S. A. 100 3339-3344.
12. FAN, J. and LV, J. (2008). Sure independence screening for ultra-high-dimensional feature space. J. R. Stat. Soc. Ser. B Stat. Methodol. 70 849-911.
13. GREEN, P. J. and SILVERMAN, B. W. (1994). Nonparametric Regression and Generalized Linear Models. Monographs on Statistics and Applied Probability 58. Chapman and Hall, London. MR1270012
14. GREENSHTEIN, E. and RITOV, Y. (2004). Persistency in high-dimensional linear predictorselection and the virtue of over-parametrization. Bernoulli 10 971-988. MR2108039
15. HÄRDLE, W., MÜLLER, M., SPERLICH, S. and WERWATZ, A. (2004). Nonparametric and Semiparametric Models. Springer, New York. MR2061786
16. KIM, Y, KIM, J. and KIM, Y (2006). BLOCKWISE sparse regression. STATIST. SINICA 16 375-390. MR2267240
17. KOLTCHINSKII, V. and YUAN, M. (2008). Sparse recovery in large ensembles of kernel machines. In COLT (R. A. Servedio and T. Zhang, eds.) 229-238. Omnipress, Madison, WI.
18. LEDOUX, M. and TALAGRAND, M. (1991). Probability in Banach Spaces: Isoperimetry and Processes. Springer, Berlin. MR1102015
19. LIN, Y. and ZHANG, H. H. (2006). Component selection and smoothing in multivariate nonparametric regression. Ann. Statist. 34 2272-2297. MR2291500
20. LIU, X. S., BRUTLAG, D. L. and LIU, J. S. (2002). An algorithm for finding protein-DNA binding sites with applications to chromatin-immunoprecipitation microarray experiments. Nature Biotechnology 20 835-839.
21. MEIER, L., VAN DE GEER, S. and BÜHLMANN, P. (2008). The group lasso for logistic regression. J. R. Stat. Soc. Ser. B Stat. Methodol. 70 53-71. MR2412631
22. MEINSHAUSEN, N. (2007). Relaxed Lasso. Comput. Statist. Data Anal. 52 374-393. MR2409990
23. MEINSHAUSEN, N. and BÜHLMANN, P. (2006). High-dimensional graphs and variable selection with the lasso. Ann. Statist. 34 1436-1462. MR2278363
24. MEINSHAUSEN, N. and YU, B. (2009). Lasso-type recovery of sparse representations for highdimensional data. Ann. Statist. 37 246-270. MR2488351
25. OSBORNE, M. R., PRESNELL, B. and TURLACH, B. A. (2000). On the lasso and its dual. J. Comput. Graph. Statist. 9 319-337. MR1822089
26. RAVIKUMAR, P., LIU, H., LAFFERTY, J. and WASSERMAN, L. (2008). Spam: Sparse additive models. In Advances in Neural Information Processing Systems 20 (J. Platt, D. Koller, Y. Singer and S. Roweis, eds.) 1201-1208. MIT Press, Cambridge, MA.
27. SARDY, S. and TSENG, P. (2004). Amlet, Ramlet, and Gamlet: Automatic nonlinear fitting of additive models, robust and generalized, with wavelets. J. Comput. Graph. Statist. 13 283-309. MR2063986
28. TIBSHIRANI, R. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58 267-288. MR1379242
29. VAN DE GEER, S. (2000). Empirical Processes in M-Estimation. Cambridge Univ. Press, Cambridge.
30. VAN DE GEER, S. (2008). HIGH-dimensional generalized linear models and the lasso. ANN. STATIST. 36 614-645. MR2396809
31. VAN DER VAART, A. and WELLNER, J. (1996). Weak Convergence and Empirical Processes. Springer, New York. MR1385671
32. YUAN, M. and LIN, Y. (2006). Model selection and estimation in regression with grouped variables. J. R. Stat. Soc. Ser. B Stat. Methodol. 68 49-67. MR2212574
33. ZHANG, C.-H. and HUANG, J. (2008). The sparsity and bias of the lasso selection in highdimensional linear regression. Ann. Statist. 36 1567-1594. MR2435448
34. ZOU, H. (2006). The adaptive lasso and its oracle properties. J. Amer. Statist. Assoc. 101 1418-1429. MR2279469