Aggregation and sparsity via ℓ1 penalized least squares

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4005 LNAI, Issue , 2006, Pages 379-391

  Bunea, Florentina ^a   Tsybakov, Alexandre B ^b,c   Wegkamp, Marten H ^a  

^a FLORIDA STATE UNIVERSITY   (United States)

^b SORBONNE UNIVERSITÉ   (France)

^c INSTITUTE FOR INFORMATION TRANSMISSION PROBLEMS   (Russian Federation)

Author keywords

[No Author keywords available]

Indexed keywords

FUNCTIONS; LEARNING ALGORITHMS; PARAMETER ESTIMATION; REGRESSION ANALYSIS;

NONPARAMETRIC REGRESSION SETTING; OPTIMAL RATES; PENALIZED LEAST SQUARES;

LEAST SQUARES APPROXIMATIONS;

EID: 33746056860     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11776420_29     Document Type: Conference Paper

References (18)

1. Baraud, Y.: Model selection for regression on a random design. ESAIM Probability & Statistics. 7 (2002) 127-146.
2. Birgé, L.: Model selection for Gaussian regression with random design, Prépublication n. 783, Laboratoire de Probabilités et Modèles Aléatoires, Universités Paris 6 - Paris 7 (2002). http://www.proba.jussieu.fr/mathdoc/preprints/index.html#2002.
3. Birgé, L., Massart, P.: Minimum contrast estimators on sieves: Exponential bounds and rates of convergence. Bernouilli 4 (1998) 329-375.
4. Bunea, F., Tsybakov, A., Wegkamp, M.H.: Aggregation for Gaussian regression. Preprint (2005). http://www.stat.fsu.edu/~wegkamp.
5. Bunea, F., Wegkamp, M.: Two stage model selection procedures in partially linear regression. The Canadian Journal of Statistics 22 (2004) 1-14.
6. Candes, E., Tao, T.: The Dantzig selector: statistical estimation when p is much larger than n. Preprint (2005).
7. Catoni, O.: Statistical Learning Theory and Stochastic Optimization, Ecole d'Eté de Probabilités de Saint-Flour 2001, Lecture Notes in Mathematics, Springer, N.Y. (2004).
8. Donoho, D.L., Johnstone, I.M.: Ideal spatial adaptation by wavelet shrinkage. Biometrika 81 (1994) 425-455.
9. Györfi, L., Kohler, M., Krzyżak, A., Walk, H.: A Distribution-Free Theory of Non-parametric Regression. Springer, N.Y.(2002).
10. Juditsky, A., Nemirovski, A.: Functional aggregation for nonparametric estimation. Annals of Statistics 28 (2000) 681-712.
11. Kerkyacharian, G., Picard, D.: Tresholding in learning theory. Prépublication n. 1017, Laboratoire de Probabilités et Modèles Aléatoires, Universités Paris 6 - Paris 7. http://www.proba.jussieu.fr/mathdoc/preprints/index.html#2005.
12. Koltchinskii, V.: Model selection and aggregation in sparse classification problems. Oberwolfach Reports: Meeting on Statistical and Probabilistic Methods of Model Selection, October 2005 (to appear).
13. Nemirovski, A.: Topics in Non-parametric Statistics. Ecole d'Eté de Probabilités de Saint-Flour XXVIII - 1998, Lecture Notes in Mathematics, v. 1738, Springer, N.Y. (2000).
14. Tibshirani, R.: Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society, Series B. 58 (1996) 267-288.
15. Tsybakov, A.B.: Optimal rates of aggregation. Proceedings of 16th Annual Conference on Learning Theory (COLT) and 7th Annual Workshop on Kernel Machines. Lecture Notes in Artificial Intelligence 2777 303-313. Springer-Verlag, Heidelberg (2003).
16. Wegkamp, M.H.: Model selection in nonparametric regression. Annals of Statistics 31 (2003) 252-273.
17. Yang, Y.: Combining different procedures for adaptive regression. J.of Multivariate Analysis 74 (2000) 135-161.
18. Yang, Y.: Aggregating regression procedures for a better performance. Bernoulli 10 (2004) 25-47.