Random design analysis of ridge regression

Journal of Machine Learning Research

Volumn 23, Issue , 2012, Pages

  Hsu, Daniel ^a   Kakade, Sham M ^a   Zhang, Tong ^b  

^a MICROSOFT RESEARCH   (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ERRORS; REGRESSION ANALYSIS;

CONCENTRATION INEQUALITY; COVARIANCE STRUCTURES; DESIGN ANALYSIS; ORDINARY LEAST SQUARES ESTIMATORS; PREDICTION ERRORS; RIDGE REGRESSION; RIDGE REGRESSION ESTIMATORS; SIMULTANEOUS ANALYSIS;

DESIGN;

EID: 84898046816     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (16)

1. J.-Y. Audibert and O. Catoni. Robust linear least squares regression, 2010a. arXiv:1010.0074.
2. J.-Y. Audibert and O. Catoni. Robust linear regression through PAC-Bayesian truncation, 2010b. arXiv:1010.0072.
3. A. Caponnetto and E. De Vito. Optimal rates for the regularized least-squares algorithm. Foundations of Computational Mathematics, 7(3):331-368, 2007.
4. O. Catoni. Statistical Learning Theory and Stochastic Optimization, Lectures on Probability and Statistics, Ecole d'Et́e de Probabilitíes de Saint-Flour XXXI - 2001, volume 1851 of Lecture Notes in Mathematics. Springer, 2004.
5. L. Gÿorfi, M. Kohler, A. Kryzak, and H. Walk. A Distribution-Free Theory of Nonparametric Regression. Springer, 2004.
6. A. E. Hoerl. Application of ridge analysis to regression problems. Chemical Engineering Progress, 58:54-59, 1962.
7. R. Horn and C. R. Johnson. Matrix Analysis. Cambridge University Press, 1985.
8. D. Hsu, S. M. Kakade, and T. Zhang. A tail inequality for quadratic forms of subgaussian random vectors, 2011. arXiv:1110.2842.
9. D. Hsu, S. M. Kakade, and T. Zhang. Tail inequalities for sums of random matrices that depend on the intrinsic dimension. Electronic Communications in Probability, 17(14):1-13, 2012.
10. V. Koltchinskii. Local Rademacher complexities and oracle inequalities in risk minimization. The Annals of Statistics, 34(6):2593-2656, 2006.
11. B. Laurent and P. Massart. Adaptive estimation of a quadratic functional by model selection. The Annals of Statistics, 28(5):1302-1338, 2000.
12. S. Smale and D.-X. Zhou. Learning theory estimates via integral operators and their approximations. Constructive Approximations, 26:153-172, 2007.
13. I. Steinwart, D. Hush, and C. Scovel. Optimal rates for regularized least squares regression. In Proceedings of the 22nd Annual Conference on Learning Theory, pages 79-93, 2009.
14. G. W. Stewart and J.-G. Sun. Matrix Perturbation Theory. Academic Press, 1990.
15. C. J. Stone. Optimal global rates of convergence for nonparametric regression. Annals of Statistics, 10:1040-1053, 1982.
16. T. Zhang. Learning bounds for kernel regression using effective data dimensionality. Neural Computation, 17:2077-2098, 2005.