Statistical properties of the method of regularization with periodic Gaussian reproducing kernel

Annals of Statistics

Volumn 32, Issue 4, 2004, Pages 1723-1743

  Lin, Yi ^a,c   Brown, Lawrence D ^b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

^c University of Wisconsin Madison   (United States)

Author keywords

Asymptotic minimax risk; Gaussian reproducing kernel; Nonparametric estimation; Rate of convergence; Sobolev spaces; White noise model

Indexed keywords

EID: 24344444131     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/009053604000000454     Document Type: Article

References (22)

1. BROWN, L. D. and Low, M. G. (1996). Asymptotic equivalence of nonparametric regression and white noise. Ann. Statist. 24 2384-2398.
2. BROWN, L. D. and ZHAO, L. H. (2002). Direct asymptotic equivalence of nonparametric regression and the infinite dimensional location problem. Technical report. Available at http://ljsavage.wharton.upenn.edu/~lzhao/papers/.
3. CARTER, C. K., EAGLESON, G. K. and SILVERMAN, B. W. (1992). Comparison of the Reinsch and Speckman splines. Biometrika 79 81-91.
4. CAVALIER, L., GOLUBEV, G. K., PICARD, D. and TSYBAKOV, A. B. (2002). Oracle inequalities for inverse problems. Ann. Statist. 30 843-874.
5. EVGENIOU, T., PONTIL, M. and POGGIO, T. (2000). Regularization networks and support vector machines. Adv. Comput. Math. 13 1-50.
6. GIOSI, F., JONES, M. and POGGIO, T. (1993). Priors, stabilizers and basis functions: From regularization to radial, tensor and additive splines. M.I.T. Artificial Intelligence Laboratory Memo 1430, C.B.C.I. Paper 75.
7. GOLUBEV, G. and NUSSBAUM, M. (1998). Asymptotic equivalence of spectral density and regression estimation. Technical report, Weierstrass Institute for Applied Analysis and Stochastics, Berlin.
8. GRAMA, I. and NUSSBAUM, M. (1997). Asymptotic equivalence for nonparametric generalized linear models. Technical report, Weierstrass Institute for Applied Analysis and Stochastics, Berlin.
9. GU, C. (2002). Smoothing Spline ANOVA Models. Springer, New York.
10. JOHNSTONE, I. M. (1998). Function estimation in Gaussian noise: Sequence models. Draft of a monograph.
11. KIMELDORF, G. S. and WAHBA, G. (1971). Some results on Tchebycheffian spline functions. J. Math. Anal. Appl. 33 82-95.
12. KNEIP, A. (1994). Ordered linear smoothers. Ann. Statist. 22 835-866.
13. LI, K.-C. (1986). Asymptotic optimality of CL and generalized cross-validation in ridge regression with application to spline smoothing. Ann. Statist. 14 1101-1112.
14. L, cross-validation and generalized cross-validation: Discrete index set. Ann. Statist. 15 958-975.
15. p. Technometrics 15 661-675.
16. NUSSBAUM, M. (1996). Asymptotic equivalence of density estimation and Gaussian white noise. Ann. Statist. 24 2399-2430.
17. PINSKER, M. (1980). Optimal filtering of square integrable signals in Gaussian white noise. Problems Inform. Transmission 16 120-133.
18. SCHÖLKOPF, B., HERBRICH, R. and SMOLA, A. J. (2001). A generalized representer theorem. In Proc. Fourteenth Annual Conference on Computational Learning Theory. Lecture Notes in Comput. Sci. 2111 416-426. Springer, London.
19. SMOLA, A. J., SCHÖLKOPF, B. and MÜLLER, K. (1998). The connection between regularization operators and support vector kernels. Neural Networks 11 637-649.
20. WAHBA, G. (1990). Spline Models for Observational Data. SIAM, Philadelphia.
21. WAHBA, G. (1999). Support vector machines, reproducing kernel Hilbert spaces and randomized GACV. In Advances in Kernel Methods: Support Vector Learning (B. Schölkopf, C. J. Burges and A. J. Smola, eds.) 69-88. MIT Press, Cambridge, MA.
22. WILLIAMSON, R. C., SMOLA, A. J. and SCHÖLKOPF, B. (2001). Generalization performance of regularization networks and support vector machines via entropy numbers of compact operators. IEEE Trans. Inform. Theory 47 2516-2532.