An introduction to reproducing kernel hilbert spaces and why they are so useful

IFAC Proceedings Volumes (IFAC-PapersOnline)

Volumn 36, Issue 16, 2003, Pages 525-528

  Wahba, Grace ^a  

^a University of Wisconsin   (United States)

Author keywords

bias variance tradeoff; ill posed inverse problems; optimization; representers; reproducing kernel Hilbert spaces; RKHS; tuning parameters

Indexed keywords

CURVE FITTING; DIFFERENTIAL EQUATIONS; HILBERT SPACES; OPTIMIZATION; RELIGIOUS BUILDINGS; VECTOR SPACES;

BIAS-VARIANCE TRADEOFFS; ILL-POSED INVERSE PROBLEM; REPRESENTERS; REPRODUCING KERNEL HILBERT SPACES; RKHS; TUNING PARAMETER;

INVERSE PROBLEMS;

EID: 84874384553     PISSN: 14746670     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1016/S1474-6670(17)34815-2     Document Type: Conference Paper

References (34)

1. N. Akhiezer, and I. Glazman Theory of Linear Operators in Hilbert Space, Ungar New York. 1963
2. N. Aronszajn Theory of reproducing kernels' Trans. Am. Math. Soc 68 1950 337 404
3. P. Craven, and G. Wahba Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the method of generalized cross-validation Numer. Math 31 1979 377 403
4. F. Gao, G. Wahba, R. Klein, and B. Klein Smoothing spline ANOVA for multivariate Bernoulli observations, with applications to ophthalmology data, with discussion J. Amer. Statist. Assoc 96 2001 127 160
5. G. Golub, M. Heath, and G. Wahba Generalized cross validation as a method for choosing a good ridge parameter Technometrics 21 1979 215 224
6. C. Gu, and G. Wahba Minimizing GCV/GML scores with multiple smoothing parameters via the Newton method SIAM J. Sci. Statist. Comput 12 1991 383 398
7. P. Halmos Introduction to Hilbert Space and the Theory of Spectral Multiplicity 1957 Chelsea New York.
8. G. Kimeldorf, and G. Wahba Some results on Tchebycheffian spline functions' J. Math. Anal. Applic 33 1971 82 95
9. Y. Lee, Y. Lin, and G. Wahba Multicategory support vector machines, theory, and application to the classification of microarray data and satellite radiance data Technical Report 1064 2002 Department of Statistics University of Wisconsin, Madison WI
10. X. Lin Smoothing spline analysis of variance for polychotomous response data, Technical Report 1003 PhD thesis 1998 Department of Statistics, University of Wisconsin Madison WI. Available via G. Wahba's website
11. X. Lin, G. Wahba, D. Xiang, F. Gao, R. Klein, and B. Klein Smoothing spline ANOVA models for large data sets with Bernoulli observations and the randomized GACV Ann. Statist 28 2000 1570 1600
12. C. Micchelli Interpolation of scattered data: distance matrices and conditionally positive definite functions' Constructive Approximation 2 1986 11 22
13. D. Nychka Bayesian confidence intervals for smoothing splines' J. Amer. Statist. Assoc 83 1988 1134 1143
14. D. Nychka, G. Wahba, S. Goldfarb, and T. Pugh Cross-validated spline methods for the estimation of three dimensional tumor size distributions from observations on two dimensional cross sections' J. Am. Stat. Assoc 79 1984 832 846
15. F. O'Sullivan, and G. Wahba A cross validated Bayesian retrieval algorithm for non-linear remote sensing J. Comput. Physics 59 1985 441 455
16. E. Parzen Statistical inference on time series by rkhs methods R. Pyke, Proceedings 12th Biennial Seminar Canadian Mathematical Congress, Montreal 1970 1 37
17. F. Riesz, and B.S. Nagy Functional Analysis, Ungar New York 1955
18. I. Schoenberg Spline functions and the problem of graduation Proc. Nat. Acad. Sci. U.S.A 52 1964 947 950
19. A. Tikhonov Solution of incorrectly formulated problems and the regularization method Soviet Math. Dokl 4 1963 1035 1038
20. G. Wahba Practical approximate solutions to linear operator equations when the data are noisy SIAM J. Numer. Anal 14 1977 651 667
21. G. Wahba Spline interpolation and smoothing on the sphere SIAM J. Sci. Stat. Comput 2 1981 5 16
22. G. Wahba Erratum: Spline interpolation and smoothing on the sphere SIAM J. Sci. Stat. Comput 3 1982 385 386
23. G. Wahba Vector splines on the sphere, with application to the estimation of vorticity and divergence from discrete, noisy data W. Schempp, K. Zeller, Multivariate Approximation Theory, Vol.2 1982 Birkhauser Verlag 407 429
24. G. Wahba Bayesian "confidence intervals" for the cross-validated smoothing spline J. Roy. Stat. Soc. Ser. B 45 1983 133 150
25. G. Wahba Spline Models for Observational Data, SIAM CBMS-NSF Regional Conference Series in Applied Mathematics 59 1990
26. G. Wahba Multivariate function and operator estimation, based on smoothing splines and reproducing kernels M. Casdagli, S. Eubank, Nonlinear Modeling and Forecasting, SFI Studies in the Sciences of Complexity, Proc. Vol XII 1992 Addison-Wesley 95 112
27. G. Wahba NIPS 1996 model complexity workshop notes lecture overheads 1996 http://www.stat.wisc.edu/wahba via, goto TALKKS goto 1996
28. G. Wahba Support vector machines, reproducing kernel Hilbert spaces and the randomized GACV B. Scholkopf, C. Burges, A. Smola, Advances in Kernel Methods-Support Vector Learning 1999 MIT Press 69 88
29. G. Wahba Soft and hard classification by reproducing kernel Hilbert space methods' Proc.National Academy of Sciences 99 2002 16524 16530
30. G. Wahba, and Y. Wang When is the optimal regularization parameter insensitive to the choice of the loss function?' Commun. Statist.-Theory Meth 19 1990 1685 1700
31. G. Wahba, and J. Wendelberger Some new mathematical methods for variational objective analysis using splines and cross-validation Monthly Weather Review 108 1980 1122 1145
32. G. Wahba, Y Wang, C. Gu, R. Klein, and B. Klein Smoothing spline ANOVA for exponential families, with application to the Wisconsin Epidemiological Study of Diabetic Retinopathy Ann. Statist 23 1995 1865 1895 Neyman Lecture
33. Y. Wang, and G. Wahba Bootstrap confidence intervals for smoothing splines and their comparison to Bayesian 'confidence intervals Technical Report 913 1994 Dept. of Statistics, University of Wisconsin Madison, WI to appear, J. Stat. Camp. Sim.
34. D. Xiang, and G. Wahba A generalized approximate cross validation for smoothing splines with non-Gaussian data Statistica Sinica 6 1996 675 692