Smoothing spline Gaussian regression: More scalable computation via efficient approximation

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 66, Issue 2, 2004, Pages 337-356

  Kim, Young Ju ^a   Gu, Chong ^b,c  

^a YALE UNIVERSITY   (United States)

^b PURDUE UNIVERSITY   (United States)

^c PURDUE UNIVERSITY   (United States)

Author keywords

Bayesian confidence interval; Computation; Generalized cross validation; Penalized least squares

Indexed keywords

EID: 2442486641     PISSN: 13697412     EISSN: None     Source Type: Journal    
DOI: 10.1046/j.1369-7412.2003.05316.x     Document Type: Article

References (29)

1. Breiman, L. and Friedman, J. H. (1985) Estimating optimal transformations for multiple regression and correlation (with discussion). J. Am. Statist. Ass., 80, 580-598.
2. Buja, A., Hastie, T. and Tibshirani, R. (1989) Linear smoothers and additive models (with discussion). Ann. Statist., 17, 453-555.
3. Craven, P. and Wahba, G. (1979) Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the method of generalized cross-validation. Numer Math., 31, 377-403.
4. Dennis, J. E. and Schnabel, R. B. (1996) Numerical Methods for Unconstrained Optimization and Nonlinear Equations. Philadelphia: Society for Industrial and Applied Mathematics.
5. Golub, G. and Van Loan, C. (1989) Matrix Computations, 2nd edn. Baltimore: Johns Hopkins University Press.
6. Green, P. J. and Silverman, B. W. (1994) Nonparametric Regression and Generalized Linear Models. London: Chapman and Hall.
7. Gu, C. (2002) Smoothing Spline ANOVA Models. New York: Springer.
8. Gu, C., Bates, D. M., Chen, Z. and Wahba, G. (1989) The computation of GCV functions through Householder tridiagonalization with application to the fitting of interaction spline models. SIAM J. Matrix Anal. Applic., 10, 457-480.
9. Gu, C. and Kim, Y.-J. (2002) Penalized likelihood regression: general formulation and efficient approximation. Can. J. Statist., 30, 619-628.
10. Gu, C. and Wahba, G. (1991) Minimizing GCV/GML scores with multiple smoothing parameters via the Newton method. SIAM J. Sci. Statist. Comput., 12, 383-398.
11. Gu, C. and Wahba, G. (1993a) Smoothing spline ANOVA with component-wise Bayesian "confidence intervals". J. Comput. Graph. Statist., 2, 97-117.
12. Gu, C. and Wahba, G. (1993b) Semiparametric analysis of variance with tensor product thin plate splines. J. R. Statist. Soc. B, 55, 353-368.
13. Gu, C. and Wang, J. (2003) Penalized likelihood density estimation: direct cross-validation and scalable approximation. Statist. Sin., 13, 811-826.
14. Ihaka, R. and Gentleman, R. (1996) R: a language for data analysis and graphics. J. Comput. Graph. Statist., 5, 299-314.
15. Kimeldorf, G. and Wahba, G. (1970a) A correspondence between Bayesian estimation of stochastic processes and smoothing by splines. Ann. Math. Statist., 41, 495-502.
16. Kimeldorf, G. and Wahba, G. (1970b) Spline functions and stochastic processes. Sankhya A, 32, 173-180.
17. Kimeldorf, G. and Wahba, G. (1971) Some results on Tchebycheffian spline functions. J. Math. Anal. Applic., 33, 82-85.
18. Li, K.-C. (1986) Asymptotic optimality of CL and generalized cross-validation in the ridge regression with application to spline smoothing. Ann. Statist., 14, 1101-1112.
19. Luo, Z. and Wahba, G. (1997) Hybrid adaptive splines. J. Am. Statist. Ass., 92, 107-116.
20. Nychka, D. (1988) Bayesian confidence intervals for smoothing splines. J. Am. Statist. Ass., 83, 1134-1143.
21. Nychka, D., Haaland, P. D., O'Connell, M. A. and Ellner, S. (1998) FUNFITS: data analysis and statistical tools for estimating functions. In Case Studies in Environmental Statistics (eds D. Nychka, W. W. Piegorsch and L. H. Cox), pp. 159-179. New York: Springer.
22. Rao, C. R. (1973) Linear Statistical Inference and Its Applications. New York: Wiley.
23. Wahba, G. (1978) Improper priors, spline smoothing and the problem of guarding against model errors in regression. J. R. Statist. Soc. B, 40, 364-372.
24. Wahba, G. (1981) Spline interpolation and smoothing on the sphere. SIAM J. Sci. Statist. Comput., 2, 5-16.
25. Wahba, G. (1983) Bayesian "confidence intervals" for the cross-validated smoothing spline. J. R. Statist. Soc. B, 45, 133-150.
26. Wahba, G. (1985) A comparison of GCV and GML for choosing the smoothing parameter in the generalized spline smoothing problem. Ann. Statist., 13, 1378-1402.
27. Wahba, G. (1990) Spline Models for Observational Data. Philadelphia: Society for Industrial and Applied Mathematics.
28. Wang, Y. and Ke, C. (2002) ASSIST: a Suite of S-plus Functions Implementing Spline Smoothing Techniques. (Available from www.pstat.ucsb.edu/faculty/yuedong/research.html.)
29. Wood, S. N. (2000) Modelling and smoothing parameter estimation with multiple quadratic penalties. J. R. Statist. Soc. B, 62, 413-428.