Smoothers and the Cp, generalized maximum likelihood, and extended exponential criteria: A geometric approach

Journal of the American Statistical Association

Volumn 97, Issue 459, 2002, Pages 766-782

  Kou, S C ^a   Efron, B ^b  

^a HARVARD UNIVERSITY   (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Bias; Curvature; Degrees of freedom; Geometry; Prediction error; Reversal effects; Spline like smoothers; Variability

Indexed keywords

EID: 0036746656     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214502388618582     Document Type: Review

References (30)

1. Abramowitz, M., and Stegun, I. (1972), Handbook of Mathematical Function, Washington, DC: U.S. National Bureau of Standards.
2. Akaike, H. (1974), "A New Look at Statistical Model Identification," IEEE Transactions on Automatic Control, AU-19, 716-722.
3. Bowman, A., and Azzalini, A. (1997), Applied Smoothing Techniques for Data Analysis: The Kernel Approach With S-PLUS Illustrations, New York: Oxford University Press.
4. Craven, P., and Wahba, G. (1979), "Smoothing Noisy Data With Spline Functions: Estimating the Correct Degree of Smoothing by the Method of Generalized Cross-Validation," Numerical Mathematics, 31, 377-403.
5. Efron, B. (1975), "Defining the Curvature of a Statistical Problem (With Application to Second-Order Efficiency)" (with discussion), The Annals of Statistics, 3, 1189-1242.
6. _ (1986), "How Biased is the Apparent Error Rate of a Prediction Rule?," Journal of the American Statistical Association, 81, 461-470.
7. _ (2000), "Smoothers and the Cost of Model Selection," Technical Report 209, Stanford University, Dept. Statistics.
8. _ (2001), "Selection Criteria for Scatterplot Smoothers," The Annals of Statistics, 29, 470-504.
9. Eubank, R. (1988), Spline Smoothing and Nonparametric Regression, New York: Marcel Dekker.
10. Feller, W. (1971), An Introduction to Probability Theory and Its Applications, Vol. II, New York: Wiley.
11. Green, P., and Silverman, B. (1994), Nonparametric Regression and Generalized Linear Models, London: Chapman and Hall.
12. Gu, C. (1998), "Model Indexing and Smoothing Parameter Selection in Nonparametric Function Estimation" (with discussion), Statistica Sinica, 8, 607-646.
13. Hall, P., and Johnstone, I. (1992), "Empirical Functionals and Efficient Smoothing Parameter Selection" (with discussion), Journal of the Royal Statistical Society, Ser. B, 54, 475-530.
14. Härdle, W. (1990), Applied Nonparametric Regression, Cambridge, U.K.: Cambridge University Press.
15. Härdle, W., Hall, P., and Marron, J. (1988), "How Far are Automatically Chosen Regression Smoothing Parameters From the Optimum" (with discussion), Journal of the American Statistical Association, 83, 86-101.
16. Hastie, T. (1996), "Pseudosplines," Journal of the Royal Statistical Society, Ser. B, 58, 379-396.
17. Hastie, T., and Tibshirani, R. (1990), Generalized Additive Models, London: Chapman and Hall.
18. Hurvich, C., Simonoff, J., and Tsai, C. (1998), "Smoothing Parameter Selection in Nonparametric Regression Using an Improved Akaike Information Criterion," Journal of the Royal Statistical Society, Ser. C, 60, 271-294.
19. Jones, M., Marron, J., and Sheather, S. (1996), "A Brief Survey of Bandwidth Selection for Density Estimation," Journal of the American Statistical Association, 91, 401-407.
20. Kou, S.C. (2001), "Extended Exponential Criterion: A New Selection Procedure for Scatterplot Smoothers," unpublished doctoral thesis Stanford University, Department of Statistics.
21. L and Generalized Cross-Validation in Ridge Regression With Application to Spline Smoothing," Annals of Statistics, 14, 1101-1112.
22. L, Cross-Validation and Generalized Cross-Validation: Discrete Index Set," Annals of Statistics, 15, 958-975.
23. p," Technometrics, 15, 661-675.
24. Rosenblatt, M. (1991), Stochastic Curve Estimation, NSF-CBMS Regional Conference Series in Probability and Statistics, Vol. 3, Hayward, CA: IMS.
25. Simonoff, J. (1996), Smoothing Methods in Statistics, New York: Springer-Verlag.
26. Stein, M. (1990), "A Comparison of Generalized Cross-Validation and Modified Maximum Likelihood for Estimating the Parameters of a Stochastic Process," Annals of Statistics, 18, 1139-1157.
27. Wahba, G. (1985), "A Comparison of GCV and GML for Choosing the Smoothing Parameter in the Generalized Spline Smoothing Problem," Annals of Statistics, 13, 1378-1402.
28. _ (1990), Spline Models for Observational Data, CBMS-NSF Regional Conference Series in Applied Mathematics, Vol. 59, Philadelphia: SIAM.
29. Wahba, G., and Wang, Y. (1995), "Behavior Near Zero of the Distribution of GCV Smoothing Parameter Estimates," Statistics & Probability Letters, 25, 105-111.
30. Wecker, W., and Ansley, C. (1983), "The Signal Extraction Approach to Nonlinear Regression and Spline Smoothing," Journal of the American Statistical Association, 78, 81-89.