Model indexing and smoothing parameter selection in nonparametric function estimation

Statistica Sinica

Volumn 8, Issue 3, 1998, Pages 607-646

  Gu, Chong ^a,b  

^a PURDUE UNIVERSITY   (United States)

^b PURDUE UNIVERSITY   (United States)

Author keywords

Constraint; Cross validation; Kernel method; Negative correlation; Penalized likelihood; Plug in method

Indexed keywords

EID: 0001638770     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (47)

1. Buja, A., Hastie, T. and Tibshirani, R. (1989). Linear smoothers and additive models (with discussion). Ann. Statist. 17, 453-555.
2. Craven, P. and Wahba, G. (1979). Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the method of generalized cross-validation. Numer. Math. 31, 377-403.
3. Gu, C. (1990). Adaptive spline smoothing in non Gaussian regression models. J. Amer. Statist. Assoc. 85, 801-807.
4. Gu, C. (1992). Cross-validating non Gaussian data. J. Comput. Graph. Statist. 1, 169-179.
5. Gu, C. (1993). Smoothing spline density estimation: A dimcnsionless automatic algorithm. J. Amer. Statist. Assoc. 88, 495-504.
6. Gu, C. (1998). Structural multivariate function estimation: Some automatic density and hazard estimates. Statist. Sinica 8, 317-335.
7. Hall, P. and Johnstone, I. (1992). Empirical functionals and efficient smoothing parameter selection (with discussion). J. Roy. Statist. Soc. Ser. B 54, 475-530.
8. Jones, M. C., Marron, J. S. and Sheather, S. J. (1992). Progress in data-based bandwidth selection for kernel density estimation. Mimeo Series #2088, University of North Carolina, Dept. of Statistics.
9. L and generalized cross-validation in ridge regression with application to spline smoothing. Ann. Statist. 14, 1101-1112.
10. Rudemo, M. (1982). Empirical choice of histograms and kernel density estimators. Scand. J. Statist. 9, 65-78.
11. Schoenberg, I. J. (1964). Spline functions and the problem of graduation. Proc. Nat. Acad. Sci. 52, 947-950.
12. Scott, D. W. and Terrell, G. R. (1987). Biased and unbiased cross-validation in density estimation, J. Amer. Statist. Assoc. 82, 1131-1146.
13. Sheather, S. J. and Jones, M. C. (1991). A reliable data-based bandwidth selection method for kernel density estimation, J. Roy. Statist. Soc. Ser. B 53, 683-690.
14. Wahba, G. (1990). Spline Models for Observational Data. CBMS-NSF Regional Conference Series in Applied Mathematics, Vol. 59, SIAM.
15. Basu, A., Harris, I. R., Hjort, N. L. and Jones, M. C. (1998). Robust and efficient estimation by minimising a density power divergence. Biometrika, to appear.
16. Chen, S., Donoho, D. and Saunders, M. (1995). Atomic decomposition by basis pursuit. Technical Report 479, Dept of Statistics, Stanford University, Stanford CA.
17. Cox, D. (1983). Asymptotics for M type smoothing splines. Ann. Math. Statist. 11, 530-551.
18. DeVore, R. and Lucier, B. (1992). Fast wavelet techniques for near-optimal image processing. In 1992 IEEE Military Communications Conference, IEE Communications Society, 1129-1135.
19. Donoho, D., Johnstone, I., Kerkyacharian, G. and Picard, D. (1995). Wavelet shrinkage: asymptopia? J. Roy. Statist. Soc. Ser. B 57, 301-370.
20. L in ridge regression and regularization. Ann. Statist. 19, 1950-1963.
21. L procedures: Comments, new results and application to image recovery problems. Comput. Statist. 10, 205-231.
22. Gong, J., Wahba, G., Johnson, D. and Tribbia, J. (1998). Adaptive tuning of numerical weather prediction models: simultaneous estimation of weighting, smoothing and physical parameters. Monthly Weather Review 125, 210-231.
23. Grund, B., Hall, P. and Marron, J. S. (1994). Loss and risk in smoothing parameter selection. J. Nonparametr. Statist. 4, 107-132.
24. Gu, C. and Qiu, C. (1993). Smoothing spline density estimation: Theory. Ann. Statist. 21, 217-234.
25. Hall, P. (1987). On Kullback-Leibler loss and density estimation. Ann. Statist. 15, 1491-1519.
26. Hall, P. and Marron, J. S. (1987). Estimation of integrated squared density derivatives. Statist. Probab. Lett. 6, 109-115.
27. Hall, P. and Marron, J. S. (1991). Lower bounds for bandwidth selection in density estimation. Probab. Theory Rel. Fields 90, 149-173.
28. Hurvich, C. M., Simonoff, J. S. and Tsai, C. L. (1998). Smoothing parameter selection in nonparametric regression using an improved AIC criterion. J. Roy. Statist. Soc. Ser. B 60, 271-293.
29. Jones, M. C. (1991). The role of ISE and MISE in density estimation. Statist. Probab. Lett. 12, 51-56.
30. Jones, M. C. (1998). On some kernel density estimation bandwidth selectors related to the double kernel method. Sankhya Ser. A, to appear.
31. Jones, M. C. and Kappenman, R. F. (1992). On a class of kernel density estimate bandwidth selectors. Scand. J. Statist. 19, 337-349.
32. Jones, M. C. and Sheather, S. J. (1991). Using non-stochastic terms to advantage in kernel-based estimation of integrated squared density derivatives. Statist. Probab. Lett. 11, 511-514.
33. Koenker, R., Ng, P. and Portnoy, S. (1994). Quantile smoothing splines. Biometrika 81, 673-680.
34. Marron, J. S. and Tsybakov, A. B. (1995). Visual error criteria for qualitative smoothing. J. Amer. Statist. Assoc. 90, 499-507.
35. Rudin, L., Osher, S. and Fatemi, E. (1992). Nonlinear total-variation-based noise removal algorithms. Physica D 60, 259-268.
36. Scott, D. W. (1988). Comment on "How far are automatically chosen regression smoothing parameters from their optimum?" by W. Härdle, P. Hall and J. S. Marron. J. Amer. Statist. Assoc. 83, 96-98.
37. Scott, D. W. (1992). Multivariate Density Estimation: Theory, Practice, and Visualization. Wiley, New York.
38. Silverman, B. W. (1984). Spline smoothing: the equivalent variable kernel method. Ann. Statist. 12, 898-916.
39. Terrell, G. R. (1990). Linear density estimates. Proc. Statist. Comput. Sec., Amer. Statist. Assoc., 297-302.
40. Terrell, G. R. (1993). Spline density estimators. ASA Proc. Statist. Comput. Section 255-260.
41. Wahba, G. (1975a). Optimal convergence properties of variable knot, kernel and orthogonal series methods for density estimation. Ann. Statist. 3, 15-29.
42. Wahba, G. (1975b). Smoothing noisy data by spline functions. Numer. Math. 24, 383-393.
43. Wahba, G. (1983). Bayesian "confidence intervals" for the cross-validated smoothing spline. J. Roy. Statist. Soc. Ser. B 45, 133-150.
44. Wahba, G. (1998). Support vector machines, reproducing kernel Hilbert spaces and the randomized GACV. Technical Report 984r, Department of Statistics, University of Wisconsin, Madison WI. In Advances in Kernel Methods-Support Vector Learning (Edited by B. Schölkopf, C. Burges and A. Smola), MIT Press.
45. Wahba, G. and Wang, Y. (1995). Behavior near zero of the distribution of GCV smoothing parameter estimates. Statist. Probab. Lett. 25, 105-111.
46. Wahba, G. and Wold, S. (1975). A completely automatic French curve. Commun. Statist. 4, 1-17.
47. Xiang, D. and Wahba, G. (1996). A generalized approximate cross validation for smoothing splines with non-Gaussian data. Statist. Sinica 6, 675-692.