Penalized likelihood density estimation: Direct cross-validation and scalable approximation

Statistica Sinica

Volumn 13, Issue 3, 2003, Pages 811-826

  Gu, Chong ^a   Wang, Jingyuan ^a  

^a PURDUE UNIVERSITY   (United States)

Author keywords

Cross validation; Kullback Leibler loss; Penalized likelihood; Smoothing parameter

Indexed keywords

EID: 0141796394     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (20)

1. Aronszajn, N. (1950). Theory of reproducing kernels. Trans. Amer. Math. Soc. 68, 337-404.
2. Craven, P. and G. Wahba (1979). Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the method of generalized cross-validation. Numer. Math. 31, 377-403.
3. Dennis, J. E. and R. B. Schnabel (1996). Numerical Methods for Unconstrained Optimization and Nonlinear Equations. SIAM, Philadelphia. Corrected reprint of the 1983 original.
4. Good, I. J. and R. A. Gaskins (1971). Nonparametric roughness penalties for probability densities. Biometrika 58, 255-277.
5. Gu, C. (1993). Smoothing spline density estimation: A dimensionless automatic algorithm. J. Amer. Statist. Assoc. 88, 495-504.
6. Gu, C. (1995). Smoothing spline density estimation: Conditional distribution. Statist. Sinica 5, 709-726.
7. Gu, C. (1996). Penalized likelihood hazard estimation: A general procedure. Statist. Sinica 6, 861-876.
8. Gu, C. (1998). Structural multivariate function estimation: Some automatic density and hazard estimates. Statist. Sinica 8, 317-335.
9. Gu, C. (2002). Smoothing Spline ANOVA Models. Springer-Verlag, New York.
10. Gu, C. and C. Qiu (1993). Smoothing spline density estimation: theory. Ann. Statist. 21, 217-234.
11. Kim, Y.-J. and C. Gu (2002). Penalized least squares regression: fast computation via efficient approximation. Technical report, Department of Statistics, Purdue University, West Lafayette, IN.
12. Leonard, T. (1978). Density estimation, stochastic processes and prior information. J. Roy. Statist. Soc. Ser. B 73, 113-146 (with discussions).
13. Novak, E. and K. Ritter (1996). High dimensional integration of smooth functions over cubes. Numer. Math. 75, 79-97.
14. O'Sullivan, F. (1988). Fast computation of fully automated log-density and log-hazard estimators. SIAM J. Sci. Statist. Comput. 9, 363-379.
15. Petras, K. (2001). Asymptotically minimal smolyak cubature. Preprint.
16. Silverman, B. W. (1982). On the estimation of a probability density function by the maximum penalized likelihood method. Ann. Statist. 10, 795-810.
17. Wahba, G. (1990). Spline Models for Observational Data, Volume 59 of CBMS-NSF Regional Conference Series in Applied Mathematics. SIAM, Philadelphia.
18. Wahba, G., Y. Lin and C. Leng (2002). Comment on "Spline adaptation in extended linear models" by M. H. Hansen and C. Kooperberg. Statist. Sci. 17, 33-37.
19. Wang, M.-C. (1989). A semiparametric model for randomly truncated data. J. Amer. Statist. Assoc. 84, 742-748.
20. Whittaker, J. (1990). Graphical Models in Applied Multivariate Statistics. Wiley, Chichester.