Prediction error estimation under Bregman divergence for non-parametric regression and classification

Scandinavian Journal of Statistics

Volumn 35, Issue 3, 2008, Pages 496-523

  Zhang, Chunming ^a  

^a University of Wisconsin Madison

Author keywords

Cross validation; Exponential family; Generalized varying coefficient model; Local likelihood; Loss function; Prediction error

Indexed keywords

EID: 50249168281     PISSN: 03036898     EISSN: 14679469     Source Type: Journal    
DOI: 10.1111/j.1467-9469.2008.00593.x     Document Type: Article

References (34)

1. Albright, S. C., Winston, W. L. Zappe, C. J. (1999). Data analysis and decision making with Microsoft Excel. Duxbury Press, Pacific Grove, California.
2. Altman, N. MacGibbon, B. (1998). Consistent bandwidth selection for kernel binary regression. J. Statist. Plan. Inference 70, 121 137.
3. Aragaki, A. Altman, N. S 1997). Local polynomial regression for binary response. In Computing science and statistics: Proceedings of the 29th Symposium on the Interface. Houston, Texas.
4. Böhning, D. Lindsay, B. G. (1988). Monotonicity of quadratic approximation algorithms. Ann. Inst. Statist. Math. 40, 641 663.
5. Bregman, L. M. (1967). A relaxation method of finding a common point of convex sets and its application to the solution of problems in convex programming. U.S.S.R. Comput. Math. and Math. Phys. 7, 620 631.
6. Cai, Z., Fan, J. Li, R. (2000). Efficient estimation and inferences for varying-coefficient models. J. Amer. Statist. Assoc. 95, 888 902.
7. Davidson, A. C. Hinkley, D. V. (1997). Bootstrap methods and their application. Cambridge University Press, Cambridge.
8. Efron, B. (1986). How biased is the apparent error rate of a prediction rule? J. Amer. Statist. Assoc. 81, 461 470.
9. Efron, B. (2004). The estimation of prediction error: covariance penalties and cross-validation (with discussion). J. Amer. Statist. Assoc. 99, 619 642.
10. Fan, J. Chen, J. (1999). One-step local quasi-likelihood estimation. J. Roy. Statist. Soc. Ser. B 61, 927 943.
11. Fan, J., Heckman, N. Wand, M. P. (1995). Local polynomial kernel regression for generalized linear models and quasi-likelihood functions. J. Amer. Statist. Assoc. 90, 141 150.
12. Fan, J., Farmen, M. Gijbels, I. (1998). Local maximum likelihood estimation and inference. J. Roy. Statist. Soc. Ser. B 60, 591 608.
13. Fan, J. Peng, H. (2004). On non-concave penalized likelihood with diverging number of parameters. Ann. Statist. 32, 928 961.
14. Golub, G. H. Van Loan, C. F. (1996). Matrix computations. 3rd edn. Johns Hopkins University Press, Baltimore.
15. Hall, P. Johnstone, I. (1992). Empirical functionals and efficient smoothing parameter selection (with discussion). J. Royal. Statist. Soc. B 54, 475 530.
16. Hardy, G. H., Littlewood, J. E. Pólya, G. (1988). Inequalities, 2nd edn. Cambridge University Press, Cambridge, UK.
17. Härdle, W., Hall, P. Marron, J. S. (1992). Regression smoothing parameters that are not far from their optimum. J. Amer. Statist. Assoc. 87, 227 233.
18. Harrison, D. Rubinfeld, D. L. (1978). Hedonic housing prices and the demand for clean air. J. Environ. Econ. Manage. 5, 81 102.
19. Hastie, T. J. Tibshirani, R. J. (1990). Generalized additive models. Chapman and Hall, London.
20. Hastie, T. J., Tibshirani, R. Friedman, J. (2001). The elements of statistical learning: data mining, inference, and prediction. Springer-Verlag, New York.
21. McCullagh, P. Nelder, J. A. (1989). Generalized linear models, 2nd edn. Chapman and Hall, London.
22. Mitrinović, D. S., Pečarić, J. E. Fink, A. M. (1993). Classical and new inequalities in analysis. Kluwer Academic Publishers Group, Dordrecht.
23. Müller, H.-G. Schmitt, T. (1988). Kernel and probit estimates in quantal bioassay. J. Amer. Statist. Assoc. 83, 750 759.
24. Nelder, J. A. Wedderburn, R. W. M. (1972). Generalized linear models. J. Roy. Statist. Soc. Ser. A 135, 370 384.
25. Pregibon, D. (1981). Logistic regression diagnostics. Ann. Statist. 9, 705 724.
26. Rice, J. (1984). Bandwidth choice for nonparametric regression. Ann. Statist. 20, 712 736.
27. Ruppert, D. Wand, M. P. (1994). Multivariate locally weighted least squares regression. Ann. Statist. 22, 1346 1370.
28. Severini, T. A. Staniswalis, J. G. (1994). Quasi-likelihood estimation in semiparametric models. J. Amer. Statist. Assoc. 89, 501 511.
29. Staniswalis, J. G. (1989). The kernel estimate of a regression function in likelihood-based models. J. Amer. Statist. Assoc. 84, 276 283.
30. Tibshirani, R. Hastie, T. (1987). Local likelihood estimation. J. Amer. Statist. Assoc. 82, 559 567.
31. Tibshirani, R. (1996). Bias, variance and prediction error for classification rules. Technical report. Statistics Department, University of Toronto.
32. Wong, W. H. (1983). On the consistency of cross-validation in kernel nonparametric regression. Ann. Statist. 11, 1136 1141.
33. Xiang, D. Wahba, G. (1996). A generalized approximate cross validation for smoothing splines with non-Gaussian data. Statist. Sinica 6, 675 692.
34. Zhang, C. M. (2003). Calibrating the degrees of freedom for automatic data smoothing and effective curve checking. J. Amer. Statist. Assoc. 98, 609 628.