Consistency of cross validation for comparing regression procedures

Annals of Statistics

Volumn 35, Issue 6, 2007, Pages 2450-2473

  Yang, Yuhong ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Consistency; Cross validation; Model selection

Indexed keywords

EID: 39649100346     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/009053607000000514     Document Type: Article

References (35)

1. AKAIKE, H. (1973). Information theory and an extension of the maximum likelihood principle. In Proc. 2nd Int. Symp. Information Theory (B. N. Petrov and F. Csáki, eds.) 267-281. Akadémiai Kiadó, Budapest. MR0483125
2. ALLEN, D. M. (1974). The relationship between variable selection and data augmentation and a method for prediction. Technometrics 16 125-127. MR0343481
3. BREIMAN, L., FRIEDMAN, J. H., OLSHEN, R. A. and STONE, C. J. (1984). Classification and Regression Trees. Wadsworth, Belmont, CA. MR0726392
4. BURMAN, P. (1989). A comparative study of ordinary cross-validation, u-fold cross-validation and the repeated learning-testing methods. Biometrika 76 503-514. MR1040644
5. BURMAN, P. (1990). Estimation of optimal transformations using u-fold cross validation and repeated learning-testing methods. Sankhyā Ser A 52 314-345. MR1178041
6. CRAVEN, P. and WAHBA, G. (1979). Smoothing noisy data with spline functions. Numer. Math. 31 377-403. MR0516581
7. DONOHO, D. L. and JOHNSTONE, I. M. (1998). Minimax estimation via wavelet shrinkage. Ann. Statist. 26 879-921. MR 1635414
8. FAN, J. and GIJBELS, I. (1996). Local Polynomial Modelling and Its Applications. Chapman and Hall, London. MR1383587
9. GEISSER, S. (1975). The predictive sample reuse method with applications. J. Amer. Statist. Assoc. 70 320-328.
10. GYÖRFI, L., KOHLER, M., KRZYZAK, A. and WALK, H. (2002). A Distribution-Free Theory of Nonparametric Regression. Springer, New York. MR 1920390
11. HALL, P. and JOHNSTONE, I. (1992). Empirical functional and efficient smoothing parameter selection (with discussion). J. Roy. Statist. Soc. Ser. B 54 475-530. MR 1160479
12. HARDLE, W., HALL, P. and MARRON, J. S. (1988). How far are automatically chosen regression smoothing parameters from their optimum? (with discussion). J. Amer. Statist. Assoc. 83 86-101. MR0941001
13. HART, J. D. (1997). Nonparametric Smoothing and Lack-of-Fit Tests. Springer, New York. MR 1461272
14. LI, K.-C. (1984). Consistency for cross-validated nearest neighbor estimates in nonparametric regression. Ann. Statist. 12 230-240. MR0733510
15. L, cross-validation and generalized crossvalidation: Discrete index set. Ann. Statist. 15 958-975. MR0902239
16. NEMIROVSKI, A. (2000). Topics in nonparametric statistics. Lectures on Probability Theory and Statistics (Saint-Flour, 1998). Lecture Notes in Math. 1738 85-277. Springer, Berlin. MR 1775640
17. OPSOMER, J., WANG, Y. and YANG, Y. (2001). Nonparametric regression with correlated errors. Statist. Sci. 16 134-153. MR1861070
18. POLLARD, D. (1984). Convergence of Stochastic Processes. Springer, New York. MR0762984
19. SHAO, J. (1993). Linear model selection by cross-validation. J. Amer. Statist. Assoc. 88 486-494. MR1224373
20. SHAO, J. (1997). An asymptotic theory for linear model selection (with discussion). Statist. Sinica 7 221-264. MR1466682
21. SIMONOFF, J. S. (1996). Smoothing Methods in Statistics. Springer, New York. MR1391963
22. SPECKMAN, P. (1985). Spline smoothing and optimal rates of convergence in nonparametric regression models. Ann. Statist. 13 970-983. MR0803752
23. STONE, C. J. (1980). Optimal rates of convergence for nonparametric estimators. Ann. Statist. 8 1348-1360. MR0594650
24. STONE, C. J. (1982). Optimal global rates of convergence for nonparametric regression. Ann. Statist. 10 1040-1053. MR0673642
25. STONE, M. (1974). Cross-validatory choice and assessment of statistical predictions (with discussion). J. Roy. Statist. Soc. Ser. B 36 111-147. MR0356377
26. VAN DER LAAN, M. J. and DUDOIT, S. (2003). Unified cross-validation methodology for selection among estimators and a general cross-validated adaptive epsilon-net estimator: Finite sample oracle inequalities and examples. U.C. Berkeley Div. Biostatistics Working Paper Series. Available at www.bepress.com/ucbbiostat/paper130.
27. VAN DER LAAN, M. J., DUDOIT, S. and VAN DER VAART, A. W. (2006). The cross-validated adaptive epsilon-net estimator. Statist. Decisions 24, 373-395. MR2305113
28. VAN DER VAART, A. W., DUDOIT, S. and VAN DER LAAN, M. J. (2006). Oracle inequalities for multi-fold cross-validation. Statist. Decisions 24 351-371. MR2305112
29. WAHBA, G. (1990). Spline Models for Observational Data. SIAM, Philadelphia. MR1045442
30. WEGKAMP, M. (2003). Model selection in nonparametric regression. Ann. Statist. 31252-273. MR1962506
31. WEISBERG, S. (2005). Applied Linear Regression, 3rd ed. Wiley, Hoboken, NJ. MR2112740
32. WONG, W. H. (1983). On the consistency of cross-validation in kernel nonparametric regression. Ann. Statist., 11 1136-1141. MR0720259
33. YANG, Y. (2001). Adaptive regression by mixing. J. Amer. Statist. Assoc. 96 574-588. MR1946426
34. YANG, Y. (2003). Regression with multiple candidate models: Selecting or mixing? Statist. Sinica 13 783-809. MR1997174
35. ZHANG, P. (1993). Model selection via multifold cross validation. Ann. Statist. 21 299-313. MR1212178