The covariance inflation criterion for adaptive model selection

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 61, Issue 3, 1999, Pages 529-546

  Tibshirani, Robert ^a   Knight, Keith ^b  

^a STANFORD UNIVERSITY   (United States)

^b NONE

Author keywords

Adaptive prediction; Bootstrap; Cross validation; Model selection; Permutation

Indexed keywords

EID: 0039724913     PISSN: 13697412     EISSN: None     Source Type: Journal    
DOI: 10.1111/1467-9868.00191     Document Type: Article

References (18)

1. Akaike, H. (1973) Information theory and an extension of the maximum likelihood principle. In Proc. 2nd Int. Symp. Inference Theory (eds B. N. Petrov and F. Csàki), pp. 267-281. Budapest: Akadémiai Kiadó.
2. Breiman, L. (1992) The little bootstrap and other methods for dimensionality selection in regression: X-fitted prediction error. J. Am. Statist. Ass., 87, 738-754.
3. Cleveland, W. and Devlin, S. J. (1988) Locally weighted regression: an approach to regression analysis by local fitting. J. Am. Statist. Ass., 83, 596-610.
4. Cox, D. and Hinkley, D. (1974) Theoretical Statistics. London: Chapman and Hall.
5. Donoho, D. and Johnstone, I. (1994) Ideal spatial adaptation by wavelet shrinkage. Biometrika, 81, 425-455.
6. Efron, B. (1983) Estimating the error rate of a prediction rule: some improvements on cross-validation. J. Am. Statist. Ass., 78, 316-331.
7. _ (1986) How biased is the apparent error rate of a prediction rule? J. Am. Statist. Ass., 81, 461-470.
8. Efron, B. and Tibshirani, R. (1997) Improvements on cross-validation: the 632+ bootstrap: method. J. Am. Statist. Ass., 92, 548-560.
9. Foster, D. and George, E. (1994) The risk inflation criterion for multiple regression. Ann. Statist., 22, 1947-1975.
10. Geisser, S. (1975) The predictive sample reuse method with applications. J. Am. Statist. Ass., 70, 320-328.
11. Hastie, T. and Tibshirani, R. (1990) Generalized Additive Models. New York: Chapman and Hall.
12. p. Technometrics, 15, 661-675.
13. Moody, J. (1992) The effective number of parameters: an analysis of generalization and regularization in nonlinear learning systems. In Advances in Neural Information Processing Systems, vol. 4, pp. 847-854. San Mateo: Morgan Kaufman.
14. Schwarz, G. (1979) Estimating the dimension of a model. Ann. Statist., 6, 461-464.
15. Stone, M. (1974) Cross-validatory choice and assessment of statistical predictions (with discussion). J. R. Statist. Soc. B, 36, 111-147.
16. Tibshirani, R. and Knight, K. (1997) The covariance inflation criterion for adaptive model selection. Technical Report. University of Toronto, Toronto.
17. Vapnik, V. (1996) The Nature of Statistical Learning Theory. New York: Springer.
18. Ye, J. (1998) On measuring and correcting the effects of data mining and model selection. J. Am. Statist. Ass., 93, 120-131.