Improvements on cross-validation: The .632+ bootstrap method

Journal of the American Statistical Association

Volumn 92, Issue 438, 1997, Pages 548-560

  Efron, Bradley ^a   Tibshirani, Robert ^b  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Classification; Cross validation bootstrap; Prediction rule

Indexed keywords

EID: 0031536511     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1080/01621459.1997.10474007     Document Type: Article

References (26)

1. Allen, D. M. (1974), "The Relationship Between Variable Selection and Data Augmentation and a Method of Prediction," Technometrics, 16, 125-127.
2. Breiman, L. (1994), "Bagging Predictors," technical report, University of California, Berkeley.
3. Breiman, L., Friedman, J., Olshen, R., and Stone, C. (1984), Classification and Regression Trees, Pacific Grove, CA: Wadsworth.
4. Breiman, L., and Spector, P. (1992), "Submodel Selection and Evaluation in Regression: The x-Random Case," International Statistical Review, 60, 291-319.
5. Chernick, M., Murthy, V., and Nealy, C. (1985), "Application of Bootstrap and Other Resampling Methods: Evaluation of Classifier Performance," Pattern Recognition Letters, 4, 167-178.
6. _ (1986), Correction to "Application of Bootstrap and Other esampling Methods: Evaluation of Classifier Performance," Pattern Recognition Letters, 4, 133-142.
7. Cosman, P., Perlmutter, K., Perlmutter, S., Olshen, R., and Gray, R. (1991), "Training Sequence Size and Vector Quantizer Performance," in 25th Asilomar Conference on Signals, Systems, and Computers, November 4-6, 1991, ed. Ray R. Chen, Los Alamitos, CA: IEEE Computer Society Press, pp. 434-448.
8. Davison, A. C., Hinkley, D. V., and Schechtman, E. (1986), "Efficient Bootstrap Simulations," Biometrika, 73, 555-566.
9. Efron, B. (1979), "Bootstrap Methods: Another Look at the Jackknife," The Annals of Statistics, 7, 1-26.
10. _ (1983), "Estimating the Error Rate of a Prediction Rule: Some Improvements on Cross-Validation," Journal of the American Statistical Association, 78, 316-331.
11. _ (1986), "How Biased is the Apparent Error Rate of a Prediction Rule?," Journal of the American Statistical Association, 81, 461-470.
12. _ (1992), "Jackknife-After-Bootstrap Standard Errors and Influence Functions" (with discussion), Journal of the Royal Statistical Society, Ser. B, 83-111.
13. Efron, B., and Gong, G. (1983), "A Leisurely Look at the Bootstrap, The Jackknife and Cross-Validation," The American Statistician, 37, 36-48.
14. Efron, B., and Tibshirani, R. (1993), An Introduction to the Bootstrap, London: Chapman and Hall.
15. _ (1995), "Cross-Validation and the Bootstrap: Estimating the Error Rate of a Prediction Rule," Technical Report 176, Stanford University, Department of Statistics.
16. Friedman, J. (1994), "Flexible Metric Nearest-Neighbor Classification," Technical Report, Stanford University, Department of Statistics.
17. Geisser, S. (1975), "The Predictive Sample Reuse Method With Applications," Journal of the American Statistical Association, 70, 320-328.
18. Jain, A., Dubes, R. P., and Chen, C. (1987), "Bootstrap Techniques for Error Estimation," IEEE Transactions on Pattern Analysis and Machine Intelligence, 9, 628-633.
19. Kohavi, R. (1995), "A Study of Cross-Validation and Bootstrap for Accuracy Assessment and model selection," technical report, Stanford University, Department of Computer Sciences.
20. Mallows, C. (1973), "Some Comments on Cp," Technometrics, 15, 661-675.
21. McLachlan, G. (1992), Discriminant Analysis and Statistical Pattern Recognition, New York: Wiley.
22. Stone, M. (1974), "Cross-Validatory Choice and Assessment of Statistical Predictions," Journal of the Royal Statistical Society, Ser. B, 36, 111-147.
23. _ (1977), "An Asymptotic Equivalence of Choice of Model by Cross-Validation and Akaike's Criterion," Journal of the Royal Statistical Society, Ser. B, 39, 44-47.
24. Wahba, G. (1980), "Spline Bases, Regularization, and Generalized Cross-Validation for Solving Approximation Problems With Large Quantities of Noisy Data," in Proceedings of the International Conference on Approximation Theory in Honour of George Lorenz, Austin, TX: Academic Press.
25. Zhang, P. (1993), "Model Selection via Multifold CV," The Annals of Statistics, 21, 299-311.
26. _ (1995), "APE and Models for Categorical Panel Data," Scandinavian Journal of Statistics, 22, 83-94.