Bias in estimating the variance of K-fold cross-validation

Statistical Modeling and Analysis for Complex Data Problems

Volumn , Issue , 2005, Pages 75-95

  Bengio, Yoshua ^a   Grandvalet, Yves ^a  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84863051852     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/0-387-24555-3_5     Document Type: Chapter

References (13)

1. Alpaydin, E. (1999). Combined 5 x 2 cv F test for comparing supervised classification learning algorithms. Neural Computation, 11:1885-1892.
2. Anthony, M. and Holden, S. B. (1998). Cross-validation for binary classification by real-valued functions: Theoretical analysis. In Proceedings of the International Conference on Computational Learning Theory, pages 218-229.
3. Blum, A., Kalai, A., and Langford, J. (1999). Beating the hold-out: Bounds for k-fold and progressive cross-validation. In Proceedings of the International Conference on Computational Learning Theory, pages 203-208.
4. Breiman, L. (1996). Heuristics of instability and stabilization in model selection. The Annals of Statistics, 24:2350-2383.
5. Dawid, A. P. (1997). Prequential analysis. In Kotz, S., Read, C. B., and Banks, D. L., editors, Encyclopedia of Statistical Sciences, Update Volume 1, pages 464-470. Wiley-Interscience.
6. Devroye, L., Györfi, L., and Lugosi, G. (1996). A Probabilistic Theory of Pattern Recognition. Springer-Verlag, New York.
7. Dietterich, T. G. (1999). Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation, 10:1895-1924.
8. Efron, B. and Tibshirani, R. J. (1993). An Introduction to the Bootstrap, volume 57 of Monographs on Statistics and Applied Probability. Chapman & Hall, London.
9. Hastie, T. J. and Tibshirani, R. J. (1990). Generalized Additive Models. Volume 43 of Monographs on Statistics and Applied Probability, Chapman & Hall, London.
10. Kearns, M. and Ron, D. (1996). Algorithmic stability and sanity-check bounds for leave-one-out cross-validation. Neural Computation, 11:1427-1453.
11. Kohavi, R. (1995). A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, pages 1137-1143.
12. Nadeau, C. and Bengio, Y. (2003). Inference for the generalization error. Machine Learning, 52:239-281.
13. Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society, Series B, 36:111-147.