A Bound on the Error of Cross Validation Using the Approximation and Estimation Rates, with Consequences for the Training-Test Split

Neural Computation

Volumn 9, Issue 5, 1997, Pages 1143-1161

  Kearns, Michael ^a  

^a AT AND T LABS RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0000900996     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/neco.1997.9.5.1143     Document Type: Article

References (12)

1. Barron, A. (1990). Universal approximation bounds for superpositions of a sigmoidal function. IEEE Transactions on Information Theory 19:930-944.
2. Barron, A. R., & Cover, T. M. (1991). Minimum complexity density estimation. IEEE Transactions on Information Theory 37:1034-1054.
3. Devroye, L. (1988). Automatic pattern recognition: A study of the probability of error. IEEE Trans. Pattern Anal. Mach. Intell. 10(4)530-543.
4. Haussler, D., Kearns, M., Seung, H. S., & Tishby, N. (1994). Rigourous learning curve bounds from statistical mechanics. In Proceedings of the Seventh Annual ACM Confernce on Computational Learning Theory (pp. 76-87).
5. Kearns, M., Mansour, Y., Ng, A., & Ron, D. (1995). An experimental and theoretical comparison of model selection methods. In Proceedings of the Eighth Annual ACM Conference on Computational Learning Theory.
6. Rissanen, J. (1989). Stochastic complexity in statistical inquiry. Singapore: World Scientific.
7. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature 323:533-536.
8. Seung, H. S., Sompolinsky, H., & Tishby, N. (1992). Statistical mechanics of learning from examples. Physical Review A 45:6056-6091.
9. Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society B 36:111-147.
10. Stone, M. (1977). Asymptotics for and against cross-validation. Biometrika 64(1):29-35.
11. Vapnik, V. N. (1982). Estimation of dependences based on empirical data. New York: Springer-Verlag.
12. Vapnik, V N., & Chervonenkis, A. Y. (1971). On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability and Its Applications 16(2):264-280.