Lower bounds for training and leave-one-out estimates of the generalization error

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2415 LNCS, Issue , 2002, Pages 583-588

  Gavin, Gerald ^a   Teytaud, Olivier ^b  

^a UNIVERSITÉ LYON 1   (France)

^b INSTITUT DES SCIENCES COGNITIVES   (France)

Author keywords

[No Author keywords available]

Indexed keywords

NEURAL NETWORKS;

GENERALIZATION ERROR; LEAVE ONE OUT; LEAVE ONE OUT ERRORS; LOWER BOUNDS; TRAINING ERRORS; HEIDELBERG;

ERRORS;

EID: 84902200832     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-46084-5_95     Document Type: Conference Paper

References (10)

1. M. Anthony, P.L. Bartlett, Neural Network Learning: Theoretical Foundations, Cambridge University Press, 1999.
2. M. Anthony, S.B. Holden, Cross-Validation for Binary Classification by Real-Valued Functions: Theoretical Analysis, Proceedings of the Eleventh International Conference on Computational Learing Theory, pp. 218-229, 1998.
3. A. Blum, A. Kalai, J. Langford. Beating the hold-out: Bounds for k-fold and progressive cross-validation. Proceedings of the Twelfth International Conference on Computational Learning Theory, 1999.
4. L. Devroye, L. Gyorfi, G. Lugosi, A probabilistic theory of pattern recognition, 1996.
5. G. Gavin, O. Teytaud, Lower bounds for Empirical, cross-validation and Leave-One-Out estimates of the generalization error, research report, 2002.
6. P.M. Long, The Complexity of Learning According to Two Models of a Drifting Environment, Proceedings of the eleventh Annual Conference on Computational Learning Theory, 116-125, ACM press, 1998.
7. M. Kearns, D. Ron, Algorithmic Stability and Sanity-Check Bounds for Leave-One-Out Cross Validation, AT& T Labs research Murray Hill, New Jersey and MIT Cambridge, MA, 1997.
8. K. Alexander, Probabilities Inequalities for Empirical Processes and a Law of the Iterated Logarithm, Annals of Probability, volume 4, pp. 1041-1067, 1984
9. M. Talagrand, Sharper Bounds for Gaussian and Empirical Processes, The Annals of Probability, 22(1), 28-76, 1994
10. V.N. Vapnik, Estimation of Dependences Based on Empirical Data, 1982.