Distribution-balanced stratified cross-validation for accuracy estimation

Journal of Experimental and Theoretical Artificial Intelligence

Volumn 12, Issue 1, 2000, Pages 1-12

  Zeng, Xinchuan ^a   Martinez, Tony R ^a  

^a 3361 TMCB   (United States)

Author keywords

Classifier; Cross validation; Machine learning research; True accuracy

Indexed keywords

EID: 0034418371     PISSN: 0952813X     EISSN: 13623079     Source Type: Journal    
DOI: 10.1080/095281300146272     Document Type: Article

References (9)

1. Breiman, L., Friedman, J. H., Olshen, R. A. and Stone, C. J., 1984, Classification and Regression Trees (Wadsworth International Group).
2. Dietterich, T. G., 1998, Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms. Neural Computation, 10: 1895-1923.
3. Efron, B. and Tibshirani, R., 1993, An Introduction to the Bootstrap (Chapman & Hall).
4. Jain, A. K., Dubes, R. C. and Chen, C., 1987, Bootstrap techniques for error estimation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 9: 628-633.
5. Kohavi, R., 1995, A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 1 137-1143.
6. Merz, C. J., and Murphy, P. M., 1996, UCI repository of machine learning databases. http://www.ics.uci.edu/~mlearn /MLRepository.html
7. Quinlan, J. R., 1993, C4.5: Programs for Machine Learning. (Morgan Kaufman, Los Altos, California).
8. Weiss, S. M., 1991, Small sample error rate estimation for k-nearest neighbor classifiers, IEEE Transactions on Pattern Analysis and Machine Intelligence, 13: 285-289.
9. Weiss, S. M. and Indurkhya, N., 1994, Decision tree pruning: biased or optimal?, in Proceedings of the twelfth national conference on artificial intelligence, 626-632.