Error-Correcting Output Coding Corrects Bias and Variance

Proceedings of the 12th International Conference on Machine Learning, ICML 1995

Volumn , Issue , 1995, Pages 313-321

  Kong, Eun Bae ^a   Dietterich, Thomas G ^b  

^a Chungnam National University   (South Korea)

^b OREGON STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION TREES; ERRORS;

BIAS AND VARIANCE; BIAS CORRECTION; CLASSIFICATION ACCURACY; CODING METHODS; CODING TECHNIQUES; CORRECTION ABILITY; DATAPOINTS; DECISION TREE LEARNING ALGORITHM; ERROR-CORRECTING OUTPUT CODING; LEARN+;

LEARNING ALGORITHMS;

EID: 84992322729     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Bakiri, G. (1991). Converting English text to speech: A machine learning approach. Tech. rep. 91- 30-2, Oregon State University, Corvallis, OR. Bates, J. M., & Granger, C. W. J. (1969). The combination of forecasts. Op. Res. Qtly., 20, 319- 325.
2. Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984). Classification and Regression Trees. Wadsworth.
3. Breiman, L. (1994). Bagging predictors. Tech. rep. 421, Dept. of Statistics, Univ. of Cal., Berkeley, CA.
4. Cardie, C. (1993). Using decision trees to improve case-based learning. In Proc. 10th Intl. Conf. Mach. Learn., pp. 17-24 San Francisco, CA. Morgan Kaufmann.
5. Clemen, R. T. (1989). Combining forcasts: A review and annotated bibliography. Int. J. of Forecasting, 5, 559-583.
6. Dietterich, T. G., & Bakiri, G. (1991). Errorcorrecting output codes: A general method for improving multiclass inductive learning programs. In Proc. AAAI-91, pp. 572-577. AAAI Press/MIT Press.
7. Dietterich, T. G., & Bakiri, G. (1995). Solving multiclass learning problems via error-correcting output codes. J. of Art. Int. Res., 2, 263-286.
8. Efron, B. (1978). Regression and ANOVA with zeroone data: Measures of residual variation. J. Am. Stat. As., 75(361), 113-121.
9. Hampshire II, J. B., & Waibel, A. H. (1990). A novel objective function for improved phoneme recognition using time-delay neural networks. IEEE Trans. Neural Networks, 1(2), 216-228.
10. Hansen, L., & Salamon, P. (1990). Neural network ensembles. IEEE PAMI, 12, 993-1001.
11. LeBlanc, M., & Tibshirani, R. (1993). Combining estimates in regression and classification. Tech. rep., Dept. of Statistics, Univ. of Toronto.
12. Makridakis, S., & Winkler, R. L. (1983). Averages of forecasts: Some empirical results. Management Sei., 29(9), 987-996.
13. Meir, R. (1994). Bias, variance, and the combination of estimators; The case of linear least squares. Tech. rep., Technion, Israel.
14. Murphy, P., & Aha, D. (1994). UCI repository of machine learning databases [machine-readable data repository]. Univ. of Cal., Irvine.
15. Nilsson, N. J. (1965). Learning Machines. McGraw- Hill, New York.
16. Perrone, M. P. (1993). Improving regression estimation: Averaging methods for variance reduction with extensions to general convex measure optimization. Ph.D. thesis, Brown Univ.
17. Perrone, M. P. (1994). Putting it all together: Methods for combining neural networks. In Cowan, J. D., Tesauro, G., L• Alspector, J. (Eds.), Advances in Neural Information Processing Systems, 6, 1188-1189. Morgan Kaufmann, San Francisco, CA.
18. Perrone, M. P., & Cooper, L. N. (1993). When networks disagree: Ensemble methods for hybrid neural networks. In Mammone, R. J. (Ed.), Neural networks for speech and image processing. Chapman and Hall.
19. Quinlan, J. R. (1993a). C4.5: Programs for Empirical Learning. Morgan Kaufmann, San Francisco, CA.
20. Quinlan, J. R. (1993b). Combining instance-based and model-based learning. In Utgoff, P. E. (Ed.), Proc. Int. Conf. on Mach. Learn. San Francisco, CA. Morgan Kaufmann.
21. Schapire, R. E. (1990). The strength of weak learnability. Mach. Learn., 5(2), 197-227.
22. Wettschereck, D., & Dietterich, T. G. (1992). Improving the performance of radial basis function networks by learning center locations. In Moody, J. E., Hanson, S. J., L• Lippmann, R. P. (Eds.), Advances in Neural Information Processing Systems, 4, 1133-1140. Morgan Kaufmann, San Francisco, CA.
23. Zhang, X., Mesirov, J. P., & Waltz, D. L. (1992). Hybrid system for protein secondary structure prediction. J. of Mol. Biol., 225.