Coding and decoding strategies for multi-class learning problems

Information Fusion

Volumn 4, Issue 1, 2003, Pages 11-21

  Windeatt, Terry ^a   Ghaderi, Reza ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Binary coding; Decision level fusion; ECOC; Error correcting; Multiple classifier

Indexed keywords

DECODING; ENCODING (SYMBOLS); ERROR CORRECTION; GAUSSIAN NOISE (ELECTRONIC);

DECISION LEVEL FUSION;

BINARY CODES;

EID: 0037368938     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1566-2535(02)00101-X     Document Type: Article

References (33)

1. Aha D.W., Bankert R.L. Cloud classification using error-correcting output codes. Artificial Intelligence Applications: Natural Resources, Agriculture, and Environmental Science. 11(1):1997;13-28.
2. Allwein E.L., Schapire R.E., Singer Y. Reducing multi-class to binary: A unifying approach for margin classifiers. Machine Learning Research. 1:2000;113-141.
3. E. Alpaydin, E. Mayoraz, Learning error-correcting output codes from data, in: Proceedings of International Conference on Artificial Neural Networks ICANN'99, Edinburgh, UK, September 1999, pp. 743-748.
4. A. Berger, Error-correcting output coding for text classification, in: Proceedings of International Joint Conference on Artificial Intelligence, IJCAI'99, Stockholm, Sweden, 1999.
5. C.L. Blake, C.J. Merz, UCI repository of machine learning databases, University of California, Irvine, Department of Information and Computer Sciences, 1998, http://www.ics.uci.edu/̃mlearn/MLRepository.html.
6. Breiman L. Bagging predictors. Machine Learning. 24(2):1997;123-140.
7. L. Breiman, Some infinity theory for predictor ensembles, Technical Report 577, Statistic Department of University of California, Berkeley, CA, 2000.
8. Crammer K., Singer Y. On the learnability and design of output codes for multiclass problems. Machine Learning. 47(2-3):2002;201-233.
9. T.G. Dietterich, Ensemble methods in machine learning, in: J. Kittler, F. Roli (Eds.), Multiple Classifier Systems, MCS2000, Cagliari, Italy, Springer Lecture Notes in Computer Science, 2000, pp. 1-15.
10. T.G Dietterich, G. Bakiri, Error-correcting output codes: A general method for improving multiclass inductive learning programs, in: Proceedings of the Ninth National Conference on Artificial Intelligence (AAAI-91), AAAI Press, 1991, pp. 572-577.
11. Dietterich T.G., Bakiri G. Solving multi-class learning problems via error-correcting output codes. Journal of Artificial Intelligence Research. 2:1995;263-286.
12. Freund Y., Schapire R.E. A decision-theoretic generalisation of on-line learning and application to boosting. Journal of Computer and System Science. 55:1997;119-139.
13. R. Ghaderi, T. Windeatt, Least squares and estimation measures via error correcting output code, in: 2nd International Workshop on Multiple Classifier Systems, Lecture Notes in Computer Science, Springer-Verlag, July 2001, pp. 148-157.
14. Hastie T., Tibshirani R. Classification by pairwise coupling. The Annals of Statistics. 2:1998;451-471.
15. G.M. James, Majority Vote Classifiers: Theory and Applications. PhD Thesis, Department of Statistics, University of Stanford, California, May 1998.
16. G.M. James, Variance, bias for general loss functions, Machine Learning, in press.
17. James G.M., Hastie T. The error coding method and PICT's. Computational and Graphical Statistics. 7:1998;377-387.
18. J. Kittler, F.M. Alkoot, Relationship of sum and vote fusion strategies, in: 2nd International Workshop on Multiple Classifier Systems, Lecture Notes in Computer Science, Springer-Verlag, July 2001, pp. 339-348.
19. J. Kittler, R. Ghaderi, T. Windeatt, G. Matas, Face verification using error correcting output codes, in: Computer Vision and Pattern Recognition CVPR01, Hawaii, IEEE Press, December 2001.
20. E.B. Kong, T.G. Diettrich, Error-correcting output coding corrects bias and variance, in: M. Kaufmann (Ed.), 12th International Conference of Machine Learning, San Fransisco, 1995, pp. 313-321.
21. E.B. Kong, T.G. Diettrich, Probability estimation via error-correcting output coding, in: International Conference of Artificial Intelligence and Soft Computing, Banff, Canada, 1997
22. F. Leisch, K. Hornik, Combining neural networks voting classifiers and error correcting output codes, in: I. Frolla, A. Plakove, (Eds.), MEASURMENT 97, Smolenice, Slovakia, May 1997, pp. 266-269.
23. F. Masulli, G. Valentini, Effectiveness of error correcting output codes in multiclass learning problems, in: J. Kittler, F. Roli (Eds.), Multiple Classifier Systems, MCS2000, Cagliari, Italy, Springer Lecture Notes in Computer Science, 2000, pp. 107-116.
24. Peterson W.W., Weldon J.R. Error-Correcting Codes. 1972;MIT press, Cambridge, MA.
25. R.E. Schapire, Using output codes to boost multiclass learning problems, in: M. Kaufman (Ed.), 14th International Conference on Machine Learning, 1997, pp. 313-321.
26. Sejnowski T.J., Rosenberg C.R. Parallel networks that learn to pronounce english text. Complex Systems. 1:1987;145-168.
27. Shafer G. A Mathematical Theory of Evidence. 1976;Princeton University Press, Princeton, NJ.
28. E. Tapia, E.J.C. Gonzalez, J. Garcia-Villalba, On the design of error adaptive ecoc algorithms, in: Integrating Aspects of Data Mining, Decision Support and Meta-Learning, IDDM, Freiburg, September 2001.
29. Tumer K., Ghosh J. Error correlation and error reduction in ensemble classifiers. Connection Science, special issue on combining artificial neural networks: ensemble approaches. 8(3):1996;385-404.
30. Wilson C.L., Grother P.J., Barnes C.S. Binary decision clustering for neural-network-based optical character recognition. Pattern Recognition. 29(3):1996;425-437.
31. T. Windeatt, R. Ghaderi, Binary codes for multi-class decision combining, in: 14th Annual International Conference of Society of Photo-Optical Instrumentation Engineers (SPIE), vol. 4051, Florida, USA, April 2000, pp. 23-34.
32. Windeatt T., Ghaderi R. Multi-class learning and error-correcting code sensitivity. Electronics Letters. 36(19):2000;1630-1632.
33. Windeatt T., Ghaderi R. Binary labelling and decision level fusion. Information Fusion. 2(2):2001;103-112.