Subclass problem-dependent design for error-correcting output codes

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 30, Issue 6, 2008, Pages 1041-1054

  Escalera, Sergio ^a   Tax, David M J ^b   Pujol, Oriol ^a   Radeva, Petia ^a   Duin, Robert P W ^b  

^a Barcelona Perception Computing Lab   (Spain)

^b Delft University of Technology ^*  (Netherlands)

Author keywords

Embedding of dichotomizers; Error correcting output codes; Multiclass classification; Subclasses

Indexed keywords

ERROR CORRECTION; MATHEMATICAL MODELS; PROBLEM SOLVING;

CODEWORD; DICHOTOMIZERS; ERROR-CORRECTING OUTPUT CODES; MULTICLASS CLASSIFICATION PROBLEMS;

CODES (SYMBOLS);

ALGORITHM; ARTICLE; ARTIFACT; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFACTS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 43249104670     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2008.38     Document Type: Article

References (28)

1. E. Allwein, R. Schapire, and Y. Singer, "Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers," J. Machine Learning Research, vol. 1, pp. 113-141, 2002.
2. A. Asuncion and D. Newman, UCI Machine Learning Repository. School of Information and Computer Sciences, Univ. of California, Irvine, 2007.
3. J. Casacuberta, J. Miranda, M. Pla,S. Sanchez,A. Serra, and J. Talaya, "On the Accuracy and Performance of the Geomobil System," Proc. 20th Congress Int'l Soc. for Photogrammetry and Remote Sensing, 2004.
4. K. Crammer and Y. Singer, "On the Learnability and Design of Output Codes for Multi-Class Problems," Machine Learning, vol. 47, pp. 201-233, 2002.
5. H. Daume and D. Marcu, "A Bayesian Model for Supervised Clustering with the Dirichlet Process Prior," J. Machine Learning Research, 14 pp. 1551-1577, 2005.
6. J. Demsar, "Statistical Comparisons of Classifiers over Multiple Data Sets," J. Machine Learning Research, pp. 1-30, 2006.
7. T. Dietterich and G. Bakiri, "Solving Multiclass Learning Problems via Error-Correcting Output Codes," J. Artificial Intelligence Research vol. 2, pp. 263-282, 1995.
8. S. Escalera, O. Pujol, and P. Radeva, "Loss-Weighted Decoding for Error-Correcting Output Codes," Proc. Int'l Conf. Computer Vision Theory and Applications, vol. 2, pp. 117-122, 2008.
9. S. Escalera, O. Pujol, and P. Radeva, "Boosted Landmarks of Contextual Descriptors and Forest-ECOC: A Novel Framework to Detect and Classify Objects in Clutter Scenes," Pattern Recognition Letters, vol. 28, no. 13, pp. 1759-1768, 2007.
10. T.N. Faculty of Applied Physics, Delft Univ. of Technology, http:// www.prtools.org/, 2008.
11. J. Friedman, T. Hastie, and R. Tibshirani, "Additive Logistic Regression: A Statistical View of Boosting," The Annals of Statistics, vol. 38, pp. 337-374, 1998.
12. R. Ghani, "Combining Labeled and Unlabeled Data for Text Classification with a Large Number of Categories," Proc. IEEE Int'l Conf. Data Mining, pp. 597-598, 2001.
13. T. Hastie and R. Tibshirani, "Classification by Pairwise Grouping," Proc. Neural Information Processing Systems Conf., vol. 26, pp. 451-471, 1998.
14. J. Kapur and H. Kesavan, Entropy Optimization Principles with Applications. Academic Press, 1992.
15. J. Kittler, R. Ghaderi, T. Windeatt, and J. Matas, "Face Verification Using Error Correcting Output Codes," Proc. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 755-760, 2001.
16. E.B. Kong and T.G. Dietterich, "Error-Correcting Output Coding Corrects Bias and Variance," Proc. 12th Int'l Conf. Machine Learning, pp. 313-321, 1995.
17. N.J. Nilsson, Learning Machines. McGraw-Hill, 1965.
18. OSU-SVM-TOOLBOX, http://svm.sourceforge.net/docs/3.00/api/, 2008.
19. P. Pudil, F. Ferri, J. Novovicova, and J. Kittler, "Floating Search Methods for Feature Selection with Nonmonotonic Criterion Functions," Proc. Int'l Conf. Pattern Recognition, pp. 279-283, 1994.
20. O. Pujol, S. Escalera, and P. Radeva, "An Incremental Node Embedding Technique for Error Correcting Output Codes," Pattern Recognition submitted for publication.
21. O. Pujol, P. Racova, and J. Vitrià, "Discriminant ECOC: A Heuristic Method for Application Dependent Design of Error Correcting Output Codes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 6, pp. 1001-1007, June 2006.
22. J. Shi and J. Malik, "Normalized Cuts and Image, Segmentation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2000.
23. J. Shi and J. Malik, "Feature Extraction by Non-Parametric Mutual Information Maximization," J. Machine Learning Research, pp. 1415-1438, 2003.
24. W. Utschick and W. Weichselberger, "Stochastic Organization of Output Codes in Multiclass Learning Problems," Neural Computation, vol. 13, no. 5, pp. 1065-1102, 2001.
25. T. Windeatt and G. Ardeshir, "Boosted ECOC Ensembles for Face Recognition," Proc. Int'l Conf. Visual Information Eng., pp. 165-168, 2003.
26. Q. Zgu, "Minimum Cross-Entropy Approximation for Modeling of Highly Intertwining Data Sets at Subclass Levels," J. Intelligent Information Systems, pp. 139-152, 1998.
27. J. Zhou and C. Suen, "Unconstrained Numeral Pair Recognition Using Enhanced Error Correcting Output Coding: A Holistic Approach," Proc. Eighth Int'l Conf. Document Analysis and Recognition, vol. 1. pp. 484-488, 2005.
28. M. Zhu and A.M. Martinez, "Subclass Discriminant Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 8, pp. 1274-1286, Aug. 2006.