A genetic-based subspace analysis method for improving Error-Correcting Output Coding

Pattern Recognition

Volumn 46, Issue 10, 2013, Pages 2830-2839

  Bagheri, Mohammad Ali ^a   Gao, Qigang ^a   Escalera, Sergio ^b,c  

^a DALHOUSIE UNIVERSITY   (Canada)

^b Edifici O Bellaterra ^*  (Spain)

^c UNIVERSITY OF BARCELONA   (Spain)

Author keywords

Ensemble classification; Error Correcting Output Codes; Evolutionary computation; Feature subspace; Multiclass classification

Indexed keywords

COMPUTER VISION PROBLEMS; ENSEMBLE CLASSIFICATION; ERROR CORRECTING OUTPUT CODE; ERROR-CORRECTING OUTPUT CODING; FEATURE SUBSPACE; MULTI-CLASS CLASSIFICATION; MULTICLASS CLASSIFICATION PROBLEMS; UCI MACHINE LEARNING REPOSITORY;

CLASSIFICATION (OF INFORMATION); DECISION TREES; DESIGN; LEARNING ALGORITHMS; THREE DIMENSIONAL;

EVOLUTIONARY ALGORITHMS;

EID: 84878011646     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2013.03.014     Document Type: Article

References (52)

1. V. Vapnik Statistical Learning Theory 1998 Wiley New York
2. J. Tanha, M. van Someren, H. Afsarmanesh, An adaboost algorithm for multiclass semi-supervised learning, in: 2012 IEEE 12th International Conference on Data Mining (ICDM), 2012, pp. 1116-1121.
3. N. García-Pedrajas, and D. Ortiz-Boyer An empirical study of binary classifier fusion methods for multiclass classification Information Fusion 12 2 2011 111 130
4. C.-W. Hsu, and C.-J. Lin A comparison of methods for multiclass support vector machines IEEE Transactions on Neural Networks 13 2 2002 415 425
5. R. Anand, K. Mehrotra, C.K. Mohan, and S. Ranka Efficient classification for multiclass problems using modular neural networks IEEE Transactions on Neural Networks 6 1 1995 117 124
6. T. Hastie, R. Tibshirani, Classification by pairwise coupling, The Annals of Statistics 26 (2) (1998) 451-471
7. T. Dietterich, and G. Bakiri Solving multiclass learning problems via error-correcting output codes Journal of Artificial Intelligence Research 2 1995 263 286
8. E.L. Allwein, R.E. Schapire, and Y. Singer Reducing multiclass to binary: a unifying approach for margin classifiers Journal of Machine Learning Research 1 2001 113 141
9. S. Escalera, O. Pujol, and P. Radeva Separability of ternary codes for sparse designs of error-correcting output codes Pattern Recognition Letters 30 3 2009 285 297
10. E. Kong, T. Dietterich, Error-correcting output coding corrects bias and variance, in: A. Prieditis, J. Lemmer (Eds.), Machine Learning: Proceedings of the Twelfth International Conference on Machine Learning, 1995, pp. 313-321.
11. E. Kong, T. Dietterich, Why Error-Correcting Output Coding Works with Decision Trees, Technical Report, Department of Computer Science, Oregon State University, Corvallis, OR, 1995.
12. T. Windeatt, and R. Ghaderi Coding and decoding strategies for multi-class learning problems Information Fusion 4 1 2003 11 21
13. A. David, and B. Lerner Support vector machine-based image classification for genetic syndrome diagnosis Pattern Recognition Letters 26 8 2005 1029 1038
14. E.D. Ubeyli Multiclass support vector machines for diagnosis of erythemato-squamous diseases Expert Systems with Applications 35 4 2008 1733 1740
15. J. Kittler, R. Ghaderi, T. Windeatt, and J. Matas Face verification via error correcting output codes Image and Vision Computing 21 13-14 2003 1163 1169
16. M.A. Bagheri, G.A. Montazer, S. Escalera, Error correcting output codes for multiclass classification: application to two image vision problems, in: 2012 16th CSI International Symposium on Artificial Intelligence and Signal Processing (AISP), Shiraz, Iran, 2012, pp. 508-513.
17. T. Windeatt, and R. Ghaderi Binary labelling and decision-level fusion Information Fusion 2 2 2001 103 112
18. W. Peterson, and J.R. Weldon Error-Correcting Codes 1972 MIT Press Cambridge, MA
19. L. Eshelman The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination 1990 Morgan Kauffman San Mateo, CA
20. N. Garcia-Pedrajas, and C. Fyfe Evolving output codes for multiclass problems IEEE Transactions of Evolutionary Computation 12 1 2007 93 106
21. R. Schapire, Using output codes to boost multiclass learning problems, in: Proceedings of the 14th International Conference on Machine Learning, San Francisco, CA, Morgan Kauffman, Los Altos, CA, 1997, pp. 313-321.
22. T.K. Ho The random subspace method for constructing decision forests IEEE Transactions on Pattern Analysis and Machine Intelligence 20 1998 832 844
23. S. Geman, E. Bienenstock, and R. Doursat Neural networks and the bias/variance dilemma Neural Computing 4 1995 1 58
24. K. Tumer, and J. Ghosh Linear and order statistics combiners for pattern classification A. Sharkey, Combining Artificial Neural Nets 1999 Springer Berlin 127 162
25. T. Windeatt, G. Ardeshir, Boosted ECOC ensembles for face recognition, in: International Conference on Visual Information Engineering, 2003, pp. 165-168.
26. A. Passerini, M. Pontil, and P. Frasconi New results on error correcting output codes of kernel machines IEEE Transactions on Neural Networks 15 1 2004 45 54
27. J.D. Zhou, X.D. Wang, H.J. Zhou, J.M. Zhang, and N. Jia Decoding design based on posterior probabilities in ternary error-correcting output codes Pattern Recognition 45 4 2012 1802 1818
28. S. Escalera, O. Pujol, and P. Radeva On the decoding process in ternary error-correcting output codes IEEE Transactions on Pattern Analysis and Machine Intelligence 32 1 2010 120 134
29. R. Bose, and D. Ray-Chaudhuri On a class of error-correcting binary group codes Information and Control 3 1960 68 79
30. M.n. Bautista, S. Escalera, X. Baró, P. Radeva, J. Vitriá, and O. Pujol Minimal design of error-correcting output codes Pattern Recognition Letters 33 6 2012 693 702
31. L.I. Kuncheva Using diversity measures for generating error-correcting output codes in classifier ensembles Pattern Recognition Letters 26 2005 83 90
32. W. Utschick, and W. Weichselberger Stochastic organization of output codes in multiclass learning problems Neural Computation 13 5 2001 1065 1102
33. S. Escalera, D. Tax, O. Pujol, P. Radeva, and R. Duin Subclass problem-dependent design of error-correcting output codes IEEE Transactions on Pattern Analysis and Machine Intelligence 30 6 2009 1041 1054
34. K. Crammer, and Y. Singer On the learnability and design of output codes for multiclass problems Machine Learning 47 2-3 2002 201 233
35. O. Pujol, P. Radeva, and J. Vitria Discriminant ECOC: a heuristic method for application dependent design of error correcting output codes IEEE Transactions on Pattern Analysis and Machine Intelligence 28 6 2006 1007 1012
36. S. Escalera, O. Pujol, P. Radeva, ECOC-ONE: A novel coding and decoding strategy, in: 18th International Conference on Pattern Recognition, 2006 (ICPR 2006), vol. 3, 2006, pp. 578-581.
37. E. Alpaydin, E. Mayoraz, Learning error-correcting output codes from data, in: International Conference on Artificial Neural Networks (ICANN99), vol. 2, 1999, pp. 43-748.
38. J. Zhou, H. Peng, and C.Y. Suen Data-driven decomposition for multi-class classification Pattern Recognition 41 1 2008 67 76
39. G. Zhong, K. Huang, and C.-L. Liu Joint learning of error-correcting output codes and dichotomizers from data Neural Computing and Applications 21 4 2012 715 724
40. N. Hatami Thinned-ECOC ensemble based on sequential code shrinking Expert Systems with Applications 39 1 2012 936 947
41. A. Frank, A. Asuncion, UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences, 2010.
42. J. Demsar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30
43. P. Nemenyi, Distribution-Free Multiple Comparisons, Ph.D. Thesis, 1963.
44. R. Iman, and J. Davenport Approximations of the critical regions of the Friedman statistic Communications in Statistics 6 1980 571 595
45. S. Escalera, A. Fornés, O. Pujol, P. Radeva, G. Sánchez, and J. Lladós Blurred shape model for binary and grey-level symbol recognition Pattern Recognition Letters 30 15 2009 1424 1433
46. University of Maryland, Laboratory for Language and Media Processing (LAMP), Logo Dataset (2012).
47. D. Doermann, E. Rivlin, and I. Weiss Applying algebraic and differential invariants for logo recognition Machine Vision and Applications 9 2 1996 73 86
48. A. Jain, and A. Vailaya Shape-based retrieval a case study with trademark image databases Pattern Recognition 31 9 1998 1369 1390
49. C. Wei, Y. Li, W. Chau, and C. Li Trademark image retrieval using synthetic features for describing global shape and interior structure Pattern Recognition 42 3 2009 386 394
50. H. Jiang, C.-W. Ngo, and H.-K. Tan Gestalt-based feature similarity measure in trademark database Pattern Recognition 39 5 2006 988 1001
51. J. Chen, M.K. Leung, and Y. Gao Noisy logo recognition using line segment Hausdorff distance Pattern Recognition 36 4 2003 943 955
52. M. Hu Visual pattern recognition by moment invariants IRE Transactions on Information Theory 8 2 1962 179 187