Joint binary classifier learning for ECOC-based multi-class classification

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 38, Issue 11, 2016, Pages 2335-2341

  Liu, Mingxia ^a,b   Zhang, Daoqiang ^a   Chen, Songcan ^a   Xue, Hui ^c  

^a NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

^b TAISHAN UNIVERSITY   (China)

^c SOUTHEAST UNIVERSITY   (China)

Author keywords

(joint) binary classifier learning; Error correcting output coding (ECOC); Multi class classification; Relationship

Indexed keywords

ARTIFICIAL INTELLIGENCE; BINS; CLASSIFIERS; FACE RECOGNITION; IMAGE RECOGNITION; LEARNING ALGORITHMS; LEARNING SYSTEMS; OPTIMIZATION;

ALTERNATING OPTIMIZATIONS; BINARY CLASSIFIERS; ERROR-CORRECTING OUTPUT CODING; GENERALIZATION PERFORMANCE; MULTI-CLASS CLASSIFICATION; RELATIONSHIP; STATE-OF-THE-ART METHODS; UCI MACHINE LEARNING REPOSITORY;

CLASSIFICATION (OF INFORMATION);

EID: 84990982240     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2430325     Document Type: Article

References (37)

1. T. Gao and D. Koller, "Discriminative learning of relaxed hierarchy for large-scale visual recognition," in Proc. IEEE Int. Conf. Comput. Vis., pp. 2072-2079, 2011.
2. K. Crammer and C. Gentile, "Multiclass classification with bandit feedback using adaptive regularization," Mach. Learning, vol. 90, pp. 347-383, 2013.
3. T. G. Dietterich and G. Bakiri, "Solving multiclass learning problems via error-correcting output codes," J. Artif. Intell. Res., vol. 2, pp. 263-286, 1995.
4. M. M. David, "Statistical decision-tree models for parsing," in Proc. 33rd Ann. Meeting Assoc. Comput. Linguistics, pp. 276-283, 1995.
5. M. T. Hagan, H. B. Demuth, and M. H. Beale, Neural Network Design, PWS Pub. Co., 1996.
6. T.-F. Wu, C.-J. Lin, and R. C. Weng, "Probability estimates for multi-class classification by pairwise coupling," J. Mach. Learning Res., vol. 5, pp. 975-1005, 2004.
7. W. W. Peterson and E. J. Weldon, Error-Correcting Codes, Cambridge MIT Press, 1972.
8. O. Pujol, P. Radeva, and J. Vitria, "Discriminant ECOC: A heuristic method for application dependent design of error correcting output codes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 6, pp. 1007-1012, Jun. 2006.
9. S. Escalera, D. M. J. Tax, O. Pujol, P. Radeva, and R. P. W. Duin, "Subclass problem-dependent design for error-correcting output codes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 6, pp. 1041-1054, Jun. 2008.
10. M. Cissé, T. Artiéres, and P. Gallinari, "Learning compact class codes for fast inference in large multi class classification," in Proc. IEEE Int. Conf. Mach. Learning, pp. 506-520, 2012.
11. T. Takenouchi and S. Ishii, "A unified framework of binary classifiers ensemble for multi-class classification," in Proc. IEEE Int. Conf. Neural Inform. Process., vol. 7664, pp. 375-382, 2012.
12. A. Frank and A. Asuncion, "UCI Machine Learning Repository," ed. Irvine School Inf. Comput. Sci., Univ. California, Berkeley, CA, USA, 2007.
13. T. Gao and D. Koller, "Discriminative learning of relaxed hierarchy for large-scale visual recognition," in Proc. IEEE Int. Conf. Comput. Vision, pp. 2072-2079, 2011.
14. N. J. Nilsson, Learning Machines. New York: McGraw-Hill, 1965.
15. T. Hastie and R. Tibshirani, "Classification by pairwise coupling," Annals Stat., vol. 26, pp. 451-471, 1998.
16. E. L. Allwein, R. E. Schapire, Y. Singer, and P. Kaelbling, "Reducing multiclass to binary: A unifying approach for margin classifiers," J. Mach. Learning Res., vol. 1, pp. 113-141, 2001.
17. J. D. Zhou, X. D. Wang, H. J. Zhou, J. M. Zhang, and N. Jia, "Decoding design based on posterior probabilities in ternary error-correcting output codes," Pattern Recognit., vol. 45, pp. 1802-1818, 2012.
18. T. Takenouchi and S. Ishii, "Ternary Bradley-Terry model-based decoding for multi-class classification and its extensions," Mach. Learning, vol. 85, pp. 249-272, 2011.
19. G. Q. Zhong, K. Z. Huang, and C. L. Liu, "Joint learning of error-correcting output codes and dichotomizers from data," Neural Comput. Appl., vol. 21, pp. 715-724, 2012.
20. C. Koby and S. Yoram, "On the learnability and design of output codes for multiclass problems," Mach. Learning, vol. 47, pp. 201-233, 2002.
21. M. A. Bautista, S. Escalera, X. Baró, and O. Pujol, "On the design of an ecoccompliant genetic algorithm," Pattern Recognit., vol. 47, pp. 865-884, 2014.
22. M. Ali Bagheri, Q. Gao, and S. Escalera, "A genetic-based subspace analysis method for improving error-correcting output coding," Pattern Recognit., vol. 46, pp. 2830-2839, 2013.
23. S. Escalera, O. Pujol, and P. Radeva, "Boosted landmarks of contextual descriptors and forest-ecoc: A novel framework to detect and classify objects in cluttered scenes," Pattern Recognit. Lett., vol. 28, pp. 1759-1768, 2007.
24. N. Hatami, "Thinned-ECOC ensemble based on sequential code shrinking," Expert Syst. Appl., vol. 39, pp. 936-947, 2012.
25. B. Zadrozny, "Reducing multiclass to binary by coupling probability estimates," Proc. Adv. Neural Inf. Process. Syst., pp. 1041-1048, 2001.
26. S. Escalera, O. Pujol, and P. Radeva, "On the decoding process in ternary error-correcting output codes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 120-134, Jan. 2010.
27. R. Rifkin and A. Klautau, "In defense of one-vs-all classification," J. Mach. Learning Res., vol. 5, pp. 101-141, 2004.
28. Y. Wang, S. Chen, and H. Xue, "Can under-exploited structure of originalclasses help ecoc-based multi-class classification?," Neurocomputing, vol. 89, pp. 158-167, 2012.
29. O. Pujol, S. Escalera, and P. Radeva, "An incremental node embedding technique for error correcting output codes," Pattern Recognit., vol. 41, pp. 713-725, 2008.
30. Y. Zhang and D.-Y. Yeung, "A convex formulation for learning task relationships in multi-task learning," in Proc. IEEE Int. Conf. Uncertainty Artif. Intell., pp. 733-742, 2010.
31. T. Evgeniou and M. Pontil, "Regularized multi-task learning," in Proc. ACM SIGKDD Int'l Conf. Knowledge Discovery Data Mining, Seattle, WA, USA, 2004, pp. 109-117.
32. M. A. Hearst, S. Dumais, E. Osman, J. Platt, and B. Scholkopf, "Support vector machines," IEEE Intell. Syst. Their Appl., vol. 13, no. 4, pp. 18-28, Jul./Aug. 1998.
33. T. Ojala, T. Mäenpää, M. Pietikäinen, J. Viertola, J. Kyllönen, and S. Huovinen, "Outex-new framework for empirical evaluation of texture analysis algorithms," in Proc. IEEE Int. Conf. Pattern Recognit., 2002, pp. 701-706.
34. A. L. da Cunha, J. Zhou, and M. N. Do, "The nonsubsampled contourlet transform: Theory, design, and applications," IEEE Trans. Image Process., vol. 15, no. 10, pp. 3089-3101, Oct. 2006.
35. D. Zhang, Y. Wang, L. Zhou, H. Yuan, and D. Shen, "Multimodal classification of Alzheimer's disease and mild cognitive impairment," NeuroImage, vol. 55, pp. 856-867, 2011.
36. S. Escalera, O. Pujol, and P. Radeva, "Error-correcting ouput codes library," J. Mach. Learning Res., vol. 11, pp. 661-664, 2010.
37. E. B. Kong and T. G. Dietterich, "Error-correcting output coding corrects bias and variance," Int. Conf. Mach. Learning, 1995.