Data-driven decomposition for multi-class classification

Pattern Recognition

Volumn 41, Issue 1, 2008, Pages 67-76

  Zhou, Jie ^a   Peng, Hanchuan ^b   Suen, Ching Y ^c  

^a NORTHERN ILLINOIS UNIVERSITY   (United States)

^b HOWARD HUGHES MEDICAL INSTITUTE   (United States)

^c Gina Cody School of Engineering and Computer Science   (Canada)

Author keywords

Data driven Error Correcting Output Coding (DECOC); Error Correcting Output Coding (ECOC); Gene expression classification; Handwritten numeral recognition; Multi class classification; Support vector machine

Indexed keywords

CHARACTER RECOGNITION; CODES (SYMBOLS); ERROR CORRECTION; GENE EXPRESSION; MATRIX ALGEBRA; SUPPORT VECTOR MACHINES;

DATA-DRIVEN ERROR CORRECTING OUTPUT CODING (DECOC); ERROR CORRECTING OUTPUT CODING (ECOC); GENE EXPRESSION CLASSIFICATION; HANDWRITTEN NUMERAL RECOGNITION; MULTICLASS CLASSIFICATION;

CLASSIFICATION (OF INFORMATION);

EID: 34548126507     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.05.020     Document Type: Article

References (34)

1. Wu T.-F., Lin C.J., and Weng R.C. Probability estimates for multi-class classification by pairwise coupling. J. Mach. Learn. Res. 5 (2004) 975-1005
2. Hastie T., and Tibshirani R. Classification by pairwise coupling. Ann. Stat. 26 2 (1998) 451-471
3. Vapnik V. The Nature of Statistical Learning Theory (1996), Springer, New York
4. Dietterich T.G., and Bakiri G. Solving multiclass learning problems via error-correcting output codes. J. Artif. Intell. Res. 2 (1995) 263-286
5. Berger A. Error-correcting output coding for text classification. Proceedings of IJCAI'99: Workshop on Machine Learning for Information Filtering (1999), Stockholm, Sweden
6. K. Crammer, Y. Singer, Improved output coding for classification using continuous relaxation, in: Proceedings of NIPS, 2000.
7. Alpaydin E., and Mayoraz E. Learning error-correcting output codes from data. Proceedings of International Conference on Artificial Neural Networks (ICANN'99) vol. 2 (1999) 743-748
8. Allwein E.L., Schapire R.E., and Singer Y. Reducing multiclass to binary: a unifying approach for margin classifiers. J. Mach. Learn. Res. 1 (2000) 113-141
9. C.L. Blake, C.J. Merz, UCI repository of machine learningdatabases, a huge collection of artificial and real-world data sets, 1998, Available from: 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉.
10. R. Ghani, Using error-correcting codes for text classification, in: Proceedings of ICML, 2000, pp. 303-310.
11. J.D.M. Rennie, R. Rifkin, Improving multiclass text classification with the support vector machine, (MIT AI Memo 2001-026).
12. J.X. Dong, A. Krzyzak, C.Y. Suen, A fast SVM training algorithm, in: S.-W. Lee, A. Verri (Eds.), International Workshop on Pattern Recognition with Support Vector Machines, Lecture Notes in Computer Science, vol. 2388, Springer, Niagara Falls, Canada, August 10, 2002, pp. 53-67.
13. J.S. Marron, M. Todd, Distance weighted discrimination, Technical Report No. 1339, School of Operations Research and Industrial Engineering, Cornell University, July 2002.
14. Raudy S.J., and Jain A.K. Small sample size effects in statistical pattern recognition: recommendations for practitioners. IEEE Trans. PAMI 13 3 (1991) 252-264
15. Viterbi A., and Omura J. Principles of Digital Communication and Coding (1979), Mc-Graw Hill, New York
16. MacKay D. Information Theory, Inference, and Learning Algorithms (2003), Cambridge University Press, Cambridge, UK
17. Schapire R.E. Using output codes to boost multiclass learning problems. Proceedings of 14th International Conference on Machine Learning (1997)
18. Bezdek J.C., and Pal N.R. Some new indexes of cluster validity. IEEE Trans. Syst. Man Cybernet. B 28 3 (1998) 301-315
19. Rencher A.C. Methods of Multivariate Analysis. second ed. (2002), Wiley, New York
20. Kuncheva L.I. A theoretical study on six classifier fusion strategies. IEEE Trans. Pattern Anal. Mach. Intell. 24 2 (2002) 281-286
21. Schapire R.E., Freund Y., Bartlett P., and Lee W.S. Boosting the margin: a new explanation for the effectiveness of voting methods. Ann. Stat. 26 (1998) 1651-1686
22. Zhou J., and Suen C.Y. Unconstrained numeral pair recognition using enhanced error correcting output coding: a holistic approach. Proceedings of International Conference on Document Analysis and Recognition (ICDAR'2005) (2005) 484-488
23. Liu C.L., Sako H., and Fujisawa H. Effects of classifier structure and training regimes on integrated segmentation and recognition of handwritten numeral strings. IEEE Trans. PAMI 26 (2004) 1395-1407
24. Zhou J., Krzyzak A., and Suen C.Y. Verification-a method of enhancing the recognizers of isolated and touching handwritten numerals. Pattern Recognition 35 (2002) 1179-1189
25. Oliveira L.S., Sabourin R., Bortolozzi F., and Suen C.Y. Automatic recognition of handwritten numerical strings: a recognition and verification strategy. IEEE Trans. PAMI 4 11 (2002) 1438-1454
26. Wang X., Govindaraju V., and Srihari S. Multi-experts for touching digit string recognition. Proceedings of ICDAR (1999) 800-803
27. Choi S.-M., and Oh I.-S. A segmentation-free recognition of handwritten touching numeral paris using modular neural network. Int. J. Pattern Recognition Artif. Intell. 15 (2001) 949-966
28. Hsu C.-W., and Lin C.-J. A comparison of methods for multi-class support vector machines. IEEE Trans. Neural Networks 13 (2002) 415-425
29. Platt J., Cristianini N., and Shawe-Taylor J. Large margin DAGs for multiclass classification. Advances in Neural Information Processing Systems vol. 12 (2000), MIT Press, Cambridge 547-553
30. Speed T. Statistical Analysis of Gene Expression Microarray Data (2003), Chapman & Hall, London Press, CRC, Boca Raton, FL
31. Ross D.T., Sherf U., et al. A cDNA microarray gene expression database for the molecular pharmacology of cancer. Nat. Genet. 24 3 (2000) 236-244
32. Garber M., Troyanskaya O., et al. Diversity of gene expression in adenocarcinoma of the lung. PNAS USA 98 24 (2001) 13784-13789
33. Peng H.C., Long F.H., and Ding C. Feature selection based on mutual information: criteria of max-dependency max-relevance and min-redundancy. IEEE Trans. PAMI 27 8 (2005) 1226-1238
34. Ding C., and Peng H.C. Minimum redundancy feature selection from microarray gene expression data. J. Bioinformatics Comput. Biol. 3 2 (2005) 185-205