Multiclass support vector classification via coding and regression

Neurocomputing

Volumn 73, Issue 7-9, 2010, Pages 1501-1512

  Chen, Pei Chun ^a   Lee, Kuang Yao ^b   Lee, Tsung Ju ^c   Lee, Yuh Jye ^d   Huang, Su Yun ^e  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

^c NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^d NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

^e INSTITUTE OF STATISTICAL SCIENCE   (Taiwan)

Author keywords

Kernel map; Multiclass classification; Output code; Regularization; Support vector machine; Support vector regression

Indexed keywords

CLASS LABELS; CODING SCHEME; CPU TIME; EQUIVALENCE NOTIONS; FEATURE DATA; FEATURE SUBSPACE; INPUT DATAS; LINEAR CLASSIFIERS; LINEAR SUBSPACE; MULTI-CLASS; MULTI-CLASS CLASSIFICATION; MULTI-CLASS PROBLEMS; MULTICLASS CLASSIFICATION PROBLEMS; REGULARIZATION; SUPPORT VECTOR CLASSIFICATION; SUPPORT VECTOR REGRESSIONS;

FEATURE EXTRACTION; IMAGE RETRIEVAL; SUPPORT VECTOR MACHINES; VECTORS;

REGRESSION ANALYSIS;

ARTICLE; CLASSIFICATION ALGORITHM; CODING; COMPUTER PREDICTION; CONTROLLED STUDY; DATA EXTRACTION; DATA SYNTHESIS; DISCRIMINANT ANALYSIS; EXPERIMENTAL STUDY; INTERMETHOD COMPARISON; KERNEL METHOD; LINEAR SYSTEM; MATHEMATICAL COMPUTING; POWER ANALYSIS; PRIORITY JOURNAL; REGRESSION ANALYSIS; SUPPORT VECTOR MACHINE;

EID: 77649232848     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.11.005     Document Type: Article

References (37)

1. Allwein E.L., Schapire R.E., and Singer Y. Reducing multiclass to binary: a unifying approach for margin classifiers. J. Mach. Learn. Res. 1 (2001) 113-141
2. Anderson T.W. An Introduction to Multivariate Statistical Analysis. 3rd ed. (2003), Wiley, New York
3. A. Asuncion, D.J. Newman, UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences, 2007, 〈http://www.ics.uci.edu/∼ mlearn/MLRepository.htm〉.
4. Bredensteiner E.J., and Bennett K.P. Multicategory classification by support vector machines. Comput. Optim. Appl. 12 (1999) 53-79
5. Burges C.J.C. A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Disc. 2 (1998) 121-167
6. C.C. Chang, C.J. Lin, LIBSVM: a library for support vector machines, 2001, 〈http://www.csie.ntu.edu.tw/∼cjlin/libsvm〉.
7. Cortes C., and Vapnik V. Support vector networks. Mach. Learn. 20 (1995) 273-297
8. K. Crammer, Y. Singer, Improved output coding for classification using continuous relaxation, in: Proceeding of the Thirteenth Annual Conference on Neural Information Processing Systems, 2000.
9. Crammer K., and Singer Y. On the algorithmic implementation of multiclass kernel-based vector machines. J. Mach. Learn. Res. 2 (2001) 265-292
10. Crammer K., and Singer Y. On the learnability and design of output codes for multiclass problems. Mach. Learn. 47 (2002) 201-233
11. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines (2000), Cambridge University Press, Cambridge
12. Dietterich T.G., and Bakiri G. Solving multiclass learning problems via error-correcting output codes. J. Artif. Intell. Res. 2 (1995) 263-286
13. Fang K.T., and Wang Y. Number-Theoretic Methods in Statistics (1994), Chapmman & Hall, London
14. Fisher R.A. The use of multiple measurements in taxonomic problems. Ann. Eugen. 7 (1936) 179-188
15. Friedman J.H. Multivariate adaptive regression splines (with discussion). Ann. Stat. 19 (1991) 1-141
16. G.M. Fung, O.L. Mangasarian, Proximal support vector machine classifiers, in: Proceedings KDD-2001: Knowledge Discovery and Data Mining, 2001, pp. 77-86.
17. Fung G.M., and Mangasarian O.L. Multicategory proximal support vector machine classifiers. Mach. Learn. 59 (2005) 77-97
18. Fürnkranz J. Round robin classification. J. Mach. Learn. Res. 2 (2002) 721-747
19. Hastie T., Buja A., and Tibshirani R. Penalized discriminant analysis. Ann. Stat. 23 (1995) 73-102
20. Hastie T., Tibshirani R., and Buja A. Flexible discriminant analysis by optimal scoring. J. Am. Stat. Assoc. 89 (1994) 1255-1270
21. Hoffman D.G., Leonard D.A., Lindner C.C., Phelps K.T., Rodger C.A., and Wall J.R. Coding Theory: The Essentials (1991), Marcel Dekker, New York
22. Hsu C.W., and Lin C.J. A comparison on methods for multi-class support vector machines. IEEE Trans. Neural Network 13 (2002) 415-425
23. Huang C.M., Lee Y.J., Lin D.K.J., and Huang S.Y. Model selection for support vector machines via uniform design. Comput. Stat. Data Anal. 52 (2007) 335-346
24. Lee Y., Lin Y., and Wahba G. Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data. J. Am. Stat. Assoc. 99 (2004) 67-81
25. Lee Y.J., and Huang S.Y. Reduced support vector machines: a statistical theory. IEEE Trans. Neural Network 18 (2007) 1-13
26. Y.J. Lee, O.L. Mangasarian, RSVM: reduced support vector machines, in: First SIAM International Conference on Data Mining, Chicago, 2001.
27. Lee Y.J., and Mangasarian O.L. SSVM: a smooth support vector machine for classification. Comput. Optim. Appl. 20 (2001) 5-22
28. Liu Y., You Z., and Cao L. A novel and quick SVM-based multi-class classifier. Pattern Recognition 39 (2006) 2258-2264
29. Mangasarian O.L., and Musicant D.R. Lagrangian support vector machines. J. Mach. Learn. Res. 1 (2001) 161-177
30. Mardia K.V., Kent J.T., and Bibby J.M. Multivariate Analysis (1979), Academic Press, New York
31. S. Mika, G. Rätsch, J. Weston, B. Schölkopf, K.R. Müller, Fisher discriminant analysis with kernels, in: Neural Networks for Single Processing IX, 1999, pp. 41-48.
32. H. Niederreiter, Random number generation and quasi-Monte Carlo methods, in: Society for Industrial and Applied Mathematics (SIAM), Philadelphia, 1999.
33. Rifkin R., and Klautau A. In defense of one-vs-all classification. J. Mach. Learn. Res. 5 (2004) 101-141
34. V. Roth, V. Steinhage, Nonlinear discriminant analysis using kernel functions, in: Advances in Neural Information Processing System, vol. 12, 1999, pp. 568-574.
35. Suykens J.A.K., Van Gestel T., De Brabanter J., De Moor B., and Vandewalle J. Least Squares Support Vector Machines (2002), World Scientific, New Jersey
36. Suykens J.A.K., and Vandewalle J. Least squares support vector machine classifiers. Neural Process. Lett. 9 (1999) 293-300
37. Vapnik V.N. Statistical Learning Theory (1998), Wiley, New York