Variable selection for the multicategory SVM via adaptive sup-norm regularization

Electronic Journal of Statistics

Volumn 2, Issue , 2008, Pages 149-167

  Zhang, Hao Helen ^a   Liu, Yufeng ^b   Wu, Yichao ^c   Zhu, Ji ^d  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b University of North Carolina at Chapel Hill   (United States)

^c Princeton University   (United States)

^d UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Classification; L1 norm penalty; Multicategory; Sup norm; SVM

Indexed keywords

EID: 47749133494     PISSN: 19357524     EISSN: None     Source Type: Journal    
DOI: 10.1214/08-EJS122     Document Type: Article

References (36)

1. Argyriou, A., Evgeniou, T. and M., P. (2006). Multi-task feature learning. Neural Information Processing Systems, 19.
2. Argyriou, A., Evgeniou, T. and M., P. (2007). Convex multi-task feature learning. Machine Learning. To appear.
3. Boser, B. E., Guyon, I. M. and Vapnik, V. (1992). A training algorithm for optimal margin classifiers. In Fifth Annual ACM Workshop on Computational Learning Theory. ACM Press, Pittsburgh, PA, 144-152.
4. Bradley, P. S. and Mangasarian, O. L. (1998). Feature selection via concave minimization and support vector machines. In Proc. 15th International Conf. on Machine Learning. Morgan Kaufmann, San Francisco, CA, 82-90.
5. Christianini, N. and Shawe-Taylor, J. (2000). An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press.
6. Crammer, K. and Singer, Y. (2001). On the algorithmic implementation of multiclass kernel-based vector machines. Journal of Machine Learning Research, 2 265-292.
7. H.H. Zhang et al. Variable selection for multicategory SVM 166.
8. Dudoit, S., Fridlyand, J. and Speed, T. (2002). Comparison of discrimination methods for the classification of tumors using gene expression data. Journal of American Statistical Association, 97 77-87.
9. Fourer, R., Gay, D. and Kernighan, B. (2003). AMPL: A Modeling Language for Mathematical Programming. Duxbury Press.
10. Khan, J., Wei, J. S., Ringnér, M., Saal, L. H., Ladanyi, M., Westermann, F., Berthold, F., Schwab, M., Antonescu, C. R., Peterson, C. and Meltzer, P. S. (2001). Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nature Medicine, 7 673-679.
11. Lafferty, J. and Wasserman, L. (2006). Challenges in statistical machine learning. Statistica Sinica, 16 307-323.
12. Lee, Y., Kim, Y., Lee, S. and Koo, J.-Y. (2006). Structured multicategory support vector machine with anova decomposition. Biometrika, 93 555-571.
13. Lee, Y., Lin, Y. and Wahba, G. (2004). Multicategory support vector machines, theory, and application to the classification of microarray data and satellite radiance data. Journal of American Statistical Association, 99 67-81.
14. Liu, Y. and Shen, X. (2006). Multicategory ψ-learning. Journal of the American Statistical Association, 101 500-509.
15. Liu, Y. and Wu, Y. (2007). Variable selection via a combination of the and l1 penalties. Journal of Computation and Graphical Statistics, 16 782-798.
16. Liu, Y., Zhang, H. H., Park, C. and Ahn, J. (2007). Support vector machines with adaptive lq penalties. Computational Statistics and Data Analysis, 51 6380-6394.
17. Micchelli, C. and Pontil, M. (2007). Feature space perspectives for learning the kernel. Machine Learning, 66 297-319.
18. Schölkopf, B. and Smola, A. J. (2002). Learning with Kernels. MIT Press.
19. Vapnik, V. (1995). The Nature of Statistical Learning Theory. Springer-Verlag, New York.
20. Vapnik, V. (1998). Statistical learning theory. Wiley.
21. Wang, H., Li, G. and Jiang, G. (2007). Robust regression shrinkage and consistent variable selection via the lad-lasso. Journal of Business and Economics Statistics, 25 347-355.
22. Wang, J. and Shen, X. (2007a). Large margin semi-supervised learning. Journal of Machine Learning Research, 8 1867-1891.
23. Wang, L. and Shen, X. (2007b). On-norm multi-class support vector machines: methodology and theory. Journal of the American Statistical Association, 102 583-594.
24. Wang, L., Zhu, J. and Zou, H. (2006). The doubly regularized support vector machine. Statistica Sinica, 16 589-615.
25. Weston, J., Elisseeff, A., Schölkopf, B. and Tipping, M. (2003). Use of the zero-norm with linear models and kernel methods. Journal of Machine Learning Research, 3 1439-1461.
26. H.H. Zhang et al. Variable selection for multicategory SVM 167.
27. Weston, J. and Watkins, C. (1999). Multiclass support vector machines. In Proceedings of (M. Verleysen, ed.). D. Facto Press.
28. Wu, Y. and Liu, Y. (2007a). Robust truncated-hinge-loss support vector machines. Journal of the American Statistical Association, 102 974-983.
29. Wu, Y. and Liu, Y. (2007b). Variable selection in quantile regression. Statistica Sinica. To appear.
30. Yuan, M. and Lin, Y. (2006). Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society, Series B, 68 49-67.
31. Zhang, H. H., Ahn, J., Lin, X. and Park, C. (2006). Gene selection using support vector machines with nonconvex penalty. Bioinformatics, 22 88-95.
32. Zhang, H. H. and Lu, W. (2007). Adaptive-lasso for cox’s proportional hazard model. Biometrika, 94 691-703.
33. Zhao, P., Rocha, G. and Yu, B. (2006). Grouped and hierarchical model selection through composite absolute penalties. Technical Report 703, Department of Statistics University of California at Berkeley.
34. Zhu, J., Hastie, T., Rosset, S. and Tibshirani, R. (2003). 1-norm support vector machines. Neural Information Processing Systems, 16.
35. Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association, 101 1418-1429.
36. ∞-norm support vector machine. Statistica Sinica. To appear.