Sparse high-dimensional fractional-norm support vector machine via DC programming

Computational Statistics and Data Analysis

Volumn 67, Issue , 2013, Pages 136-148

  Guan, Wei ^a   Gray, Alexander ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

Difference of Convex functions programming; Feature selection; Fractional norm SVM; Reweighted L1 norm SVM Low sample size high dimensional data set; Support vector machine

Indexed keywords

DC PROGRAMMING AND DCA; DIFFERENCE OF CONVEX FUNCTIONS; FRACTIONAL-NORM SVM; HIGH DIMENSIONAL DATA; OPTIMIZATION PROBLEMS; STATISTICAL LEARNING THEORY; SUPPORT VECTOR MACHINE (SVMS); TRUST-REGION SUBPROBLEM;

ALGORITHMS; FEATURE EXTRACTION; FUNCTIONS; ITERATIVE METHODS; NUMERICAL METHODS;

SUPPORT VECTOR MACHINES;

EID: 84879054008     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2013.01.020     Document Type: Article

References (37)

1. T. Abeel, T. Helleputte, Y. Van de Peer, P. Dupont, and Y. Saeys Robust biomarker identification for cancer diagnosis with ensemble feature selection methods Bioinformatics 26 3 2010 392 398
2. U. Alon, N. Barkai, D. Notterman, K. Gish, S. Ybarra, D. Mack, and A. Levine Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays Proceedings of the National Academy of Sciences of the United States of America 96 12 1999 6745
3. E. Amaldi, and V. Kann On the approximability of minimizing nonzero variables or unsatisfied relations in linear systems Theoretical Computer Science 209 1-2 1998 237 260 (Pubitemid 128450440)
4. A. Ben-Israel, and T. Greville Generalized Inverses: Theory and Applications 2003 Springer Verlag
5. Bradley, P.; Mangasarian, O.; 1998. Feature selection via concave minimization and support vector machines. In: Machine Learning Proceedings of the Fifteenth International Conference (ICML98). Citeseer, pp. 82-90.
6. 1 minimization Journal of Fourier Analysis and Applications 14 5 2008 877 905
7. Chang, C.; Lin, C.; 2001. LIBSVM: a library for support vector machines. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm.
8. J. Fan, and R. Li Variable selection via nonconcave penalized likelihood and its oracle properties Journal of the American Statistical Association 96 456 2001 1348 1361
9. G. Fung, and O. Mangasarian A feature selection newton method for support vector machine classification Computational Optimization and Applications 28 2 2004 185 202
10. G. Gasso, A. Rakotomamonjy, and S. Canu Recovering sparse signals with a certain family of nonconvex penalties and DC programming IEEE Transactions on Signal Processing 57 12 2009 4686 4698
11. W. Guan, M. Zhou, C. Hampton, B. Benigno, L. Walker, A. Gray, J. McDonald, and F. Fernández Ovarian cancer detection from metabolomic liquid chromatography/mass spectrometry data by support vector machines BMC Bioinformatics 10 1 2009 259
12. I. Guyon, and A. Elisseeff An introduction to variable and feature selection The Journal of Machine Learning Research 3 2003 1157 1182
13. I. Guyon, S. Gunn, A. Ben-Hur, and G. Dror Result analysis of the nips 2003 feature selection challenge Advances in Neural Information Processing Systems 17 2005 545 552
14. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik Gene selection for cancer classification using support vector machines Machine Learning 46 1 2002 389 422 (Pubitemid 34129977)
15. S. Hingorani, E. Petricoin III, A. Maitra, V. Rajapakse, C. King, M. Jacobetz, S. Ross, T. Conrads, T. Veenstra, and B. Hitt Preinvasive and invasive ductal pancreatic cancer and its early detection in the mouse Cancer Cell 4 6 2003 437 450 (Pubitemid 38050041)
16. K. Knight, and W. Fu Asymptotics for lasso-type estimators Annals of Statistics 2000 1356 1378 (Pubitemid 33244917)
17. J. Langford, L. Li, and T. Zhang Sparse online learning via truncated gradient The Journal of Machine Learning Research 10 2009 777 801
18. H. Le Thi, H. Le, V. Nguyen, and T. Pham Dinh A DC programming approach for feature selection in support vector machines learning Advances in Data Analysis and Classification 2 3 2008 259 278
19. H. Le Thi, and T. Pham Dinh A continuous approach for the concave cost supply problem via DC programming and DCA Discrete Applied Mathematics 156 3 2008 325 338
20. q penalty Computational Statistics & Data Analysis 51 12 2007 6380 6394 (Pubitemid 47126026)
21. S. Loscalzo, L. Yu, and C. Ding Consensus group stable feature selection Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2009 ACM 567 576
22. O. Mangasarian Exact 1-norm support vector machines via unconstrained convex differentiable minimization The Journal of Machine Learning Research 7 2006 1530
23. Murphy, P.; Aha, D.; 1992. UCI repository of machine learning databases.
24. J. Neumann, C. Schnörr, and G. Steidl Combined SVM-based feature selection and classification Machine Learning 61 1 2005 129 150 (Pubitemid 43049365)
25. T. Pham Dinh, and H. Le Thi A DC optimization algorithm for solving the trust-region subproblem SIAM Journal on Optimization 8 2 1998 476 505 (Pubitemid 128078209)
26. R. Rockafellar Convex Analysis 1997 Princeton landmarks in mathematics
27. Saab, R.; Chartrand, R.; Yilmaz, O.; 2008. Stable sparse approximations via nonconvex optimization. In: Acoustics, Speech and Signal Processing, 2008. ICASSP 2008. IEEE International Conference on. IEEE, pp. 3885-3888.
28. 1 regularized loss minimization Proceedings of the 26th Annual International Conference on Machine Learning 2009 ACM 929 936
29. D. Singh, P. Febbo, K. Ross, D. Jackson, J. Manola, C. Ladd, P. Tamayo, A. Renshaw, A. D'Amico, and J. Richie Gene expression correlates of clinical prostate cancer behavior Cancer Cell 1 2 2002 203 209 (Pubitemid 41039166)
30. V. Vapnik The Nature of Statistical Learning Theory 1995 Springer NY
31. J. Weston, S. Mukherjee, O. Chapelle, M. Pontil, T. Poggio, and V. Vapnik Feature selection for SVMs Advances in Neural Information Processing Systems 2001 668 674
32. L. Yu, C. Ding, and S. Loscalzo Stable feature selection via dense feature groups Proceeding of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2008 ACM 803 811
33. A. Yuille, and A. Rangarajan The concave-convex procedure Neural Computation 15 4 2003 915 936 (Pubitemid 37049812)
34. H. Zhang, J. Ahn, X. Lin, and C. Park Gene selection using support vector machines with non-convex penalty Bioinformatics 22 1 2005 88
35. Z. Zhang, J. Kwok, and D. Yeung Surrogate maximization/minimization algorithms and extensions Machine Learning 69 1 2007 1 33 (Pubitemid 47536395)
36. Zhu, J.; Rosset, S.; Hastie, T.; Tibshirani, R.; 2004. 1-norm support vector machines. In: Advances in Neural Information Processing Systems 16: Proceedings of the 2003 Conference. pp. 49-56.
37. H. Zou, and R. Li One-step sparse estimates in nonconcave penalized likelihood models Annals of Statistics 36 4 2008 1509