On the SVMpath singularity

IEEE Transactions on Neural Networks and Learning Systems

Volumn 24, Issue 11, 2013, Pages 1736-1748

  Dai, Jisheng ^a   Chang, Chunqi ^b   Mai, Fei ^c   Zhao, Dean ^a   Xu, Weichao ^d  

^a JIANGSU UNIVERSITY   (China)

^b SOOCHOW UNIVERSITY   (China)

^c UNIVERSITY OF HONG KONG   (Hong Kong)

^d GUANGDONG UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Homotopy method; piecewise linear solution; regularization path; solution path; support vector machine (SVM)

Indexed keywords

EFFICIENT IMPLEMENTATION; HOMOTOPY METHOD; OPTIMALITY CONDITIONS; PIECEWISE LINEAR SOLUTIONS; REGULARIZATION PATHS; SINGULARITY AVOIDANCE; SOLUTION PATH; TIME-CONSUMING PROCEDURE;

ALGORITHMS; INVERSE PROBLEMS; PIECEWISE LINEAR TECHNIQUES;

SUPPORT VECTOR MACHINES;

EID: 84886954217     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2262180     Document Type: Article

References (28)

1. V. Vapnik, Estimation of Dependences Based on Empirical Data. New York, NY, USA: Springer-Verlag, 1982
2. V. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer-Verlag, 1995
3. I. W. Tsang, J. T. Kwok, and P. Cheung, "Core vector machines: Fast SVM training on very large data sets," J. Mach. Learn. Res., vol. 6, no. 1, pp. 363-392, 2005
4. S. Kim, Y. Park, K. Toh, and S. Lee, "SVM-based feature extraction for face recognition," Pattern Recognit., vol. 43, no. 8, pp. 2871-2881, 2010
5. C. Sentelle, G. C. Anagnostopoulos, and M. Georgiopoulos, "Efficient revised simplex method for SVM training," IEEE Trans. Neural Netw., vol. 22, no. 10, pp. 1650-1661, Oct. 2011
6. S. Keerthi, S. Shevade, C. Bhattacharyya, and K. Murthy, "Improvements to Platt?s SMO algorithm for SVM classifier design," Neural Comput., vol. 13, no. 3, pp. 637-649, 2001 (Pubitemid 33595014)
7. C. Chang and C. Lin. (2001). LIBSVM: A Library for Support Vector Machines
8. [Online]. Available: http://www.csie.ntu.edu.tw/cjlin/libsvm
9. T. Hastie, S. Rosset, R. Tibshirani, and J. Zhu, "The entire regularization path for the support vector machine," J. Mach. Learn. Res., vol. 5, pp. 1391-1415, Oct. 2004
10. G. Wang, D. Yeung, and F. H. Lochovsky, "A new solution path algorithm in support vector regression," IEEE Trans. Neural Netw., vol. 19, no. 10, pp. 1753-1767, Oct. 2008
11. L. Gunter and J. Zhu, "Efficient computation and model selection for the support vector regression," Neural Comput., vol. 19, no. 6, pp. 1633-1655, 2007
12. S. Rosset and J. Zhu, "Piecewise linear regularized solution paths," Ann. Stat., vol. 35, no. 3, pp. 1012-1030, 2007
13. D. L. Donoho and Y. Tsaig. (2006). Fast Solution of l1-norm Minimization Problems When the Solution May Be Sparse, Preprint
14. [Online]. Available: http://www.stanford.edu/tsaig/research.html
15. J. Dai, C. Chang, W. Xu, and Z. Ye, "Linear precoder optimization for MIMO systems with joint power constraints," IEEE Trans. Commun., vol. 60, no. 8, pp. 2240-2254, Aug. 2012
16. K. Scheinberg, "An efficient implementation of an active set method for SVMs," J. Mach. Learn. Res., vol. 7, pp. 2237-2257, Oct. 2006 (Pubitemid 44611764)
17. A. Shilton, M. Palaniswami, D. Ralph, and A. C. Tsoi, "Incremental training of support vector machines," IEEE Trans. Neural Netw., vol. 16, no. 1, pp. 114-131, Jan. 2005 (Pubitemid 40241914)
18. C. Ong, S. Shao, and J. Yang, "An improved algorithm for the solution of the regularization path of support vector machine," IEEE Trans. Neural Netw., vol. 21, no. 3, pp. 451-462, Mar. 2010
19. J. Dai and F. Mai, "On the SVMpath initialization," Signal Process., vol. 92, no. 5, pp. 1258-1267, 2012
20. M. Grant and S. Boyd. (2010, Sep.). CVX: Matlab Software for Disciplined Convex Programming, Version 1.21
21. [Online]. Available: http://cvxr.com/cvx
22. M. Grant and S. Boyd, "Graph implementations for nonsmooth convex programs," in Recent Advances in Learning and Control (Lecture Notes in Control and Information Sciences), V. Blondel, S. Boyd, and H. Kimura, Eds. New York, NY, USA: Springer-Verlag, 2008, pp. 95-110
23. M. Pontil and A. Verri, "Properties of support vector machines," Neural Comput., vol. 10, no. 4, pp. 955-974, 1998 (Pubitemid 128463186)
24. L. Trefethen and D. Bau, Numerical Linear Algebra. Philadelphia, PA, USA: Society of Industrial and Applied Mathematics, 1997
25. H. G. Golub and C. F. V. Loan, Matrix Computations. Baltimore, MD, USA: The John Hopkins Univ. Press, 1989
26. J. Yang and C. Ong, "Determination of global minima of some common validation functions in support vector machine," IEEE Trans. Neural Netw., vol. 22, no. 4, pp. 654-659, Apr. 2011
27. A. Frank and A. Asuncion. (2010). UCI Machine Learning Repository
28. [Online]. Available: http://archive.ics.uci.edu/ml