Geometric algorithms for parametric-margin ν-support vector machine

Neurocomputing

Volumn 99, Issue , 2013, Pages 197-205

  Peng, Xinjun ^a   Xu, Dong ^a  

^a SHANGHAI NORMAL UNIVERSITY   (China)

Author keywords

Geometric algorithm; Nearest point problem; Parametric margin; Reduced convex hull; Support vector machine

Indexed keywords

BENCHMARK DATASETS; CLASSIFICATION ACCURACY; COMPUTATIONAL RESULTS; CONVEX HULL; GEOMETRIC ALGORITHM; GEOMETRIC INTERPRETATION; HETEROSCEDASTIC; NEAREST POINT; PARAMETRIC-MARGIN; WEIGHT FACTOR;

ALGORITHMS; BENCHMARKING; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL GEOMETRY; SUPPORT VECTOR MACHINES;

PARAMETER ESTIMATION;

ACCURACY; ARTICLE; CLASSIFICATION ALGORITHM; CONTROLLED STUDY; GEOMETRY; INTERMETHOD COMPARISON; KERNEL METHOD; MATHEMATICAL COMPUTING; PARAMETRIC TEST; PRIORITY JOURNAL; SUPPORT VECTOR MACHINE;

EID: 84867864947     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2012.06.026     Document Type: Article

References (39)

1. Christianini V., Shawe-Taylor J. An Introduction to Support Vector Machines 2002, Cambridge University Press, Cambridge.
2. Vapnik V.N. The Natural of Statistical Learning Theory 1995, Springer, New York.
3. Vapnik V.N. Statistical Learning Theory 1998, Wiley, New York.
4. Ripley B.D. Pattern Recognition and Neural Networks 1996, Cambridge University Press, Cambridge.
5. S. Mukherjee, E. Osuna, F. Girosi, Nonlinear prediction of chaotic time series using a support vector machine, in: Proceedings of the 1997 IEEE Workshop on Neural Networks for Signal Processing, Amelia Island, FL, USA, 1997, pp. 511-520.
6. E. Osuna, R. Freund, F. Girosi, Training support vector machines: an application to face detection, in: Proceedings of IEEE Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 1997, pp. 130-136.
7. T. Joachims, C. Ndellec, C. Rouveriol, Text categorization with support vector machines: learning with many relevant features, in: European Conference on Machine Learning No. 10, Chemnitz, Germany, 1998, pp. 137-142.
8. El-Naqa I., Yang Y., Wernik M.N., Galatsanos N.P., Nishikawa R.M. A support vector machine approach for detection of microcalcifications. IEEE Trans. Med. Imaging 2002, 21(12):1552-1563.
9. Cao X.B., Xu Y.W., Chen D., Qiao H. Associated evolution of a support vector machine-based classifier for pedestrian detection. Inf. Sci. 2009, 179(8):1070-1077.
10. D. Zhou, B.H. Xiao, H.B. Zhou, R.W. Dai, Global geometric of SVM classifiers, Technique Report, AI Lab, Institute of automation, Chinese Academy of Sciences, 2002.
11. Platt J. Fast training of support vector machines using sequential minimal optimization. Advances in Kernel Methods-Support Vector Learning 1999, 185-208. MIT Press, Cambridge, MA. B. Schölkopf, C.J.C. Burges, A.J. Smola (Eds.).
12. Bennett K.P., Bredensteiner E.J. Geometry in learning. Geometry at Work 1998, Mathematical Association of America, Washington, DC. C. Gorini, E. Hart, W. Meyer, T. Phillips (Eds.).
13. Bennett K.P., Bredensteiner E.J. Duality and geometry in SVM classifiers. Proceedings of the 17th International Conference on Machine Learning 2000, 57-64. Morgan Kaufmann, Los Altos, CA. P. Langley (Ed.).
14. Crisp D.J., Burges C.J.C. A geometric interpretation of ν-SVM classifiers. Advances in Neural Information Processing Systems 2000, vol. 12:244-250.
15. Gilbert E.G. An iterative procedure for computing the minimum of a quadratic form on a convex set. SIAM J. Control 1966, 4(1):61-79.
16. Schlesinger M.I., Kalmykov V.G., Suchorukov A.A. Sravnitelnyj analiz algoritmov sinteza linejnogo reshajushchego pravila dlja proverki slozhnych gipotez (comparative analysis of algorithms synthesising linear decision rule for analysis of complex hypotheses). Automatika 1981, 1:3-9. (in Russian).
17. Schlesinger M.I., Hlavac V. Ten Lectures on Statistical and Structural Pattern Recognition 2002, Kluwer Academic Publishers, Dordrecht.
18. Mitchell B., Dem'yanov V., Malozemov V. Finding the point of a polyhedron closest to the origin. SIAM J. Control 1974, 12:19-26.
19. Keerthi S.S., Shevade S.K., Bhattacharyya C., Murthy K.R.K. A fast iterative nearest point algorithm for support vector machine classifier design. IEEE Trans. Neural Networks 2000, 11(1):124-136.
20. Franc V., Hlaváč V. An iterative algorithm learning the maximal margin classifier. Pattern Recognition 2003, 36(9):1985-1996.
21. J. López, Á. Barbero, J.R. Dorronsoro, On the equivalence of the SMO and MDM algorithms for SVM training, in: Machine Learning and Knowledge Discovery in Databases-ECML2008 Proceedings, Lecture Notes in Artificial Intelligence, no. Part II, Springer, 2008.
22. J. López, J.R. Dorronsoro, A common framework for the convergence of the GSK, MDM and SMO algorithms, in: Lecture Notes in Computer Science, vol. 6353, Springer, 2010, pp. 82-87. doi:10.1007/978-3-642-15822-3_10.
23. T.T. Friess, R. Harisson, Support Vector Neural Networks: The Kernel Adatron with Bias and Soft Margin, Technique Report ACSE-TR-752, Department of ACSE, University of Sheffield, 1998.
24. Mavroforakis M.E., Theodoridis S. A geometric approach to support vector machine classification. IEEE Trans. Neural Networks 2006, 17(3):671-682.
25. Tao Q., Wu G., Wang J. A generalized S-K algorithm for learning ν-SVM classifiers. Pattern Recognition Lett. 2004, 25(10):1165-1171.
26. 1-norm penalty. Pattern Recognition 2008, 41(3):939-948.
27. Mavroforakis M.E., Sdralis M., Theodoridis S. A geometric nearest point algorithm for the efficient solution of the SVM classification task. IEEE Trans. Neural Networks 2007, 18(5):1545-1549.
28. López J., Barbero Á., Dorronsoro J.R. Clipping algorithms for solving the nearest point problem over reduced convex hulls. Pattern Recognition 2011, 44(3):607-614.
29. Liu Z.B., Liu J.G., Pan C., Wang G.Y. A novel geometric approach to binary classification based on scaled convex hulls. IEEE Trans. Neural Networks 2009, 20(7):1215-1220.
30. Liu Z.B., Liu J.G., Chen Z., Wang G.Y. A generalized Gilbert's algorithm for approximating general SVM classifiers. Neurocomputing 2009, 73:219-224.
31. Peng X.J., Wang Y.F. CCH-based geometric algorithm for SVM classification and the application. Apply Mathematics and Mechanics (English Edition) 2009, 30(1):89-100.
32. Peng X.J., Wang Y.F. Total margin ν-support vector machine and its geometric problem. Pattern Recognition Artif. Intell. 2009, 22(1):8-16. (in Chinese).
33. Peng X.J. A ν-twin support vector machine (ν-TSVM) classifier and its geometric approaches. Inf. Sci. 2010, 180:3863-3875.
34. Jayadeva, Khemchandani R., Chandra S. Twin support vector machines for pattern classification. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29(5):905-910.
35. Bi J., Bennett K.P. A geometric approach to support vector regression. Neurocomputing 2003, 55:79-108.
36. Peng X.J., Wang Y.F. The robust and efficient adaptive normal direction support vector regression. Expert Syst. Appl. 2011, 38(4):2998-3008.
37. Hao P.-Y. New support vector algorithms with parameteric insensitive/margin model. Neural Networks 2010, 23(1):60-73.
38. Schölkopf B., Smola A., Williamson R., Bartlett P.L. New support vector algorithms. Neural Comput. 2000, 12(5):1207-1245.
39. G. Rätsch, Benchmark repository, datasets available at: 2000. http://ida.first.fhg.de/projects/bench/benchmarks.htm.