Geometric algorithms to large margin classifier based on affine hulls

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 2, 2012, Pages 236-246

  Peng, Xinjun ^a   Wang, Yifei ^b  

^a SHANGHAI NORMAL UNIVERSITY   (China)

^b SHANGHAI UNIVERSITY   (China)

Author keywords

Candidate extreme point; geometric algorithms; nearest point problem; reduced affine hull (RAH); support vector machine

Indexed keywords

BINARY CLASSIFICATION PROBLEMS; EXTREME POINTS; GEOMETRIC ALGORITHM; GEOMETRIC OPTIMIZATION; LARGE MARGIN CLASSIFIERS; NEAREST POINT PROBLEMS; PRACTICAL SOLUTIONS; REDUCED AFFINE HULLS;

ALGORITHMS; GEOMETRY; SUPPORT VECTOR MACHINES;

PROBLEM SOLVING;

EID: 84866284017     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2011.2179120     Document Type: Article

References (44)

1. V. Christianini, and J. Shawe-Taylor, An Introduction to Support Vector Machines. Cambridge, U.K.: Cambridge Univ. Press, 2002.
2. V. N. Vapnik, The Natural of Statistical Learning Theory. New York: Springer-Verlag, 1995.
3. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
4. B. D. Ripley, Pattern Recognition and Neural Networks. Cambridge, U.K.: Cambridge Univ. Press, 1996.
5. J. W.-H. Kao, S. M. Berber, and V. Kecman, "Blind multiuser detector for chaos-based CDMA using aupport vector machine," IEEE Trans. Neural Netw., vol. 21, no. 8, pp. 1221-1231, Aug. 2010.
6. E. Osuna, R. Freund, and F. Girosi, "Training support vector machines: An application to face detection," in Proc. IEEE Comput. Vision Pattern Recognit., San Juan, Puerto Rico, 1997, pp. 130-136.
7. T. Joachims, C. Ndellec, and C. Rouveriol, "Text categorization with support vector machines: Learning with many relevant features," in Proc. Eur. Conf. Machine Learn., Chemnitz, Germany, 1998, pp. 137-142.
8. I. El-Naqa, Y. Yang, M. N. Wernik, N. P. Galatsanos, and R. M. Nishikawa, "A support vector machine approach for detection of microcalcifications, " IEEE Trans. Med. Imag., vol. 21, no. 12, pp. 1552-1563, Dec. 2002.
9. E. J. Bayro-Corrochano and N. Arana-Daniel, "Clifford support vector machines for classification, regression, and recurrence," IEEE Trans. Neural Netw., vol. 21, no. 11, pp. 1731-1746, Nov. 2010.
10. Y. Li, L. Bo, X. Yang, Y. Fu, and H. Li, "Multiconlitron: A general piecewise linear classifier," IEEE Trans. Neural Netw., vol. 22, no. 2, pp. 276-289, Feb. 2011.
11. J. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods-Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 185-208.
12. K. P. Bennett and E. J. Bredensteiner, "Geometry in learning," in Geometry at Work, C. Gorini, E. Hart, W. Meyer, and T. Phillips, Eds. Washington D.C. Mathematical Association of America, 1998.
13. K. P. Bennett and E. J. Bredensteiner, "Duality and geometry in SVM classifiers," in Proc. 17th Int. Conf. Mach. Learn., Los Altos, CA, 2000, pp. 57-64.
14. D. J. Crisp and C. J. C. Burges, "A geometric interpretation of ν-SVM classifiers," Adv. Neural Inf. Process. Syst., vol. 12, no. 4, pp. 244-250, 2000.
15. E. G. Gilbert, "An iterative procedure for computing the minimum of a quadratic form on a convex set," SIAM J. Control, vol. 4, no. 1, pp. 61-79, 1966.
16. M. I. Schlesinger, V. G. Kalmykov, and A. A. Suchorukov, "Sravnitelnyj analiz algoritmov sinteza linejnogo reshajushchego pravila dlja proverki slozhnych gipotez (comparative analysis of algorithms synthesising linear decision rule for analysis of complex hypotheses)," Automatika, vol. 1, no. 1, pp. 3-9, 1981.
17. M. I. Schlesinger and H. Václav, Ten Lectures on Statistical and Structural Pattern Recognition. Dordrecht, The Netherlands: Kluwer, 2002.
18. B. Mitchell, V. Dem'yanov, and V. Malozemov, "Finding the point of a polyhedron closest to the origin," SIAM J. Control, vol. 12, no. 1, pp. 19-26, 1974.
19. S. S. Keerthi, S. K. Shevade, C. Bhattacharyya, and K. R. K. Murthy, "A fast iterative nearest point algorithm for support vector machine classifier design," IEEE Trans. Neural Netw., vol. 11, no. 1, pp. 124-136, Jan. 2000.
20. V. Franc and V. Hlavác, "An iterative algorithm learning the maximal margin classifier," Pattern Recognit., vol. 36, no. 9, pp. 1985-1996, 2003.
21. J. López and J. R. Dorronsoro, A Common Framework for the Convergence of the GSK, MDM and SMO Algorithms (Lecture Notes in Computer Science), LNCS 6353. New York: Springer-Verlag, 2010, pp. 82-87.
22. J. López, Á. Barbero, and J. R. Dorronsoro, "On the equivalence of the SMO and MDM algorithms for SVM training," in Artificial Intelligence: Machine Learning and Knowledge Discovery in Databases. New York: Springer-Verlag, 2008.
23. T. T. Friess and R. Harisson, "Support vector neural networks: The kernel adatron with bias and soft margin," Dept. ACSE, Univ. Sheffield, Sheffield, U.K., Tech. Rep. ACSE-TR-752, 1998.
24. M. E. Mavroforakis and S. Theodoridis, "A geometric approach to support vector machine (SVM) classification," IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 671-682, May 2006.
25. Q. Tao, G. Wu, and J. Wang, "A generalized S-K algorithm for learning ν-SVM classifiers," Pattern Recognit. Lett., vol. 25, no. 10, pp. 1165-1171, 2004.
26. Q. Tao, G. Wu, and J. Wang, "A general soft method for learning SVM classifiers with L1-norm penalty," Pattern Recognit., vol. 41, no. 3, pp. 939-948, 2008.
27. M. E. Mavroforakis, M. Sdralis, and S. Theodoridis, "A geometric nearest point algorithm for the efficient solution of the SVM classification task," IEEE Trans. Neural Netw., vol. 18, no. 5, pp. 1545-1549, Sep. 2007.
28. J. López, Á. Barbero, and J. R. Dorronsoro, "Clipping algorithms for solving the nearest point problem over reduced convex hulls," Pattern Recognit., vol. 44, no. 3, pp. 607-614, 2011.
29. Z. B. Liu, J. G. Liu, C. Pan, and G. Y. Wang, "A novel geometric approach to binary classification based on scaled convex hulls," IEEE Trans. Neural Netw., vol. 20, no. 7, pp. 1215-1220, Jul. 2009.
30. Z. B. Liu, J. G. Liu, Z. Chen, and G. Y. Wang, "A generalized Gilbert's algorithm for approximating general SVM classifiers," Neurocomputing, vol. 73, nos. 1-3, pp. 219-224, Dec. 2009.
31. X. J. Peng and Y. F. Wang, "CCH-based geometric algorithm for SVM classification and the application," Appl. Math. Mech., vol. 30, no. 1, pp. 89-100, 2009.
32. X. J. Peng and Y. F. Wang, "Total margin ν-support vector machine and its geometric problem," Pattern Recognit. Artif. Intell., vol. 22, no. 1, pp. 8-16, 2009.
33. J. Bi and K. P. Bennett, "A geometric approach to support vector regression," Neurocomputing, vol. 55, no. 6, pp. 79-108, 2003.
34. X. J. Peng and Y. F. Wang, "The robust and efficient adaptive normal direction support vector regression," Exp. Syst. Appl., vol. 38, no. 4, pp. 2998-3008, 2011.
35. P. Williams, S. Li, J. F. Feng, and S. Wu, "A geometrical method to improve performance of the support vector machine," IEEE Trans. Neural Netw., vol. 18, no. 3, pp. 942-947, May 2007.
36. H. Cevikalp, B. Triggs, and R. Polikar, "Nearest hyperdisk methods for high-dimensional classification," in Proc. 25th Int. Conf. Mach. Learn., 2008, pp. 1-8.
37. H. Cevikalp and B. Triggs, "Large margin classifiers based on convex class models," in Proc. Int. Conf. Comput. Vis. Workshops, Sep.-Oct. 2009, pp. 101-108.
38. X. F. Zhou, W. H. Jiang, and J. Y. Yang, "Kernel affine subspace nearest points classification algorithm," Comput. Eng., vol. 34, no. 17, pp. 23-25, 2008.
39. X. F. Zhou and Y. Shi, "Affine subspace nearest points classification algorithm for wavelet face recognition," in Proc. WRI World Congr. Comput. Sci. Inf. Eng., Mar.-Apr. 2009, pp. 684-688.
40. X. F. Zhou, W. H. Jiang, Y. J. Tian, P. Zhang, G. L. Nie, and Y. Shi, "A new kernel-based classification algorithm," in Proc. 9th IEEE Int. Conf. Data Mining, Dec. 2009, pp. 1094-1099.
41. H. Cevikalp, B. Triggs, H. S. Yavuz, Y. Küçük, M. Küçük, and A. Barkana, "Large margin classifiers based on affine hulls," Neurocomputing, vol. 73, nos. 16-18, pp. 3160-3168, 2010.
42. B. Schölkopf, A. Smola, R. Williamson, and P. L. Bartlett, "New support vector algorithms," Neural Comput., vol. 12, no. 5, pp. 1207-1245, 2000.
43. G. Rätsch. (2000). Benchmark Repository [Online]. Available: http://ida. first.fhg.de/projects/bench/benchmarks.htm
44. J. Sun, C. Zheng, X. Li, and Y. Zhou, "Analysis of the distance between two classes for tuning SVM hyperparameters," IEEE Trans. Neural Netw., vol. 21, no. 2, pp. 305-318, Feb. 2010.