An overview on theory and algorithm of support vector machines

Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China

Volumn 40, Issue 1, 2011, Pages 2-10

  Ding, Shi Fei ^a,b   Qi, Bing Juan ^a   Tan, Hong Yan ^c  

^a CHINA UNIVERSITY OF MINING AND TECHNOLOGY   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^c INSTITUTE OF ACOUSTICS   (China)

Author keywords

Fuzzy support vector machines; Granular support vector machines; Statistical learning theory; Support vector machines; Training algorithm; Twin support vector machines

Indexed keywords

FUZZY SUPPORT VECTOR MACHINES; GRANULAR SUPPORT VECTOR MACHINES; STATISTICAL LEARNING THEORY; TRAINING ALGORITHM; TWIN SUPPORT VECTOR MACHINES;

GEARS; LEARNING ALGORITHMS; STATISTICS; VECTORS;

SUPPORT VECTOR MACHINES;

EID: 79953166136     PISSN: 10010548     EISSN: None     Source Type: Journal    
DOI: 10.3969/j.issn.1001-0548.2011.01.001     Document Type: Review

References (69)

1. CRISTIANINI N, TAYLOR J S. An introduction to support vector machines and other kernel-based learning methods[M]. Translated by LI Guo-zheng, WANG Meng, ZENG Hua-jun. Beijing: Publishing House of Electronics Industry, 2004.
2. ZHANG Xue-gong. Statistical learning theory and support vector machines[J]. Acta Automatica Sinica, 2000, 26(1): 32-41.
3. VAPNIK V N. The nature of statistical learning theory[M]. Translated by ZHANG Xue-gong. Beijing: Tsinghua University Press, 2000.
4. VAPNIK V N. Statistical Learning Theory[M]. Translated by XU Jian-hua, ZHANG Xue-gong. Beijing: Publishing House of Electronics Industry, 2004.
5. LIU Xiao-liang, DING Shi-fei. Appropriateness in applying SVMs to text classification[J]. Computer Engineering and Science, 2010, 32(6): 106-108.
6. LIN Kai-biao, WANG Zhou-jing. The method of fax receiver's name recognition based on SVM[J]. Computer Engineering and Applications, 2006, 42(7): 156-158.
7. XIE Sai-qin, SHEN Fu-ming, QIU Xue-na. Face recognition using support vector machines[J]. Computer Engineering, 2009, 35(16): 186-188.
8. LI Ying-xin, RUAN Xiao-gang. Feature selection for cancer classification based on support vector machine[J]. Journal of Computer Research and Development, 2005, 42(10): 1796-1801.
9. GAO Wei, WANG Ning. Prediction of shallow-water reverberation time series using support vector machine[J]. Computer Engineering, 2008, 34(6): 25-27.
10. BOSER B E, GUYON I M, VAPNIK V N. A training algorithm for optimal margin classifiers[C]//Proceedings of The Fifth Annual Workshop on Computational Learning Theory. New York: ACM Press, 1992: 144-152.
11. OSUNA E, FRENUD R, GIROSI F. An improved training algorithm for support vector machines[C]//Proceedings of IEEE Workshop on Neural Networks for Signal Processing. New York, USA: [s.n.], 1997: 276-285.
12. JOACHIMS T. Making large-scale support vector machine learning practical[C]//Advances in Kernel Methods: Support Vector Learning. Cambridge, MA: The MIT Press, 1998.
13. PLATT J. Fast training of support vector machines using sequential minimal optimization[C]//Advances in Kernel Methods: Support Vector Learning. Cambridge, MA: The MIT Press, 1998.
14. DAI Liu-ling, HUANG He-yan, CHEN Zhao-xiong. Ternary sequential analytic optimization algorithm for SVM classifier design[J]. Asian Journal of Information Technology, 2005, 4(3): 2-8.
15. KEERTHI S S, SHEVADE S K, BHATTAEHARYYA C. Improvements to platt's SMO algorithm for SVM classifier design[J]. Neural Computation, 2001, 13(3): 637-649.
16. PLATT J. Using analytic QP and sparseness to speed training support vector machines[C]//Advances in Neural Information Processing Systems. [S.l]: MIT Press, 1999, 557-563.
17. SYED N, LIU H, SUNG K. Incremental learning with support vector machines[C]//International Joint Conference on Artificial Intelligence. Sweden: Morgan kaufmann publishers, 1999: 352-356.
18. GAUWENBERGHS G, POGGIO T. Incremental and decremental support vector machine[J]. Machine Learning. 2001, 44(13): 409-415.
19. RALAIVOLA L, FLORENCE D'ALCHÉ-BUC. Incremental support vector machine learning: a local approach[C]//Proceedings of International Conference on Neural Networks. Vienna, Austria: [s.n.], 2001: 322-330.
20. KONG Rui, ZHANG Bing. A fast incremental learning algorithm for support vector machine[J]. Control And Decision, 2005, 20(1): 1129-1132.
21. KONG Bo, LIU Xiao-mao, ZHANG Jun. Incremental support vector machine based on center distance ratio[J]. Journal of Computer Applications, 2006, 26(6): 1434-1436.
22. LI Dong-hui, DU Shu-xin, WU Tie-jun. Fast incremental learning algorithm of linear support vector machine based on hull vectors[J]. Journal of Zhejiang University (Engineering Science), 2006, 40(2): 202- 215.
23. TANG Yu-chun, JIN Bo, ZHANG Yan-qing et al. Granular support vector machines for medical binary classification problems[C]//Proceedings of the IEEE CIBIB. Piscataway, HJ: IEEE Computationl Intelligence Society, 2004: 73-78.
24. LI Dao-guo, MIAO Duo-qian, ZHANG Dong-xing, et al. An overview of granular computing[J]. Computer Science, 2005, 32(9): 1-12.
25. CHENG Wei, SHI Yang, ZHANG Yan-ping. Three primary mothods of granular computing[J]. Computer Technology and Development, 2007, 17(3): 91-94.
26. DING Shi-fei, XU Li, ZHU Hong et al. Research and progress of cluster algorithms based on granular computing[J]. International Journal of Digital Content Technology and its Applications, 2010, 4(5): 96-104.
27. TANG Yu-chun, JIN Bo, ZHANG Yan-qing. Granular support vector machines with association rules mining for protein homology prediction[J]. Artificial Intelligence in Medicine, 2005, 35: 121-134.
28. ZHANG Wen-hao, WANG Wen-jian. A kernel granular support vector machine based on association rules[J]. Journal of Guangxi Normal University (Natural Science Edition), 2009, 27(3): 89-92.
29. WANG Wen-jian, XU Zong-ben. A heuristic training in support vector regression[J]. Neurocomputing, 2004, 61: 259-275.
30. ZHANG Xin, WANG Wen-jian. A support vector machine learning strategy based on Granular[J]. Computer Science, 2008, 35(8a): 101-103, 116.
31. DUAN Dan-qing, CHEN Song-qiao, YANG Wei-jun, et al. Detect intrusion using rough set and support vector machine[J]. Journal of Chinese Computer Systems, 2008, 29(4): 627-630.
32. LI Ye, CAI Yun-ze, LI Yuan-gui, et al. Rough sets method for SVM data preprocessing[C]//IEEE Conference on Cybernetics and Intelligent Systems. Singapore: [s.n.], 2004, 1039-1042.
33. YU H, YANG-JIONG, HAN Jia-wei, et al. Making SVMs scalable to large data sets using hierarchical cluster indexing[J]. Data Mining and Knowledge Discovery, 2005, 11(3): 295-321..
34. WEN Gui-hua, XIANG Jun, DING Yue-hua. Large-scale SVM classification algorithm based on granularity of quotient space theory[J]. Application Research of Computers, 2008, 25(8): 2299-2301.
35. CHENG Wei, ZHANG Yan-ping, ZHAO Shu. Research of yield prediction model based on support vector machine within the framework of quotient space theory[J]. Journal of China Agricultural University, 2009, 14(5): 135-139.
36. LIAN Ke, HUANG Jian-guo, WANG Hou-jun, et al. Study on a GA-based SVM decision2tree multi-classification strategy[J]. Acta Electronic Sinica, 2008, 36(8): 1502-1507.
37. GUO Hu-sheng, WANG Wen-jian. SVM learning algorithms based on neural network[J]. Computer Engineering and Applications, 2009, 45(2): 51-54.
38. GUO Hu-sheng, WANG Wen-jian, MEN Chang-qian. A novel learning model-kernel granular support vector machine[C]//Proceeding of the eighth international conference on machine learning and cybernetic. Baoding: [s.n.], 2009: 930-935.
39. WANG Wen-jian, GUO Hu-sheng. Granular support vector machine learning model[J]. Journal of Shanxi University: Natural Science Edition, 2009, 32(4): 535-540.
40. ZHANG Wen-hao, WANG Wen-jian. A kernel granular support vector machine based on association rules[J]. Journal of Guangxi Normal University: Natural Science Edition, 2009, 27(3): 89-92.
41. LI Xue-hua, SHU Lan. Fuzzy theory based support vector machine classifier[C]//Proceedings of the Fifth International Conference on Fuzzy Systems and Knowledge Discovery. Shandong, China: [s.n.], 2008: 600-604.
42. HAO Pei-yi, LIN Min-shiu, TSAI Lung-biao. A new support vector machine with fuzzy hyper-plane and its application to evaluate credit risk[C]//Proceedings of the eighth international conference on intelligent systems design and applications. Taiwan, China: [s.n.], 2008, 3: 83-88.
43. LIN Chun-fu, WANG Sheng-de. Fuzzy support vector machines[J]. IEEE Transactions on Neural Networks, 2002, 3(2): 464-471.
44. HUANG H P, LIU Y H. Fuzzy support vector machines for pattern recognition and data mining[J]. International Journal of Fuzzy Systems, 2002, 4(3): 826-835.
45. ZHANG Xiang, XIAO Xiao-ling, XU Guang-you. Determination and analysis of fuzzy membership for SVM[J]. Journal of Image and Graphics, 2006, 11(8): 1188-1192.
46. ZHANG Gui-xiang, FEI Lan, DU Zhe, et al. Fuzzy support vector machine based on cluster hyperplane[J]. Computer Engineering and Design, 2008, 12(29): 3177-3178, 3207.
47. LI Miao-miao, XIANG Feng-hong, LIU Xin-wang. A novel membership function for fuzzy support vector machine[J]. Computer Engineering and Science, 2009, 31(9): 92-94.
48. SUN Ming-song, GAO Qing-guo, WANG Xuan-dan. Mail filtering by dual membership fuzzy support vector machine[J]. Computer Engineering and Applications, 2010, 46(2): 93-95.
49. WU Qing, LIU San-yang, DU Zhe. Fuzzy support vector machine method based on border vector extraction[J]. Pattern Recognition and Artificial Intelligence, 2008, 21(3): 332-337.
50. YAN W Y, HE Q. Multi-class fuzzy support vector machine based on dismissing margin[C]//Proceedings of the Eighth International Conference on Machine Learning and Cybernetics. Baoding, China: [s.n.], 2009: 1139-1144.
51. LIU Hong-bing, XIONG Sheng-wu. A kind of fast fuzzy support vector machines[J]. Journal of System Simulation, 2008, 20(24): 6664-6667.
52. SHI Qi-quan, LI Xiao-ming, XIAO Ci-yuan. A kind of novel fast fuzzy support vector machines[J]. Computer Technology and Development, 2010, 20(2): 103-105.
53. JAYADCVA R, KHEMCHANDANI S C. Twin support vector machines for pattern classification[J]. IEEE Trans On Pattern Analysis and Machine Intelligence, 2007, 29(5): 905-910.
54. ARUN K M, GOPAL M. Least squares twin support vector machines for pattern classification[J]. Expert Systems with Applications, 2009, 36: 7535-7543.
55. ZHANG Xin-sheng. Boosting twin support vector machine approach for MCs detection[C]//Proceedings of Asia-Pacific Conference on Information Processing. Shenzhen: [s.n.], 2009, 46: 149-152.
56. PENG Xin-jun. A v-twin support vector machine (v-TSVM) classifier and its geometric algorithms[J]. Information Sciences, 2010, 180(20): 3863-3875.
57. CHEN Jing, JI Guang-rong. Weighted least squares twin support vector machines for pattern classification[C] //Proceedings of the 2nd International Conference on Computer and Automation Engineering. Singapore: [s.n.], 2010, 2: 242-246.
58. WANG Di, YE Ning, YE Qiao-lin. Twin support vector machines via fast generalized Newton refinement[C] //Proceedings of the 2nd International Conference on Intelligent Human-Machine Systems and Cybernetics. Nanjing, Jiangsu: [s.n.], 2010, 115: 62-65.
59. GANESH R N, DINESH K K, JAYADEVA. Twin SVM for gesture classification using the surface electromyogram[J]. IEEE Transactions on Information Technology in Biomedicine, 2010, 14(2): 301-308.
60. WANG Yang, HUANG Yan-lou, LIU Jie, et al. Algorithm of active learning to rank based on PRank algorithm[J]. Computer Engineering, 2008, 34(21): 38-39, 47.
61. HERBRICH R, GRAEPEL T, OBERMAYER K. Large margin rank boundaries for ordinal regression[C] //Advances in Large Margin Classifiers. Cambridge, MA: MIT Press, 2000, 7: 115-132.
62. DING Shi-fei, LIU Xiao-liang, ZHANG Li-wen. Research on ranking support vector machine and prospects[C]// Proceedings of the 29th Chinese Control Conference, Beijing: [s.n.], 2010, 2829-2831.
63. JOACHIMS T. Optimizing Serarch engines using clickthrough data[C]//Proceedings of the eighth ACM SIGKDD International Conference on Knowledge Discovery And Data Mining. New York, USA: ACM, 2002, 133-142.
64. CAO Yun-bo, Xu Jun, LIU Tie-yan, et al. Adapting ranking SVM to document retrieval[C]//Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, USA: ACM, 2006, 186-193.
65. YAJIMA Y, Kuo Tien-fang. Efficient formulations for 1-SVM and their application to recommendation tasks[J]. Journal of Computers, 2006, 1(3): 27-34.
66. WANG Hong-yu, MI Zhong-chun, LIANG Xiao-yan, et al. A recommendation algorithm based on support vector regression[J]. Journal of the Graduate School of the Chinese Academy of Sciences, 2007, 24(6): 742-748.
67. YU H, KIM Y, HWANG S. An efficient method for learning ranking SVM[C]//Proceedings of Pacific-Asia Conference on Knowledge Discovery and Data Mining. Berlin: Springer, 2009, 426-438.
68. QIN Tao, ZHANG Xu-dong, WANG De-sheng, et al. Ranking with multiple hyperplanes[C]//Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, USA: ACM, 2007, 279-286.
69. NGUYEN T, NGO A V, NGUYEN H V, et al. Probabilistic ranking support vector machine[C]//Advances in Neural Networks-ISNN 2009. Berlin: Springer, 2009: 345-353.