An efficient weighted Lagrangian twin support vector machine for imbalanced data classification

Pattern Recognition

Volumn 47, Issue 9, 2014, Pages 3158-3167

  Shao, Yuan Hai ^a   Chen, Wei Jie ^a   Zhang, Jing Jing ^b   Wang, Zhen ^c   Deng, Nai Yang ^b  

^a ZHEJIANG UNIVERSITY OF TECHNOLOGY   (China)

^b CHINA AGRICULTURAL UNIVERSITY   (China)

^c JILIN UNIVERSITY   (China)

Author keywords

Imbalanced data classification; Lagrangian functions; Quadratic cost functions; Twin support vector machine; Weighted twin support vector machine

Indexed keywords

COST FUNCTIONS; GRAPHIC METHODS; LAGRANGE MULTIPLIERS; SUPPORT VECTOR MACHINES; VECTORS;

IMBALANCED DATA; LAGRANGIAN FUNCTIONS; QUADRATIC COST FUNCTIONS; REAL DATA SETS; TRAINING POINTS; TRAINING PROCEDURES; TWIN SUPPORT VECTOR MACHINES; UNDER-SAMPLING;

CLASSIFICATION (OF INFORMATION);

EID: 84900803418     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.03.008     Document Type: Article

References (47)

1. C. Cortes, and V.N. Vapnik Support vector networks Mach. Learn. 20 1995 273 297
2. C. Burges A tutorial on support vector machines for pattern recognition Data Mining Knowl. Discovery 2 1998 1 43
3. N. Deng, Y. Tian, and C. Zhang Support Vector Machines: Optimization Based Theory, Algorithms, and Extensions 2012 CRC Press Chapman & Hall
4. Y.-X. Li, Y.-H. Shao, and N.-Y. Deng Improved prediction of palmitoylation sites using PWMS and SVM Prot. Pept. Lett. 18 2 2011 186 193
5. D. Isa, L. Lee, V. Kallimani, and R. RajKumar Text document preprocessing with the Bayes formula for classification using the support vector machine IEEE Trans. Knowl. Data Eng. 20 9 2008 1264 1272
6. Y. Tian, Y. Shi, and X. Liu Recent advances on support vector machines research Technological and Economic Development of Economy 18 1 2012 5 33
7. J. Platt, Fast training of support vector machines using sequential minimal optimization, in: Advances in Kernel Methods-Support Vector Learning, MIT Press, Cambridge, MA, 1999, pp. 185-2008
8. T. Joachims, Making large-scale SVM learning practical, in: Advances in Kernel Methods-Support Vector Learning, Cambridge, 1998, pp. 169-184
9. J.A.K. Suykens, and J. Vandewalle Least squares support vector machine classifiers Neural Process Lett. 9 3 1999 293 300
10. J.A.K. Suykens, L. Lukas, P. Van Dooren, B. De Moor, J. Vandewalle, Least squares support vector machine classifiers: a large scale algorithm, in: Proceedings of European Conference of Circuit Theory Design, Stresa Italy, 1999, pp. 839-842
11. G. Fung, O.L. Mangasarian, Proximal support vector machine classifiers, in: Proceedings of Seventh International Conference on Knowledge and Data Discovery, San Francisco, 2001, pp. 77-86
12. C.-C. Chang, and C.-J. Lin Libsvm a library for support vector machines ACM Trans. Intell. Syst. Technol. (TIST) 2 3 2011 27
13. R.E. Fan, K.W. Chang, C.J. Hsieh, X.R. Wang, and C.J. Lin LIBLINEAR a library for large linear classification J. Mach. Learn. Res. 9 2008 1871 1874
14. O.L. Mangasarian, and E.W. Wild Multisurface proximal support vector classification via generalized eigenvalues IEEE Trans. Pattern Anal. Mach. Intell. 28 1 2006 69 74
15. J. Jayadeva, R. Khemchandani, and S. Chandra Twin support vector machines for pattern classification IEEE Trans. Pattern Anal. Mach. Intell. 29 5 2007 905 910
16. Y.H. Shao, C.H. Zhang, X.B. Wang, and N.Y. Deng Improvements on twin support vector machines IEEE Trans. Neural Networks 22 6 2011 962 968
17. Z. Qi, Y. Tian, and Y. Shi Laplacian twin support vector machine for semi-supervised classification Neural Networks 35 2012 46 53
18. Y. Tian, Z. Qi, X. Ju, Y. Shi, and X. Liu Nonparallel support vector machines for pattern classification IEEE Trans. Cybern. 99 2013 1-1
19. Y.-H. Shao, N.-Y. Deng, and W.-J. Chen A proximal classifier with consistency Knowledge-Based Syst. 49 2013 171 178
20. Z. Qi, Y. Tian, and Y. Shi Robust twin support vector machine for pattern classification Pattern Recognit. 46 1 2013 305 316
21. Y.-H. Shao, W.-J. Chen, and N.-Y. Deng Nonparallel hyperplane support vector machine for binary classification problems Inf. Sci. 263 2014 22 35
22. N. Japkowicz, and S. Stephen The class imbalance problem a systematic study Intell. Data Anal. 6 5 2002 429 449
23. Y. Tang, Y.-Q. Zhang, N.V. Chawla, and S. Krasser SVMS modeling for highly imbalanced classification IEEE Trans. Syst. Man Cybern. B: Cybern. 39 1 2009 281 288
24. B.X. Wang, and N. Japkowicz Boosting support vector machines for imbalanced data sets Knowl. Inf. Syst. 25 1 2010 1 20
25. Z.-H. Zhou, and X.-Y. Liu Training cost-sensitive neural networks with methods addressing the class imbalance problem IEEE Trans. Knowl. Data Eng. 18 1 2006 63 77
26. J.A. Suykens, J. De Brabanter, L. Lukas, and J. Vandewalle Weighted least squares support vector machines robustness and sparse approximation Neurocomputing 48 1 2002 85 105
27. G.M. Fung, and O.L. Mangasarian Multicategory proximal support vector machine classifiers Mach. Learn. 59 1-2 2005 77 97
28. Y.-M. Huang, S.-X. Du, Weighted support vector machine for classification with uneven training class sizes, in: Proceedings of 2005 International Conference on Machine Learning and Cybernetics, vol. 7, IEEE, 2005, pp. 4365-4369
29. J.P. Hwang, S. Park, and E. Kim A new weighted approach to imbalanced data classification problem via support vector machine with quadratic cost function Exp. Syst. Appl. 38 7 2011 8580 8585
30. R. Akbani, S. Kwek, N. Japkowicz, Applying support vector machines to imbalanced datasets, in: Machine Learning: ECML 2004, Springer, 2004, pp. 39-50
31. D. Tao, X. Tang, X. Li, and X. Wu Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval IEEE Trans. Pattern Anal. Mach. Intell. 28 7 2006 1088 1099
32. M. Wang, J. Yang, G.-P. Liu, Z.-J. Xu, and K.-C. Chou Weighted-support vector machines for predicting membrane protein types based on pseudo-amino acid composition Protein Eng. Des. Selection 17 6 2004 509 516
33. M. Belkin, P. Niyogi, and V. Sindhwani Manifold regularization a geometric framework for learning from labeled and unlabeled examples J. Mach. Learn. Res. 7 2006 2399 2434
34. X. Yang, S. Chen, B. Chen, and Z. Pan Proximal support vector machine using local information Neurocomputing 73 1 2009 357 365
35. O.L. Mangasarian, and D.R. Musicant Lagrangian support vector machines J. Mach. Learn. Res. 1 2001 161 177
36. B. Scholköpf, and A. Smola Learning with Kernels 2002 MIT Press Cambridge, MA
37. Trends ® Mach. Learn. 3 1 2011 1 122
38. G.-B. Ye, Y. Chen, X. Xie, Efficient variable selection in support vector machines via the alternating direction method of multipliers, in: International Conference on Artificial Intelligence and Statistics, 2011, pp. 832-840
39. Y. Tang, Y.-Q. Zhang, N.V. Chawla, and S. Krasser SVMS modeling for highly imbalanced classification IEEE Trans. Syst. Man Cybern. B: Cybern. 39 1 2009 281 288
40. X.-Y. Liu, J. Wu, and Z.-H. Zhou Exploratory undersampling for class-imbalance learning IEEE Trans. Syst. Man Cybern. B: Cybern. 39 2 2009 539 550
41. A. Fernández, S. García, M.J. del Jesus, and F. Herrera A study of the behaviour of linguistic fuzzy rule based classification systems in the framework of imbalanced data-sets Fuzzy Sets Syst. 159 18 2008 2378 2398
42. N.V. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer Smote synthetic minority over-sampling technique J. Artif. Intell. Res. 16 1 2002 321 357
43. Matlab., Users Guide, The MathWorks, Inc, http://www.mathworks.com (1994-2001)
44. Y.-H. Shao, Z. Wang, W.-J. Chen, and N.-Y. Deng A regularization for the projection twin support vector machine Knowl.-Based Syst. 37 2013 203 210
45. R. Duda, P. Hart, and D. Stork Pattern Classification 2nd Edition 2001 John Wiley and Sons Hoboken, NJ
46. N. Japkowicz, and M. Shah Evaluating Learning Algorithms: A Classification Perspective 2011 Cambridge University Press New York
47. N.V. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer Smote synthetic minority over-sampling technique J. Artif. Intell. Res. 16 1 2002 321 357