Improved support vector machine algorithm for heterogeneous data

Pattern Recognition

Volumn 48, Issue 6, 2015, Pages 2072-2083

  Peng, Shili ^a,b   Hu, Qinghua ^a,c   Chen, Yinli ^b   Dang, Jianwu ^a,c  

^a TIANJIN UNIVERSITY   (China)

^b GUANGDONG UNIVERSITY OF FINANCE AND ECONOMICS   (China)

^c Tianjin Key Laboratory of Cognitive Computing and Application   (China)

Author keywords

Classification learning; Heterogeneous data; Nominal attribute; Numerical attribute; Support vector machine

Indexed keywords

LEARNING SYSTEMS; SUPPORT VECTOR MACHINES;

CLASSIFICATION LEARNING; CLASSIFICATION PERFORMANCE; CLASSIFICATION TASKS; GENERALIZATION ERROR; HETEROGENEOUS DATA; NOMINAL ATTRIBUTES; NUMERICAL ATTRIBUTES; SUPPORT VECTOR MACHINE ALGORITHM;

LEARNING ALGORITHMS;

EID: 84925344790     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.12.015     Document Type: Article

References (43)

1. V. Vapnik The Nature of Statistical Learning Theory 1999 Springer Berlin, Germany
2. X.-X. Niu, and C.Y. Suen A novel hybrid cnn-svm classifier for recognizing handwritten digits Pattern Recognit. 45 4 2012 1318 1325
3. C.-L. Liu, K. Nakashima, H. Sako, and H. Fujisawa Handwritten digit recognition benchmarking of state-of-the-art techniques Pattern Recognit. 36 10 2003 2271 2285
4. R. Huerta, S. Vembu, M.K. Muezzinoglu, A. Vergara, Dynamical svm for time series classification, in: Pattern Recognition, Springer, Berlin, Germany, 2012, pp. 216-225.
5. T. Warren Liao Clustering of time series dataa survey Pattern Recognit. 38 11 2005 1857 1874
6. E. Tapia, P. Bulacio, and L. Angelone Sparse and stable gene selection with consensus svm-rfe Pattern Recognit. Lett. 33 2 2012 164 172
7. R. Ruiz, J.C. Riquelme, and J.S. Aguilar-Ruiz Incremental wrapper-based gene selection from microarray data for cancer classification Pattern Recognit. 39 12 2006 2383 2392
8. J. Cheng, and K. Wang Active learning for image retrieval with co-svm Pattern Recognit. 40 1 2007 330 334
9. Y. Liu, D. Zhang, G. Lu, and W.-Y. Ma A survey of content-based image retrieval with high-level semantics Pattern Recognit. 40 1 2007 262 282
10. R. Kachouri, K. Djemal, and H. Maaref Multi-model classification method in heterogeneous image databases Pattern Recognit. 43 12 2010 4077 4088
11. C.-W. Hsu, C.-C. Chang, C.-J. Lin, et al., A Practical Guide to Support Vector Classification, 2003.
12. J.R. Quinlan C4. 5: Programs for Machine Learning vol. 1 1993 Morgan Kaufmann Massachusetts, America
13. L. Breiman, J. Friedman, C.J. Stone, and R.A. Olshen Classification and Regression Trees 1984 Chapman & Hall/CRC London, England
14. D. Lin, An information-theoretic definition of similarity, in: Proceedings of the 15th International Conference on Machine Learning, San Francisco, vol. 1, 1998, pp. 296-304.
15. C. Stanfill, and D. Waltz Toward memory-based reasoning Commun. ACM 29 12 1986 1213 1228
16. D.R. Wilson, and T.R. Martinez Improved heterogeneous distance functions J. Artif. Intell. Res. 6 1997 1 34
17. E. Fix, and J.L. Hodges Jr. Discriminatory analysis. nonparametric discrimination consistency properties Int. Stat. Rev./Rev. Int. Stat. 1989 238 247
18. P.-N. Tan Introduction to Data Mining 2007 Pearson Education India
19. V. Cheng, C.-H. Li, J.T. Kwok, and C.-K. Li Dissimilarity learning for nominal data Pattern Recognit. 37 7 2004 1471 1477
20. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee Choosing multiple parameters for support vector machines Mach. Learn. 46 1 2002 131 159
21. C.J. Burges A tutorial on support vector machines for pattern recognition Data Min. Knowl. Discov. 2 2 1998 121 167
22. O. Chapelle, V. Vapnik, Model selection for support vector machines, in: Advances in Neural Information Processing Systems, vol. 12, 1999, pp. 230-236.
23. I.W. Tsang, J.T. Kwok, and P.-M. Cheung Core vector machines fast svm training on very large data sets J. Mach. Learn. Res. 6 1 2006 363
24. R.C. Barros, M.P. Basgalupp, A. de Carvalho, and A.A. Freitas A survey of evolutionary algorithms for decision-tree induction IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 42 3 2012 291 312
25. X. Wu, V. Kumar, J. Ross Quinlan, J. Ghosh, Q. Yang, H. Motoda, G.J. McLachlan, A. Ng, B. Liu, and P.S. Yu Top 10 algorithms in data mining Knowl. Inf. Syst. 14 1 2008 1 37
26. J. Gama, and P. Brazdil Cascade generalization Mach. Learn. 41 3 2000 315 343
27. J. Maudes, J. J. Rodríguez, C. García-Osorio, Cascading for nominal data, in: Multiple Classifier Systems, Springer, Berlin, Germany, 2007, pp. 231-240.
28. Y. Tian, N. Deng, Support vector classification with nominal attributes, in: Computational Intelligence and Security, Springer, Berlin, Germany, 2005, pp. 586-591.
29. H. Do, A. Kalousis, A. Woznica, M. Hilario, Margin and radius based multiple kernel learning, in: Machine Learning and Knowledge Discovery in Databases, Springer, Berlin, Germany, 2009, pp. 330-343.
30. N. Cristianini, and J. Shawe-Taylor An Introduction to Support Vector Machines and Other Kernel-based Learning Methods 2000 Cambridge University Press Cambridge, England
31. A. Asuncion, D.J. Newman, Uci Machine Learning Repository, 2007.
32. R. Rifkin, and A. Klautau In defense of one-vs-all classification J. Mach. Learn. Res. 5 2004 101 141
33. S. Li, and M. Tan Tuning svm parameters by using a hybrid clpso-bfgs algorithm Neurocomputing 73 10 2010 2089 2096
34. H. Frohlich, A. Zell, Efficient parameter selection for support vector machines in classification and regression via model-based global optimization, in: IJCNN'05. Proceedings of 2005 IEEE International Joint Conference on Neural Networks, vol. 3, IEEE, New Jersey, America, 2005, pp. 1431-1436.
35. J. Bergstra, and Y. Bengio Random search for hyper-parameter optimization J. Mach. Learn. Res. 13 2012 281 305
36. G.E. Batista, D.F. Silva, How k-nearest neighbor parameters affect its performance, in: Argentine Symposium on Artificial Intelligence, 2009, pp. 1-12.
37. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten The weka data mining software: an update ACM SIGKDD Explor. Newslett. 11 1 2009 10 18
38. G. David, and A. Averbuch Spectralcat categorical spectral clustering of numerical and nominal data Pattern Recognit. 45 1 2012 416 433
39. J. Demšar Statistical comparisons of classifiers over multiple data sets J. Mach. Learn. Res. 7 2006 1 30
40. H. He, and E.A. Garcia Learning from imbalanced data IEEE Trans. Knowl. Data Eng. 21 9 2009 1263 1284
41. B.X. Wang, and N. Japkowicz Boosting support vector machines for imbalanced data sets Knowl. Inf. Syst. 25 1 2010 1 20
42. F. Provost, Machine learning from imbalanced data sets 101, in: Proceedings of the AAAI2000 Workshop on Imbalanced Data Sets, 2000.
43. M. Takác, A. Bijral, P. Richtárik, N. Srebro, Mini-batch primal and dual methods for svms, in: 30th International Conference on Machine Learning, 2013.