Particle swarm optimization for parameter determination and feature selection of support vector machines

Expert Systems with Applications

Volumn 35, Issue 4, 2008, Pages 1817-1824

  Lin, Shih Wei ^a   Ying, Kuo Ching ^a   Chen, Shih Chieh ^b   Lee, Zne Jung ^a  

^a HUAFAN UNIVERSITY   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

Author keywords

Feature selection; Parameter determination; Particle swarm optimization; Support vector machine

Indexed keywords

CLASSIFICATION (OF INFORMATION); GEARS; IMAGE RETRIEVAL; LEARNING SYSTEMS; MULTILAYER NEURAL NETWORKS; OPTIMIZATION; SUPPORT VECTOR MACHINES; VECTORS;

CLASSIFICATION ACCURACIES; CONVENTIONAL METHODS; DATA-SETS; DIVERSE APPLICATIONS; FEATURE SELECTION; GRID SEARCH; KERNEL PARAMETERS; PARAMETER DETERMINATION; PARAMETER VALUES; PARTICLE SWARM OPTIMIZATION; PARTICLE SWARM OPTIMIZATIONS; PATTERN CLASSIFICATIONS; SUPPORT VECTOR MACHINE; SVM CLASSIFICATION; SVM TRAINING;

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 48749109333     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2007.08.088     Document Type: Article

References (37)

1. Acir N., Özdamar O., and Guzelis C. Automatic classification of auditory brainstem responses using SVM-based feature selection algorithm for threshold detection. Engineering Applications of Artificial Intelligence 19 (2006) 209-218
2. Burgers C.J.C. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2 (1998) 121-167
3. Cao L.J., and Tay F.E.H. Support vector machine with adaptive parameters in financial time series forecasting. IEEE Transactions on Neural Network 14 6 (2003) 1506-1518
4. Chen R.-C., and Hsieh C.-H. Web page classification based on a support vector machine using a weighed vote schema. Expert Systems with Applications 31 (2006) 427-435
5. Fung G., and Mangasarian O.L. Finite newton method for lagrangian support vector machine classification. Neurocomputing 55 (2003) 39-55
6. Gold C., Holub A., and Sollich P. Bayesian approach to feature selection and parameter tuning for support vector machine classifiers. Neural Networks 18 (2005) 693-701
7. Han J., and Kamber M. Data mining: concepts and techniques (2003), Morgan Kaufmann, San Francisoc
8. Hettich, S., Blake, C., & Merz, C. (1998). UCI repository of machine information and computer sciences, available at .
9. Hsu, C.-W., Chang, C.-C., & Lin, C.-J. (2003). A practical guide to support vector classification. Technical report, University of National Taiwan, Department of Computer Science and Information Engineering, July, pp. 1-12.
10. Huang C.-L., Chen M.-C., and Wang C.-J. Credit scoring with a data mining approach based on support vector machines. Expert Systems with Applications (2006) 10.1016/j.eswa.2006.07.007
11. Huang C.-J., Lai W.-K., Luo R.-L., and Yan Y.-L. Application of support vector machine to bandwidth reservation in sectored cellular communications. Engineering Applications of Artificial Intelligence 18 (2005) 585-594
12. Huang C.-L., and Wang C.-J. A GA-based feature selection and parameters optimization for support vector machines. Expert Systems with Applications 31 (2006) 231-240
13. Jack L.B., and Nandi A.K. Fault detection using support vector machines and artificial neural networks, augmented by genetic algorithms. Mechanical Systems and Signal Processing 16 (2002) 373-390
14. Keerthi S.S., and Lin C.-J. Asymptotic behaviors of support vector machines with gaussian kernel. Neural Computation 15 (2003) 1667-1689
15. Kennedy J., and Eberhart R.C. Particle swarm optimization. Proceedings of IEEE Conference on Neural Network 4 (1995) 1942-1948
16. Kohavi R., and John G.H. Wrappers for feature subset selection. Artificial Intelligence 97 (1997) 273-324
17. Liao Y., Fang S.-C., and Nuttle H.L.W. A neural network model with bounded-weights for pattern classification. Computers and Operations Research 31 (2004) 1411-1426
18. Liang J.-Z. SVM multi-classifier and web document classification. Proceedings of the Third International Conference on Machine Learning and Cybernetics 3 (2004) 1347-1351
19. Lin, H.-T., & Lin, C.-J. (2003). A study on sigmoid kernels for SVM and the training of non-PSD kernels by SMO-type methods. Technical report, University of National Taiwan, Department of Computer Science and Information Engineering. March, pp. 1-32.
20. Liu H., and Motoda H. Feature Selection for knowledge discovery and data mining (1998), Kluwer Academic, Boston
21. Müller K.R., Mike S., Rätsch G., Tsuda K., and Schölkopf B. An introduction to kernel-based learning algorithms. IEEE Transactions on Neural Networks 12 2 (2001) 181-201
22. Ng J., and Gong S. Composite support vector machines for detection of faces across views and pose estimation. Image and Vision Computing 20 (2002) 359-368
23. Pai P.-F., and Hong W.-C. Support vector machines with simulated annealing algorithms in electricity load forecasting. Energy Conversion and Management 46 (2005) 2669-2688
24. Pardo M., and Sberveglieri G. Classification of electronic nose data with support vector machines. Sensors and Actuators B Chemical 107 (2005) 730-737
25. Salzberg S.L. On comparing classifiers: pitfalls to avoid and a recommended approach. Data Mining and Knowledge Discovery 1 (1997) 317-327
26. Samanta B., Al-Balushi K.R., and Al-Araimi S.A. Artificial neural networks and support vector machines with genetic algorithm for bearing fault detection. Engineering Applications of Artificial Intelligence 16 (2003) 657-665
27. SchÖlkopf B., and Smola A.J. Learning with kernels (2002), MIT, London
28. Shi Y., and Eberhart R.C. A Modified particle swarm optimizer. Proceeding of the IEEE congress on Evolutionary Computation (1998) 69-73
29. Shin K.-S., Lee T.-S., and Kim H.-J. An application of support vector machines in bankruptcy prediction Model. Expert Systems with Applications 28 (2005) 127-135
30. Shon, T., Kim, Y., Lee, C., & Moon, J. (2005). A machine learning framework for network anomaly detection using SVM and GA. In Proceedings of IEEE Workshop on Information Assurance and Security 2, pp. 176-183.
31. Valentini G. Gene expression data analysis of human lymphoma using support vector machines and output coding ensembles. Artificial Intelligence in Medicine 26 (2002) 281-304
32. Valentini G., Muselli M., and Ruffino F. Cancer recognition with bagged ensembles of support vector machines. Neurocomputing 56 (2004) 461-466
33. Vapnik V.N. The nature of statistical learning theory (1995), Springer, New York
34. Wang J., Wu X., and Zhang C. Support vector machines based on k-means clustering for real-time business intelligence systems. International Journal of Business Intelligence and Data Mining 1 1 (2005) 54-64
35. Wei Y., and Lin C.-J. Feature Extraction, Foundations and Applications (2005), Springer
36. Zhang Y.L., Guo N., Du H., and Li W.H. Automated defect recognition of C-SAM image in IC packaging using support vector machines. International Journal of Advanced Manufacturing Technology 25 (2005) 1191-1196
37. Zhang L., Jack L.B., and Nandi A.K. Fault detection using genetic programming. Mechanical Systems and Signal Processing 19 (2005) 271-289