ACO-based hybrid classification system with feature subset selection and model parameters optimization

Neurocomputing

Volumn 73, Issue 1-3, 2009, Pages 438-448

  Huang, Cheng Lung ^a  

^a NATIONAL KAOHSIUNG UNIVERSITY OF APPLIED SCIENCES   (Taiwan)

Author keywords

Ant colony optimization; Feature selection; Support vector machine

Indexed keywords

ANT COLONY OPTIMIZATION; CLASSIFICATION ACCURACY; CLASSIFIER MODELS; FEATURE SELECTION; FEATURE SUBSET; FEATURE SUBSET SELECTION; HYBRID CLASSIFICATION; INPUT FEATURES; KERNEL PARAMETER; MODEL PARAMETERS; SVM CLASSIFIERS; TRANSITION PROBABILITIES; WEIGHT VECTOR;

CLASSIFIERS; GEARS; IMAGE RETRIEVAL; MULTILAYER NEURAL NETWORKS; OPTIMIZATION; VECTORS;

SUPPORT VECTOR MACHINES;

PHEROMONE;

ANT COLONY OPTIMIZATION; ARTICLE; CLASSIFICATION ALGORITHM; CLASSIFIER; CONTROLLED STUDY; KERNEL METHOD; MATHEMATICAL ANALYSIS; PRIORITY JOURNAL; PROCESS OPTIMIZATION; SUPPORT VECTOR MACHINE;

EID: 70350705845     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.07.014     Document Type: Article

References (49)

1. Zhang G.P. Neural networks for classification: a survey. IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews 30 4 (2000) 451-462
2. Yang J., and Honavar V. Feature subset selection using a genetic algorithm. IEEE Intelligent Systems 13 2 (1998) 44-49
3. G. John, R. Kohavi, K. Peger, Irrelevant features and the subset selection problem, in: Proceedings of the Eleventh International Conference on Machine Learning, 1994, pp. 121-129.
4. Kohavi R., and John G. Wrappers for feature subset selection. Artificial Intelligence 97 1-2 (1997) 273-324
5. Liu H., and Motoda H. Feature Selection for Knowledge Discovery and Data Mining (1998), Kluwer Academic, Norwell, MA
6. Vapnik V.N. The Nature of Statistical Learning Theory (1995), Springer, NY, USA
7. Dorigo M., Maniezzo V., and Colorni A. The ant system: optimization by a colony of cooperating agents. IEEE Transactions on System, Man, and Cybernetics 26 1 (1996) 1-13
8. Dorigo M., and Gambardella L.M. Ant colonies for the traveling salesman problem. BioSystems 43 (1997) 73-81
9. Dorigo M., and Gambardella L.M. Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Transactions on Evolutionary Computation 1 1 (1997) 53-66
10. Dorigo M., Caro G.D., and Gambardella L.M. Ant algorithms for discrete optimization. Artificial Life 5 2 (1999) 137-172
11. D. Merkle, M. Middendorf, H. Schmeck, Ant colony optimization for resource-constrained project scheduling, in: Proceedings of the Genetic and Evolutionary Computation Conference, 2000, pp. 893-900.
12. Izrailev S., and Agrafiotis D.K. Variable selection for QSAR by artificial ant colony systems. SAR and QSAR in Environmental Research 13 3-4 (2002) 417-423
13. Al-Ani A. Feature subset selection using ant colony optimization. International Journal of Computational Intelligence 2 1 (2005) 53-58
14. Sivagaminathan R.K., and Ramakrishnan S. A hybrid approach for feature subset selection using neural networks and ant colony optimization. Expert Systems with Applications 33 1 (2007) 49-60
15. H.R. Kanan, K. Faez, M. Hosseinzadeh, Face recognition system using ant colony optimization-based selected features. in: IEEE Symposium on Computational Intelligence in Security and Defense Applications, 2007, pp. 57-62.
16. Jensen R., and Shen Q. Fuzzy-rough data reduction with ant colony optimization. Fuzzy Sets and Systems 149 1 (2005) 5-20
17. Jensen R., and Shen Q. Webpage classification with ACO-enhanced fuzzy-rough feature selection. Lecture Notes in Computer Science vol. 4259 (2006), Springer, Berlin 147-156
18. Perez R.B., Nowe A., Vrancx P., Gomez Y.D., and Caballero Y. Using ACO and rough set theory to feature selection. WSEAS Transactions on Information Science and Applications 2 5 (2005) 512-517
19. Yan Z., and Yuan C. Ant colony optimization for feature selection in face recognition. Lecture Notes in Computer Science vol. 3072 (2004), Springer, Berlin 221-226
20. H.-H. Gao, H.-H. Yang, X.-Y. Wang, Ant colony optimization based network intrusion feature selection and detection, in: International Conference on Machine Learning and Cybernetics, 2005, pp. 3871-3875.
21. Zhang C., and Hu H. Ant colony optimization combining with mutual information for feature selection in support vector machines. Lecture Notes in Computer Science vol. 3809 (2005), Springer, Berlin 918-921
22. Mohamed S.S., Youssef A.M., El-Saadany E.F., and Salama M.M.A. Artificial life feature selection techniques for prostrate cancer diagnosis using TRUS images. Lecture Notes in Computer Science vol. 3656 (2005), Springer, Berlin 903-913
23. Huang C.-L., and Wang C.-J. A GA-based attribute selection and parameter optimization for support vector machine. Expert Systems with Applications 31 2 (2006) 231-240
24. H. Fröhlich, O. Chapelle, Feature selection for support vector machines by means of genetic algorithms, in: Proceedings of the 15th IEEE International Conference on Tools with Artificial Intelligence, 2003, pp. 142-148.
25. Oliveira L.S., Sabourin R., Bortolozzi F., and Suen C.Y. A methodology for feature selection using multi-objective genetic algorithms for handwritten digit string recognition. International Journal of Pattern Recognition and Artificial Intelligence 17 6 (2003) 903-929
26. Kecman V. Learning and Soft Computing (2001), MIT Press, Cambridge, Massachusetts, USA
27. Scho{combining double acute accent}lkopf B., and Smola A.J. Statistical Learning and Kernel Methods (2000), MIT Press, Cambridge, Massachusetts, USA
28. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines (2000), Cambridge University Press, Cambridge, UK
29. L. Bottou, C. Cortes, J. Denker, H. Drucker, I. Guyon, L. Jackel, Y. LeCun, U. Muller, E. Sackinger, P. Simard, V. Vapnik, Comparison of classifier methods: a case study in handwriting digit recognition, in: International Conference on Pattern Recognition, 1994, pp. 77-87.
30. Knerr S., Personnaz L., and Dreyfus G. Single-layer learning revisited: a stepwise procedure for building and training a neural network. In: Fogelman-Soulíe F., and Herault J. (Eds). Neurocomputing: Algorithms, Architectures and Application vol. F68 (1990), Springer, Berlin 41-50
31. KreBel U. Pairwise classification and support vector machines. In: Schölkopf B., Burges C.J., and Smola A.J. (Eds). Advances in Kernel Methods-Support Vector Learning (1999), MIT Press, Cambridge, Massachusetts, USA 254-268
32. Dorigo M., and Stützle T. Ant Colony Optimization (2004), MIT Press, Cambridge, Massachusetts
33. C.-W. Hsu, C.-C. Chang, C.-J. Lin, A practical guide to support vector classification, Available at: 〈http://www.csie.ntu.edu.tw/∼cjlin/papers/guide/guide.pdf〉, January 2008.
34. H.-T. Lin, C.-J. Lin, A study on sigmoid kernels for SVM and the training of non-PSD kernels by SMO-type methods, Technical Report, Department of Computer Science and Information Engineering, National Taiwan University, Available at: 〈http://www.csie.ntu.edu.tw/∼cjlin/papers/tanh.pdf〉, January 2008.
35. Chen Y.-W., and Lin C.-J. Combining SVMs with various feature selection strategies. In: Guyon I., Gunn S., Nikravesh M., and Zadeh L.A. (Eds). Feature Extraction, Foundations and Applications, Studies in Fuzziness and Soft Computing (2005), Springer, Berlin 273-282
36. Salzberg S.L. On comparing classifiers: Pitfalls to avoid and a recommended approach. Data Mining and Knowledge Discovery 1 (1997) 317-327
37. Morariu D., Vintan L., and Tresp V. Evaluating some feature selection methods for an improved SVM classifier. International Journal of Intelligent Technology 1 4 (2006) 288-298
38. Fine S., and Scheinberg K. Efficient SVM training using low-rank kernel representations. Journal of Machine Learning Research 2 (2001) 243-264
39. Shalev-Shwartz S., and Srebro N. SVM optimization: inverse dependence on training set size. In: Cohen W.W., McCallum A., and Roweis S.T. (Eds). The 25th International Conference on Machine Learning (2008), Berlin, Springer 928-935
40. Hsu C.W., and Lin C.J. A simple decomposition method for support vector machine. Machine Learning 46 1-3 (2002) 219-314
41. LaValle S.M., Branicky M.S., and Lindemann S.R. On the relationship between classical grid search and probabilistic roadmaps. International Journal of Robotics Research 23 7-8 (2004) 673-692
42. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, Software available at: 〈http://www.csie.ntu.edu.tw/∼cjlin/libsvm〉, January 2008.
43. Punch W.F., Goodman E.D., Pei M., Chia-Shun L., Hovland P., and Enbody R. Further research on feature selection and classification using genetic algorithms. In: Forrest S. (Ed). Fifth International Conference on Genetic Algorithms (1993) 557-564
44. Conover W. Practical Nonparametric Statistics. second ed. (1980), Wiley, New York
45. P.M. Murphy, D.W. Aha, UCI Repository of machine learning databases, Department of Information and Computer Science, University of California, Irvine, CA, 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉, 2001.
46. Bilchev G., and Parmee I.C. The ant colony metaphor for searching continuous design space. In: Fogarty T. (Ed). Proceeding of the AISB Workshop on Evolutionary Computation, Lecture Notes in Computer Science vol. 993 (1995), Springer, Berlin 25-39
47. W. Lei, W. Qidi, Ant system algorithm for optimization in continuous space, in: Proceeding of the IEEE International Conference on Control Applications, 2001, pp. 395-400.
48. Chen L., Shen J., Qin L., and Fan J. A method for solving optimization problem in continuous space using improved ant colony algorithm. In: Shi Y., Xu W., and Chen Z. (Eds). CASDMKM 2004, Lecture Notes in Computer Science vol. 3327 (2004), Springer, Berlin 61-70
49. Socha K., and Dorigo M. Ant colony optimization for continuous domains. European Journal of Operational Research 185 3 (2008) 1155-1173