Simultaneous feature selection and SVM parameter determination in classification of hyperspectral imagery using Ant Colony Optimization

Canadian Journal of Remote Sensing

Volumn 38, Issue 2, 2012, Pages 139-156

  Samadzadegan, Farhad ^a   Hasani, Hadiseh ^a   Schenk, Toni ^b  

^a UNIVERSITY OF TEHRAN   (Iran)

^b Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANT COLONY OPTIMIZATION (ACO); CLASSIFICATION ACCURACY; CLASSIFICATION PROCESS; DATA SETS; FEATURE SUBSET; GEOGRAPHICAL AREA; HIGH DIMENSIONAL SPACES; HYPERSPECTRAL; HYPERSPECTRAL IMAGERY; HYPERSPECTRAL REMOTE SENSING; INPUT FEATURES; LAND COVER CLASSIFICATION; LOCAL OPTIMA; METAHEURISTIC; OPTIMIZATION ALGORITHMS; OPTIMUM SOLUTION; PARAMETER DETERMINATION; REDUNDANT FEATURES; SEARCH SPACES; SPECTRAL INFORMATION;

ARTIFICIAL INTELLIGENCE; CONSTRAINED OPTIMIZATION; HEURISTIC ALGORITHMS; REMOTE SENSING; SIMULATED ANNEALING; TABU SEARCH;

SUPPORT VECTOR MACHINES;

EID: 84865742501     PISSN: 07038992     EISSN: 17127971     Source Type: Journal    
DOI: 10.5589/m12-022     Document Type: Article

References (48)

1. Aghdam, M.H., Ghasem-Aghaee, N., and Basiri, M.E. 2009. Text feature selection using ant colony optimization. Expert Systems with Applications, Vol. 36, No. 3, pp. 6843-6853. doi: 10.1016/j.eswa.2008.08.022.
2. Arlot, S., and Celisse, A. 2010. A survey of cross-validation procedures for model selection. Statistics Surveys, Vol. 4, pp. 40-79. doi: 10.1214/09-SS054.
3. Babaoglu I. findik, O., and Ulker, E. 2010. A comparison of feature selection models utilizing binary particle swarm optimization and genetic algorithm in determining coronary artery disease using support vector machine. Expert Systems with Applications, Vol. 37, No. 4, pp. 3177-3183. doi: 10.1016/j.eswa.2009.09.064.
4. Bajcsy, P., and Groves, P. 2004. Methodology for hyperspectral band selection. Photogrammetric Engineering and Remote Sensing, Vol. 70, pp. 793-802. (Pubitemid 39081750)
5. Bazi, Y., and Melgani, F. 2006. Toward an optimal SVM classification system for hyperspectral remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, Vol. 44, No. 11, pp. 3374-3385. doi: 10.1109/TGRS.2006. 880628. (Pubitemid 44711679)
6. Camps-Valls, G., and Bruzzone, L. 2005. Kernel-based methods for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, Vol. 43, No. 6, pp. 1351-1362. doi: 10.1109/TGRS.2005.846154. (Pubitemid 40811944)
7. Chang, C.I. 2007. Hyperspectral data exploitation: theory and applications. Wiley-Blackwell.
8. Congalton, R.G., Fenstermaker, L.K., Jensen, J.R., McGwire, K., and Tinney, L.R. 1991. Remote sensing and geographic information system data integration: error sources and research issues. Photogrammetric Engineering & Remote Sensing, Vol. 57, No. 6, pp. 677-687. (Pubitemid 21650621)
9. Dai, C., Huang, X., and Dong, G. 2007. Support vector machine for classification of hyperspectral remote sensing imagery. IEEE Computer Society, Fourth International Conference on Fuzzy System and Knowledge Discovery (FSKD 2007), pp. 77-80. (Pubitemid 351711006)
10. de Souza, B.F., de Carvalho, A., Calvo, R., and Ishii, R.P. 2006. Multiclass SVM model selection using particle swarm optimization. IEEE Computer Society, Proceeding of Sixth International Conference on Hybrid Inelligent System (HIS'06).
11. Dópido, I., Villa, A., Plaza, A., and Gamba, P. 2011. A quantitative and comparative assessment of unmixing-based feature extraction techniques for hyperspectral image classification.
12. Du, P., Tan, K., Zhang, W., and Yan, Z. 2008. ANN classification of OMIS hyperspectral remotely sensed imagery: Experiments and analysis. IEEE Computer Society, Congress on Image and Signal Processing, pp. 692-696.
13. Engelbrencht, A.P. 2007. Computational Intelligence Introduction. John Wiley & Sons Ltd, West Sussex, England.
14. Gao, H.H., Yang, H.H., and Wang, X.Y. 2005. Ant colony optimization based network intrusion feature selection and detection. Proceeding of International Conference on Machine Learning and Cybernetics, Vol. 6, Guangzhou, China, pp. 3871-3875.
15. Guo, B., Gunn, S.R., Damper, R.I., and Nelson, J.D.B. 2008. Customizing kernel functions for SVM-based hyperspectral image classification. IEEE Transactions on Image Processing, Vol. 17, No. 4, pp. 622-629. doi: 10.1109/TIP.2008.918955. (Pubitemid 351493884)
16. H-c. Yan, S.-b.Z., K-z. Deng, P-j. Du. 2007. Research into a Feature Selection Method for Hyperspectral Imagery Using PSO and SVM. Journal of China University of Mining & Technology, Vol. 17, pp. 0473-0478. doi: 10.1016/S1006-1266(07)60128-X. (Pubitemid 350286769)
17. Ham, J., Chen, Y., Crawford, M.M., and Ghosh, J. 2005. Investigation of the random forest framework for classification of hyperspectral data. IEEE Transactions on Geoscience and Remote Sensing, Vol. 43, No. 3, pp. 492-501. doi: 10.1109/TGRS.2004.842481. (Pubitemid 40320271)
18. Hong, W.C., Cheng, Y.F., Chen, P.W., and Yeh, Y.H. 2007. Continuous ant colony optimization algorithms in a support vector regression based financial forecasting model. Third International Conference on Natural Computation (ICNC).
19. Hsu, C.W., Chang, C.C., and Lin, C.J. 2003. A practical guide to support vector classification. Citeseer National Technical Report, TaiwanUniversity.
20. Huang, C.L. 2009. ACO-based hybrid classification system with feature subset selection and model parameters optimization. Neurocomputing, Vol. 73, No. 1-3, pp. 438-448. doi: 10.1016/j.neucom.2009.07.014.
21. Huang, C.L., and Wang, C.J. 2006. A GA-based feature selection and parameters optimizationfor support vector machines. Expert Systems with Applications, Vol. 31, No. 2, pp. 231-240. doi: 10.1016/j.eswa.2005.09.024. (Pubitemid 44294444)
22. Koller, D., and Sahami, M. 1996. Toward optimal feature selection. Citeseer, pp. 284-292.
23. Kumar, M. 2004. Feature selection for classification of hyperspectral remotely sensed data using NSGA- II. Citeseer.
24. Lee, M.C. 2009. Using support vector machine with a hybrid feature selection method to the stock trend prediction. Expert Systems with Applications, Vol. 36, No. 8, pp. 10896-10904. doi: 10.1016/j.eswa.2009.02.038.
25. Lin, S.W., Lee, Z.J., Chen, S.C., and Tseng, T.Y. 2008. Parameter determination of support vector machine and feature selection using simulated annealing approach. Applied soft computing, Vol. 8, No. 4, pp. 1505-1512. doi: 10.1016/j.asoc.2007.10.012.
26. Lin, S.W., Ying, K.C., Chen, S.C., and Lee, Z.J. 2008. Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Systems with Applications, Vol. 35, No. 4, pp. 1817-1824. doi: 10.1016/j.eswa.2007.08.088.
27. Lorena, A.C., and de Carvalho, A.C. 2008. Evolutionary tuning of SVM parameter values in multiclass problems. Neurocomputing, Vol. 71, Nos. 16-18, pp. 3326-3334. doi: 10.1016/j.neucom.2008.01.031.
28. Melgani, F., and Bruzzone, L. 2004. Classification of hyperspectral remote sensing images with support vector machines. IEEE Transactions on Geoscience and Remote Sensing, Vol. 42, No. 8, pp. 1778-1790. doi: 10.1109/TGRS.2004.831865.
29. Noomen, M.F. 2007. Hyperspectral reflectance of vegetation affected by underground hydrocarbon gas seepage. Ph.D Thesis, International Institute for Geo-information Science & Earth Observation, Enschede, the Netherlands.
30. O'Boyle, N.M., Palmer, D.S., Nigsch, F., and Mitchell, J.B.O. 2008. Simultaneous feature selection and parameter optimisation using an artificial ant colony: case study of melting point prediction. Chemistry Central Journal, Vol. 2, pp. 21-25. doi: 10.1186/1752-153X-2-21.
31. Pham, D.T., Muhamad, Z., Mahmuddin, M., Ghanbarzadeh, A., Koc, E., and Otri, S. 2006. Using the Bees Algorithm to Optimise a Support Vector Machine for Wood Defect Classification.
32. Tan, F., Fu, X., Zhang, Y., and Bourgeois, A.G. 2008. A genetic algorithmbased method for feature subset selection. Soft Computing-A Fusion of Foundations. Methodologies and Applications, Vol. 12, No. 2, pp. 111-120. (Pubitemid 47421541)
33. Vapnik, V.N., and Vapnik, V. 1998. Statistical learning theory. Wiley New York.
34. Waheed, T., Bonnell, R.B., Prasher, S.O., and Paulet, E. 2006. Measuring performance in precision agriculture: CART-A decision tree approach. Agricultural water management, Vol. 84, Nos. 1-2, pp. 173-185. doi: 10.1016/j.agwat.2005.12.003. (Pubitemid 44192459)
35. Wang, L., and Yu, J. 2006. A Modified Adaptive Chaotic Binary Ant System and Its Application in Chemical Process Fault Diagnosis. Advances in Natural Computation, Vol. 42222, pp. 530-539. (Pubitemid 44618056)
36. Wang, Y., Li, L., Ni, J., and Huang, S. 2009. Feature selection using tabu search with long-term memories and probabilistic neural networks. Pattern Recognition Letters, Vol. 30, No. 7, pp. 661-670. doi: 10.1016/j.patrec.2009.02. 001.
37. Watanachaturaporn, P., Arora, M.K., and Varshney, P.K. 2006. Hyperspectral image classification using support vector machines: A comparison with decision tree and neural network classifiers. ASPRS, Annual Conference, Baltimore, Maryland.
38. Wu, C.H., Tzeng, G.H., Goo, Y.J., and Fang, W.C. 2007. A real-valued genetic algorithm to optimize the parameters of support vector machine for predicting bankruptcy. Expert Systems with Applications, Vol. 32, No. 2, pp. 397-408. doi: 10.1016/j.eswa.2005.12.008. (Pubitemid 44754927)
39. Xiaojia, B., Fang, M., Bin, W., Jiaguang, L., and Dong, W. 2010. Hyperion hyperspectral remote sensing application in altered mineral mapping in East Kunlun of the Qinghai-Tibet Plateau. IEEE computer society, International Conference on Challenges in Environmental Science and Computer Engineering, pp. 519-523.
40. Xue-qin, Z., Chun-hua, G., and Jia-jin, L. 2007. Intrusion Detection System Based on Feature Selection and Support Vector Machine. First International Conference on Communications and Networking, Beijing, China, pp. 1-5.
41. Yu, H., Gu, G., Liu, H., Shen, J., and Zhao, J. 2009. A modified ant colony optimization algorithm for tumor marker gene selection. Genomics Proteomics Bioinformatic, Vol. 7, No. 4, pp. 200-208. doi: 10.1016/S1672- 0229(08)60050-9.
42. Yuen, P.W.T., and Richardson, M. 2010. An introduction to hyperspectral imaging and its application for security, surveillance and target acquisition. Imaging Science Journal, Vol. 58, No. 5, pp. 241-253. doi: 10.1179/ 174313110X12771950995716.
43. Zapfel, G., Braune, R., and Bogl, M. 2010. Metaheuristic search concepts, A tutorial with applications to production and logistics. Springer Heidelberg Dordrecht London New York.
44. Zhang, X.L., Chen, X.F., and He, Z.J. 2010. An ACO-based algorithm for parameter optimization of support vector machines. Expert Systems with Applications, Vol. 37, pp. 6618-6628. doi: 10.1016/j.eswa.2010.03.067.
45. Zhang, Y. 2008. Evolutionary Computation Based Automatic SVM Model Selection. Fourth Conference on Natural Computation, pp. 66-70. IEEE Computer Society Washington, D.C.
46. Zhen-yu, H., Ming, L., and Hong-ya, F. 2009. Design and application of support vector regression algorithm based on ant colony optimization. International Conference on Computational Intelligence and Natural Computing, pp. 182-185. IEEE Computer Society Washington, D.C.
47. Zheng, L., Yu, M., and Yu, S. 2008. Support vector regression and ant colony optimization for combustion performance of boilers. Fourth Conference on Natural Computation, pp. 178-182.
48. Zhuo, L., Zheng, J., Wang, F., Li, X., Ai, B., and Qian, J. 2008. A genetic algorithm based wrapper feature selection method for classification of hyperspectral images using support vector machine. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 37, No. B7, pp. 397-402.