Optimizing subspace SVM ensemble for hyperspectral imagery classification

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Volumn 7, Issue 4, 2014, Pages 1295-1305

  Chen, Yushi ^a   Zhao, Xing ^a   Lin, Zhouhan ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Ensemble; hyperspectral imagery classification; optimal subspace; random subspace; support vector machine (SVM)

Indexed keywords

CLASSIFICATION (OF INFORMATION); IMAGE CLASSIFICATION; IMAGE RECONSTRUCTION; OPTIMIZATION; REMOTE SENSING; SPECTROSCOPY;

ENSEMBLE; ENSEMBLE SYSTEMS; HYPERSPECTRAL IMAGERY CLASSIFICATIONS; HYPERSPECTRAL REMOTE SENSING IMAGE; INDIVIDUAL CLASSIFIERS; OPTIMAL SUBSPACE; OVERALL ACCURACIES; RANDOM SUBSPACES;

SUPPORT VECTOR MACHINES;

ACCURACY ASSESSMENT; GENETIC ALGORITHM; IMAGE CLASSIFICATION; OPTIMIZATION; PERFORMANCE ASSESSMENT; REMOTE SENSING; SATELLITE IMAGERY; SPECTRAL RESOLUTION;

EID: 84899990796     PISSN: 19391404     EISSN: 21511535     Source Type: Journal    
DOI: 10.1109/JSTARS.2014.2307356     Document Type: Article

References (54)

1. D. Landgrebe, "Hyperspectral image data analysis," IEEE Signal Process. Mag., vol. 19, no. 1, pp. 17-28, Jan. 2002. (Pubitemid 34237205)
2. J. A. Richards, Remote Sensing Digital Image Analysis. New York, NY, USA: Springer, 2012.
3. M. Pal and G. M. Foody, "Feature selection for classification of hyperspectral data by SVM," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 5, pp. 2297-2307, May 2010.
4. F. Melgani and L. Bruzzone, "Classification of hyperspectral remote sensing images with support vector machines," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 8, pp. 1778-1790, Aug. 2004.
5. J. A. Gualtieri and S. Chettri, "Support vector machines for classification of hyperspectral data," in Proc. IEEE IGARSS, Honolulu, HI, USA, 2000, pp. 813-815. (Pubitemid 32019653)
6. G. M. Foody and A. Mathur, "A relative evaluation of multiclass image classification by support vector machines," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 6, pp. 1335-1343, Jun. 2004.
7. Y. Bazi and F. Melgani, "Toward an optimal SVM classification system for hyperspectral remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 11, pp. 3374-3385, Nov. 2006. (Pubitemid 44711679)
8. B. Bigdeli, F. Samadzadegan, and P. Reinartz, "A multiple SVM system for classification of hyperspectral remote sensing data," J. Indian Soc. Remote Sens., vol. 41, no. 4, pp. 763-776, Dec. 2013.
9. R. Polikar, "Ensemble based systems in decision making," IEEE Circuits and Syst. Mag., vol. 6, no. 3, pp. 21-45, Third Quarter, 2006.
10. L. Breiman, "Bagging predictors," Mach. Learn., vol. 24, no. 2, pp. 123-140, 1996. (Pubitemid 126724382)
11. Q. Wu, L. W. Wang, and J. Wu, "Ensemble learning on hyperspectral remote sensing image classification," Adv. Mater. Res., vol. 546, pp. 508-513, Jul. 2012.
12. B. Waske et al., "Sensitivity of support vector machines to random feature selection in classification of hyperspectral data," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 7, pp. 2880-2889, Jul. 2010.
13. H. Kwon and P. Rauss, "Feature-based ensemble learning for hyperspectral chemical plume detection," Int. J. Remote Sens., vol. 32, no. 21, pp. 6631-6652, Jul. 2011.
14. J.-M. Yang et al., "A dynamic subspace method for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 7, pp. 2840-2853, Jul. 2010.
15. S. Kumar, J. Ghosh, and M. M. Crawford, "Best-bases feature extraction algorithms for classification of hyperspectral data," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 7, pp. 1368-1379, Jul. 2001. (Pubitemid 32732653)
16. A. B. Santos, A. de Albuquerque Araujo, and D. Menotti, "Combining multiple classification methods for hyperspectral data interpretation," IEEE Sel. Topics Appl. Earth Observ. Remote Sens., vol. 6, no. 3, pp. 1450-1459, Jun. 2013.
17. C. Padilha, A. D. Neto, and J. Melo, "Random subspace method and genetic algorithmapplied to a LS-SVM ensemble," in Proc. Artificial Neural Netw. Machine Learning-ICANN 2012, Berlin, Germany: Springer, 2012, pp. 164-171.
18. J. A. Dos Santos, C. D. Ferreira, R. S. Torres et al., "A relevance feedback method based on genetic programming for classification of remote sensing images," Inf. Sci., vol. 181, no. 13, pp. 2671-2684, 2011.
19. F. A. Faria, J. A. dos Santos, A. Rocha et al., "Aframework for selection and fusion of pattern classifiers in multimedia recognition," Pattern Recognit. Lett., vol. 39, pp. 52-64, Apr. 2014.
20. W. Siedlecki and J. Sklansky, "A note on genetic algorithms for large-scale feature selection," Pattern Recognit. Lett., vol. 10, no. 5, pp. 335-347, Nov. 1989.
21. L. I. Kuncheva, "Combining pattern classifiers: Methods and algorithms: (Hoboken, NJ: Wiley, 2004)," IEEE Trans. Neural Netw., vol. 18, no. 3, p. 964, May 2007.
22. H. Yao and L. Tian, "A genetic-algorithm-based selective principal component analysis (GA-SPCA) method for high-dimensional data feature extraction," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 6, pp. 1469-1478, Jun. 2003.
23. L. Bruzzone, F. Roli, and S. B. Serpico, "An extension of the Jeffreys-Matusita distance to multiclass cases for feature selection," IEEE Trans. Geosci. Remote Sens., vol. 33, no. 6, pp. 1318-1321, Nov. 1995.
24. S. Gunal and R. Edizkan, "Subspace based feature selection for pattern recognition," Inf. Sci., vol. 178, no. 19, pp. 3716-3726, 2008.
25. L. Bruzzone and S. B. Serpico, "A technique for feature selection in multiclass problems," Int. J. Remote Sens., vol. 21, no. 3, pp. 549-563, 2000. (Pubitemid 30102558)
26. A. Ghosh et al., "Neuro-fuzzy-combiner: An effective multiple classifier system," Int. J. Knowl. Eng. Soft Data Paradigms, vol. 2, no. 2, pp. 107-129, 2010.
27. L. Lam and S. Y. Suen, "Application of majority voting to pattern recognition: An analysis of its behavior and performance," IEEE Trans. Syst. Man Cybern. Part A: Syst. Humans, vol. 27, no. 5, pp. 553-568, 1997. (Pubitemid 127770722)
28. L. K. Hansen and P. Salamon, "Neural network ensembles," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 10, pp. 993-1001, 1990.
29. D. S. Lee and S. N. Srihari, "Handprinted digit recognition: Acomparison of algorithms," in Proc. 3rd Int. Workshop Frontiers Handwriting Recognit., Buffalo, NY, USA, 1993, pp. 153-162.
30. V. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer-Verlag, 1999.
31. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
32. B. E. Boser, I. M. Guyon, and V. N. Vapnik, "A training algorithm for optimal margin classifiers," in Proc. 5th Annu. Workshop Comput. Learn. Theory, ACM, 1992.
33. T. Zhang, "An introduction to support vector machines and other kernelbased learning methods," AI Mag., vol. 22, no. 2, p. 103, 2001.
34. C.-W. Hsu and C.-J. Lin, "A comparison of methods for multiclass support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 415-425, Mar. 2002. (Pubitemid 34475042)
35. C.-C. Chang and C.-J. Lin. (2001). LIBSVM: A Library for Support Vector Machines [Online].Available: http://www.csie.ntu.edu.tw/~nbspcjlin/libsvm.
36. C.-W. Hsu, C.-C. Chang, and C.-J. Lin. (2004). A Practical Guide to Support Vector Classification [Online]. Available: http://www.csie.ntu. edu.tw/~nbspcjlin/papers/guide/guide.pdf.
37. A. Jain and D. Zongker, "Feature selection: Evaluation, application, and small sample performance," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 2, pp. 153-158, Feb. 1997. (Pubitemid 127828334)
38. M. Kudo and J. Sklansky, "Comparison of algorithms that select features for pattern classifiers," Pattern Recognit., vol. 33, no. 1, pp. 25-41, Jan. 2000. (Pubitemid 32081876)
39. S. B. Serpico and L. Bruzzone, "A new search algorithm for feature selection in hyperspectral remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 7, pp. 1360-1367, Jul. 2001. (Pubitemid 32732652)
40. P. H. Swain and S. M. Davis, Remote Sensing. The Quantitative Approach. New York, NY, USA: McGraw-Hill, 1978.
41. L. Bruzzone and S. B. Serpico, "A technique for feature selection in multiclass problems," Int. J. Remote Sens., vol. 21, no. 3, pp. 549-563, 2000. (Pubitemid 30102558)
42. D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, MA, USA: Addison-Wesley, 1989.
43. B. C. K. Tso and P. M. Mather, "Classification of multisource remote sensing imagery using a genetic algorithm and Markov random fields," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 3, pp. 1255-1260, May 1999.
44. S. Bandyopadhyay and S. K. Pal, "Pixel classification using variable string genetic algorithms with chromosome differentiation," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 2, pp. 303-308, Feb. 2001 (Pubitemid 32270993)
45. J. Ham, Y. Chen, M. M. Crawford, and J. Ghosh, "Investigation of the random forest framework for classification of hyperspectral data," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 492-501, Mar. 2005. (Pubitemid 40320271)
46. C. Junfei, W. Qingfeng, and D. Huailin, "A random feature selection approach for neural network ensembles: Considering diversity," in Proc. IEEE Int. Conf. Comput. Intell. Software Eng. (CiSE), 2010, pp. 1-4.
47. S. Wang and X. Yao, "Relationships between diversity of classification ensembles and single-class performance measures," IEEE Trans. Knowl. Data Eng., vol. 25, no. 1, pp. 206-219, Jan. 2013.
48. X. Huang and L. Zhang, "An SVM ensemble approach combining spectral, structural, and semantic features for the classification of high-resolution remotely sensed imagery," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 1, pp. 1-16, Jan. 2013.
49. R. Y. M. Nakamura, L. M. G. Fonseca, J. A. dos Santos, R. da S Torres, X.-S. Yang, and J. P. Papa, "Nature-inspired framework for hyperspectral band selection," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 4, pp. 2126-2137, Apr. 2014.
50. P. R. Marpu, P. Gamba, and I. Niemeyer, "Hyperspectral data classification using an ensemble of class-dependent neural networks," in Proc. Hyperspectral Image Signal Process.: Evol. Remote Sens., Aug. 2009, pp. 1-4.
51. G. Brown and L. I. Kuncheva, "'Good' and 'bad' diversity in majority vote ensembles," Multiple Classifier Systems. Berlin, Germany: Springer, 2010, pp. 124-133.
52. R. Polikar, "Ensemble learning," in Ensemble Machine Learning. New York, NY, USA: Springer, 2012, pp. 1-34.
53. S. Site and S. K. Mishra. Model for measuring accuracies of majority voting of ensemble classifier withCOBand genetic algorithm. in Proc. Int. Conf. IEEE Inf. Commun. Embedded Syst. (ICICES),2013:99-103.
54. D. Ruta and B. Gabrys, "Classifier selection for majority voting," Inf. Fusion, vol. 6, no. 1, pp. 63-81, 2005.