Classification of hyperspectral data using an AdaBoostSVM technique applied on band clusters

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Volumn 7, Issue 6, 2014, Pages 2066-2079

  Ramzi, Pouria ^a   Samadzadegan, Farhad ^a   Reinartz, Peter ^b  

^a UNIVERSITY OF TEHRAN   (Iran)

^b GERMAN AEROSPACE CENTER DLR   (Germany)

Author keywords

Adaptive Boosting (AdaBoost); band clustering; hyperspectral data; multiple classifier systems (MCSs); support vector machines (SVMs)

Indexed keywords

SAMPLING; SPECTROSCOPY; SUPPORT VECTOR MACHINES;

ADABOOST CLASSIFICATIONS; BAND CLUSTERING; HYPERSPECTRAL DATA; HYPERSPECTRAL IMAGE DATAS; MULTIPLE CLASSIFIER SYSTEMS; STATISTICAL CLASSIFICATION METHODS; SUPERVISED CLASSIFICATION; SUPPORT VECTOR MACHINE (SVMS);

ADAPTIVE BOOSTING;

ALGORITHM; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; IMAGE CLASSIFICATION; IMAGERY; REMOTE SENSING;

EID: 84905820825     PISSN: 19391404     EISSN: 21511535     Source Type: Journal    
DOI: 10.1109/JSTARS.2013.2292901     Document Type: Article

References (46)

1. D. A. Landgrebe, Signal Theory Methods in Multispectral Remote Sensing, New York, NY, USA: Wiley, 2003, p. 528.
2. J. Richards, Remote Sensing Digital Image Analysis, 5th ed., Berlin, Germany: Springer-Verlag, 2013, p. 494.
3. G. F. Hughes, "On the mean accuracy of statistical pattern recognition," IEEE Trans. Inf. Theory, vol. 14, no. 1, pp. 55-63, Jan. 1968.
4. K. Bernard, Y. Tarabalka, J. Angulo, J. Chanussot, and J. A. Benediktsson, "Spectral-spatial classification of hyperspectral data based on a stochastic minimum spanning forest approach," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2008-2021, Apr. 2012.
5. J. Li, J. M. Bioucas-Dias, and A. Plaza, "Spectral-spatial classification of hyperspectral data using loopy belief propagation and active learning," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 2, pp. 844-856, Feb. 2013.
6. A. B. Santos, A. de Albuquerque Araújo, and D. Menotti, "Combining multiple classification methods for hyperspectral data interpretation," IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens., vol. 6, no. 3, pp. 1450-1459, Jun. 2013.
7. A. Villa, J.A. Benediktsson, J. Chanussot,and C. Jutten, "Hyperspectral image classification with independent component discriminant analysis," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 12, pp. 4865-4876, Dec. 2011.
8. S. Li, H. Wu, D. Wan, and J. Zhu, "An effective feature selection method for hyperspectral image classification based on genetic algorithm and support vector machine," Knowledge-Based Syst., vol. 24, no. 1, pp. 40-48, Feb. 2011.
9. S. Nakariyakul and D. P. Casasent, "Adaptive branch and bound algorithm for selecting optimal features," Pattern Recogn. Lett., vol. 28, no. 12, pp. 1415-1427, Sep. 2007. (Pubitemid 46990579)
10. A. Martínez-Usó, F. Pla, J. Martínez Sotoca, and P. García-Sevilla, "Clustering-based hyperspectral band selection using information measures," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 12, pp. 4158-4171, Dec. 2007. (Pubitemid 350157848)
11. Y. Zhao, L. Zhang, and S. G. Kong, "Band subset based clustering and fusion for hyperspectral imagery classification," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 2, pp. 747-756, Feb. 2011.
12. L. I. Kuncheva and C. J. Whitaker, "Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy," Mach. Learn., vol. 51, no. 2, pp. 181-207, May 2003.
13. S. Prasad and L. M. Bruce, "Hyperspectral feature space partitioning via mutual information for data fusion," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS 2007), Barcelona, Spain, Jul. 2007, pp. 4846-4849.
14. S. Prasad and L. M. Bruce, "Decision fusion with confidence-based weight assignment for hyperspectral target recognition," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1448-1456, May 2008.
15. S. Venkataraman, L. M. Bruce, A. Cheriyadat, and A. Mathur, "Hyperspectral dimensionality reduction via localized discriminant bases," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), 2005, Jul. 2005, pp. 1245-1248.
16. J. Xia, P. Du, X. He, and J. Chanussot, "Hyperspectral remote sensing image classification based on rotation forest," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 1, pp. 239-243, Jan. 2014.
17. P. Gurram and H. Kwon, "Sparse kernel-based ensemble learning with fully optimized kernel parameters for hyperspectral classification problems," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 2, pp. 787-801, Feb. 2013.
18. S. Samiappan, S. Prasad, and L. M. Bruce, "Non-uniform random feature selection and kernel density scoring with SVM based ensemble classification for hyperspectral image analysis," IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens., vol. 6, no. 2, pp. 792-800, Apr. 2013.
19. B. C. Kuo, C. H. Chuang, C. H. Li, and C. T. Lin, "Subspace selection based multiple classifier systems for hyperspectral image classification," in Proc. 1st Workshop Hyperspectral Image Signal Process.: Evol. Remote Sens. (WHISPERS '09), Grenoble, France, Aug. 2009, pp. 1-4.
20. B. Bigdeli, F. Samadzadegan, and P. Reinartz, "Band grouping versus band clustering in SVM ensemble classification of hyperspectral imagery," Photogramm. Eng. Remote Sens., vol. 79, no. 6, pp. 523-534, Jun. 2013.
21. X. R. Ceamanos, B. Waske, J. A. Benediktsson, J. Chanussot, M. Fauvel, and J. R. Sveinsson, "A classifier ensemble based on fusion of support vector machines for classifying hyperspectral data," Int. J. Image Data Fusion, vol. 1, no. 4, pp. 293-307, Dec. 2010.
22. X. Li, L. Wang, and E. Sung, "AdaBoost with SVM-based component classifiers," Eng. Appl. Artif. Intell., vol. 21, no. 5, pp. 785-795, Aug. 2008.
23. Z. Ye, S. Prasad, W. Li, J. E. Fowler, and M. He, "Classification based on 3-D DWT and decision fusion for hyperspectral image analysis," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 1, pp. 173-177, Jan. 2014.
24. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, no. 1, pp. 119-139, Aug. 1997. (Pubitemid 127433398)
25. J. A. Benediktsson and I. Kanellopoulos, "Classification of multisource and hyperspectral data based on decision fusion," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 3, pp. 1367-1377, May 1999.
26. G. J. Briem, J. A. Benediktsson, and J. R. Sveinsson, "Multiple classifiers applied to multisource remote sensing data," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 10, pp. 2291-2299, Oct. 2002.
27. J. C. W. Chan and D. Paelinckx, "Evaluation of random forest and Adaboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery," Remote Sens. Environ., vol. 112, no. 6, pp. 2999-3011, Jun. 2008.
28. L. Breiman, "Bagging predictors," Mach. Learn., vol. 26, no. 2, pp. 123-140, Aug. 1996. (Pubitemid 126724382)
29. D. Opitz and R. Maclin, "Popular ensemble methods: An empirical study," J. Artif. Intell. Res., vol. 11, pp. 169-198, Aug. 1999. (Pubitemid 129628763)
30. G. Camps-Valls and L. Bruzzone, "Kernel-based methods for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 6, pp. 1351-1362, Jun. 2005. (Pubitemid 40811944)
31. R. E. Schapire and Y. Singer, "Improved boosting algorithms using confidence-rated predictions," in Proc. 11th Annu. Conf. Comput. Learn. Theory. To Appear in Mach. Learn. (COLT'98), New York, NY, USA, 1998, pp. 80-91.
32. V. N. Vapnik and V. Vapnik, Statistical Learning Theory, New York, NY, USA: Wiley, 1998.
33. F. Samadzadegan, H. Hasani, and T. Schenk, "Determination of optimum classifier and feature subset in hyperspectral images based on ant colony system," Photogramm. Eng. Remote Sens., vol. 78, no. 12, pp. 1261-1273, Dec. 2012.
34. P. Watanachaturaporn and M. K. Arora, "Support vector machines for classification of multi-and hyperspectral data," in Advanced Image Processing Techniques for Remotely Sensed Hyperspectral Data, P. K. Varshney and M. K. Arora, Eds., 3rd ed., Berlin, Germany: Springer, 2004, pp. 237-255.
35. B. Scholkopf and A. J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, Cambridge, MA, USA: MIT Press, 2002, p. 626.
36. Y. Tarabalka,M. Fauvel, J. Chanussot, and J. A. Benediktsson, "SVM-and MRF-based method for accurate classification of hyperspectral images," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 4, pp. 736-740, Oct. 2010.
37. F. Melgani and L. Bruzzone, "Classification of hyperspectral remote sensing images with support vector machines," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 8, pp. 1778-1790, Aug. 2004.
38. J. Wickramaratna, S. B. Holden, and B. F. Buxton, "Performance degradation in boosting," in Multiple Classifier Syst.: 2nd Int. Workshop (MCS 2001), Cambridge, U.K., 2001, pp. 11-21. (Pubitemid 33303209)
39. G. Valentini and T. G. Dietterich, "Bias-variance analysis of support vector machines for the development of SVM-based ensemble methods," J. Mach. Learn. Res., vol. 5, pp. 725-775, Dec. 2004.
40. P. Melville and R. J. Mooney, "Creating diversity in ensembles using artificial data," Inform. Fusion, vol. 6, no. 1, pp. 99-111, 2005.
41. T. K. An and M. H. Kim, "A new diverse AdaBoost classifier," in Proc. Int. Conf. Artif. Intell. Comput. Intell. (AICI), Sanya, China, Oct. 2010, pp. 359-363.
42. C. C. Chen and C. J. Lin, "LIBSVM:Alibrary for support vector machines," ACM Trans. Intell. Syst. Technol. (TIST), vol. 2, no. 27, 2011.
43. R. G. Congalton, R. G. Oderwald, and R. A. Mead, "Assessing Landsat classification accuracy using discrete multivariate analysis statistical techniques," Photogramm. Eng. Remote Sens., vol. 49, no. 12, pp. 1671-1678, Jan. 1983.
44. G. M. Foody, "Classification accuracy comparison: Hypothesis tests and the use of confidence intervals in evaluations of difference, equivalence and non-inferiority," Remote Sens. Environ., vol. 113, no. 8, pp. 1658-1663, 2009.
45. G. M. Foody, "Harshness in image classification accuracy assessment," Int. J. Remote Sens., vol. 29, no. 11, pp. 3137-3158, Jun. 2008.
46. C. D. Manning, P. Raghavan, and H. Schütze, Introduction to Information Retrieval, Cambridge, U.K.: Cambridge Univ. Press, 2008 [Online]. Available: http://nlp.stanford.edu/IR-book/.