SVM-based fuzzy decision trees for classification of high spatial resolution remote sensing images

IEEE Transactions on Geoscience and Remote Sensing

Volumn 50, Issue 1, 2012, Pages 149-169

  Moustakidis, Serafeim ^a   Mallinis, Giorgos ^a   Koutsias, Nikos ^b   Theocharis, John B ^a   Petridis, Vasilios ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^b UNIVERSITY OF IOANNINA   (Greece)

Author keywords

Classification; decision trees (DTs); feature selection (FS); fuzzy confusion (FC) metric; fuzzy partition vector (FPV); high spatial resolution images; support vector machines (SVMs)

Indexed keywords

FEATURE SELECTION (FS); FUZZY CONFUSION (FC) METRIC; FUZZY PARTITION; HIGH SPATIAL RESOLUTION IMAGES; SUPPORT VECTOR;

BINARY TREES; CLASSIFICATION (OF INFORMATION); DECISION TREES; FEATURE EXTRACTION; FORESTRY; IMAGE RECONSTRUCTION; IMAGE RESOLUTION; IMAGE SEGMENTATION; REMOTE SENSING;

SUPPORT VECTOR MACHINES;

ACCURACY ASSESSMENT; ALGORITHM; COMPUTER SIMULATION; DISCRIMINANT ANALYSIS; EXPERIMENTAL STUDY; FOREST ECOSYSTEM; FUZZY MATHEMATICS; IMAGE CLASSIFICATION; NUMERICAL MODEL; QUICKBIRD; REMOTE SENSING; SEGMENTATION; SPATIAL RESOLUTION;

ALGORITHMS; CLASSIFICATION; DECISION MAKING; FUZZY LOGIC; IMAGE ANALYSIS; REMOTE SENSING;

EID: 84855470680     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2011.2159726     Document Type: Article

References (58)

1. M. Kim, M. Madden, and T. A. Warner, "Forest type mapping using object-specific texture measures from multispectral IKONOS imagery: Segmentation quality and image classification issues," Photogramm. Eng. Remote Sens., vol. 75, no. 7, pp. 819-829, Jul. 2009.
2. Y. O. Ouma, J. Tetuko, and R. Tateishi, "Analysis of co-occurrence and discrete wavelet transform textures for differentiation of forest and nonforest vegetation in very-high-resolution optical-sensor imagery," Int. J. Remote Sens., vol. 29, no. 12, pp. 3417-3456, Jun. 2008. (Pubitemid 351917174)
3. M. Simard, S. S. Saatchi, and G. De Grandi, "The use of decision tree and multiscale texture for classification of JERS-1 SAR data over tropical forest," IEEE Trans. Geosci. Remote Sens., vol. 38, no. 5, pp. 2310-2321, Sep. 2000.
4. M. Pesaresiand and J. A. Benediktsonn, "A new approach for the morphological segmentation of high-resolution satellite imagery," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 2, pp. 309-320, Feb. 2001.
5. J. A. Benedktsonn, J. A. Palmason, and J. R. Sveinsson, "Classification of hyperspectral data from urban areas based on extended morphological profiles," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 480-491, Mar. 2005. (Pubitemid 40320270)
6. M. Dalla Mura, A. Villa, J. A. Benediktsson, J. Chanussot, and L. Bruzzone, "Classification of hyperspectral images by using extended morphological attribute profiles and independent component analysis," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 3, pp. 542-546, May 2011.
7. M. Dalla Mura, J. Atli Benediktsson, B. Waske, and L. Bruzzone, "Morphological attribute profiles for the analysis of very high resolution images," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 10, pp. 3747-3762, Oct. 2010.
8. X. Huang, L. Zhang, and P. Li, "Classification and extraction of spatial features in urban areas using high-resolution multispectral imagery," IEEE Geosci. Remote Sens. Lett., vol. 4, no. 2, pp. 260-264, Apr. 2007. (Pubitemid 46645144)
9. L. Zhang, X. Huang, B. Huang, and P. Li, "A pixel shape index coupled with spectral information for classification of high spatial resolution remotely sensed images," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 10, pp. 2950-2961, Oct. 2006.
10. X. Huang and L. Zhang, "A comparative study of spatial approaches for urban mapping using hyperspectral ROSIS images over Pavia City, northern Italy," Int. J. Remote Sens., vol. 30, no. 12, pp. 3205-3221, Jan. 2009.
11. G. Camps-Vallls, T. V. B. Marsheva, and D. Zhou, "Semi-supervised Graph-based hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp. 3044-3054, Oct. 2007.
12. X. Huang and L. Zhang, "An adaptive mean-shift analysis approach for object extraction and classification from urban hyperspectral imagery," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 12, pp. 4173-4185, Dec. 2008.
13. Y. Tarabalka, J. A. Benedktsson, and J. Chanussot, "Spectral-spatial classification of hyperspectral imagery based on partitional clustering techniques," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 8, pp. 2973-2987, Aug. 2009.
14. X. Huang and L. Zhang, "Comparison of vector stacking, multi-SVMs fuzzy output, and multi-SVMs voting methods for multiscale VHR urban mapping," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 2, pp. 261-265, Apr. 2010.
15. G. M. Foodya and M. K. Arora, "Incorporating mixed pixels in the training, allocation and testing stages of supervised classifications," Pattern Recognit. Lett., vol. 17, no. 13, pp. 1389-1398, Nov. 1996.
16. L. Bastin, "Comparison of fuzzy c-means classification, linear mixture modelling and MLC probabilities as tools for unmixing coarse pixels," Int. J. Remote Sens., vol. 18, no. 17, pp. 3629-3648, Nov. 1997.
17. N. E. Mitrakis, C. A. Topaloglou, T. K. Alexandridis, J. B. Theocharis, and G. C. Zalidis, "A novel self-organizing neuro-fuzzy multilayered classifier for land cover classification of a VHR image," Int. J. Remote Sens., vol. 29, no. 14, pp. 4061-4087, Jul. 2008. (Pubitemid 351917140)
18. N. E. Mitrakis, C. A. Topaloglou, T. K. Alexandridis, J. B. Theocharis, and G. C. Zalidis, "Decision fusion of GA self-organizing neuro-fuzzy multilayered classifiers for land cover classification using textural and spectral features," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 7, pp. 2137-2152, Jul. 2008.
19. G. M. Foody, "Estimation of sub-pixel land cover composition in the presence of untrained classes," Comput. Geosci., vol. 26, no. 4, pp. 469-478, May 2000. (Pubitemid 30228971)
20. P. M. Kumar, R. Sugumaran, and D. Zerr, "A rule-based classifier using Classification and Regression Tree (CART) approach for urban landscape dynamics," in Proc. IEEE Int. Symp. Geosci. Remote Sens., 2002, vol. 2, pp. 1193-1194. (Pubitemid 35229061)
21. C. Huang, L. S. Davis, and J. R. G. Townshend, "An assessment of support vector machines for land cover classification," Int. J. Remote Sens., vol. 23, no. 4, pp. 725-749, 2002. (Pubitemid 34119904)
22. G. Camps-Valls and L. Bruzzone, "Kernel-based methods for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 6, pp. 1351-1362, Jun. 2005. (Pubitemid 40811944)
23. V. N. Vapnik, Statistical Learning Theory. New York: Wiley-Interscience, 1998.
24. U. H.-G. Krebel, "Pairwise classification and support vector machines," in Advances in Kernel Methods: Support Vector Learning. Cambridge, MA: MIT Press, 1999, pp. 255-268.
25. C.W. Hsu and C. J. Lin, "A comparison of methods for multiclass support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 415-425, Mar. 2002.
26. T. G. Dietterich and G. Bakiri, "Solving multiclass learning problems via error-correcting output codes," J. Artif. Int. Res., vol. 2, no. 1, pp. 263-286, Aug. 1994.
27. Z. Lu, F. Lin, and H. Ying, "Design of decision tree via kernelized hierarchical clustering for multiclass support vector machines," Cybern. Syst., vol. 38, no. 2, pp. 187-202, Feb. 2007. (Pubitemid 46346883)
28. V. Vural and J. G. Dy, "A hierarchical method for multi-class support vector machines," in Proc. 21st Int. Conf. Mach. Learn. Banff, Alberta, Canada, 2004, p. 105.
29. B. Fei and L. Jinbai, "Binary tree of SVM: A new fast multiclass training and classification algorithm," IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 696-704, May 2006.
30. F. Schwenker and G. Palm, "Tree-structured support vector machines for multi-class pattern recognition," in Proc. 2nd Int. Workshop Multiple Classifier Syst., 2001, pp. 409-417. (Pubitemid 33303248)
31. C. Yangchi, M. M. Crawford, and J. Ghosh, "Integrating support vector machines in a hierarchical output space decomposition framework," in Proc. IEEE IGARSS, 2004, vol. 2, pp. 949-952. (Pubitemid 40438278)
32. F. Melgani and L. Bruzzone, Classification of Hyperspectral Remote Sensing Images With Support Vector Machines, ETATS-UNIS Institute of Electrical and Electronics Engineers, New York, vol. 42, 2004.
33. A. K. Shackelford and C. H. Davis, "A hierarchical fuzzy classification approach for high-resolution multispectral data over urban areas," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 9, pp. 1920-1932, Sep. 2003.
34. B. Waske, S. van der Linden, J. A. Benediktsson, A. Rabe, and P. Hostert, "Sensitivity of support vector machines to random feature selection in classification of hyperspectral data," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 7, pp. 2880-2889, Jul. 2010.
35. M. Pal and G. M. Foody, "Feature selection for classification of hyperspectral data by SVM," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 5, pp. 2297-2307, May 2010.
36. G. Mallinis, N. Koutsias, M. Tsakiri-Strati, and M. Karteris, "Objectbased classification using QuickBird imagery for delineating forest vegetation polygons in a Mediterranean test site," ISPRS J. Photogramm. Remote Sens., vol. 63, no. 2, pp. 237-250, Mar. 2008. (Pubitemid 351312872)
37. R. G. Congalton and K. Green, Assessing the Accuracy of Remotely Sensed Data: Principles and Practice. Boca Raton, FL: Lewis Publishers, 1999.
38. F. Dell' Acqua, P. Gamba, A. Ferari, A. Palmason, J. A. Benediktson, and K. Arnason, "Exploiting spectral and spatial information in hyperspectral urban data with high resolution," IEEE Geosci. Remote Sens. Lett., vol. 1, no. 4, pp. 322-326, Oct. 2004.
39. R. M. Haralick and L. G. Shapiro, Computer and Robot Vision. Reading, MA: Addison-Wesley, 1992.
40. L. Anselin, "Local indicators of spatial association-LISA," Geograph. Anal., vol. 27, no. 2, pp. 93-115, 1995.
41. S. G. Mallat, "A theory for multiresolution signal decomposition: The wavelet representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 7, pp. 674-693, Jul. 1989.
42. C.-T. Lin, Y.-C. Lee, and H.-C. Pu, "Satellite sensor image classification using cascaded architecture of neural fuzzy network," IEEE Trans. Geosci. Remote Sens., vol. 38, no. 2, pp. 1033-1043, Mar. 2000. (Pubitemid 30594775)
43. L. P. A. Ella, F. van den Bergh, B. J. van Wyk, and M. A. van Wyk, "A comparison of texture features algorithms for urban settlement classification," in Proc. IEEE Int. Geosci. Remote Sens. Symp., 2008, vol. III, pp. III-1308-III-1311.
44. X. Huang, L. Zhang, and P. Li, "An adaptive multiscale information fusion approach for feature extraction and classification of IKONOS multispectral imagery over urban areas," IEEE Geosci. Remote Sens. Lett., vol. 4, no. 4, pp. 654-658, Oct. 2007. (Pubitemid 47588049)
45. A. Puissant, J. Hirsch, and C. Weber, "The quality of texture analysis to improve per-pixel classification for high to very high spatial resolution imagery," Int. J. Remote Sens., vol. 26, no. 4, pp. 733-745, Feb. 2005. (Pubitemid 40210551)
46. E. Binaghi, I. Gallo, and M. Pepe, "A cognitive pyramid for contextual classification of remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 12, pp. 2906-2922, Dec. 2003.
47. D. Dubois and H. J. A. Prade, Fuzzy Sets and Systems: Theory and Applications/Didier Dubois, Henri Prade. New York: Academic, 1980.
48. C. Woodcock and V. J. Harward, "Nested-hierarchical scene models and image segmentation," Int. J. Remote Sens., vol. 13, no. 16, pp. 3167-3187, Nov. 1992.
49. J. Wu and O. L. Loucks, "From balance of nature to hierarchical patch dynamics: A paradigm shift in ecology," Quart. Rev. Biol., vol. 70, no. 4, pp. 439-466, Dec. 1995.
50. D. A. Landgrebe, Signal Theory Methods in Multispectral Remote Sensing. Hoboken, NJ: Wiley, 2003.
51. J. Platt, "Probabilistic outputs for support vector machines and comparison to regularized likelihood methods," in Advances in Large Margin Classifiers, A. J. Smola, P. Bartlett, B. Schoelkopf, and D. Schurmans, Eds. Cambridge, MA: MIT Press, 2000, pp. 61-74.
52. B. Zadrozny and C. Elkan, "Obtaining calibrated probability estimates from decision trees and naïve Bayesian classifiers," in Proc. 18th ICML, 2001, pp. 609-616.
53. B. Zadrozny and C. Elkan, "Transforming classifier scores into accurate multiclass probability estimates," in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2002, pp. 694-699.
54. T.-F.Wu, C.-J. Lin, and R. C.Weng, "Probability estimates for multi-class classification by pairwise coupling," J. Mach. Learn. Res., vol. 5, pp. 975-1005, Dec. 2004.
55. I. Guyon, J. Weston, S. Barnhill, and V. N. Vapnik, "Gene selection for cancer classification using support vector machines," Mach. Learn., vol. 46, no. 1-3, pp. 389-422, 2002. (Pubitemid 34129977)
56. M. Pal, "Support vector machine-based feature selection for land cover classification: A case study with DAIS hyperspectral data," Int. J. Remote Sens., vol. 27, no. 14, pp. 2877-2894, 2006. (Pubitemid 44219161)
57. H. Peng, F. Long, and C. Ding, "Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1226-1238, Aug. 2005. (Pubitemid 41245053)
58. L. Breiman, "Random forests," Mach. Learn., vol. 45, no. 1, pp. 5-32, 2001. (Pubitemid 32933532)