Toward an optimal SVM classification system for hyperspectral remote sensing images

IEEE Transactions on Geoscience and Remote Sensing

Volumn 44, Issue 11, 2006, Pages 3374-3385

  Bazi, Yakoub ^a,b   Melgani, Farid ^a,b  

^a IEEE   (Italy)

^b UNIVERSITY OF TRENTO   (Italy)

Author keywords

Feature detection; Feature selection; Generalization bounds; Genetic algorithms (GAs); Hyperspectral image classification; Sparseness; Support vector machines (SVMs)

Indexed keywords

FEATURE DETECTION; FEATURE SELECTION; GENERALIZATION BOUNDS; HYPERSPECTRAL IMAGE CLASSIFICATION; SUPPORT VECTOR MACHINES (SVM);

CLASSIFICATION (OF INFORMATION); GENETIC ALGORITHMS; IMAGING SYSTEMS; PARAMETER ESTIMATION; REMOTE SENSING; STATISTICAL METHODS;

LEARNING SYSTEMS;

EID: 33750798496     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2006.880628     Document Type: Article

References (47)

1. G. F. Hughes, "On the mean accuracy of statistical pattern recognizers," IEEE Trans. Inf. Theory, vol. IT-14, no. 1, pp. 55-63, Jan. 1968.
2. J. P. Hoffbeck and D. A. Landgrebe, "Covariance matrix estimation and classification with limited training data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 7, pp. 763-767, Jul. 1996.
3. S. Tadjudin and D. A. Landgrebe, "Covariance estimation with limited training samples," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 4, pp. 2113-2118, Jul. 1999.
4. B. M. Shahshahani and D. A. Landgrebe, "The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenomenon," IEEE Trans. Geosci. Remote Sens., vol. 32, no. 5, pp. 1087-1095, Sep. 1994.
5. Q. Jackson and D. A. Landgrebe, "An adaptive classifier design for high-dimensional data analysis with a limited training data set," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 12, pp. 2664-2679, Dec. 2001.
6. C. Lee and D. A. Landgrebe, "Feature extraction based on decision boundaries," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 4, pp. 388-400, Apr. 1993.
7. L. O. Jimenez and D. A. Landgrebe, "Hyperspectral data analysis and feature reduction via projection pursuit," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 6, pp. 2653-2667, Nov. 1999.
8. S. B. Serpico and L. Bruzzone, "A new search algorithm for feature selection in hyperspectral remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 7, pp. 1360-1367, Jul. 2001.
9. J. P. Hoffbeck and D. A. Landgrebe, "Classification of remote sensing images having high-spectral resolution," Remote Sens. Environ., vol. 57, no. 3, pp. 119-126, Sep. 1996.
10. F. Tsai and W. D. Philpot, "A derivative-aided hyperspectral image analysis system for land-cover classification," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 2, pp. 416-425, Feb. 2002.
11. J. A. Gualtieri and S. Chettri, "Support vector machines for classification of hyperspectral data," in Proc. IGARSS, 2000, pp. 813-815.
12. C. Huang, L. S. Davis, and J. R. G. Townshend, "An assessment of support vector machines for land cover classification," Int. J. Remote Sens., vol. 23, no. 4, pp. 725-749, Feb. 2002.
13. F. Melgani and L. Bruzzone, "Classification of hyperspectral remote sensing images with support vector machine," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 8, pp. 1778-1790, Aug. 2004.
14. G. Camps-Vails, L. Gómez-Chova, J. Calpe, E. Soria, J. D. Martín, L. Alonso, and J. Moreno, "Robust support vector method for hyperspectral data classification and knowledge discovery," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 7, pp. 1530-1542, Jul. 2004.
15. G. M. Foody and A. Mathur, "A relative evaluation of multiclass image classification by support vector machines," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 6, pp. 1335-1343, Jun. 2004.
16. G. Camps-Vails, L. Gomez-Chova, J. Muñoz-Marí, J. Vila-Francés, and J. Calpe-Maravilla, "Composite kernels for hyperspectral image classification," IEEE Geosci. Remote Sens. Lett., vol. 3, no. 1, pp. 93-97, Jan. 2006.
17. M. Pal and P. M. Mather, "Support vector machines for classification in remote sensing," Int. J. Remote Sens., vol. 26, no. 5, pp. 1007-1011, Mar. 2005.
18. M. Pontil and A. Verri, "Support vector machines for 3-D object recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 6, pp. 637-646, Jun. 1998.
19. I. El-Naqa, Y. Yongyi, M. N. Wernick, N. P. Galatsanos, and R. M. Nishikawa, "A suppoit vector machine approach for detection of microcalcifications," IEEE Trans. Med. Imag., vol. 21, no. 12, pp. 1552-1563, Dec. 2002.
20. J. Robinson and V. Kecman, "Combining support vector machine learning with the discrete cosine transform in image compression," IEEE Trans. Neural Netw., vol. 14, no. 4, pp. 950-958, Jul. 2003.
21. S. Peng, Q. Xu, X. B. Ling, X. Peng, W. Du, and L. Chen, "Molecular classification of cancer types from microarray data using the combination of genetic algorithms and support vector machines," FEBS Lett., vol. 555, pp. 358-362, 2003.
22. M. Schröder, M. Bogdan, W. Rosenstiel, T. Hinterberger, and N. Birbaumer, "Automated EEG feature selection for brain computer interfaces," in Proc. 1st Int. IEEE EMBS Conf. Neural Eng., 2003, pp. 626-629.
23. H. Frohlich, O. Chapelle, and B. Scholkopf, "Feature selection for support vector machines by means of genetic algorithm," in Proc. 15th IEEE Int. Conf. Tools with Artif. Intell., 2003, pp. 142-148.
24. R. Kumar, A. Kulkarni, V. K. Jayaraman, and B. D. Kulkarni, "Symbolization assisted SVM classifier for noisy data," Pattern Recognit. Lett., vol. 25, no. 4, pp. 495-504, Mar. 2004.
25. K. Lee and H. Byun, "A new face authentication system for memory-constrained devices," IEEE Trans. Consum. Electron., vol. 49, no. 4, pp. 1214-1222, Nov. 2003.
26. D. S. Kim, H.-N. Nguyen, and J. S. Park, "Genetic algorithm to improve SVM based network intrusion detection system," in Proc. 19th Int. Conf. Advanced Inf. Netw. and Appl., 2005, vol. 2, pp. 155-158.
27. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik, "Gene selection for cancer classification using support vector machines," Mach. Learn., vol. 46, no. 1-3, pp. 389-422, 2002.
28. J. Weston, S. Mukherjee, O. Chapelle, M. Pontil, T. Poggio, and V. Vapnik, "Feature selection for SVMs," in Advances in Neural Information Processing Systems, vol. 13, T. K. Leen, T. G. Dietterich, and V. Tresp, Eds. Cambridge, MA: MIT Press, 2001, pp. 668-674.
29. C. W. Hsu and C. J. Lin, "A comparison of methods for multiclass support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 415-425, Mar. 2002.
30. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection," J. Mach. Learn. Res., vol. 3, no. 7-8, pp. 1157-1182, 2003.
31. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
32. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee, "Choosing multiple parameters for support vector machines," Mach. Learn., vol. 46, no. 1-3, pp. 131-159, 2002.
33. D.E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning. Reading, MA: Addison-Wesley, 1989.
34. L. Davis, Handbook of Genetic Algorithms. New York: Van Nostrand Reinhold, 1991.
35. B. C. K. Tso and P. M. Mather, "Classification of multisource remote sensing imagery using a genetic algorithm and Markov random fields," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 3, pp. 1255-1260, May 1999.
36. J. A. Benediktsson and J. R. Sveinsson, "Multisource remote sensing data classification based on consensus and pruning," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 4, pp. 932-936, Apr. 2003.
37. B.-K. Jeon, J.-H. Jang, and K.-S. Hong, "Road detection in spaceborne SAR images using a genetic algorithm," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 1, pp. 22-29, Jan. 2002.
38. H. Yao and L. Tian, "A genetic-algorithm-based selective principal component analysis (GA-SPCA) method for high-dimensional data feature extraction," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 6, pp. 1469-1478, Jun. 2003.
39. Y.-C. Lin and K. Sarabandi, "Retrieval of forest parameters using a fractal-based coherent scattering model and a genetic algorithm," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 3, pp. 1415-1424, May 1999.
40. H. Zhan, Z. Lee, P. Shi, C. Chen, and K. L. Carder, "Retrieval of water optical properties for optically deep waters using genetic algorithms," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 5, pp. 1123-1128, May 2003.
41. Y. Bazi, L. Bruzzone, and F. Melgani, "Change detection in multitemporal SAR images based on generalized Gaussian distribution and EM algorithm," in Proc. SPIE Conf. Image and Signal Processing for Remote Sensing X, 2004, vol. 5573, pp. 364-375.
42. G. M. Foody and A. Mathur, "Toward intelligent training of supervised image classifications: Directing training data acquisition for SVM classification," Remote Sens. Environ., vol. 93, no. 1/2, pp. 107-117, Oct. 2004.
43. AVIRIS NW Indiana's Indian Pines 1992 Data Set. [Online]. Available: ftp://ftp.ecn.purdue.edu/biehl/MultiSpec/92AV3C.lan (original files); ftp://ftp.ecn.purdue.edu/biehl/PC_MultiSpec/ThyFiles.zip (ground truth)
44. A. Agresti, Categorical Data Analysis, 2nd ed. New York: Wiley, 2002.
45. G. M. Foody, "Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy," Photogramm. Eng. Remote Sens., vol. 70, no. 5, pp. 627-633, May 2004.
46. M. Stone, "Cross-validatory choice and assessment of statistical predictions," J. R. Statist. Soc. B, vol. 36, no. 1, pp. 111-147, 1974.
47. C. C. Chang and C. J. Lin, LIBSVM-A Library for Support Vector Machines. [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm