Non-uniform random feature selection and kernel density scoring with SVM based ensemble classification for hyperspectral image analysis

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Volumn 6, Issue 2, 2013, Pages 792-800

  Samiappan, Sathishkumar ^a   Prasad, Saurabh ^b   Bruce, Lori M ^a  

^a MISSISSIPPI STATE UNIVERSITY   (United States)

^b UNIVERSITY OF HOUSTON   (United States)

Author keywords

Ground cover classification; hyperspectral imagery (HSI); multi classifier systems (MCSs); random feature selection (RFS); support vector machines (SVMs)

Indexed keywords

GROUND COVERS; HYPERSPECTRAL IMAGERY; MULTICLASSIFIER SYSTEM; RANDOM FEATURES; SUPPORT VECTOR MACHINE (SVMS);

CLASSIFICATION (OF INFORMATION); REMOTE SENSING; SAMPLING; SPECTROSCOPY;

SUPPORT VECTOR MACHINES;

ACCURACY ASSESSMENT; ALGORITHM; IMAGE ANALYSIS; IMAGE CLASSIFICATION; IMAGERY; SENSITIVITY ANALYSIS; SPECTRAL ANALYSIS;

EID: 84877927185     PISSN: 19391404     EISSN: 21511535     Source Type: Journal    
DOI: 10.1109/JSTARS.2013.2237757     Document Type: Article

References (38)

1. S. G. Beaven,D. Stein, and L. E. Hoff, "Comparison of Gaussian mixture and linear mixture models for classification of hyperspectral data," in Proc. IEEE IGARSS, 2000, vol. 4, pp. 1597-1599.
2. B. Demir and S. Erturk, "Increasing hyperspectral image classification accuracy for data sets with limited training samples by sample interpolation," in Proc. 4th Int. Conf. Recent Advances in Space Technologies, 2009, 2009, pp. 367-369.
3. Q. Jackson and D. A. Landgrebe, "An adaptive classifier design for high-dimensional data analysis with a limited training data set," IEEE Trans. Geosci. Remote Sens. , vol. 39, pp. 2664-2679, Dec. 2001. (Pubitemid 34091845)
4. F. Melgani and L. Bruzzone, "Classification of hyperspectral remote sensing images with support vector machines," IEEE Trans. Geosci. Remote Sens. , vol. 42, pp. 1778-1790, Aug. 2004.
5. J. A. Benediktsson,C. Garcia, B. Waske, J. Chanussot, J. R. Sveinsson, and M. Fauvel, "Ensemble methods for classification of hyperspectral data," in Proc. IEEE IGARSS 2008, pp. I-62-I-65.
6. S. Prasad and L. M. Bruce, "A robust multi-classifier decision fusion framework for hyperspectral, multi-temporal classification," in Proc. IEEE IGARSS 2008, pp. II-273-II-276.
7. S. Prasad and L. M. Bruce, A Divide-and-Conquer Paradigm for Hyperspectral Classification and Target Recognition Optical Remote Sensing. Berlin Heidelberg: Springer, 2011, vol. 3, pp. 99-122.
8. C. Mingmin, K. Qian, J. A. Benediktsson, and R. Feng, "Ensemble classification algorithm for hyperspectral remote sensing data," IEEE Geosci. Remote Sens. Lett. , vol. 6, pp. 762-766, Oct. 2009.
9. M. S. Haghighi, A. Vahedian, and H. S. Yazdi, "Creating and measuring diversity in multiple classifier systems using support vector data description," Elsevier Applied Soft Computing, vol. 11, pp. 4941-4942, Dec. 2011.
10. R. Ranawana, "Intelligent multi-classifier design methods for the classification of imbalanced data sets-Application to DNA sequence analysis," Ph. D. dissertation, Univ. of Oxford, Oxford, U. K. , 2007.
11. G. Brown, J. Waytt, R. Harris, and X. Yao, "Diversity creationmethods: A survey and categorisation," J. Information Fusion, vol. 6, 2005.
12. B. Waske, S. van der Linden, J. A. Benediksson, A. Rabe, and P. Hostert, "Sensitivity of support vector machines to random feature selection in classification of hyperspectral data," IEEE Trans. Geosci. Remote Sens. , vol. 48, pp. 2880-2889, Jul. 2010.
13. Y. Jinn-Min, K. Bor-Chen, Y. Pao-Ta, and C. Chun-Hsiang, "A dynamic subspace method for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens. , vol. 48, pp. 2840-2853, Jul. 2010.
14. J. Ham, C. Yangchi, M. M. Crawford, and J. Ghosh, "Investigation of the random forest framework for classification of hyperspectral data," IEEE Trans. Geosci. Remote Sens. , vol. 43, pp. 492-501, Mar. 2005. (Pubitemid 40320271)
15. L. Breiman, "Bagging predictors," Machine Learning, vol. 24, pp. 123-140, Aug. 1996. (Pubitemid 126724382)
16. R. Bryll, R. G. Osuna, and F. Quek, "Attribute bagging: Improving accuracy of classifier ensembles by using random feature subsets," Pattern Recogn. , vol. 36, pp. 1291-1302, 2003. (Pubitemid 36225868)
17. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," in Proc. 13th Int. Conf. Machine Learning, Bari, Italy, 1996.
18. S. Samiappan, S. Prasad, and L. M. Bruce, "Automated hyperspectral imagery analysis via support vector machines based multi-classifier system with non-uniform random feature selection," in Proc. IEEE IGARSS, Vancouver, Canada, 2011.
19. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," Data Mining and Knowledge Discovery, vol. 2, pp. 212-167, 1998.
20. D. J. Sebald and J. A. Bucklew, "Support vector machines and the multiple hypothesis test problem," IEEE Trans. Signal Process. , vol. 49, pp. 2865-2872, 2001. (Pubitemid 33048455)
21. C. -W. Hsu and C. -J. Lin, "A comparison of methods for multiclass support vector machines," IEEE Trans. Neural Networks, vol. 13, pp. 415-425, 2002. (Pubitemid 34475042)
22. E. Alpaydin, "Multiple networks for function learning," in Proc. IEEE Int. Conf. Neural Networks, 1993, vol. 1, pp. 9-14.
23. R. T. Clemen, "Combining forecasts: A review and annotated bibliography," Int. J. Forecasting, vol. 5, pp. 559-583, 1989.
24. A. Krogh, "Neural network ensembles, cross validation, active learning," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1995.
25. D. W. Opitz, "Generating accurate and diverse members of a neuralnetwork ensemble," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1996.
26. D. W. Opitz et al. , "Actively searching for an effective neural-network ensemble," Connection Science, vol. 8, pp. 337-353, 1996. (Pubitemid 126400569)
27. L. Breiman, "Random forests," Machine Learning, vol. 45, pp. 5-32, 2001. (Pubitemid 32933532)
28. S. Prasad and L. M. Bruce, "Decision fusion with confidence-based weight assignment for hyperspectral target recognition," IEEE Trans. Geosci. Remote Sens. , vol. 46, pp. 1448-1456, 2008.
29. T. K. Ho, "The random subspace method for constructing decision forests," IEEE Trans. Pattern Anal. Machine Intell. , vol. 20, pp. 832-844, 1998. (Pubitemid 128741345)
30. C. Simin, R. Zhang, W. Cheng, and H. Yuan, "Band selection of hyperspectral images based on Bhattacharyya distance," WSEAS Trans. Inf. Sci. and App. , vol. 6, pp. 1165-1175, 2009.
31. I. -S. Oh, J. S. Lee, and Y. S. Ching, "Analysis of class separation and combination of class-dependent features for handwriting recognition," IEEE Trans. Pattern Anal. Machine Intell. , vol. 21, pp. 1089-1094, 1999.
32. Purdue University, link (on September 29, 2011) [Online] . Available: https://engineering. purdue. edu/~biehl/MultiSpec/hyperspectral. html
33. R. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. Chicester, U. K. : Wiley, 2006.
34. V. A. Epanechnikov, "Non-parametric estimation of a multivariate probability density," Theory of Probability and Its Applications, vol. 14, pp. 153-158, 1967.
35. M. A. Lee, S. Prasad, L. M. Bruce, T. R. West, D. Reynolds, T. Irby, and H. Kalluri, "Sensitivity of hyperspectral classification algorithms to training sample size," in Proc. IEEE WHISPERS 2009, Grenoble, France, 2009.
36. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, "Adaptive mixtures of local experts," Neural Computing, vol. 3, pp. 79-87, 1991.
37. R. A. Jacobs and M. I. Jordan, "Adaptive mixtures of local experts and the EM algorithm," Neural Computing, vol. 6, pp. 79-87, 1991.
38. S. Kumar, J. Ghosh, andM. M. Crawford, "Hierarchical fusion of multiple classifiers for hyperspectral data analysis," Pattern Analysis Applications, pp. 210-220, 2002, Springer Verlag. (Pubitemid 40830134)