Incremental import vector machines for classifying hyperspectral data

IEEE Transactions on Geoscience and Remote Sensing

Volumn 50, Issue 9, 2012, Pages 3463-3473

  Roscher, Ribana ^a   Waske, Björn ^a   Förstner, Wolfgang ^a  

^a UNIVERSITY OF BONN   (Germany)

Author keywords

Hyperspectral data; import vector machines; incremental learning; self training

Indexed keywords

CLASSIFICATION ACCURACY; COMPUTATION TIME; HYPERSPECTRAL DATA; INCREMENTAL LEARNING; LARGE DATASETS; PROBABILISTIC INFORMATION; PROBABILISTIC OUTPUT; RUNTIMES; SELF-TRAINING; SPARSE KERNELS; SUPPORT VECTOR; TRAINING SAMPLE; VECTOR MACHINES;

LOGISTICS; VECTORS;

SUPPORT VECTOR MACHINES;

ACCURACY ASSESSMENT; DATA SET; EXPERIMENTAL STUDY; IMAGE CLASSIFICATION; PERFORMANCE ASSESSMENT; PROBABILITY; REGRESSION ANALYSIS; SPECTRAL ANALYSIS; VECTOR;

EID: 84865698912     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2012.2184292     Document Type: Article

References (58)

1. A. Goetz, "Three decades of hyperspectral remote sensing of the earth: A personal view," Remote Sens. Environ., vol. 113, no. Suppl. 1, pp. S5-S16, Sep. 2009.
2. B. Waske, S. van der Linden, J. Benediktsson, A. Rabe, and P. Hostert, "Sensitivity of support vector machines to random feature selection in classification of hyperspectral data," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 7, pp. 2880-2889, Jul. 2010.
3. G. Mitri and I. Gitas, "Mapping postfire vegetation recovery using EO-1 hyperion imagery," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 3, pp. 1613-1618, Mar. 2010.
4. J. Benediktsson, J. Palmason, and J. Sveinsson, "Classification of hyperspectral data from urban areas based on extended morphological profiles," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 480-491, Mar. 2005. (Pubitemid 40320270)
5. L. Guanter, K. Segl, and H. Kaufmann, "Simulation of optical remotesensing scenes with application to the EnMAP hyperspectral mission," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 7, pp. 2340-2351, Jul. 2009.
6. J. Richards, "Analysis of remotely sensed data: The formative decades and the future," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 422- 432, Mar. 2005. (Pubitemid 40320265)
7. A. Plaza, J. Benediktsson, J. Boardman, J. Brazile, L. Bruzzone, G. Camps-Valls, J. Chanussot, M. Fauvel, P. Gamba, A. Gualtieri, M. Marconcini, J. Tilton, and G. Trianni, "Recent advances in techniques for hyperspectral image processing," Remote Sens. Environ., vol. 113, no. Suppl. 1, pp. S110-S122, Sep. 2009.
8. X. Chen, T. Warner, and D. Campagna, "Integrating visible, near-infrared and short-wave infrared hyperspectral and multispectral thermal imagery for geological mapping at Cuprite, Nevada," Remote Sens. Environ., vol. 110, no. 3, pp. 344-356, Oct. 2007. (Pubitemid 47287766)
9. S. Van der Linden, A. Janz, B. Waske, M. Eiden, and P. Hostert, "Classifying segmented hyperspectral data from a heterogeneous urban environment using support vector machines," J. Appl. Remote Sens., vol. 1, no. 1, p. 013 543, Oct. 2007.
10. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 2000.
11. M. Pal and P. Mather, "Some issues in the classification of DAIS hyperspectral data," Int. J. Remote Sens., vol. 27, no. 14, pp. 2895-2916, 2006. (Pubitemid 44219162)
12. B. Waske, J. Benediktsson, K. Arnason, and J. Sveinsson, "Mapping of hyperspectral AVIRIS data using machine-learning algorithms," Can. J. Remote Sens., vol. 35, no. S1, pp. S106-S116, Sep. 2009.
13. G. Camps-Valls, N. Shervashidze, and K. M. Borgwardt, "Spatio-spectral remote sensing image classification with graph kernels," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 4, pp. 741-745, Oct. 2010.
14. J. Muñoz-Marí, F. Bovolo, L. Gómez-Chova, L. Bruzzone, and G. Camp-Valls, "Semisupervised one-class support vector machines for classification of remote sensing data," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 8, pp. 3188-3197, Aug. 2010.
15. A. Mathur and G. Foody, "Multiclass and binary SVM classification: Implications for training and classification users," IEEE Geosci. Remote Sens. Lett., vol. 5, no. 2, pp. 241-245, Apr. 2008.
16. J. Platt, N. Cristianini, and J. Shawe-Taylor, "Large margin DAGs for multiclass classification," Adv. Neural Inf. Process. Syst., vol. 12, no. 3, pp. 547-553, 2000.
17. G. Foody, "RVM-based multi-class classification of remotely sensed data," Int. J. Remote Sens., vol. 29, no. 6, pp. 1817-1823, Mar. 2008. (Pubitemid 351338305)
18. M. Tipping, "Sparse Bayesian learning and the relevance vectormachine," J. Mach. Learn. Res., vol. 1, pp. 211-244, Sep. 2001. (Pubitemid 33687203)
19. F. Giacco, C. Thiel, L. Pugliese, S. Scarpetta, and M. Marinaro, "Uncertainty analysis for the classification of multispectral satellite images using SVMs and SOMs," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 10, pp. 3769-3779, Oct. 2010.
20. P. Zhong and R.Wang, "Learning conditional random fields for classification of hyperspectral images," IEEE Trans. Image Process, vol. 19, no. 7, pp. 1890-1907, Jul. 2010.
21. Y. Tarabalka, M. Fauvel, J. Chanussot, and J. Benediktsson, "SVM-and MRF-based method for accurate classification of hyperspectral images," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 4, pp. 736-740, Oct. 2010.
22. P. Zhong, P. Zhang, and R.Wang, "Dynamic learning of SMLR for feature selection and classification of hyperspectral data," IEEE Geosci. Remote Sens. Lett., vol. 5, no. 2, pp. 280-284, Apr. 2008.
23. Q. Cheng, P. Varshney, and M. Arora, "Logistic regression for feature selection and soft classification of remote sensing data," IEEE Geosci. Remote Sens. Lett., vol. 3, no. 4, pp. 491-494, Oct. 2006. (Pubitemid 44679657)
24. S. Keerthi, K. Duan, S. Shevade, and A. Poo, "A fast dual algorithm for kernel logistic regression," Mach. Learn., vol. 61, no. 1, pp. 151-165, Nov. 2005. (Pubitemid 43049366)
25. G. Cawley and N. Talbot, "Efficient model selection for kernel logistic regression," in Proc. Pattern Recognit., 2004, vol. 2, pp. 439-442.
26. J. Borges, J. Bioucas-Dias, and A. Marcal, "Bayesian hyperspectral image segmentation with discriminative class learning," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 6, pp. 2151-2164, Jun. 2011.
27. J. Li, J. Bioucas-Dias, and A. Plaza, "Hyperspectral image segmentation using a new Bayesian approach with active learning," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 10, pp. 3947-3960, Oct. 2011.
28. G. Cawley, N. Talbot, and M. Girolami, "Sparse multinomial logistic regression via Bayesian L1 regularisation," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 209-216.
29. B. Krishnapuram, L. Carin, M. Figueiredo, and A. Hartemink, "Sparse multinomial logistic regression: Fast algorithms and generalization bounds," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 957- 968, Jun. 2005. (Pubitemid 40889845)
30. B. Demir and S. Erturk, "Hyperspectral image classification using relevance vector machines," IEEE Geosci. Remote Sens. Lett., vol. 4, no. 4, pp. 586-590, Oct. 2007. (Pubitemid 47588035)
31. J. Zhu and T. Hastie, "Kernel logistic regression and the import vector machine," J. Comput. Graph. Stat., vol. 14, no. 1, pp. 185-205, Mar. 2005. (Pubitemid 40447832)
32. M. Pal and G. Foody, "Feature selection for classification of hyperspectral data by SVM," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 5, pp. 2297-2307, May 2010.
33. D. Tuia, M. Volpi, L. Copa, M. Kanevski, and J. Munoz-Mari, "A survey of active learning algorithms for supervised remote sensing image classification," IEEE J. Sel. Topics Signal Process., vol. 5, no. 3, pp. 606-617, Jun. 2011.
34. J. Li, J. Bioucas-Dias, and A. Plaza, "Semisupervised hyperspectral image segmentation using multinomial logistic regression with active learning," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 11, pp. 4085-4098, Nov. 2010.
35. S. Rajan, J. Ghosh, and M. Crawford, "An active learning approach to hyperspectral data classification," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 4, pp. 1231-1242, Apr. 2008. (Pubitemid 351459470)
36. V. Ng and C. Cardie, "Weakly supervised natural language learning without redundant views," in Proc. NAACL, 2003, pp. 94-101.
37. S. Kumar and M. Hebert, "Discriminative random fields," Int. J. Comput. Vis., vol. 68, no. 2, pp. 179-201, Jun. 2006. (Pubitemid 43724245)
38. P. Zhong and R. Wang, "Learning sparse CRFs for feature selection and classification of hyperspectral imagery," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 12, pp. 4186-4197, Dec. 2008.
39. L. Fei-Fei, R. Fergus, and P. Perona, "Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories," Comput. Vis. Image Understand., vol. 106, no. 1, pp. 59-70, Apr. 2007. (Pubitemid 46528761)
40. S. Pang, S. Ozawa, and N. Kasabov, "Incremental linear discriminant analysis for classification of data streams," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 35, no. 5, pp. 905-914, Oct. 2005. (Pubitemid 41444576)
41. G. Cauwenberghs and T. Poggio, "Incremental and decremental support vector machine learning," in Proc. Adv. Neural Inf. Process. Syst., 2001, pp. 409-415.
42. M. Karasuyama and I. Takeuchi, "Multiple incremental decremental learning of support vector machines," IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1048-1059, Jul. 2010.
43. G. Fung and O.Mangasarian, "Incremental Support VectorMachine Classification," in Proc. SIAM, 2002, pp. 247-260.
44. M. Figueiredo, "Adaptive sparseness for supervised learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1050-1159, Sep. 2003.
45. M. Figueiredo and A. Jain, "Bayesian learning of sparse classifiers," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2001, pp. I-35-I-41.
46. L. Csató and M. Opper, "Sparse on-line Gaussian processes," Neural Comput., vol. 14, no. 3, pp. 641-668, Mar. 2002.
47. N. Lawrence, M. Seeger, and R. Herbrich, "Fast sparse Gaussian process methods: The informative vector machine," in Proc. Adv. Neural Inf. Process. Syst., 2003, pp. 625-632.
48. R. Neal, Bayesian Learning for Neural Networks. New York: Springer- Verlag, 1996.
49. J. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods - Support Vector Learning. Cambridge, MA: MIT Press, 1999, pp. 185-208.
50. C. Hsu and C. Lin, "A comparison of methods for multiclass support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 415-425, Mar. 2002. (Pubitemid 34475042)
51. P. Rousseeuw, A. Leroy, and J. Wiley, Robust Regression and Outlier Detection. Hoboken, NJ: Wiley, 1987.
52. N. Japkowicz, "The class imbalance problem: Significance and strategies," in Proc. Int. Conf. Artif. Intell., 2000, vol. 1, pp. 111-117.
53. N. Higham, Accuracy and Stability of Numerical Algorithms. Philadelphia, PA: SIAM, 2002.
54. R. Cook and S. Weisberg, Residuals and Influence in Regression. New York: Chapman & Hall, 1982.
55. J.-M. Yang, B.-C. Kuo, P.-T. Yu, and C.-H. Chuang, "A dynamic subspace method for hyperspectral image classification," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 7, pp. 2840-2853, Jul. 2010.
56. F. Melgani and L. Bruzzone, "Classification of hyperspectral remote sensing images with support vector machines," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 8, pp. 1778-1790, Aug. 2004.
57. C. Chang and C. Lin, LIBSVM: A Library for Support Vector Machines: 2001.
58. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001. (Pubitemid 33137959)