A novel spectral-spatial co-training algorithm for the transductive classification of hyperspectral imagery data

Pattern Recognition

Volumn 63, Issue , 2017, Pages 229-245

  Appice, Annalisa ^a,b,c   Guccione, Pietro ^d   Malerba, Donato ^a,b,c  

^a UNIVERSITY OF BARI   (Italy)

^b Consorzio Interuniversitario Nazionale per l'Informatica CINI ^*  (Italy)

^c Centro Interdipartimentale di Logica e Applicazioni CILA   (Italy)

^d POLITECNICO DI BARI   (Italy)

Author keywords

Co training; Collective inference; Hyperspectral imagery classification; Spectral spatial data; Transductive learning

Indexed keywords

IMAGE CLASSIFICATION; ITERATIVE METHODS; PIXELS; REMOTE SENSING; SPECTROSCOPY;

CO-TRAINING; COLLECTIVE INFERENCE; HYPERSPECTRAL IMAGERY CLASSIFICATIONS; SPATIAL DATA; TRANSDUCTIVE LEARNING;

CLASSIFICATION (OF INFORMATION);

EID: 84999035133     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2016.10.010     Document Type: Article

References (61)

1. [1] Appice, A., Guccione, P., Malerba, D., Transductive hyperspectral image classification: toward integrating spectral and relational features via an iterative ensemble system. Mach. Learn. J., 103(3), 2016 (343–3).
2. [2] Benediktsson, J., Pesaresi, M., Amason, K., Classification and feature extraction for remote sensing images from urban areas based on morphological transformations. IEEE Trans. Geosci. Remote Sens. 41:9 (2003), 1940–1949.
3. [3] Bernardini, A., Frontoni, E., Malinverni, E., Mancini, A., Tassetti, A., Zingaretti, P., Pixel, object and hybrid classification comparisons. J. Spat. Sci. 55:1 (2010), 43–54.
4. [4] A. Blum, T. in: Mitchell, Combining labeled and unlabeled data with co-training, in: Proceedings of the 11th Workshop on Computational Learning Theory, COLT 1998, 1998.
5. [5] F. Bovolo, L. Bruzzone, M. Marconcini, A novel context-sensitive SVM for classification of remote sensing images, in: Proceedings of the 2006 IEEE International Conference on Geoscience and Remote Sensing Symposium, IGARSS 2006, 2006, pp. 2498–2501.
6. [6] Bruzzone, L., Chi, M., Marconcini, M., A novel transductive SVM for semisupervised classification of remote-sensing images. IEEE Trans. Geosci. Remote Sens. 44:11 (2006), 3363–3373.
7. [7] Camps-Valls, G., Bandos Marsheva, T., Zhou, D., Semi-supervised graph-based hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 45:10 (2007), 3044–3054.
8. [8] X. Ceamanos, B. Waske, J. Benediktsson, J. Chanussot, J. Sveinsson, Ensemble strategies for classifying hyperspectral remote sensing data, in: J. Benediktsson, J. Kittler, F. Roli, (eds.), Multiple Classifier Systems, vol. 5519 of Lecture Notes in Computer Science, Springer Berlin Heidelberg, 2009, pp. 62–71.
9. [9] M. Ceci, A. Appice, H.L. Viktor, D. Malerba, E. Paquet, H. Guo, Transductive relational classification in the co-training paradigm, in: P. Perner, (ed.), Proceedings of the 8th International Conference Machine Learning and Data Mining in Pattern Recognition, MLDM 2012, vol. 7376 of Lecture Notes in Computer Science, Springer, 2012, pp. 11–25.
10. [10] Chang, C.-I., Hyperspectral Data Exploitation: theory and Applications. 2007, Wiley.
11. [11] W. Cheetham, J. Price, Measures of solution accuracy in case-based reasoning systems, in: P. Funk, P. A. González-Calero (eds.), Proceedings of the 7th European Conference on Advances in Case-Based Reasoning, ECCBR 2004, vol. 3155 of Lecture Notes in Computer Science, Springer, 2004, pp. 106–118.
12. [12] Chen, J., Xia, J., Du, P., Chanussot, J., Combining rotation forest and multiscale segmentation for the classification of hyperspectral data. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. PP 99 (2016), 1–14.
13. [13] Cortes, C., Vapnik, V., Support-vector networks. Mach. Learn. 20:3 (1995), 273–297.
14. [14] Demir, B., Persello, C., Bruzzone, L., Batch-mode active-learning methods for the interactive classification of remote sensing images. IEEE Trans. Geosci. Remote Sens. 49:3 (2011), 1014–1031.
15. [15] Fauvel, M., Chanussot, J., Benediktsson, J., A spatial-spectral kernel-based approach for the classification of remote-sensing images. Pattern Recognit. 45:1 (2012), 381–392.
16. [16] M. Fauvel, Y. Tarabalka, J. Benediktsson, J. Chanussot, J. Tilton, Advances in spectral-spatial classification of hyperspectral images, in: Proceedings of the IEEE 101 (3) (2013) 652–675.
17. [17] Fujino, A., Ueda, N., Saito, K., Semisupervised learning for a hybrid generative/discriminative classifier based on the maximum entropy principle. IEEE Trans. Pattern Anal. Mach. Intell. 30:3 (2008), 424–437.
18. [18] P. Gamba, ROSIS Pavia University 2003 data set, 2003.
19. [19] L. Getoor, B. Taskar, Introduction to Statistical Relational Learning (Adaptive Computation and Machine Learning), The MIT Press, 2007.
20. [20] Guccione, P., Mascolo, L., Appice, A., Iterative hyperspectral image classification using spectral-spatial relational features. IEEE Trans. Geosci. Remote Sens. 53:7 (2015), 3615–3627.
21. [21] Hang, R., Liu, Q., Song, H., Sun, Y., Matrix-based discriminant subspace ensemble for hyperspectral image spatial-spectral feature fusion. IEEE Trans. Geosci. Remote Sens. 54:2 (2016), 783–794.
22. [22] R. Huang, W. He, Using tri-training to exploit spectral and spatial information for hyperspectral data classification, in: Proceedings of the 2012 International Conference on Computer Vision in Remote Sensing, CVRS 2012, 2012, pp. 30–33.
23. [23] Hughes, G., On the mean accuracy of statistical pattern recognizers. IEEE Trans. Inf. Theory 14:1 (1968), 55–63.
24. [24] Isaaks, E.H., Srivastava, M.R., An Introduction to Applied Geostatistics. 1990, Oxford University Press, USA.
25. [25] D. Jensen, J. Neville, B. in: Gallagher, Why collective inference improves relational classification, in: Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2004, ACM, 2004, pp. 593–598.
26. [26] T. Joachims, Transductive inference for text classification using support vector machines, in: I. Bratko, S. Dzeroski (eds.), Proceedings of the 16th International Conference on Machine Learning, (ICML 1999), Morgan Kaufmann, 1999, pp. 200–209.
27. [27] T. Joachims, Transductive learning via spectral graph partitioning, in: T. Fawcett, N. Mishra (eds.), Proceedings of the 20th International Conference on Machine Learning, ICML 2003, AAAI Press, 2003, pp. 290–297.
28. [28] L. Johnson, AVIRIS Hyperpsectral Radiance Data from: f981009t01r07, 1998.
29. [29] D. Landgrebe, AVIRIS NW Indiana's Indian Pines 1992 data set, 1992.
30. [30] Legendre, P., Spatial autocorrelation: trouble or new paradigm?. Ecology 74:6 (1993), 1659–1673.
31. [31] Li, J., Bioucas-Dias, J., Plaza, A., Hyperspectral image segmentation using a new bayesian approach with active learning. IEEE Trans. Geosci. Remote Sens. 49:10 (2011), 3947–3960.
32. [32] Li, J., Bioucas-Dias, J., Plaza, A., Spectral-spatial hyperspectral image segmentation using subspace multinomial logistic regression and markov random fields. IEEE Trans. Geosci. Remote Sens. 50:3 (2012), 809–823.
33. [33] Li, J., Bioucas-Dias, J., Plaza, A., Spectral-spatial classification of hyperspectral data using loopy belief propagation and active learning. IEEE Trans. Geosci. Remote Sens. 51:2 (2013), 844–856.
34. [34] Lv, Q., Niu, X., Dou, Y., Xu, J., Lei, Y., Classification of hyperspectral remote sensing image using hierarchical local-receptive-field-based extreme learning machine. IEEE Geosci. Remote Sens. Lett. 13:3 (2016), 434–438.
35. [35] Malerba, D., Ceci, M., Appice, A., A relational approach to probabilistic classification in a transductive setting. Eng. Appl. Artif. Intell. 22:1 (2009), 109–116.
36. [36] Maulik, U., Chakraborty, D., Learning with transductive SVM for semisupervised pixel classification of remote sensing imagery. ISPRS J. Photogramm. Remote Sens. 77:0 (2013), 66–78.
37. [37] L. McDowell, D.W. in: Aha, Semi-supervised collective classification via hybrid label regularization, in: Proceedings of the 29th International Conference on Machine Learning, ICML 2012, Omnipress, 2012.
38. [38] Melgani, F., Bruzzone, L., Classification of hyperspectral remote sensing images with support vector machines. IEEE Trans. Geosci. Remote Sens. 42:8 (2004), 1778–1790.
39. [39] Miao, L., Shuying, Z., Zhang, B., Shanshan, L., Changshan, W., A review of remote sensing image classification techniques: the role of spatio-contextual information. Eur. J. Remote Sens. 47 (2014), 389–411.
40. [40] Pasolli, E., Melgani, F., Tuia, D., Pacifici, F., Emery, W.J., SVM active learning approach for image classification using spatial information. IEEE Trans. Geosci. Remote Sens. 52:4 (2014), 2217–2233.
41. [41] Pasolli, E., Yang, H.L., Crawford, M.M., Active-metric learning for classification of remotely sensed hyperspectral images. IEEE Trans. Geosci. Remote Sens. 54:4 (2016), 1925–1939.
42. [42] J.C. Platt, Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods, in: Advances in Large Margin Classifiers, MIT Press, 1999, pp. 61–74.
43. [43] Plaza, A., Benediktsson, J.A., Boardman, J.W., Brazile, J., Bruzzone, L., Camps-Valls, G., Chanussot, J., Fauvel, M., Gamba, P., Gualtieri, A., Marconcini, M., Tilton, J.C., Trianni, G., Recent advances in techniques for hyperspectral image processing. Remote Sens. Environ. 113:1 (2009), 110–122.
44. [44] Ratle, F., Camps-Valls, G., Weston, J., Semisupervised neural networks for efficient hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 48:5 (2010), 2271–2282.
45. [45] Richards, J.A., Remote Sensing Digital Image Analysis: an Introduction. 2nd ed., 1993, Springer-Verlag, New York, Inc.
46. [46] M. Seeger, Learning with labeled and unlabeled data, Tech. rep., 2001.
47. [47] Shackelford, A.K., Davis, C.H., A combined fuzzy pixel-based and object-based approach for classification of high-resolution multispectral data over urban areas. IEEE Trans. Geosci. Remote Sens. 41:10 (2003), 2354–2363.
48. [48] Shahshahani, B., Landgrebe, D., The effect of unlabeled samples in reducing the small sample size problem and mitigating the hughes phenomenon. IEEE Trans. Geosci. Remote Sens. 32:5 (1994), 1087–1095.
49. [49] X. Shi, Y. Li, P. in: Yu, Collective prediction with latent graphs, in:Proceedings of the 20th ACM International Conference on Information and Knowledge Management, CIKM 2011, ACM, 2011, pp. 1127–1136.
50. [50] V. Sindhwani, S.S. Keerthi, Large scale semi-supervised linear SVMs, in: E.N. Efthimiadis, S.T. Dumais, D. Hawking, K. Järvelin (eds.), Proceedings of the 29th Annual International Conference on Research and Development in Information Retrieval, SIGIR 2006, ACM, 2006, pp. 477–484.
51. [51] S. D. Stearns, B. E. Wilson, J. R. Peterson, Dimensionality reduction by optimal band selection for pixel classification of hyperspectral imagery, in: Proceedings of SPIE Applications of Digital Image Processing, vol. 2028, 1993, pp. 118–127.
52. [52] Tan, K., Li, E., Du, Q., Du, P., An efficient semi-supervised classification approach for hyperspectral imagery. ISPRS J. Photogramm. Remote Sens. 97:0 (2014), 36–45.
53. [53] Tan, K., Li, E., Du, Q., Du, P., Hyperspectral image classification using band selection and morphological profiles. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 7:1 (2014), 40–48.
54. [54] Tarabalka, Y., Chanussot, J., Benediktsson, J., Segmentation and classification of hyperspectral images using watershed transformation. Pattern Recognit. 43:7 (2010), 2367–2379.
55. [55] Tarabalka, Y., Fauvel, M., Chanussot, J., Benediktsson, J., SVM- and MRF-based method for accurate classification of hyperspectral images. IEEE Geosci. Remote Sens. Lett. 7:4 (2010), 736–740.
56. [56] Triguero, I., García, S., Herrera, F., Self-labeled techniques for semi-supervised learning: taxonomy, software and empirical study. Knowl. Inf. Syst. 42:2 (2015), 245–284.
57. [57] V.N. Vapnik, The Nature of Statistical Learning Theory, New York, NY, USA, 1995.
58. [58] Wang, L., Hao, S., Wang, Q., Wang, Y., Semi-supervised classification for hyperspectral imagery based on spatial-spectral label propagation. ISPRS J. Photogramm. Remote Sens. 97:0 (2014), 123–137.
59. [59] Witten, I., Frank, E., Data Mining: practical Machine Learning Tools and Techniques. 2nd ed., 2005, Morgan Kaufmann.
60. [60] R. Xiang, J. Neville, Pseudolikelihood em for within-network relational learning, in: Proceedings of the 8th IEEE International Conference on Data Mining, ICDM 2008, IEEE, 2008, pp. 1103–1108.
61. [61] Zhang, X., Song, Q., Liu, R., Wang, W., Jiao, L., Modified co-training with spectral and spatial views for semisupervised hyperspectral image classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 7:6 (2014), 2044–2055.