Dense semantic labeling of subdecimeter resolution images with convolutional neural networks

IEEE Transactions on Geoscience and Remote Sensing

Volumn 55, Issue 2, 2017, Pages 881-893

  Volpi, Michele ^a   Tuia, Devis ^a  

^a UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Aerial images; classification; convolutional neural networks (CNNs); deconvolution networks; deep learning; semantic labeling; subdecimeter resolution

Indexed keywords

CONVOLUTION; FLIGHT DYNAMICS; IMAGE SEGMENTATION; NETWORK ARCHITECTURE; NEURAL NETWORKS; PIXELS; SEMANTIC WEB; SEMANTICS;

APPEARANCE DESCRIPTORS; CONVOLUTIONAL NEURAL NETWORK; GEOMETRIC ACCURACY; LAND COVER CLASSIFICATION; NUMERICAL ACCURACY; SPATIAL INFORMATIONS; SUBDECIMETER RESOLUTION; ULTRAHIGH RESOLUTION;

IMAGE PROCESSING;

AERIAL PHOTOGRAPH; ARTIFICIAL NEURAL NETWORK; DECONVOLUTION; IMAGE CLASSIFICATION; IMAGE RESOLUTION; IMAGERY; NUMERICAL METHOD; PIXEL;

EID: 84994217941     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2016.2616585     Document Type: Article

References (45)

1. M. Fauvel, Y. Tarabalka, J. A. Benediktsson, J. Chanussot, and J. C. Tilton, "Advances in spectral-spatial classification of hyperspectral images," Proc. IEEE, vol. 101, no. 3, pp. 652-675, Mar. 2013.
2. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. IEEE/CVF Int. Conf. Comput. Vis. Pattern Recognit., Oct. 2003, pp. 1470-1477.
3. L. Gueguen, "Classifying compound structures in satellite images: A compressed representation for fast queries," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 1803-1818, Apr. 2015.
4. J. Shotton, J. Winn, C. Rother, and A. Criminisi, "TextonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation," in Proc. Eur. Conf. Comput. Vis., 2006, pp. 1-15.
5. D. Tuia, M. Volpi, M. D. Mura, A. Rakotomamonjy, and R. Flamary, "Automatic feature learning for spatio-spectral image classification with sparse SVM," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 10, pp. 6062-6074, Oct. 2014.
6. P. Tokarczyk, J. D. Wegner, S. Walk, and K. Schindler, "Features, color spaces, and boosting: New insights on semantic classification of remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 1, pp. 280-295, Jan. 2015.
7. D. Tuia, R. Flamary, and N. Courty, "Multiclass feature learning for hyperspectral image classification: Sparse and hierarchical solutions," ISPRS J. Photogram. Remote Sens., vol. 105, pp. 272-285, Jul. 2015.
8. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, "Greedy layerwise training of deep networks," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 1-8.
9. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol, "Extracting and composing robust features with denoising autoencoders," in Proc. Int. Conf. Mach. Learn., 2008, pp. 1096-1103.
10. K. Kavukcuoglu, P. Sermanet, Y.-L. Boureau, K. Gregor, M. Mathieu, and Y. LeCun, "Learning convolutional feature hierarchies for visual recognition," in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 1090-1098.
11. V. Nair and G. E. Hinton, "Rectified linear units improve restricted Boltzmann machines," in Proc. Int. Conf. Mach. Learn., 2010, pp. 1-8.
12. V. Mnih and G. E. Hinton, "Learning to label aerial images from noisy data," in Proc. Int. Conf. Mach. Learn., 2012, pp. 1-8.
13. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006.
14. Y. Bengio, "Learning deep architectures for AI," Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
15. I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. Cambridge, MA, USA: MIT Press, 2016. [Online]. Available: http://www.deeplearningbook.org
16. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
17. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 1097-1105.
18. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," in Proc. Int. Conf. Learn. Represent., 2015, pp. 1-14.
19. C. Szegedy et al., "Going deeper with convolutions," in Proc. IEEE/CVF Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 1-9.
20. K. He, X. Zhang, S. Ren, and J. Sun, "Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification," in Proc. IEEE/CVF Int. Conf. Comput. Vis. Pattern Recognit., Dec. 2015, pp. 1026-1034.
21. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting," J. Mach. Learn. Res., vol. 15, no. 1, pp. 1929-1958, 2014.
22. S. Ioffe and C. Szegedy, "Batch normalization: Accelerating deep network training by reducing internal covariate shift," in Proc. Int. Conf. Mach. Learn., 2015, pp. 1-11.
23. K. Jarrett, K. Kavukcuoglu, M. Ranzato, and Y. LeCun, "What is the best multi-stage architecture for object recognition?" in Proc. IEEE Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 2146-2153.
24. C. Farabet, C. Couprie, L. Najman, and Y. LeCun, "Learning hierarchical features for scene labeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1915-1929, Aug. 2013.
25. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. IEEE/CVF Comput. Vis. Pattern Recognit., Jun. 2014, pp. 580-587.
26. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation," in Proc. IEEE/CVF Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 3431-3440.
27. H. Noh, S. Hong, and B. Han, "Learning deconvolution network for semantic segmentation," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2015, pp. 1520-1528.
28. D. Marmanis, M. Datcu, T. Esch, and U. Stilla, "Deep learning earth observation classification using ImageNet pretrained networks," IEEE Geosci. Remote Sens. Lett., vol. 13, no. 1, pp. 105-109, Jan. 2015.
29. O. A. B. Penatti, K. Nogueira, and J. A. dos Santos, "Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?" in Proc. IEEE/CVF Comput. Vis. Pattern Recognit. Workshops, Jun. 2015, pp. 44-51.
30. M. Castelluccio, G. Poggi, C. Sansone, and L. Verdoliva. (2015). "Land use classification in remote sensing images by convolutional neural networks." [Online]. Available: https://arxiv.org/abs/1508.00092
31. Y. Chen, Z. Lin, X. Zhao, G. Wang, and Y. Gu, "Deep learning-based classification of hyperspectral data," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 6, pp. 2094-2107, Jun. 2014.
32. O. Firat, G. Can, and F. T. Y. Vural, "Representation learning for contextual object and region detection in remote sensing," in Proc. Int. Conf. Pattern Recognit., Aug. 2014, pp. 3708-3713.
33. F. Zhang, B. Du, and L. Zhang, "Saliency-guided unsupervised feature learning for scene classification," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 2175-2184, Apr. 2015.
34. C. Romero, A. Gatta, and G. Camps-Valls, "Unsupervised deep feature extraction for remote sensing image classification," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 3, pp. 1349-1362, Mar. 2016.
35. S. Paisitkriangkrai, J. Sherrah, P. Janney, and A. Van-Den Hengel, "Effective semantic pixel labelling with convolutional networks and conditional random fields," in Proc. IEEE/CVF Int. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2015, pp. 36-43.
36. J. Sherrah. (2016). "Fully convolutional networks for dense semantic labelling of high-resolution aerial imagery." [Online]. Available: https://arxiv.org/abs/1606.02585
37. B. Xu, N. Wang, T. Chen, and M. Li, "Empirical evaluation of rectified activations in convolutional network," in Proc. Int. Conf. Mach. Learn. Workshops, Deep Learn., 2015, pp. 1-5.
38. A. L. Maas, A. Y. Hannun, and A. Y. Ng, "Rectier nonlinearities improve neural network acoustic models," in Proc. Int. Conf. Mach. Learn., 2013, pp. 1-6.
39. M. D. Zeiler and R. Fergus, "Stochastic pooling for regularization of deep convolutional neural networks," in Proc. Int. Conf. Learn. Represent., 2013, pp. 1-9.
40. C. M. Bishop, "Training with noise is equivalent to Tikhonov regularization," Neural Comput., vol. 7, no. 1, pp. 108-116, 1995.
41. X. Wang, M. Yang, S. Zhu, and Y. Lin, "Regionlets for generic object detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 10, pp. 2071-2084, Oct. 2015.
42. B. Hariharan, P. Arbeláez, R. Girshick, and J. Malik, "Hypercolumns for object segmentation and fine-grained localization," in Proc. IEEE/CVF Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 447-456.
43. M. Gerke, "Use of the stair vision library within the ISPRS 2D semantic labeling benchmark (Vaihingen)," ITC, Univ. Twente, Enschede, The Netherlands, Tech. Rep., 2015, doi: 10.13140/2.1.5015.9683.
44. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graph-based image segmentation," Int. J. Comput. Vis., vol. 59, no. 2, pp. 167-181, Sep. 2004.
45. R. G. Congalton and K. Green, Assessing the Accuracy of Remotely Sensed Data, 2nd ed. Boca Raton, FL, USA: CRC Press, 2008.