Semantic labeling of high-resolution aerial images using an ensemble of fully convolutional networks

Journal of Applied Remote Sensing

Volumn 11, Issue 4, 2017, Pages

  Sun, Xiaofeng ^a,b   Shen, Shuhan ^a,b   Lin, Xiangguo ^c   Hu, Zhanyi ^a,b  

^a INSTITUTE OF AUTOMATION   (China)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^c CHINESE ACADEMY OF SURVEYING AND MAPPING   (China)

Author keywords

aerial images; convolutional neural network; ensemble learning; fully convolutional network; semantic labeling

Indexed keywords

ANTENNAS; ASPECT RATIO; CLASSIFICATION (OF INFORMATION); CONVOLUTION; IMAGE SEGMENTATION; NEURAL NETWORKS; REMOTE SENSING; SEMANTIC WEB; SEMANTICS;

AERIAL IMAGES; CONVOLUTIONAL NETWORKS; CONVOLUTIONAL NEURAL NETWORK; ENSEMBLE LEARNING; SEMANTIC LABELING;

DEEP LEARNING;

EID: 85034968011     PISSN: None     EISSN: 19313195     Source Type: Journal    
DOI: 10.1117/1.JRS.11.042617     Document Type: Article

References (42)

1. M. Volpi and D. Tuia, " Dense semantic labeling of subdecimeter resolution images with convolutional neural networks.," IEEE Trans. Geosci. Remote Sens. 55 (2), 881-893 (2017). IGRSD2 0196-2892 http://dx.doi.org/10.1109/TGRS.2016.2616585
2. J. Sherrah, " Fully convolutional networks for dense semantic labelling of high-resolution aerial imagery.," Eprint Arxiv: 1606.02585 (2016).
3. D. Marmanis et al., " Classification with an edge: Improving semantic image segmentation with boundary detection.," arXiv:1612.01337 (2016).
4. Y. Lecun et al., " Gradient-based learning applied to document recognition.," Proc. IEEE 86 (11), 2278-2324 (1998). IEEPAD 0018-9219 http://dx.doi.org/10.1109/5.726791
5. A. Krizhevsky, I. Sutskever and G. E. Hinton, " Imagenet classification with deep convolutional neural networks.," in Advances in Neural Information Processing Systems, pp. 1097-1105 (2012).
6. C. Szegedy et al., " Going deeper with convolutions.," arXiv:1409.4842 (2014).
7. K. Simonyan and A. Zisserman, " Very deep convolutional networks for large-scale image recognition.," in Int. Conf. on Learning Representations (ICLR '15) (2015).
8. K. He et al., " Deep residual learning for image recognition.," in IEEE Conf. on Computer Vision and Pattern Recognition (CVPR '16) (2016). http://dx.doi.org/10.1109/CVPR.2016.90
9. J. Long, E. Shelhamer and T. Darrell, " Fully convolutional networks for semantic segmentation.," in IEEE Conf. on Computer Vision and Pattern Recognition (CVPR '15) (2015). http://dx.doi.org/10.1109/CVPR.2015.7298965
10. R. Vemulapalli et al., " Gaussian conditional random field network for semantic segmentation.," in IEEE Conf. on Computer Vision and Pattern Recognition (CVPR '16) (2016). http://dx.doi.org/10.1109/CVPR.2016.351
11. G. Lin et al., " Efficient piecewise training of deep structured models for semantic segmentation.," in IEEE Conf. on Computer Vision and Pattern Recognition (CVPR '16), pp. 3194-3203 (2016).
12. L.-C. Chen et al., " Semantic image segmentation with deep convolutional nets and fully connected CRFS.," in Int. Conf. on Learning Representations (ICLR '15) (2015).
13. O. A. B. Penatti, K. Nogueira and J. A. D. S. Santos, " Do deep features generalize from everyday objects to remote sensing and aerial scenes domains " in IEEE Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW '15) (2015). http://dx.doi.org/10.1109/CVPRW.2015.7301382
14. S. Paisitkriangkrai et al., " Effective semantic pixel labelling with convolutional networks and conditional random fields.," in IEEE Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW '15), pp. 36-43 (2015). http://dx.doi.org/10.1109/CVPRW.2015.7301381
15. J. Y. Rau, J. P. Jhan and Y. C. Hsu, " Analysis of oblique aerial images for land cover and point cloud classification in an urban environment.," IEEE Trans. Geosci. Remote Sens. 53 (3), 1304-1319 (2015). IGRSD2 0196-2892 http://dx.doi.org/10.1109/TGRS.2014.2337658
16. T. Speldekamp et al., " Automatic semantic labelling of urban areas using a rule-based approach and realized with MeVisLab.," Technical Report, University of Twente, Enschede (2015).
17. M. Gerke, " Use of the stair vision library within the ISPRS 2D Semantic Labeling Benchmark (Vaihingen).," Technical Report, ITC, University of Twente, Enschede (2015).
18. Y. Tarabalka et al., " SVM-and MRF-based method for accurate classification of hyperspectral images.," IEEE Geosci. Remote Sens. Lett. 7 (4), 736-740 (2010). http://dx.doi.org/10.1109/LGRS.2010.2047711
19. J. A. Richards, Remote Sensing Digital Image Analysis, Springer, Berlin, Heidelberg (2013).
20. M. Everingham et al., " Visual object classes challenge 2012 (voc2012).," http://host.robots.ox.ac.uk/pascal/VOC/voc2012/index.html (2017).
21. F. Rottensteiner et al., " 2D semantic labeling contest.," http://www2.isprs.org/commissions/comm3/wg4/semantic-labeling.html (2017).
22. D. Marmanis et al., " Semantic segmentation of aerial images with an ensemble of CNNS.," in ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. III, p. 473 (2016).
23. M. Kampffmeyer, A.-B. Salberg and R. Jenssen, " Semantic segmentation of small objects and modeling of uncertainty in urban remote sensing images using deep convolutional neural networks.," in IEEE Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW '16) (2016). http://dx.doi.org/10.1109/CVPRW.2016.90
24. A. Boulch, " DAG of convolutional networks for semantic labeling.," Technical Report, The French Aerospace Lab, Paris (2015).
25. M. Holschneider et al., " A real-time algorithm for signal analysis with the help of the wavelet transform.," in Wavelets, Time-Frequency Methods and Phase Space, pp. 286-297, Springer, Berlin, Heidelberg (1989).
26. L.-C. Chen et al., " Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFS.," arXiv:1606.00915 (2016).
27. M. Cordts et al., " The cityscapes dataset for semantic urban scene understanding.," in IEEE Conf. on Computer Vision and Pattern Recognition (CVPR '16) (2016).
28. G. J. Briem, J. A. Benediktsson and J. R. Sveinsson, " Multiple classifiers applied to multisource remote sensing data.," IEEE Trans. Geosci. Remote Sens. 40 (10), 2291-2299 (2002). http://dx.doi.org/10.1109/TGRS.2002.802476
29. P. Du et al., " Multiple classifier system for remote sensing image classification: A review.," Sensors 12 (4), 4764-4792 (2012). SNSRES 0746-9462 http://dx.doi.org/10.3390/s120404764
30. D. Lu and Q. Weng, " A survey of image classification methods and techniques for improving classification performance.," Int. J. Remote Sens. 28 (5), 823-870 (2007). IJSEDK 0143-1161 http://dx.doi.org/10.1080/01431160600746456
31. A. Krogh and J. Vedelsby, " Neural network ensembles, cross validation, and active learning.," in Advances in Neural Information Processing Systems, pp. 231-238 (1995).
32. A. Chandra and X. Yao, " Evolving hybrid ensembles of learning machines for better generalisation.," Neurocomputing 69 (79), 686-700 (2006). NRCGEO 0925-2312 http://dx.doi.org/10.1016/j.neucom.2005.12.014
33. R. Ranawana and V. Palade, " Multi-classifier systems: Review and a roadmap for developers.," Int. J. Hybrid Intell. Syst. 3 (1), 35-61 (2006). http://dx.doi.org/10.3233/HIS-2006-3104
34. P. Krahenbuhl and V. Koltun, " Efficient inference in fully connected CRFS with Gaussian edge potentials.," in Conf. on Neural Information Processing Systems (NIPS) (2011).
35. F. Rottensteiner et al., " 2D semantic labeling-Vaihingen data.," http://www2.isprs.org/commissions/comm3/wg4/2d-sem-label-vaihingen.html (2017).
36. Y. Jia et al., " Caffe: Convolutional architecture for fast feature embedding.," arXiv:1408.5093 (2014).
37. P. Krähenbühl and V. Koltun, " Parameter learning and convergent inference for dense random fields.," http://graphics.stanford.edu/projects/drf (2017).
38. F. Rottensteiner et al., " 2D semantic labeling contest-Potsdam.," http://www2.isprs.org/commissions/comm3/wg4/2d-sem-label-potsdam.html (2017).
39. X. Sun et al., " High-resolution remote sensing data classification over urban areas using random forest ensemble and fully connected conditional random field.," ISPRS Int. J. Geo-Inf. 6 (8), 245 (2017). http://dx.doi.org/10.3390/ijgi6080245
40. S. Piramanayagam et al., " Classification of remote sensed images using random forests and deep learning framework.," Proc. SPIE 10004, 100040L (2016). PSISDG 0277-786X http://dx.doi.org/10.1117/12.2243169
41. N. Audebert, B. L. Saux and S. Lefevre, " Semantic segmentation of earth observation data using multimodal and multi-scale deep networks.," in Asian Conf. on Computer Vision (ACCV '16) (2016).
42. H. Wang et al., " Gated convolutional neural network for semantic segmentation in high-resolution images.," Remote Sens. 9 (5), 446 (2017). RSEND3 http://dx.doi.org/10.3390/rs9050446