High-Resolution Aerial Image Labeling with Convolutional Neural Networks

IEEE Transactions on Geoscience and Remote Sensing

Volumn 55, Issue 12, 2017, Pages 7092-7103

  Maggiori, Emmanuel ^a   Tarabalka, Yuliya ^a   Charpiat, Guillaume ^b   Alliez, Pierre ^a  

^a UNIVERSITÉ CÔTE D'AZUR   (France)

^b INRIA SACLAY   (France)

Author keywords

Convolutional neural networks (CNNs); deep learning; high resolution aerial imagery; semantic labeling

Indexed keywords

AERIAL PHOTOGRAPHY; COMPUTER ARCHITECTURE; CONVOLUTION; CONVOLUTIONAL CODES; DEEP LEARNING; IMAGE ANALYSIS; LABELING; NETWORK ARCHITECTURE; NEURAL NETWORKS; NEURONS; SEMANTICS;

AERIAL IMAGE ANALYSIS; CONVOLUTIONAL NEURAL NETWORK; DIFFERENT RESOLUTIONS; EFFICIENT ARCHITECTURE; HIGH RESOLUTION AERIAL IMAGERY; HIGH-RESOLUTION AERIAL IMAGES; HIGH-RESOLUTION OUTPUT; SEMANTIC LABELING;

IMAGE PROCESSING;

AERIAL PHOTOGRAPHY; ARTIFICIAL NEURAL NETWORK; BENCHMARKING; FINE GRAINED SEDIMENT; IMAGE ANALYSIS; IMAGE RESOLUTION; PIXEL;

EID: 85029010312     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2017.2740362     Document Type: Article

References (34)

1. G. Mattyus, S. Wang, S. Fidler, R. Urtasun, "HD maps: Fine-grained road segmentation by parsing ground and aerial images, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2016, pp. 3611-3619.
2. Q. Wang, J. Lin, Y. Yuan, "Salient band selection for hyperspectral image classification via manifold ranking, " IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 6, pp. 1279-1289, Jun. 2016.
3. M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional networks, " in Proc. ECCV, 2014, pp. 818-833.
4. Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, "Gradient-based learning applied to document recognition, " Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
5. A. Krizhevsky, I. Sutskever, G. E. Hinton, "ImageNet classification with deep convolutional neural networks, " in Proc. NIPS, 2012, pp. 1097-1105.
6. J. Long, E. Shelhamer, T. Darrell, "Fully convolutional networks for semantic segmentation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2015, pp. 3431-3440.
7. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, A. L. Yuille, "DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, fully connected CRFs, " unpublished paper, 2014. [Online]. Available: Https://arxiv.org/abs/1606.00915
8. M. Volpi and D. Tuia, "Dense semantic labeling of subdecimeter resolution images with convolutional neural networks, " IEEE Trans. Geosci. Remote Sens., vol. 55, no. 2, pp. 881-893, Feb. 2017.
9. J. Sherrah, "Fully convolutional networks for dense semantic labelling of high-resolution aerial imagery, " unpublished paper, 2016. [Online]. Available: Https://arxiv.org/abs/1606.02585
10. A. Dubrovina, P. Kisilev, B. Ginsburg, S. Hashoul, R. Kimmel, "Computational mammography using deep neural networks, " in Computer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization. London, U.K.: Taylor & Francis, 2016, pp. 1-5.
11. H. Noh, S. Hong, B. Han, "Learning deconvolution network for semantic segmentation, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2015, pp. 1520-1528.
12. V. Badrinarayanan, A. Handa, R. Cipolla, "SegNet: A deep convolutional encoder-decoder architecture for robust semantic pixelwise labelling, " unpublished paper, 2015. [Online]. Available: Https://arxiv.org/abs/1505.07293
13. A. Paszke, A. Chaurasia, S. Kim, E. Culurciello, "ENet: A deep neural network architecture for real-time semantic segmentation, " unpublished paper, 2016. [Online]. Available: Https://arxiv.org/abs/1606.02147
14. D. Marmanis, J. Wegner, S. Galliani, K. Schindler, M. Datcu, U. Stilla, "Semantic segmentation of aerial images with an ensemble of CNSS, " in Proc. ISPRS Ann. Photogramm., Remote Sens. Spatial Inf. Sci., 2016, pp. 473-480.
15. S. Paisitkriangkrai, J. Sherrah, P. Janney, A. Van-Den Hengel, "Effective semantic pixel labelling with convolutional networks and conditional random fields, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR) Workshops, Jun. 2015, pp. 36-43.
16. ISPRS. [Online]. Available: Http://www2.isprs.org/commissions/comm3/wg4/semantic-labeling.html
17. E. Maggiori, Y. Tarabalka, G. Charpiat, P. Alliez, "Convolutional neural networks for large-scale remote-sensing image classification, " IEEE Trans. Geosci. Remote Sens., vol. 55, no. 2, pp. 645-657, Feb. 2017.
18. C. M. Bishop, Neural Networks for Pattern Recognition. London, U.K.: Oxford Univ. Press, 1995.
19. Y.-L. Boureau, J. Ponce, Y. LeCun, "A theoretical analysis of feature pooling in visual recognition, " in Proc. ICML, 2010, pp. 111-118.
20. M. Kampffmeyer, A.-B. Salberg, R. Jenssen, "Semantic segmentation of small objects and modeling of uncertainty in urban remote sensing images using deep convolutional neural networks, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR) Workshops, Jun. 2016, pp. 1-9.
21. F. Yu and V. Koltun, "Multi-scale context aggregation by dilated convolutions, " unpublished paper, 2015. [Online]. Available: Https://arxiv.org/abs/1511.07122
22. J. Yang, B. Price, S. Cohen, H. Lee, M.-H. Yang, "Object contour detection with a fully convolutional encoder-decoder network, " unpublished paper, 2016. [Online]. Available: Https://arxiv.org/abs/1603.04530
23. V. Badrinarayanan, A. Kendall, R. Cipolla, "SegNet: A deep convolutional encoder-decoder architecture for image segmentation, " unpublished paper, 2015. [Online]. Available: Https://arxiv.org/abs/1511.00561
24. J. T. Springenberg, A. Dosovitskiy, T. Brox, M. Riedmiller, "Striving for simplicity: The all convolutional net, " unpublished paper, 2014. [Online]. Available: Https://arxiv.org/abs/1412.6806
25. E. Simo-Serra, S. Iizuka, K. Sasaki, H. Ishikawa, "Learning to simplify: Fully convolutional networks for rough sketch cleanup, " ACM Trans. Graph., vol. 35, no. 4, Jul. 2016, Art. no. 121.
26. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, D. Ramanan, "Object detection with discriminatively trained part-based models, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
27. C. Farabet, C. Couprie, L. Najman, Y. LeCun, "Learning hierarchical features for scene labeling, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1915-1929, Aug. 2013.
28. M. Gerke, "Use of the Stair Vision Library within the ISPRS 2D semantic labeling benchmark (Vaihingen), " Univ. Twente, Enschede, The Netherlands, Tech. Rep., 2015.
29. R. G. Congalton and K. Green, Assessing Accuracy Remotely Sensed Data: Principles Practices. Boca Raton, FL, USA: CRC, 2008.
30. S. Ioffe and C. Szegedy, "Batch normalization: Accelerating deep network training by reducing internal covariate shift, " unpublished paper, 2015. [Online]. Available: Https://arxiv.org/abs/1502.03167
31. K. He, X. Zhang, S. Ren, J. Sun, "Delving deep into rectifiers: Surpassing human-level performance on imagenet classification, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2015, pp. 1026-1034.
32. Y. Bengio, "Practical recommendations for gradient-based training of deep architectures, " in Neural Networks: Tricks of the Trade. Berlin, Germany: Springer, 2012, pp. 437-478.
33. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition, " unpublished paper, 2014. [Online]. Available: Https://arxiv.org/abs/1409.1556
34. Y. Jia, et al., "Caffe: Convolutional architecture for fast feature embedding, " unpublished paper, 2014. [Online]. Available: Https://arxiv.org/abs/1408.5093