THE SEN1-2 DATASET for DEEP LEARNING in SAR-OPTICAL DATA FUSION

ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences

Volumn 4, Issue 1, 2018, Pages 141-146

  Schmitt, M ^a   Hughes, L H ^a   Zhu, X X ^a,b  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b GERMAN AEROSPACE CENTER DLR   (Germany)

Author keywords

data fusion; deep learning; optical remote sensing; Sentinel 1; Sentinel 2; Synthetic aperture radar (SAR)

Indexed keywords

EID: 85056307335     PISSN: 21949042     EISSN: 21949050     Source Type: Conference Proceeding    
DOI: 10.5194/isprs-annals-IV-1-141-2018     Document Type: Conference Paper

References (19)

1. Deshpande, A., Lu, J., Yeh, M.-C., Chong, M. J. And Forsyth, D., 2017. Learning diverse image colorization. In: Proc. CVPR, Honolulu, HI, USA, pp. 6837-6845.
2. Drusch, M., Del Bello, U., Carlier, S., Colin, O., Fernandez, V., Gascon, F., Hoersch, B., Isola, C., Laberinti, P., Martimort, P. et al., 2012. Sentinel-2: ESA's optical high-resolution mission for GMES operational services. Remote sensing of Environment 120, pp. 25-36.
3. European Space Agency, 2015. Sentinels: Space for Copernicus. http://esamultimedia. esa. int/multimedia/ publications/sentinels-family/. (Accessed July 30, 2018).
4. Gorelick, N., Hancher, M., Dixon, M., Ilyushchenko, S., Thau, D. And Moore, R., 2017. Google earth engine: Planetary-scale geospatial analysis for everyone. Remote Sensing of Environment 202, pp. 18-27.
5. Grohnfeldt, C., Schmitt, M. And Zhu, X., 2018. A conditional generative adversarial network to fuse SAR and multispectral optical data for cloud removal from Sentinel-2 images. In: Proc. IGARSS, Valencia, Spain. in press.
6. Hughes, L. H., Schmitt, M., Mou, L., Wang, Y. And Zhu, X. X., 2018. Identifying corresponding patches in SAR and optical images with a pseudo-siamese CNN. IEEE Geoscience and Remote Sensing Letters 15(5), pp. 784-788.
7. Isola, P., Zhu, J.-Y., Zhou, T. And Efros, A. A., 2017. Imageto-image translation with conditional adversarial networks. In: Proc. CVPR, Honolulu, HI, USA, pp. 1125-1134.
8. Ley, A., d'Hondt, O., Valade, S., Hänsch, R. And Hellwich, O., 2018. Exploiting GAN-based SAR to optical image transcoding for improved classification via deep learning. In: Proc. EUSAR, Aachen, Germany, pp. 396-401.
9. Marmanis, D., Yao, W., Adam, F., Datcu, M., Reinartz, P., Schindler, K., Wegner, J. D. And Stilla, U., 2017. Artificial generation of big data for improving image classification: A generative adversarial network approach on SAR data. In: Proc. BiDS, Toulouse, France, pp. 293-296.
10. Merkle, N., Auer, S., Müller, R. And Reinartz, P., 2018. Exploring the potential of conditional adversarial networks for optical and SAR image matching. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. in press.
11. Merkle, N., Wenjie, L., Auer, S., Müller, R. And Urtasun, R., 2017. Exploiting deep matching and SAR data for the geolocalization accuracy improvement of optical satellite images. Remote Sensing 9(9), pp. 586-603.
12. Schmitt, M. And Zhu, X., 2016. Data fusion and remote sensing-an ever-growing relationship. IEEE Geosci. Remote Sens. Mag. 4(4), pp. 6-23.
13. Schmitt, M., Hughes, L. H., Körner, M. And Zhu, X. X., 2018. Colorizing Sentinel-1 SAR images using a variational autoencoder conditioned on Sentinel-2 imagery. In: Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., Vol. XLII-2, pp. 1045-1051.
14. Schubert, A., Small, D., Miranda, N., Geudtner, D. And Meier, E., 2015. Sentinel-1a product geolocation accuracy: Commissioning phase results. Remote Sensing 7(7), pp. 9431-9449.
15. Torres, R., Snoeij, P., Geudtner, D., Bibby, D., Davidson, M., Attema, E., Potin, P., Rommen, B., Floury, N., Brown, M. et al., 2012. GMES Sentinel-1 mission. Remote Sensing of Environment 120, pp. 9-24.
16. Wang, P. And Patel, V. M., 2018. Generating high quality visible images from SAR images using CNNs. ArXiv:1802. 10036.
17. Wang, Y. And Zhu, X. X., 2018. The SARptical dataset for joint analysis of SAR and optical image in dense urban area. ArXiv:1801. 07532.
18. Zhang, L., Zhang, L. And Du, B., 2016. Deep learning for remote sensing data. IEEE Geoscience and Remote Sensing Magazine 4(2), pp. 22-40.
19. Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F. And Fraundorfer, F., 2017. Deep learning in remote sensing: A comprehensive review and list of resources. IEEE Geoscience and Remote Sensing Magazine 5(4), pp. 8-36.