A conditional generative adversarial network to fuse SAR and multispectral optical data for cloud removal from Sentinel-2 images

International Geoscience and Remote Sensing Symposium (IGARSS)

Volumn 2018-July, Issue , 2018, Pages 1726-1729

  Grohnfeldt, Claas ^a   Schmitt, Michael ^a   Zhu, Xiaoxiang ^a,b  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b GERMAN AEROSPACE CENTER DLR   (Germany)

Author keywords

Cloudremoval; Data fusion; Deep learning; Generative adversarial network (GAN); Optical remote sensing; SAR

Indexed keywords

DATA FUSION; DEEP LEARNING; GEOLOGY; NETWORK ARCHITECTURE; REMOTE SENSING; SYNTHETIC APERTURE RADAR;

ADVERSARIAL NETWORKS; CLOUDREMOVAL; EQUIVALENT MODEL; MULTI-SPECTRAL; OPTICAL DATA; OPTICAL REMOTE SENSING; SENTINEL-1; SINGLE SENSOR;

RADAR IMAGING;

EID: 85056354296     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IGARSS.2018.8519215     Document Type: Conference Paper

References (12)

1. M. D. King, S. Platnick, W. P. Menzel, S. A. Ackerman, and P. A. Hubanks, "Spatial and temporal distribution of clouds observed by MODIS onboard the Terra and Aqua satellites," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 7, pp. 3826-3852, 2013.
2. B. Huang, Y. Li, X. Han, Y. Cui, W. Li, and R. Li, "Cloud removal from optical satellite imagery with SAR imagery using sparse representation," IEEE Geosci. Remote Sens. Lett., vol. 12, no. 5, pp. 1046-1050, 2015.
3. M. Xu, X. Jia, M. Pickering, and A. J. Plaza, "Cloud removal based on sparse representation via multitempo-ral dictionary learning," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 5, pp. 2998-3006, 2016.
4. K. Enomoto, K. Sakurada, W. Wang, H. Fukui, M. Matsuoka, R. Nakamura, and N. Kawaguchi, "Filmy cloud removal on satellite imagery with multispectral conditional generative adversarial nets," in Proc. CVPR Workshops, Honolulu, HI, USA, 2017, pp. 1533-1541.
5. X. Zhu, D. Tuia, L. Mou, G.-S. Xia, L. Zhang, F. Xu, and F. Fraundorfer, "Deep learning in remote sensing: A comprehensive review and list of resources," IEEE Geosci. Remote Sens. Mag., vol. 5, no. 4, pp. 8-36
6. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets," in Proc. NIPS, Montreal, Canada, 2014, pp. 2672-2680.
7. M. Mirza and S. Osindero, "Conditional generative adversarial nets," ArXiv preprint arXiv:1411.1784, 2014.
8. G. Hunt, "Radiative properties of terrestrial clouds at visible and infra-red thermal window wavelengths," Quart. J. R. Met. Soc., vol. 99, pp. 346-369, 1973.
9. M. Schmitt and X. Zhu, "Data fusion and remote sensing - an ever-growing relationship," IEEE Geosci. Remote Sens. Mag., vol. 4, no. 4, pp. 6-23, 2016.
10. P. Isola, J. Y. Zhu, T. Zhou, and A. A. Efros, "Imageto-image translation with conditional adversarial networks," in Proc. CVPR, Honolulu, HI, USA, 2017, pp. 5967-5976.
11. C. Hesse, Tensorflow port of image-to-image translation with conditional adversarial nets, https://github.com/affinelayer/pix2pix-tensorflow.
12. M. Schmitt, L. H. Hughes, and X. X. Zhu, "The SEN1-2 dataset for deep learning in SAR-optical data fusion," Submitted to ISPRS TCI Symposium