Cloud detection in remote sensing images based on multiscale features-convolutional neural network

IEEE Transactions on Geoscience and Remote Sensing

Volumn 57, Issue 6, 2019, Pages 4062-4076

  Shao, Zhenfeng ^a   Pan, Yin ^a   Diao, Chunyuan ^b   Cai, Jiajun ^a  

^a WUHAN UNIVERSITY   (China)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Cloud detection; convolutional neural network (CNN); deep learning; multiscale features (MF); remote sensing images

Indexed keywords

CLASSIFICATION (OF INFORMATION); CONVOLUTION; DEEP LEARNING; INFRARED DEVICES; NEURAL NETWORKS; REMOTE SENSING; SATELLITE IMAGERY; SEMANTICS;

CLOUD DETECTION; CLOUD DETECTION METHOD; CONVOLUTIONAL NEURAL NETWORK; HIGH LEVEL SEMANTICS; MULTI-SCALE FEATURES; REMOTE SENSING IMAGES; SPECTRAL INFORMATION; THERMAL INFRARED BANDS;

FEATURE EXTRACTION;

ARTIFICIAL NEURAL NETWORK; IMAGE ANALYSIS; LANDSAT; LEARNING; PIXEL; REMOTE SENSING; SATELLITE IMAGERY; SPATIAL ANALYSIS;

EID: 85066607253     PISSN: 01962892     EISSN: 15580644     Source Type: Journal    
DOI: 10.1109/TGRS.2018.2889677     Document Type: Article

References (46)

1. K. Anderson, B. Ryan, W. Sonntag, A. Kavvada, and L. Friedl, "Earth observation in service of the 2030 agenda for sustainable development," Geo-Spatial Inf. Sci., vol. 20, no. 2, pp. 77-96, 2017.
2. Y. Zhang, W. B. Rossow, A. A. Lacis, V. Oinas, and M. I. Mishchenko, "Calculation of radiative fluxes from the surface to top of atmosphere based on ISCCP and other global data sets: Refinements of the radiative transfer model and the input data," J. Geophys. Res., Atmos., vol. 109, p. D19105, Oct. 2004.
3. H. Lv, Y. Wang, and Y. Shen, "An empirical and radiative transfer model based algorithm to remove thin clouds in visible bands," Remote Sens. Environ., vol. 179, pp. 183-195, Jun. 2016.
4. Q. Li, W. Lu, and J. Yang, "A hybrid thresholding algorithm for cloud detection on ground-based color images," J. Atmos. Ocean. Technol., vol. 28, pp. 1286-1296, Oct. 2011.
5. W. B. Rossow and L. C. Garder, "Cloud detection using satellite measurements of infrared and visible radiances for ISCCP," J. Climate, vol. 12, pp. 2341-2369, Dec. 1993.
6. K. T. Kriebel, G. Gesell, M. Kästner, and H. Mannstein, "The cloud analysis tool APOLLO: Improvements and validations," Int. J. Remote Sens., vol. 24, no. 12, pp. 2389-2408, 2003.
7. C. L. Liu and B. F. Wu, "Application of cloud detection algorithm for the AVHRR data," J. Remote Sens., vol. 8, pp. 677-687, 2004.
8. B.-C. Gao, P. Yang, and R.-R. Li, "Detection of high clouds in polar regions during the daytime using the MODIS 1.375-?m channel," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 2, pp. 474-481, Feb. 2003.
9. S. A. Ackerman, K. I. Strabala, W. P. Menzel, R. A. Frey, C. C. Moeller, and L. E. Gumley, "Discriminating clear sky from clouds with MODIS," J. Geophys. Res., Atmos., vol. 103, no. D24, pp. 32141-32157, 1998.
10. R. R. Irish, "Landsat 7 automatic cloud cover assessment," Proc. SPIE, Algorithms Multispectral, Hyperspectral, Ultraspectral Imag. VI, vol. 4049, pp. 348-355, Aug. 2000, doi: 10.1117/12.410358.
11. R. R. Irish, J. L. Barker, S. N. Goward, and T. Arvidson, "Characterization of the Landsat-7 ETM+ automated cloud-cover assessment (ACCA) algorithm," Photogramm. Eng. Remote Sens., vol. 72, no. 10, pp. 1179-1188, 2006.
12. L. Oreopoulos, M. J. Wilson, and T. Várnai, "Implementation on Landsat data of a simple cloud-mask algorithm developed for MODIS land bands," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 4, pp. 597-601, Jul. 2011.
13. C. Huang et al., "Automated masking of cloud and cloud shadow for forest change analysis using Landsat images," Int. J. Remote Sens., vol. 31, no. 20, pp. 5449-5464, Oct. 2010.
14. Z. Zhu and C. E. Woodcock, "Object-based cloud and cloud shadow detection in Landsat imagery," Remote Sens. Environ., vol. 118, pp. 83-94, Mar. 2012.
15. Y. Oishi, H. Ishida, and R. Nakamura, "A new Landsat 8 cloud discrimination algorithm using thresholding tests," Int. J. Remote Sens., pp. 1-21, Aug. 2018, doi: 10.1080/01431161.2018.1506183.
16. S. Qiu, B. He, Z. Zhu, Z. Liao, and X. Quan, "Improving Fmask cloud and cloud shadow detection in mountainous area for Landsats 4-8 images," Remote Sens. Environ., vol. 199, pp. 107-119, Sep. 2017.
17. Y. Zhang, B. Guindon, and X. Li, "A robust approach for object-based detection and radiometric characterization of cloud shadow using haze optimized transformation," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 9, pp. 5540-5547, Sep. 2014.
18. L. Tracewski, L. Bastin, and C. C. Fonte, "Repurposing a deep learning network to filter and classify volunteered photographs for land cover and land use characterization," Geo-Spatial Inf. Sci., vol. 20, no. 3, pp. 252-268, 2017.
19. S. Wang, Y. Li, and D. Wang, "Data field for mining big data," Geo-Spatial Inf. Sci., vol. 19, no. 2, pp. 106-118, 2016.
20. T. Bai, D. Li, K. Sun, Y. Chen, and W. Li, "Cloud detection for highresolution satellite imagery using machine learning and multi-feature fusion," Remote Sens., vol. 8, no. 9, p. 715, 2016.
21. A. Movia, A. Beinat, and F. Crosilla, "Shadow detection and removal in RGB VHR images for land use unsupervised classification," ISPRS J. Photogramm. Remote Sens., vol. 119, pp. 485-495, Sep. 2016.
22. S. R. Surya and P. Simon, "Automatic cloud detection using spectral rationing and fuzzy clustering," in Proc. 2nd Int. Conf. Adv. Comput., Netw. Secur., Dec. 2013, pp. 90-95.
23. M. R. Azimi-Sadjadi, W. Gao, T. H. V. Haar, and D. Reinke, "Temporal updating scheme for probabilistic neural network with application to satellite cloud classification-Further results," IEEE Trans. Neural Netw., vol. 12, no. 5, pp. 1196-1203, Sep. 2001.
24. G. Vivone, P. Addesso, R. Conte, M. Longo, and R. Restaino, "A class of cloud detection algorithms based on a MAP-MRF approach in space and time," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 8, pp. 5100-5115, Aug. 2014.
25. R. Zhang, D. Sun, S. Li, and Y. Yu, "A stepwise cloud shadow detection approach combining geometry determination and SVM classification for MODIS data," Int. J. Remote Sens., vol. 34, no. 1, pp. 211-226, 2013.
26. P. Li, L. Dong, H. Xiao, and M. Xu, "A cloud image detection method based on SVM vector machine," Neurocomputing, vol. 169, no. 2, pp. 34-42, Dec. 2015.
27. K. Tan, Y. Zhang, and X. Tong, "Cloud extraction from Chinese high resolution satellite imagery by probabilistic latent semantic analysis and object-based machine learning," Remote Sens., vol. 8, no. 11, p. 963, 2016.
28. X. Hu, Y. Wang, and J. Shan, "Automatic recognition of cloud images by using visual saliency features," IEEE Geosci. Remote Sens. Lett., vol. 12, no. 8, pp. 1760-1764, Aug. 2015.
29. C. Ma, F. Chen, J. Liu, and J. Duan, "A new method of cloud detection based on cascaded AdaBoost," IOP Conf. Ser., Earth Environ. Sci., vol. 18, no. 1, p. 012026, 2014.
30. Q. Zhang and C. Xiao, "Cloud detection of RGB color aerial photographs by progressive refinement scheme," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 11, pp. 7264-7275, Nov. 2014.
31. Z. Shao, J. Deng, L. Wang, Y. Fan, N. S. Sumari, and Q. Cheng, "Fuzzy AutoEncode based cloud detection for remote sensing imagery," Remote Sens., vol. 9, no. 4, p. 311, 2017.
32. T. Johnston, S. R. Young, D. Hughes, R. M. Patton, and D. White, "Optimizing convolutional neural networks for cloud detection," in Proc. Mach. Learn. HPC Environ., 2017, Art. no. 4.
33. M. L. Goff, J. Y. Tourneret, H. Wendt, M. Ortner, and M. Spigai, "Deep learning for cloud detection," in Proc. Int. Conf. Pattern Recognit. Syst., 2018, p. 10.
34. Z. Yan et al., "Cloud and cloud shadow detection using multilevel feature fused segmentation network," IEEE Geosci. Remote Sens. Lett., vol. 15, no. 10, pp. 1600-1604, Oct. 2018.
35. Y. Zhan, J. Wang, J. Shi, G. Cheng, L. Yao, and W. Sun, "Distinguishing cloud and snow in satellite images via deep convolutional network," IEEE Geosci. Remote Sens. Lett., vol. 14, no. 10, pp. 1785-1789, Oct. 2017.
36. H. Jiang and N. Lu, "Multi-scale residual convolutional neural network for haze removal of remote sensing images," Remote Sens., vol. 10, no. 6, p. 945, 2018.
37. M. Shi, F. Xie, Y. Zi, and J. Yin, "Cloud detection of remote sensing images by deep learning," in Proc. IEEE Int. Geosci. Remote Sens. Symp., Jul. 2016, pp. 701-704.
38. F. Xie, M. Shi, Z. Shi, J. Yin, and D. Zhao, "Multilevel cloud detection in remote sensing images based on deep learning," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 10, no. 8, pp. 3631-3640, Aug. 2017.
39. B.-C. Gao and Y. J. Kaufman, "Selection of a 1.3758-?m channel for remote sensing of cirrus clouds and stratospheric aerosols from EOS/MODIS," Proc. SPIE, Passive Infr. Remote Sens. Clouds Atmos., vol. 1934, pp. 109-116, Sep. 1993, doi: 10.1117/12.154909.
40. Z. Zhu, S. Wang, and C. E. Woodcock, "Improvement and expansion of the Fmask algorithm: Cloud, cloud shadow, and snow detection for Landsats 4-7, 8, and Sentinel 2 images," Remote Sens. Environ., vol. 159, pp. 269-277, Mar. 2015.
41. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, "DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs," IEEE Trans. Pattern Anal. Mach. Intell., vol. 40, no. 4, pp. 834-848, Apr. 2017.
42. R. Zhao, W. Ouyang, H. Li, and X. Wang, "Saliency detection by multi-context deep learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 1265-1274.
43. E. Shelhamer, J. Long, and T. Darrell, "Fully convolutional networks for semantic segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 4, pp. 640-651, Apr. 2017.
44. D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization," in Proc. Int. Conf. Learn. Represent., Dec. 2014, pp. 1-15. [Online]. Available: https://arxiv.org/abs/1412.6980
45. C. Latry, C. Panem, and P. Dejean, "Cloud detection with SVM technique," in Proc. IEEE Int. Geosci. Remote Sens. Symp., Jul. 2007, pp. 448-451.
46. B. C. Ko, J.-Y. Kwak, and J.-Y. Nam, "Wildfire smoke detection using temporospatial features and random forest classifiers," Opt. Eng., vol. 51, no. 1, p. 7208, 2012.