Cloud detection algorithm comparison and validation for operational Landsat data products

Remote Sensing of Environment

Volumn 194, Issue , 2017, Pages 379-390

  Foga, Steve ^a   Scaramuzza, Pat L ^a   Guo, Song ^a   Zhu, Zhe ^a,b   Dilley, Ronald D ^a   Beckmann, Tim ^a   Schmidt, Gail L ^a   Dwyer, John L ^a   Joseph Hughes, M ^c   Laue, Brady ^a  

^a U S GEOLOGICAL SURVEY   (United States)

^b TEXAS TECH UNIVERSITY   (United States)

^c OREGON STATE UNIVERSITY   (United States)

Author keywords

Biome sampling; CFMask; Cloud detection; Cloud validation masks; Data products; Landsat

Indexed keywords

CLOUDS; COMPUTER AIDED INSTRUCTION; ERRORS; IMAGE SEGMENTATION; INFRARED DETECTORS; LEARNING SYSTEMS; SATELLITE IMAGERY; SATELLITES; SIGNAL DETECTION; STRAY LIGHT;

CFMASK; CLOUD DETECTION; CLOUD DETECTION ALGORITHMS; DATA PRODUCTS; ENHANCED THEMATIC MAPPERS; LANDSAT; MULTIPLE LANDSAT SENSORS; U.S. GEOLOGICAL SURVEYS;

C (PROGRAMMING LANGUAGE);

ACCURACY ASSESSMENT; ALGORITHM; BIOME; CLOUD; CLOUD COVER; DATA PROCESSING; ERROR ANALYSIS; LANDSAT; PIXEL; SAMPLING; SATELLITE DATA; SATELLITE IMAGERY; THEMATIC MAPPING;

EID: 85017309987     PISSN: 00344257     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.rse.2017.03.026     Document Type: Article

References (51)

1. Arvidson, T., Goward, S., Gasch, J., Williams, D., Landsat-7 long-term acquisition plan. Photogramm. Eng. Remote Sens. 72:10 (2006), 1137–1146, 10.14358/PERS.72.10.1137.
2. Bishop, C.M., Training with noise is equivalent to Tikhonov regularization. Neural Comput. 7:1 (1995), 108–116, 10.1162/neco.1995.7.1.108.
3. Choi, H., Bindschadler, R., Cloud detection in Landsat imagery of ice sheets using shadow matching technique and automatic normalized difference snow index threshold value decision. Remote Sens. Environ. 91:2 (2004), 237–242, 10.1016/j.rse.2004.03.007.
4. Drusch, M., del Bello, U., Carlier, S., Colin, O., Fernandez, V., Gascon, F., Hoersch, B., Isola, C., Laberinti, P., Martimort, P., et al. Sentinel-2: ESA's optical high-resolution mission for GMES operational services. Remote Sens. Environ. 120 (2012), 25–36, 10.1016/j.rse.2011.11.026.
5. Frantz, D., Röder, A., Udelhoven, T., Schmidt, M., Enhancing the detectability of clouds and their shadows in multitemporal dryland Landsat imagery: extending Fmask. IEEE Geosci. Remote Sens. Lett. 12:6 (2015), 1242–1246, 10.1109/LGRS.2015.2390673.
6. st century. Remote Sens. Environ. 78:1 (2001), 3–12, 10.1016/S0034-4257(01)00262-0.
7. Hagolle, O., Huc, M., Pascual, D.V., Dedieu, G., A multi-temporal method for cloud detection, applied to FORMOSAT-2, VENμS, LANDSAT and SENTINEL-2 images. Remote Sens. Environ. 114:8 (2010), 1747–1755, 10.1016/j.rse.2010.03.002.
8. Hall, D.K., Foster, J.L., Verbyla, D.L., Klein, A.G., Benson, C.S., Assessment of snow-cover mapping accuracy in a variety of vegetation-cover densities in central Alaska. Remote Sens. Environ. 66:2 (1998), 129–137, 10.1016/S0034-4257(98)00051-0.
9. Helmer, E.H., Lefsky, M.A., Roberts, D.A., Biomass accumulation rates of Amazonian secondary forest and biomass of old-growth forests from Landsat time series and the Geoscience Laser Altimeter System. J. Appl. Remote. Sens., 3(1), 2009, 033505, 10.1117/1.3082116.
10. Helmer, E.H., Ruzycki, T.S., Benner, J., Voggesser, S.M., Scobie, B.P., Park, C., Fanning, D.W., Ramnarine, S., Detailed maps of tropical forest types are within reach: forest tree communities for Trinidad and Tobago mapped with multiseason Landsat and multiseason fine-resolution imagery. For. Ecol. Manag. 279 (2012), 147–166, 10.1016/j.foreco.2012.05.016.
11. Hollingsworth, B.V., Chen, L., Reichenbach, S.E., Irish, R.R., Automated cloud cover assessment for Landsat TM images. In: SPIE's 1996 International Symposium on Optical Science, Engineering, and Instrumentation. International Society for Optics and Photonics, 1996, 170–179, 10.1117/12.258064.
12. Huang, C., Goward, S.N., Masek, J.G., Thomas, N., Zhu, Z., Vogelmann, J.E., An automated approach for reconstructing recent forest disturbance history using dense Landsat time series stacks. Remote Sens. Environ. 114:1 (2010), 183–198, 10.1016/j.rse.2009.08.017.
13. Hughes, M.J., Hayes, D.J., Automated detection of cloud and cloud shadow in single-date Landsat imagery using neural networks and spatial post-processing. Remote Sens. 6:6 (2014), 4907–4926, 10.3390/rs6064907.
14. Irish, R.R., Landsat 7 automatic cloud cover assessment. In: AeroSense 2000. International Society for Optics and Photonics, 2000, 348–355, 10.1117/12.410358.
15. Irish, R.R., Barker, J.L., Goward, S.N., Arvidson, T., Characterization of the Landsat-7 ETM + automated cloud-cover assessment (ACCA) algorithm. Photogramm. Eng. Remote Sens. 72:10 (2006), 1179–1188, 10.14358/PERS.72.10.1179.
16. Irons, J.R., Dwyer, J.L., Barsi, J.A., The next Landsat satellite: the Landsat data continuity mission. Remote Sens. Environ. 122 (2012), 11–21, 10.1016/j.rse.2011.08.026.
17. Jin, S., Homer, C., Yang, L., Xian, G., Fry, J., Danielson, P., Townsend, P.A., Automated cloud and shadow detection and filling using two-date Landsat imagery in the USA. Int. J. Remote Sens. 34:5 (2013), 1540–1560, 10.1080/01431161.2012.720045.
18. Jones, J.W., Efficient wetland surface water detection and monitoring via Landsat: comparison with in situ data from the Everglades Depth Estimation Network. Remote Sens. 7:9 (2015), 12503–12538, 10.3390/rs70912503.
19. Ju, J., Roy, D.P., The availability of cloud-free Landsat ETM + data over the conterminous United States and globally. Remote Sens. Environ. 112:3 (2008), 1196–1211, 10.1016/j.rse.2007.08.011.
20. Kennedy, R.E., Cohen, W.B., Schroeder, T.A., Trajectory-based change detection for automated characterization of forest disturbance dynamics. Remote Sens. Environ. 110:3 (2007), 370–386, 10.1016/j.rse.2007.03.010.
21. Kennedy, R.E., Yang, Z., Cohen, W.B., Detecting trends in forest disturbance and recovery using yearly Landsat time series: 1. LandTrendr—Temporal segmentation algorithms. Remote Sens. Environ. 114:12 (2010), 2897–2910, 10.1016/j.rse.2010.07.008.
22. Lee, J., Weger, R.C., Sengupta, S.K., Welch, R.M., A neural network approach to cloud classification. Geoscience and Remote Sensing, IEEE Transactions 28:5 (1990), 846–855, 10.1109/36.58972.
23. Lewis, A., Lymburner, L., Purss, M.B., Brooke, B., Evans, B., Ip, A., Oliver, S., Rapid, high-resolution detection of environmental change over continental scales from satellite data–the Earth Observation Data Cube. International Journal of Digital Earth 9:1 (2016), 106–111, 10.1080/17538947.2015.1111952.
24. Loveland, T., Reed, B., Brown, J., Ohlen, D., Zhu, Z., Yang, L., Merchant, J., Development of a global land cover characteristics database and IGBP DISCover from 1 km AVHRR data. Int. J. Remote Sens. 21:6–7 (2000), 1303–1330, 10.1080/014311600210191.
25. Montanaro, M., Gerace, A., Lunsford, A., Reuter, D., Stray light artifacts in imagery from the Landsat 8 Thermal Infrared Sensor. Remote Sens. 6:11 (2014), 10435–10456, 10.3390/rs61110435.
26. Morfitt, R., Barsi, J., Levy, R., Markham, B., Micijevic, E., Ong, L., Scaramuzza, P., Vanderwerff, K., Landsat-8 Operational Land Imager (OLI) radiometric performance on-orbit. Remote Sens. 7:2 (2015), 2208–2237, 10.3390/rs70202208.
27. Olson, D.M., Dinerstein, E., Wikramanayake, E.D., Burgess, N.D., Powell, G.V., Underwood, E.C., D'amico, J.A., Itoua, I., Strand, H.E., Morrison, J.C., et al. Terrestrial ecoregions of the world: a new map of life on Earth a new global map of terrestrial ecoregions provides an innovative tool for conserving biodiversity. Bioscience 51:11 (2001), 933–938, 10.1641/0006-3568(2001)051[0933:TEOTWA]2.0.CO;2.
28. Oreopoulos, L., Wilson, M.J., Várnai, T., Implementation on Landsat data of a simple cloud-mask algorithm developed for MODIS land bands. Geoscience and Remote Sensing Letters, IEEE 8:4 (2011), 597–601, 10.1109/LGRS.2010.2095409.
29. Reeves, M.C., Kost, J.R., Ryan, K.C., Fuels Products of the LANDFIRE Project. USDA Forest Service Proceedings RMRS-P-41. 2006.
30. Rossow, W.B., Schiffer, R.A., Advances in understanding clouds from ISCCP. Bull. Am. Meteorol. Soc. 80:11 (1999), 2261–2287, 10.1175/1520-0477(1999)080<2261:AIUCFI>2.0.CO;2.
31. Roy, D.P., Ju, J., Lewis, P., Schaaf, C., Gao, F., Hansen, M., Lindquist, E., Multi-temporal MODIS-Landsat data fusion for relative radiometric normalization, gap filling, and prediction of Landsat data. Remote Sens. Environ. 112:6 (2008), 3112–3130, 10.1016/j.rse.2008.03.009.
32. Roy, D.P., Ju, J., Kline, K., Scaramuzza, P.L., Kovalskyy, V., Hansen, M., Loveland, T.R., Vermote, E., Zhang, C., Web-enabled Landsat Data (WELD): Landsat ETM + composited mosaics of the conterminous United States. Remote Sens. Environ. 114:1 (2010), 35–49, 10.1016/j.rse.2009.08.011.
33. Scaramuzza, P.L., Bouchard, M.A., Dwyer, J.L., Development of the Landsat data continuity mission cloud-cover assessment algorithms. Geoscience and Remote Sensing, IEEE Transactions 50:4 (2012), 1140–1154, 10.1109/TGRS.2011.2164087.
34. Schroeder, W., Oliva, P., Giglio, L., Quayle, B., Lorenz, E., Morelli, F., Active fire detection using Landsat-8/OLI data. Remote Sens. Environ. 185 (2015), 210–220, 10.1016/j.rse.2015.08.032.
35. Selkowitz, D.J., Forster, R.R., An automated approach for mapping persistent ice and snow cover over high latitude regions. Remote Sens., 8(1), 2015, 16, 10.3390/rs8010016.
36. Sheng, Y., Song, C., Wang, J., Lyons, E.A., Knox, B.R., Cox, J.S., Gao, F., Representative lake water extent mapping at continental scales using multi-temporal Landsat-8 imagery. Remote Sens. Environ. 185 (2016), 129–141, 10.1016/j.rse.2015.12.041.
37. U.S. Geological Survey, L7 Irish Cloud Validation Masks. 2016, U.S. Geological Survey data release 10.5066/F7XD0ZWC (accessed 28 February 2017).
38. U.S. Geological Survey, L8 SPARCS Cloud Validation Masks. 2016, U.S. Geological Survey data release 10.5066/F7FB5146 (accessed 28 February 2017).
39. U.S. Geological Survey, L8 Biome Cloud Validation Masks. data release, 2016, U.S. Geological Survey, 10.5066/F7251GDH (accessed 28 February 2017).
40. U.S. Geological Survey, Landsat 8 OLI and TIRS Calibration Notices. 2016, U.S. Geological Survey Landsat Missions web page, at https://landsat.usgs.gov/landsat-8-l8-operational-land-imager-oli-and-thermal-infrared-sensor-tirs (accessed 28 February 2017).
41. U.S. Geological Survey, Landsat 8 (L8) Data Users Handbook. 2016, U.S. Geological Survey Landsat Missions web page at https://landsat.usgs.gov/landsat-8-l8-data-users-handbook (accessed 28 February 2017).
42. Vermote, E., Saleous, N., LEDAPS Surface Reflectance Product Description. 2007, University of Maryland Department of Geography, College Park.
43. Vermote, E., Justice, C., Claverie, M., Franch, B., Preliminary analysis of the performance of the Landsat 8/OLI land surface reflectance product. Remote Sens. Environ. 185 (2016), 46–56, 10.1016/j.rse.2016.04.008.
44. Wang, B., Ono, A., Muramatsu, K., Automated detection and Removal of clouds and their shadows from Landsat TM images. IEICE Trans. Inf. Syst. E82-D:2 (1999), 453–460.
45. Yang, L., Huang, C., Homer, C.G., Wylie, B.K., Coan, M.J., An approach for mapping large-area impervious surfaces: synergistic use of Landsat-7 ETM + and high spatial resolution imagery. Can. J. Remote. Sens. 29:2 (2003), 230–240, 10.5589/m02-098.
46. Zhang, Y., Rossow, W.B., Lacis, A.A., Oinas, V., Mishchenko, M.I., Calculation of radiative fluxes from the surface to top of atmosphere based on ISCCP and other global data sets: refinements of the radiative transfer model and the input data. J. Geophys. Res. Atmos., 109(D19), 2004, 10.1029/2003JD004457.
47. Zhu, Z., Continuous Change Detection and Classification of Land Cover Using All Available Landsat Data. 2013, Boston University (Ph.D. thesis).
48. Zhu, Z., Woodcock, C.E., Object-based cloud and cloud shadow detection in Landsat imagery. Remote Sens. Environ. 118 (2012), 83–94, 10.1016/j.rse.2011.10.028.
49. Zhu, Z., Woodcock, C.E., Automated cloud, cloud shadow, and snow detection in multitemporal Landsat data: an algorithm designed specifically for monitoring land cover change. Remote Sens. Environ. 152 (2014), 217–234, 10.1016/j.rse.2014.06.012.
50. Zhu, Z., Woodcock, C.E., Continuous change detection and classification of land cover using all available Landsat data. Remote Sens. Environ. 144 (2014), 152–171, 10.1016/j.rse.2014.01.011.
51. Zhu, Z., Wang, S., Woodcock, C.E., Improvement and expansion of the Fmask algorithm: cloud, cloud shadow, and snow detection for Landsats 4-7, 8, and Sentinel 2 images. Remote Sens. Environ. 159 (2015), 269–277, 10.1016/j.rse.2014.12.014.