Sentinel-2 cropland mapping using pixel-based and object-based time-weighted dynamic time warping analysis

Remote Sensing of Environment

Volumn 204, Issue , 2018, Pages 509-523

  Belgiu, Mariana ^a   Csillik, Ovidiu ^b,c  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b UNIVERSITY OF SALZBURG   (Austria)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Agriculture; Image segmentation; Land use land cover mapping; OBIA; Random Forest; Remote sensing; Satellite image time series

Indexed keywords

CROPS; DECISION TREES; IMAGE ANALYSIS; IMAGE SEGMENTATION; LAND USE; REMOTE SENSING; SAMPLING; TIME SERIES; TIME SERIES ANALYSIS; VEGETATION MAPPING;

IMAGE TIME-SERIES; IMAGES SEGMENTATIONS; LAND COVER MAPPING; LAND USE/LAND COVER; LAND USE/LAND COVER MAPPING; OBIA; RANDOM FORESTS; REMOTE-SENSING; SATELLITE IMAGE TIME SERIES; SATELLITE IMAGES;

PIXELS;

AGRICULTURAL LAND; AGRICULTURAL PRACTICE; ALGORITHM; CROP PLANT; IMAGE ANALYSIS; IMAGE CLASSIFICATION; IMAGE RESOLUTION; LAND COVER; LAND USE; PIXEL; REMOTE SENSING; SATELLITE DATA; SATELLITE IMAGERY; SEGMENTATION; SENTINEL; SPECTRAL ANALYSIS; TIME SERIES;

ITALY; ROMANIA; UNITED STATES;

EID: 85033436404     PISSN: 00344257     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.rse.2017.10.005     Document Type: Article

References (75)

1. Arvor, D., Jonathan, M., Meirelles, M.S.P., Dubreuil, V., Durieux, L., Classification of MODIS EVI time series for crop mapping in the state of Mato Grosso, Brazil. Int. J. Remote Sens. 32 (2011), 7847–7871.
2. Azar, R., Villa, P., Stroppiana, D., Crema, A., Boschetti, M., Brivio, P.A., Assessing in-season crop classification performance using satellite data: a test case in Northern Italy. Eur. J. Remote. Sens. 49 (2016), 361–380.
3. Baatz, M., Schäpe, A., Multiresolution Segmentation-an optimization approach for high quality multi-scale image segmentation. Strobl, J., Blaschke, T., Griesebner, G., (eds.) Angewandte Geographische Informationsverarbeitung, 2000, Wichmann-Verlag, Heidelberg, 12–23.
4. Baret, F., Guyot, G., Potentials and limits of vegetation indices for LAI and APAR assessment. Remote Sens. Environ. 35 (1991), 161–173.
5. Baumann, M., Ozdogan, M., Richardson, A.D., Radeloff, V.C., Phenology from Landsat when data is scarce: using MODIS and dynamic time-warping to combine multi-year Landsat imagery to derive annual phenology curves. Int. J. Appl. Earth Obs. Geoinf. 54 (2017), 72–83.
6. Belgiu, M., Drǎguţ, L., Comparing supervised and unsupervised multiresolution segmentation approaches for extracting buildings from very high resolution imagery. ISPRS J. Photogramm. Remote Sens. 96 (2014), 67–75.
7. Belgiu, M., Drăguţ, L., Random forest in remote sensing: a review of applications and future directions. ISPRS J. Photogramm. Remote Sens. 114 (2016), 24–31.
8. Blaschke, T., Object based image analysis for remote sensing. ISPRS J. Photogramm. Remote Sens. 65 (2010), 2–16.
9. Boryan, C., Yang, Z., Mueller, R., Craig, M., Monitoring US agriculture: the US Department of Agriculture, National Agricultural Statistics Service, Cropland Data Layer Program. Geocarto Int. 26 (2011), 341–358.
10. Bradley, J.V., Distribution-free Statistical Tests. 1968, Prentice-Hall, New Jersey.
11. Breiman, L., Random Forest. Mach. Learn., 45, 2001.
12. Castillejo-González, I.L., López-Granados, F., García-Ferrer, A., Peña-Barragán, J.M., Jurado-Expósito, M., de la Orden, M.S., González-Audicana, M., Object- and pixel-based analysis for mapping crops and their agro-environmental associated measures using QuickBird imagery. Comput. Electron. Agric. 68 (2009), 207–215.
13. CDFA, California Agriculture Statistics Review 2015–2016. 2016, California Department of Food and Agricultural.
14. Cohen, J., A coefficient of agreement for nominal scales. Educ. Psychol. Meas. 20 (1960), 37–46.
15. Congalton, R.G., A review of assessing the accuracy of classifications of remotely sensed data. Remote Sens. Environ. 37 (1991), 35–46.
16. Croitoru, A.-E., Holobaca, I.-H., Lazar, C., Moldovan, F., Imbroane, A., Air temperature trend and the impact on winter wheat phenology in Romania. Clim. Chang. 111 (2012), 393–410.
17. Debats, S.R., Luo, D., Estes, L.D., Fuchs, T.J., Caylor, K.K., A generalized computer vision approach to mapping crop fields in heterogeneous agricultural landscapes. Remote Sens. Environ. 179 (2016), 210–221.
18. Desclée, B., Bogaert, P., Defourny, P., Forest change detection by statistical object-based method. Remote Sens. Environ. 102 (2006), 1–11.
19. Drǎguţ, L., Tiede, D., Levick, S.R., ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data. Int. J. Geogr. Inf. Sci. 24 (2010), 859–871.
20. Drăguţ, L., Csillik, O., Eisank, C., Tiede, D., Automated parameterisation for multi-scale image segmentation on multiple layers. ISPRS J. Photogramm. Remote Sens. 88 (2014), 119–127.
21. Du, Y., Zhang, Y., Ling, F., Wang, Q., Li, W., Li, X., Water bodies' mapping from Sentinel-2 imagery with modified normalized difference water index at 10-m spatial resolution produced by sharpening the SWIR band. Remote Sens., 8, 2016, 354.
22. FAO-UNESCO, Soil Map of the World 1:5000000. Vol. 2, 1975, UNESCO, Paris North America.
23. FAO-UNESCO, Soil Map of the World 1:5000000. Vol. 5, 1981, UNESCO, Paris Europe.
24. Fernández-Manso, A., Fernández-Manso, O., Quintano, C., SENTINEL-2A red-edge spectral indices suitability for discriminating burn severity. Int. J. Appl. Earth Obs. Geoinf. 50 (2016), 170–175.
25. Fisette, T., Rollin, P., Aly, Z., Campbell, L., Daneshfar, B., Filyer, P., Smith, A., Davidson, A., Shang, J., Jarvis, I., AAFC annual crop inventory. 2013 Second International Conference on Agro-geoinformatics (Agro-Geoinformatics), 2013, IEEE, Fairfax, VA USA, 270–274.
26. Forster, D., Kellenberger, T.W., Buehler, Y., Lennartz, B., Mapping diversified peri-urban agriculture–potential of object-based versus per-field land cover/land use classification. Geocarto Int. 25 (2010), 171–186.
27. Frampton, W.J., Dash, J., Watmough, G., Milton, E.J., Evaluating the capabilities of Sentinel-2 for quantitative estimation of biophysical variables in vegetation. ISPRS J. Photogramm. Remote Sens. 82 (2013), 83–92.
28. Gilabert, M., González-Piqueras, J., Garcıa-Haro, F., Meliá, J., A generalized soil-adjusted vegetation index. Remote Sens. Environ. 82 (2002), 303–310.
29. Gislason, P.O., Benediktsson, J.A., Sveinsson, J.R., Random forests for land cover classification. Pattern Recogn. Lett. 27 (2006), 294–300.
30. Gómez, C., White, J.C., Wulder, M.A., Optical remotely sensed time series data for land cover classification: a review. ISPRS J. Photogramm. Remote Sens. 116 (2016), 55–72.
31. Han, W., Yang, Z., Di, L., Mueller, R., CropScape: a web service based application for exploring and disseminating US conterminous geospatial cropland data products for decision support. Comput. Electron. Agric. 84 (2012), 111–123.
32. Hao, P., Zhan, Y., Wang, L., Niu, Z., Shakir, M., Feature selection of time series MODIS data for early crop classification using random forest: a case study in Kansas, USA. Remote Sens., 7, 2015, 5347.
33. Huete, A.R., A soil-adjusted vegetation index (SAVI). Remote Sens. Environ. 25 (1988), 295–309.
34. Huete, A., Didan, K., Miura, T., Rodriguez, E.P., Gao, X., Ferreira, L.G., Overview of the radiometric and biophysical performance of the MODIS vegetation indices. Remote Sens. Environ. 83 (2002), 195–213.
35. Immitzer, M., Vuolo, F., Atzberger, C., First experience with sentinel-2 data for crop and tree species classifications in Central Europe. Remote Sens., 8, 2016, 166.
36. Jia, K., Liang, S., Zhang, N., Wei, X., Gu, X., Zhao, X., Yao, Y., Xie, X., Land cover classification of finer resolution remote sensing data integrating temporal features from time series coarser resolution data. ISPRS J. Photogramm. Remote Sens. 93 (2014), 49–55.
37. Johnson, B., Xie, Z., Unsupervised image segmentation evaluation and refinement using a multi-scale approach. ISPRS J. Photogramm. Remote Sens. 66 (2011), 473–483.
38. King, L., Adusei, B., Stehman, S.V., Potapov, P.V., Song, X.-P., Krylov, A., Di Bella, C., Loveland, T.R., Johnson, D.M., Hansen, M.C., A multi-resolution approach to national-scale cultivated area estimation of soybean. Remote Sens. Environ. 195 (2017), 13–29.
39. Lawrence, R.L., Wood, S.D., Sheley, R.L., Mapping invasive plants using hyperspectral imagery and Breiman cutler classifications (randomForest). Remote Sens. Environ. 100 (2006), 356–362.
40. Lebourgeois, V., Dupuy, S., Vintrou, É., Ameline, M., Butler, S., Bégué, A., A combined random forest and OBIA classification scheme for mapping smallholder agriculture at different nomenclature levels using multisource data (simulated Sentinel-2 time series, VHRS and DEM). Remote Sens., 9, 2017, 259.
41. Li, Q., Wang, C., Zhang, B., Lu, L., Object-based crop classification with Landsat-MODIS enhanced time-series data. Remote Sens., 7, 2015, 15820.
42. Long, J.A., Lawrence, R.L., Greenwood, M.C., Marshall, L., Miller, P.R., Object-oriented crop classification using multitemporal ETM + SLC-off imagery and random forest. GISci. Remote Sens. 50 (2013), 418–436.
43. Mäkelä, H., Pekkarinen, A., Estimation of timber volume at the sample plot level by means of image segmentation and Landsat TM imagery. Remote Sens. Environ. 77 (2001), 66–75.
44. Matton, N., Canto, G.S., Waldner, F., Valero, S., Morin, D., Inglada, J., Arias, M., Bontemps, S., Koetz, B., Defourny, P., An automated method for annual cropland mapping along the season for various globally-distributed agrosystems using high spatial and temporal resolution time series. Remote Sens. 7 (2015), 13208–13232.
45. Maus, V., dtwSat: time-weighted dynamic time warping for satellite image time series analysis. R Package Version 0.2.0, 2016.
46. Maus, V., Camara, G., Cartaxo, R., Sanchez, A., Ramos, F.M., Queiroz, G.R.D., A time-weighted dynamic time warping method for land-use and land-cover mapping. IEEE J. Select. Top. Appl. Earth Observ. Remote Sens., 2016, 1–11.
47. McFeeters, S.K., The use of the normalized difference water index (NDWI) in the delineation of open water features. Int. J. Remote Sens. 17 (1996), 1425–1432.
48. Millard, K., Richardson, M., On the importance of training data sample selection in random forest image classification: a case study in peatland ecosystem mapping. Remote Sens., 7, 2015, 8489.
49. Montandon, L.M., Small, E.E., The impact of soil reflectance on the quantification of the green vegetation fraction from NDVI. Remote Sens. Environ. 112 (2008), 1835–1845.
50. Müller, H., Rufin, P., Griffiths, P., Siqueira, A.J.B., Hostert, P., Mining dense Landsat time series for separating cropland and pasture in a heterogeneous Brazilian savanna landscape. Remote Sens. Environ. 156 (2015), 490–499.
51. Muller-Wilm, U., Louis, J., Richter, R., Gascon, F., Niezette, M., Sentinel-2 level 2A prototype processor: architecture, algorithms and first results. Proceedings of the ESA Living Planet Symposium, Edinburgh, UK, 2013, 9–13.
52. Ng, W.-T., Rima, P., Einzmann, K., Immitzer, M., Atzberger, C., Eckert, S., Assessing the potential of Sentinel-2 and Pléiades data for the detection of Prosopis and Vachellia Spp. in Kenya. Remote Sensing, Vol. 9, 2017, 74.
53. Novelli, A., Aguilar, M.A., Nemmaoui, A., Aguilar, F.J., Tarantino, E., Performance evaluation of object based greenhouse detection from Sentinel-2 MSI and Landsat 8 OLI data: a case study from Almería (Spain). Int. J. Appl. Earth Obs. Geoinf. 52 (2016), 403–411.
54. Olofsson, P., Foody, G.M., Stehman, S.V., Woodcock, C.E., Making better use of accuracy data in land change studies: estimating accuracy and area and quantifying uncertainty using stratified estimation. Remote Sens. Environ. 129 (2013), 122–131.
55. Pelletier, C., Valero, S., Inglada, J., Champion, N., Dedieu, G., Assessing the robustness of random forests to map land cover with high resolution satellite image time series over large areas. Remote Sens. Environ. 187 (2016), 156–168.
56. Pesaresi, M., Corbane, C., Julea, A., Florczyk, A., Syrris, V., Soille, P., Assessment of the added-value of Sentinel-2 for detecting built-up areas. Remote Sens., 8, 2016, 299.
57. Petitjean, F., Weber, J., Efficient satellite image time series analysis under time warping. IEEE Geosci. Remote Sens. Lett. 11 (2014), 1143–1147.
58. Petitjean, F., Inglada, J., Gançarski, P., Satellite image time series analysis under time warping. IEEE Trans. Geosci. Remote Sens. 50 (2012), 3081–3095.
59. Petitjean, F., Kurtz, C., Passat, N., Gançarski, P., Spatio-temporal reasoning for the classification of satellite image time series. Pattern Recogn. Lett. 33 (2012), 1805–1815.
60. Rabiner, L.R., Juang, B.H., Fundamentals of Speech Recognition. 1993, PTR Prentice Hall, Englewood Cliffs, N.J.
61. Ramoelo, A., Cho, M., Mathieu, R., Skidmore, A.K., Potential of Sentinel-2 spectral configuration to assess rangeland quality. J. Appl. Remote. Sens., 9, 2015 094096–094096.
62. Sakoe, H., Chiba, S., Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoust. Speech Signal Process. 26 (1978), 43–49.
63. Satalino, G., Balenzano, A., Mattia, F., Davidson, M., Sentinel-1 SAR data for mapping agricultural crops not dominated by volume scattering. 2012 IEEE International Geoscience and Remote Sensing Symposium, 2012, 6801–6804.
64. Senf, C., Leitão, P.J., Pflugmacher, D., van der Linden, S., Hostert, P., Mapping land cover in complex Mediterranean landscapes using Landsat: improved classification accuracies from integrating multi-seasonal and synthetic imagery. Remote Sens. Environ. 156 (2015), 527–536.
65. Sima, M., Popovici, E.-A., Bălteanu, D., Micu, D.M., Kucsicsa, G., Dragotă, C., Grigorescu, I., A farmer-based analysis of climate change adaptation options of agriculture in the Bărăgan Plain, Romania. Earth Perspect., 2, 2015, 5.
66. Tucker, C.J., Red and photographic infrared linear combinations for monitoring vegetation. Remote Sens. Environ. 8 (1979), 127–150.
67. United-Nations, World population prospects: the 2015 revision. Population Division of the Department of Economic and Social Affairs of the United Nations Secretariat, 2015, Department of Economic and Social Affairs, New York.
68. United-Nations, Resolution adopted by the General Assembly on 25 September 2015. Washington: United Nations: UN General Assembly, 2015.
69. Valero, S., Morin, D., Inglada, J., Sepulcre, G., Arias, M., Hagolle, O., Dedieu, G., Bontemps, S., Defourny, P., Koetz, B., Production of a dynamic cropland mask by processing remote sensing image series at high temporal and spatial resolutions. Remote Sens., 8, 2016, 55.
70. Waldner, F., Canto, G.S., Defourny, P., Automated annual cropland mapping using knowledge-based temporal features. ISPRS J. Photogramm. Remote Sens. 110 (2015), 1–13.
71. Wood, S.N., Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models. J. R. Stat. Soc. Ser. B Stat Methodol. 73 (2011), 3–36.
72. Xiong, J., Thenkabail, P.S., Gumma, M.K., Teluguntla, P., Poehnelt, J., Congalton, R.G., Yadav, K., Thau, D., Automated cropland mapping of continental Africa using Google earth engine cloud computing. ISPRS J. Photogramm. Remote Sens. 126 (2017), 225–244.
73. Yan, L., Roy, D.P., Automated crop field extraction from multi-temporal web enabled Landsat data. Remote Sens. Environ. 144 (2014), 42–64.
74. Yan, L., Roy, D.P., Improved time series land cover classification by missing-observation-adaptive nonlinear dimensionality reduction. Remote Sens. Environ. 158 (2015), 478–491.
75. Yan, L., Roy, D., Conterminous United States crop field size quantification from multi-temporal Landsat data. Remote Sens. Environ. 172 (2016), 67–86.