Building an Earth Observations Data Cube: lessons learned from the Swiss Data Cube (SDC) on generating Analysis Ready Data (ARD)

Big Earth Data

Volumn 1, Issue 1-2, 2017, Pages 100-117

  Giuliani, Gregory ^a   Chatenoux, Bruno ^a   De Bono, Andrea ^a   Rodila, Denisa ^a   Richard, Jean Philippe ^a   Allenbach, Karin ^a   Dao, Hy ^a   Peduzzi, Pascal ^a,b  

^a UNIVERSITY OF GENEVA   (Switzerland)

^b United Nations Environment Programme   (Switzerland)

Author keywords

Analysis Ready Data; automatic processing; Data Cube; Earth Observations; Landsat

Indexed keywords

EID: 85053623907     PISSN: 20964471     EISSN: 25745417     Source Type: Journal    
DOI: 10.1080/20964471.2017.1398903     Document Type: Article

References (50)

1. Anderson, K., Ryan, B., Sonntag, W., Kavvada, A., & Friedl, L., (2017). Earth observation in service of the 2030 agenda for sustainable development. Geo-spatial Information Science, 20, 77–96. doi:10.1080/10095020.2017.1333230
2. Baumann, P., (2017). The Datacube Manifesto. Retrieved from https://earthserver.eu/tech/datacube-manifesto
3. Baumann, P., Furtado P., Ritsch R., & Widmann, N., (1997). The RasDaMan approach to multidimensional database management. In SAC’97 Proceedings of the 1997 ACM symposium on Applied computing (pp. 166–173). 331732: ACM. doi:10.1145/331697.331732
4. Baumann, P., Mazzetti, P., Ungar, J., Barbera, R., Barboni, D., Beccati, A., … Wagner, S., (2016). Big data analytics for earth sciences: The earthserver approach. International Journal of Digital Earth, 9(1), 3–29. doi:10.1080/17538947.2014.1003106
5. Baumann, P., Rossi, A. P., Clements, O., Dumitru, A., Evans, B., Hogan, P., … Wagemann J., (2016). Fostering cross-disciplinary earth science through datacube analytics (p. 32). Retrieved from https://www.rd-alliance.org/sites/default/files/earthserver-chapter_ssr-issi.pdf
6. Camps-Valls, G., (2009). Machine learning in remote sensing data processing. In 2009 IEEE international workshop on machine learning for signal processing (pp. 1–6). doi:10.1109/MLSP.2009.5306233
7. CEOS. (2017). The CEOS open data cube initiative. Retrieved from https://docs.wixstatic.com/ugd/f9d4ea_1aea90c5bb7149c8a730890c0f791496.pdf
8. Desconnets, J-C., Giuliani, G., Guigoz, Y., Lacroix, P., Mlisa, A., Noort, M., … Searby, N. D., (2017). GEOCAB portal: A gateway for discovering and accessing capacity building resources in Earth Observation. International Journal of Applied Earth Observation and Geoinformation, 54, 95–104. doi:10.1016/j.jag.2016.09.010
9. Douglas McCuistion, J., & Birk R., (2005). From observations to decision support: The new paradigm for satellite data. Acta Astronautica, 4th IAA international symposium on small satellites for earth observation, 56 (1): 5–8. doi:10.1016/j.actaastro.2004.09.046
10. Environment Switzerland 2015. (2015). er2015. State of the environment. Bern: Swiss Federal Council. Retrieved from https://www.bafu.admin.ch/bafu/en/home/state/publications-on-the-state-of-the-environment/environment-switzerland-2015.html.
11. Evangelidis, K., Ntouros, K., Makridis, S., & Papatheodorou, C., (2014). Geospatial services in the cloud. Computers & Geosciences, 63, 116–122. doi:10.1016/j.cageo.2013.10.007
12. Evans, B., Wyborn, L., Pugh, T., Allen, C., Antony, J., Gohar, K., … Bell, G., (2015). The NCI high performance computing and high performance data platform to support the analysis of petascale environmental data collections. In Ralf, Denzer, Robert M, Argent, Gerald, Schimak, & Jiří, Hřebíček (Eds.), Environmental software systems. Infrastructures, services and applications: 11th IFIP WG 5.11 International Symposium, ISESS 2015 (pp. 569–577), Melbourne, March 25–27, 2015. Cham: Springer. doi:10.1007/978-3-319-15994-2_58
13. Flach, M., Gans, F., Brenning, A., Denzler, J., Reichstein, M., Rodner, E., … Mahecha, M. D., (2016). Multivariate anomaly detection for earth observations: A comparison of algorithms and feature extraction techniques. Earth System Dynamics Discussions, 2016(November), 1–27. doi:10.5194/esd-2016-51
14. Giuliani, G., Dao, H., De Bono, A., Chatenoux, B., Allenbach, K., De Laborie, P., … Peduzzi, P., (2017). Live monitoring of earth surface (LiMES): A framework for monitoring environmental changes from earth observations. Remote Sensing of Environment. doi:10.1016/j.rse.2017.05.040
15. Giuliani, G., Lacroix, P., Guigoz, Y., Roncella, R., Bigagli, L., Santoro, M., … Lehmann, A., (2016). Bringing GEOSS services into practice: A capacity building resource on spatial data infrastructures (SDI). Transactions in GIS, 21(4), 811–824. doi:10.1111/tgis.12209
16. Gómez, C., White, J. C., & Wulder, M. A., (2016). Optical remotely sensed time series data for land cover classification: A review. ISPRS Journal of Photogrammetry and Remote Sensing, 116(June), 55–72. doi:10.1016/j.isprsjprs.2016.03.008
17. Gore, A., (1998). The digital earth: Understanding our planet in the 21st century. Australian Surveyor, 43(2), 89–91.10.1080/00050348.1998.10558728
18. Gorelick, N., Hancher, M., Dixon, M., Ilyushchenko, S., Thau, D., & Moore, R., (2017). Google Earth Engine: Planetary-scale geospatial analysis for everyone. Remote Sensing of Environment. doi:10.1016/j.rse.2017.06.031
19. Goward, S., Arvidson, T., Williams, D., Faundeen, J., Irons, J., & Franks, S., (2006). Historical record of Landsat global coverage. Photogrammetric Engineering & Remote Sensing, 72(10), 1155–1169. doi:10.14358/PERS.72.10.1155
20. Gray Davidson, O., (2014). The group on earth observations looks toward a second decade of data sharing. Earthzine. January 6. Retrieved from https://earthzine.org/2014/01/06/the-group-on-earth-observations-looks-toward-a-second-decade-of-data-sharing/
21. Group on Earth Observations. (2017). Earth observations in support of the 2030 agenda for sustainable development.
22. Irons, J. R., Dwyer, J. L., & Barsi, J. A., (2012). The next Landsat satellite: The Landsat data continuity mission. Remote Sensing of Environment, Landsat Legacy Special Issue, 122(July), 11–21. doi:10.1016/j.rse.2011.08.026
23. Karmas, A., Tzotsos A., & Karantzalos, K., (2015). Scalable geospatial web services through efficient, online and near real-time processing of earth observation data. In 2015 IEEE First International Conference on Big Data Computing Service and Applications, 194–201. doi:10.1109/BigDataService.2015.49
24. Killough, B., (2016). CEOS land surface imaging analysis ready data (ARD) description document.
25. Kuenzer, C., Ottinger, M., Wegmann, M., Guo, H., Wang, C., Zhang, J., … Wikelski, M., (2014). Earth observation satellite sensors for biodiversity monitoring: Potentials and bottlenecks. International Journal of Remote Sensing, 35(18), 6599–6647. doi:10.1080/01431161.2014.964349
26. Lary, D. J., Alavi, A. H., Gandomi, A. H., & Walker, A. L., (2016). Machine learning in geosciences and remote sensing. Geoscience Frontiers, Special Issue: Progress of Machine Learning in Geosciences, 7(1), 3–10. doi:10.1016/j.gsf.2015.07.003
27. Lehmann, A., Chaplin-Kramer, R., Lacayo, M., Giuliani, G., Thau, D., Koy, K., … Sharp, Jr., R., (2017). Lifting the information barriers to address sustainability challenges with data from physical geography and earth observation. Sustainability, 9(6), 858. doi:10.3390/su9050858
28. Lewis, A., Lymburner, L., Purss, M. B. J., Brooke, B., Evans, B., Ip, A., Oliver, S., (2016). Rapid, high-resolution detection of environmental change over continental scales from satellite data–The Earth Observation Data Cube. International Journal of Digital Earth, 9(1), 106–111. doi:10.1080/17538947.2015.1111952
29. Lewis, A., Oliver, S., Lymburner, L., Evans, B., Wyborn, L., Mueller, N., … Wu, W., (2017). The Australian Geoscience Data Cube–Foundations and Lessons Learned. Remote Sensing of Environment,. doi:10.1016/j.rse.2017.03.015
30. Mueller, N., Lewis, A., Roberts, D., Ring, S., Melrose, R., Sixsmith, J., … Ip, A., (2016). Water observations from space: Mapping surface water from 25 years of Landsat imagery across Australia. Remote Sensing of Environment, 174(March), 341–352. doi:10.1016/j.rse.2015.11.003
31. Nativi, S., Mazzetti, P., Santoro, M., Papeschi, Fabrizio, Craglia, M., & Ochiai, O., (2015). Big data challenges in building the global earth observation system of systems. Environmental Modelling & Software, 68, 1–26. doi:10.1016/j.envsoft.2015.01.017
32. OECD. (2015). Strengthening national statistical systems to monitor global goals (p 8). 2017. Earth Observation for Decision-Making. Author.
33. Purss, M. B. J., Lewis, A., Oliver, S., Ip, A., Sixsmith, J., Evans, B., … Chan, T., (2015). Unlocking the Australian Landsat archive–From dark data to high performance data infrastructures. GeoResJ, Rescuing Legacy Data for Future Science, 6(June), 135–140. doi:10.1016/j.grj.2015.02.010
34. Rockstrom, J., Steffen, W., Noone, K., Persson, A., Chapin, F. S., Lambin, E., & Foley, J., (2009). Planetary boundaries: Exploring the safe operating space for humanity. Ecology and Society, 14(2). Retrieved from http://www.ecologyandsociety.org/vol14/iss2/art32/
35. Ryan, B., (2016). The benefits from open data are immense. Geospatial World, 72–73.
36. Sagar, S., Roberts, D., Bala, B., & Lymburner, L., (2017). Extracting the intertidal extent and topography of the Australian coastline from a 28 year time series of Landsat observations. Remote Sensing of Environment, 195(June), 153–169. doi:10.1016/j.rse.2017.04.009
37. Santos, N. D., & Gonçalves, G., (2014). Remote sensing applications based on satellite open data (Landsat8 and Sentinel-2). In Conferencia Nacional de Geodecisao, Barreiro, 15 y 16 de mayo de 2014.
38. Schmidt, G., Jenkerson, C., Masek, J., Vermote, E., & Gao, F., (2013). Landsat ecosystem disturbance adaptive processing system (LEDAPS) algorithm description. Reston, VA: USGS Publications Warehouse. Retrieved from http://pubs.er.usgs.gov/publication/ofr20131057
39. Song, C., Woodcock, C. E., Seto, K. C., Lenney, M. P., & Macomber, S. A., (2001). Classification and change detection using Landsat TM data. Remote Sensing of Environment, 75(2), 230–244. doi:10.1016/S0034-4257(00)00169-3
40. Tulbure, M. G., Broich, M., Stehman, S. V., & Kommareddy, A., (2016). Surface water extent dynamics from three decades of seasonally continuous Landsat time series at subcontinental scale in a semi-arid region. Remote Sensing of Environment, 178(June), 142–157. doi:10.1016/j.rse.2016.02.034
41. Vermote, E. F., Tanre, D., Deuze, J. L., Herman, M., & Morcette, J. J., (1997). Second simulation of the satellite signal in the solar spectrum, 6S: An overview. IEEE Transactions on Geoscience and Remote Sensing, 35(3), 675–686. doi:10.1109/36.581987
42. Vihervaara, P., Auvinen, A.-P., Mononen, L., Törmä, M., Ahlroth, P., Anttila, S., … Virkkala, R., (2017). How essential biodiversity variables and remote sensing can help national biodiversity monitoring. Global Ecology and Conservation, 10(April), 43–59. doi:10.1016/j.gecco.2017.01.007
43. Woodcock, C. E., Allen, R., Anderson, M., Belward, A., Bindschadler, R., Cohen, W., … Wynne, R., (2008). Free access to Landsat imagery. Science, 320(5879), 1011a. doi:10.1126/science.320.5879.1011a
44. Wulder, M. A., Hilker, T., White, J. C., Coops, N. C., Masek, J. G., Pflugmacher, D., & Crevier, Y., (2015). Virtual constellations for global terrestrial monitoring. Remote Sensing of Environment, 170(December), 62–76. doi:10.1016/j.rse.2015.09.001
45. Wulder, M. A., Masek, J. G., Cohen, W. B., Loveland, T. R., & Woodcock, C. E., (2012). Opening the archive: How free data has enabled the science and monitoring promise of Landsat. Remote Sensing of Environment, 122, 2–10. doi:10.1016/j.rse.2012.01.010
46. Wulder, M. A., White, J. C., Goward, S. N., Masek, J. G., Irons, J. R., Herold, M., … Woodcock, C. E., (2008). Landsat continuity: Issues and opportunities for land cover monitoring. Remote Sensing of Environment, 112(3), 955–969. doi:10.1016/j.rse.2007.07.004
47. Wulder, M. A., White, J. C., Loveland, T. R., Woodcock, C. E., Belward, A. S., Cohen, W. B., … Roy, D. P., (2016). The global Landsat archive: Status, consolidation, and direction. Remote Sensing of Environment, 185, 271–283. doi:10.1016/j.rse.2015.11.032
48. Yang, C., Huang, Q., Li, Z., Liu, K., & Hu, F., (2017). Big data and cloud computing: Innovation opportunities and challenges. International Journal of Digital Earth, 10(1), 13–53. doi:10.1080/17538947.2016.1239771
49. Yang, C., Yu, M., Hu, F., Yongyao, J., & Yun, L., (2017). Utilizing cloud computing to address big geospatial data challenges. Computers, Environment and Urban Systems, Geospatial Cloud Computing and Big Data, 61(January), 120–128. doi:10.1016/j.compenvurbsys.2016.10.010
50. Zhu, Z., Wang, S., & Woodcock, C. E., (2015). Improvement and expansion of the Fmask algorithm: Cloud, cloud shadow, and snow detection for Landsats 4–7, 8, and Sentinel 2 images. Remote Sensing of Environment, 159(March), 269–277. doi:10.1016/j.rse.2014.12.014