An extended approach for spatiotemporal gapfilling: Dealing with large and systematic gaps in geoscientific datasets

Nonlinear Processes in Geophysics

Volumn 21, Issue 1, 2014, Pages 203-215

  Buttlar, J V ^a   Zscheischler, J ^a,b,c   Mahecha, M D ^a  

^a MAX PLANCK INSTITUTE FOR BIOGEOCHEMISTRY   (Germany)

^b MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^c ETH ZURICH   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY ASSESSMENT; ALGORITHM; DATA SET; EOS; ERROR ANALYSIS; OBSERVATIONAL METHOD; REMOTE SENSING; SATELLITE DATA; SOFTWARE; SPATIOTEMPORAL ANALYSIS; TWO-DIMENSIONAL MODELING;

EID: 84893577794     PISSN: 10235809     EISSN: 16077946     Source Type: Journal    
DOI: 10.5194/npg-21-203-2014     Document Type: Article

References (36)

1. Beckers, J. and Rixen, M.: EOF Calculations and Data Filling from Incomplete Oceanographic Datasets, J. Atmos. Ocean. Technol., 20, 1839-1856, doi:10.1175/1520- 0426(2003)020<1839:ECADFF<2.0.CO;2, 2003. (Pubitemid 38122799)
2. Beer, C., Reichstein, M., Tomelleri, E., Ciais, P., Jung, M., Carvalhais, N., Rodenbeck, C., Arain, M. A., Baldocchi, D., Bonan, G. B., Bondeau, A., Cescatti, A., Lasslop, G., Lindroth, A., Lomas, M., Luyssaert, S., Margolis, H., Oleson, K. W., Roupsard, O., Veenendaal, E., Viovy, N., Williams, C., Woodward, F. I., and Papale, D.: Terrestrial Gross Carbon Dioxide Uptake: global Distribution and Covariation with Climate, Science, 329, 834-838, doi:10.1126/science.1184984, 2010.
3. Broomhead, D. S. and King, G. P.: Extracting Qualitative Dynamics From Experimental data, Physica D, 20, 217-236, doi:10.1016/0167-2789(86)90031-X, 1986.
4. Dempster, A., Laird, N., and Rubin, D.: Maximum Likelihood from Incomplete Data Via the EM Algorithm, J. Royal Stat. Soc. Ser B., 39, 1-38, WOS:A1977DM46400001, 1977.
5. Falge, E., Baldocchi, D., Olson, R., Anthoni, P., Aubinet, M., Bernhofer, C., Burba, G., Ceulemans, R., Clement, R., Dolman, H., Granier, A., Gross, P., Grunwald, T., Hollinger, D., Jensen, N. O., Katul, G., Keronen, P., Kowalski, A., Lai, C. T., Law, B. E., Meyers, T., Moncrieff, H., Moors, E., Munger, J. W., Pilegaard, K., Rannik, U., Rebmann, C., Suyker, A., Tenhunen, J., Tu, K., Verma, S., Vesala, T., Wilson, K., and Wofsy, S.: Gap filling strategies for defensible annual sums of net ecosystem exchange, Agr. Forest Meteorol., 107, 43-69, doi:10.1016/S0168- 1923(00)00225-2, 2001. (Pubitemid 32176659)
6. Garcia, D.: Robust smoothing of gridded data in one and higher dimensions with missing values, Comput. Stat. Data Anal., 54, 1167-1178, doi:10.1016/j.csda.2009.09.020, 2010.
7. Ghil, M., Allen, M. R., Dettinger, M. D., Ide, K., Kondrashov, D., Mann, M. E., Robertson, A.W., Saunders, A., Tian, Y., Varadi, F., and Yiou, P.: Advanced spectral methods for climatic time series, Rev. Geophys., 40, 1003, doi:10.1029/2000RG000092, 2002.
8. Golyandina, N. and Korobeynikov, A.: Basic Singular Spectrum Analysis and forecasting with R, Comput. Stat. Data Anal., doi:10.1016/j.csda.2013.04.009, 2013.
9. Golyandina, N. and Osipov, E.: The "Caterpillar"-SSA method for analysis of time series with missing values, J. Stat. Plann. Infer., 137, 2642-2653, doi:10.1016/j.jspi.2006.05.014, 2007.
10. Golyandina, N. and Usevich, K.: Matrix Methods: Theory, Algorithms, Applications, chap. 2-D-extensions of singular spectrum analysis: algorithm and elements of theory, 450-474, World Scientific Publishing, 2009.
11. Golyandina, N. and Zhigljavsky, A.: Singular spectrum analysis for time series, Springer, available at: http://www.springer.com/statistics/ statistical+theory+and+ methods/book/978-3-642-34912-6 (last access: 19 September 2013), 2013.
12. Hocke, K. and Kämpfer, N.: Gap filling and noise reduction of unevenly sampled data by means of the Lomb-Scargle periodogram, Atmos. Chem. Phys., 9, 4197-4206, doi:10.5194/acp- 9-4197-2009, 2009.
13. Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q., Yen, N., Tung, C. C., and Liu, H. H.: The empirical mode decomposition and the Hilbert spectrum for nonlinear and nonstationary time series analysis, Proc. Royal Soc. London A, 454, 903-995, doi:10.1098/rspa.1998.0193, 1998. (Pubitemid 128733183)
14. Huete, A., Didan, K., Miura, T., Rodriguez, E. P., Gao, X., and Ferreira, L. G.: Overview of the radiometric and biophysical performance of the MODIS vegetation indices, Remote Sens. Environ., 83, 195-213, doi:10.1016/S0034- 4257(02)00096-2, 2002. (Pubitemid 35307469)
15. Janssen, P. H. M. and Heuberger, P. S. C.: Calibration of Processoriented Models, Ecol. Modell., 83, 55-66, doi:10.1016/0304- 3800(95)00084-9, 1995.
16. Justice, C. O., Vermote, E., Townshend, J. R. G., Defries, R., Roy, D. P., Hall, D. K., Salomonson, V. V., Privette, J. L., Riggs, G., Strahler, A., Lucht, W., Myneni, R. B., Knyazikhin, Y., Running, S. W., Nemani, R. R., Wan, Z. M., Huete, A. R., van Leeuwen, W., Wolfe, R. E., Giglio, L., Muller, J. P., Lewis, P., and Barnsley, M. J.: The Moderate Resolution Imaging Spectroradiometer (MODIS): Land remote sensing for global change research, IEEE Trans. Geosci. Remote Sens., 36, 1228-1249, doi:10.1109/36.701075, 1998. (Pubitemid 128748531)
17. Kaplan, A., Kushni, Y., Cane, M., and Blumenthal, M.: Reduced space optimal analysis for historical datasets: 136 years of Atlantic sea surface temperatures, J. Geophys. Res., 102, 27-27, doi:10.1029/97JC01734, 1997.
18. Kondrashov, D. and Ghil, M.: Spatio-temporal filling of missing points in geophysical datasets, Nonlin. Processes Geophys., 13, 151-159, doi:10.5194/npg-13-151-2006, 2006. (Pubitemid 43980712)
19. Liu, Y. Y., Parinussa, R. M., Dorigo, W. A., De Jeu, R. A. M., Wagner, W., van Dijk, A. I. J. M., McCabe, M. F., and Evans, J. P.: Developing an improved soil moisture dataset by blending passive and active microwave satellite-based retrievals, Hydrol. Earth Syst. Sci., 15, 425-436, doi:10.5194/hess-15-425-2011, 2011.
20. Luo, Y. Q., Randerson, J. T., Abramowitz, G., Bacour, C., Blyth, E., Carvalhais, N., Ciais, P., Dalmonech, D., Fisher, J. B., Fisher, R., Friedlingstein, P., Hibbard, K., Hoffman, F., Huntzinger, D., Jones, C. D., Koven, C., Lawrence, D., Li, D. J., Mahecha, M., Niu, S. L., Norby, R., Piao, S. L., Qi, X., Peylin, P., Prentice, I. C., Riley, W., Reichstein, M., Schwalm, C., Wang, Y. P., Xia, J. Y., Zaehle, S., and Zhou, X. H.: A framework for benchmarking land models, Biogeosciences, 9, 3857-3874, doi:10.5194/bg-9-3857- 2012, 2012.
21. Mjolsness, E. and DeCoste, D.: Machine Learning for Science: State of the Art and Future Prospects, Science, 293, 2051-2055, doi:10.1126/science.293. 5537.2051, 2001. (Pubitemid 32848047)
22. Moffat, A. M., Papale, D., Reichstein, M., Hollinger, D. Y., Richardson, A. D., Barr, A. G., Beckstein, C., Braswell, B. H., Churkina, G., Desai, A. R., Falge, E., Gove, J. H., Heimann, M., Hui, D. F., Jarvis, A. J., Kattge, J., Noormets, A., and Stauch, V. J.: Comprehensive comparison of gap-filling techniques for Eddy Covariance net carbon fluxes, Agr. Forest Meteorol., 147, 209-232, doi:10.1016/j.agrformet.2007.08.011, 2007. (Pubitemid 47628782)
23. Musial, J. P., Verstraete, M. M., and Gobron, N.: Technical Note: Comparing the effectiveness of recent algorithms to fill and smooth incomplete and noisy time series, Atmos. Chem. Phy., 11, 7905-7923, doi:10.5194/acp-11- 7905-2011, 2011.
24. Nunes, J., Bouaoune, Y., Delechelle, E., Niang, O., and Bunel, P.: Image analysis by bidimensional empirical mode decomposition, Image Vision Comput., 21, 1019-1026, doi:10.1016/S0262- 8856(03)00094-5, 2003.
25. Overpeck, J. T., Meehl, G. A., Bony, S., and Easterling, D. R.: Climate data challenges in the 21 st century, Science (Washington), 331, 700-702, doi:10.1126/science.1197869, 2011.
26. R Development Core Team: R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, available at: http://www.R-project.org, 2013.
27. Reichstein, M., Bahn, M.and Ciais, P., Frank, D., Mahecha, M. D., Seneviratne, S. I., Zscheischler, J., Beer, C., Buchmann, N., Frank, D. C., Papale, D., Rammig, A., Smith, P., Thonicke, K., van der Velde, M., Vicca, S., Walz, A., and Wattenbach, M.: Climate extremes and the carbon cycle, Nature, 500, 287-295, doi:10.1038/nature12350, 2013.
28. Reynolds, R. W. and Smith, T. M.: Improved Global Sea Surface Temperature Analyses Using Optimum Interpolation, J. Climate, 7, 929-948, doi:10.1175/1520- 0442(1994)007<0929:IGSSTA>2.0.CO;2, 1994.
29. Roerink, G. J., Menenti, M., and Verhoef, W.: Reconstructing cloudfree NDVI composites using Fourier analysis of time series, Int. J. Remote Sens., 21, 1911-1917, doi:10.1080/014311600209814, 2000. (Pubitemid 30325293)
30. Schneider, T.: Analysis of incomplete climate data: Estimation of mean values and covariance matrices and imputation of missing values, J. Climate, 14, 853-871, doi:10.1175/1520- 0442(2001)014<0853:AOICDE>2.0.CO;2, 2001. (Pubitemid 33053219)
31. Schoellhamer, D. H.: Singular Spectrum Analysis for time series with missing data, Geophys. Res. Lett., 28, 3187-3190, doi:10.1029/2000GL012698, 2001. (Pubitemid 32914206)
32. Smith, T. M., Reynolds, R. W., Livezey, R. E., and Stokes, D. C.: Reconstruction of Historical Sea Surface Temperatures Using Empirical Orthogonal Functions, J. Climate, 9, 1403-1420, doi:10.1175/1520-0442(1996)009<1403: ROHSST>2.0.CO;2, 1996.
33. Vautard, R. and Ghil, M.: Singular Spectrum Analysis in nonlinear dynamics, with applications to paleoclimatic time series, Physica D: Nonlinear Phenomena, 35, 395-424, doi:10.1016/0167- 2789(89)90077-8, 1989.
34. Wang, G., Garcia, D., Liu, Y., de Jeu, R., and Johannes Dolman, A.: A three-dimensional gap filling method for large geophysical datasets: Application to global satellite soil moisture observations, Environ. Modell. Softw., 30, 139-142, doi:10.1016/j.envsoft.2011.10.015, 2012.
35. Weedon, G. P., Gomes, S., Viterbo, P., Shuttleworth, W. J., Blyth, E., Österle, H., Adam, J. C., Bellouin, N., Boucher, O., and Best, M.: Creation of the WATCH Forcing Data and Its Use to Assess Global and Regional Reference Crop Evaporation over Land during the Twentieth Century, J. Hydrometeorol., 12, 823-848, doi:10.1175/2011JHM1369.1, 2011.
36. Wu, Z., Schneider, E. K., Kirtman, B. P., Sarachik, E. S., Huang, N. E., and Tucker, C. J.: The modulated annual cycle: an alternative reference frame for climate anomalies, Clim. Dynam., 31, 823-841, doi:10.1007/s00382-008-0437-z, 2010.