Benchmarking homogenization algorithms for monthly data

Climate of the Past

Volumn 8, Issue 1, 2012, Pages 89-115

  Venema, V K C ^a   Mestre, O ^b   Aguilar, E ^c   Auer, I ^d   Guijarro, J A ^e   Domonkos, P ^c   Vertacnik, G ^f   Szentimrey, T ^g   Stepanek, P ^h,i   Zahradnicek, P ^h,i   Viarre, J ^c   Muller Westermeier G ^j   Lakatos, M ^g   Williams, C N ^k   Menne, M J ^k   Lindau, R ^a   Rasol, D ^l   Rustemeier, E ^a   Kolokythas, K ^m   Marinova, T ⁿ   Andresen, L ^o   Acquaotta, F ^p   Fratianni, S ^p   Cheval, S ^q,r   Klancar, M ^f   Brunetti, M ^s   Gruber, C ^d   Prohom Duran, M ^t,u   Likso, T ^l   Esteban, P ^t,v   Brandsma, T ^w   more..

^a UNIVERSITY OF BONN   (Germany)

^b MÉTÉO FRANCE   (France)

^c UNIVERSITAT ROVIRA I VIRGILI   (Spain)

^d ZAMG Zentralanstalt fuer Meteorologie und Geodynamik   (Austria)

^e Agencia Estatal de Meteorologia   (Spain)

^f Environmental Agency of the Republic of Slovenia   (Slovenia)

^g HUNGARIAN METEOROLOGICAL SERVICE   (Hungary)

^h CZECH HYDROMETEOROLOGICAL INSTITUTE   (Czech Republic)

ⁱ Czechglobe Global Change Research Centre AS CR vvi   (Czech Republic)

^j DEUTSCHER WETTERDIENST   (Germany)

^k NOAA NATIONAL CLIMATIC DATA CENTER   (United States)

^l METEOROLOGICAL AND HYDROLOGICAL SERVICE   (Croatia)

^m UNIVERSITY OF PATRAS   (Greece)

ⁿ NATIONAL INSTITUTE OF METEOROLOGY AND HYDROLOGY   (Bulgaria)

^o NORWEGIAN METEOROLOGICAL INSTITUTE   (Norway)

^p UNIVERSITY OF TURIN   (Italy)

^q National Meteorological Administration   (Romania)

^r National Institute for RandD in Environmental Protection   (Romania)

^s INSTITUTE OF ATMOSPHERIC SCIENCES AND CLIMATE   (Italy)

^t UNIVERSITY OF BARCELONA   (Spain)

^u Meteorological Service of Catalonia   (Spain)

^v Institut d'Estudis Andorrans (CENMA/IEA)   (Andorra)

^w ROYAL NETHERLANDS METEOROLOGICAL INSTITUTE KNMI   (Netherlands)

more..

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; BENCHMARKING; DATA INTERPRETATION; DATA SET; ERROR ANALYSIS; HOMOGENEITY; INTEGRATED APPROACH; OUTLIER; PERFORMANCE ASSESSMENT; PRECIPITATION (CLIMATOLOGY); SOFTWARE; STOCHASTICITY; TIME SERIES ANALYSIS;

EID: 84855798694     PISSN: 18149324     EISSN: 18149332     Source Type: Journal    
DOI: 10.5194/cp-8-89-2012     Document Type: Article

References (66)

1. Aguilar, E., Auer, I., Brunet, M., Peterson, T. C., and Wieringa, J.: Guidelines on climate metadata and homogenization. World Meteorological Organization, WMO-TD No. 1186, WCDMP No. 53, Geneva, Switzerland, p. 55, 2003.
2. Alexandersson, A.: A homogeneity test applied to precipitation data, J. Climatol., 6, 661-675, 1986.
3. Alexandersson, H. and Moberg, A.: homogenization of Swedish temperature data.1, Homogeneity test for linear trends, Int. J. Climatol., 17, 25-34, 1997.
4. Auer, I., Böhm, R., Jurkovic, A., Orlik, A., Potzmann, R., Schöner, W., Ungersböck, M., Brunetti, M., Nanni, T., Maugeri, M., Briffa, K., Jones, P., Efthymiadis, D., Mestre, O., Moisselin, J.- M., Begert, M., Brazdil, R., Bochnicek, O., Cegnar, T., Gajic- Capka, M., Zaninovic, K., Majstorovicp, Z., Szalai, S., Szentimrey, T., and Mercalli, L.: A new instrumental precipitation dataset for the Greater Alpine Region for the period 1800-2002, Int. J. Climatol., 25, 139-166, 2005. (Pubitemid 40294921)
5. Auer, I., Böhm, R., Jurkovic, A., Lipa, W., Orlik, A., Potzmann, R., Schöner, W., Ungersböck, M., Matulla, C., Briffa, K., Jones, P., Efthymiadis, D., Brunetti, M., Nanni, T., Maugeri, M., Mercalli, L., Mestre, O., Moisselin, J.-M., Begert, M., Müller- Westermeier, G., Kveton, V., Bochnicek, O., Stastny, P., Lapin, M., Szalai, S., Szentimrey, T., Cegnar, T., Dolinar, M., Gajic- Capka, M., Zaninovic, K., Majstorovicp, Z., and Nieplovaq, E.: HISTALP - Historical Instrumental Climatological Surface Time Series of the Greater Alpine Region, Int. J. Climatol., 27, 17-46, doi:10.1002/joc.1377, 2007. (Pubitemid 46157861)
6. Beaulieu, C., Seidou, O., Ouarda, T. B. M. J., Zhang, X., Boulet, G., and Yagouti, A.: Intercomparison of homogenization techniques for precipitation data, Water Resour. Res., 44, W02425, doi:10.1029/2006WR005615, 2008. (Pubitemid 351442503)
7. Begert, M., Schlegel, T., and Kirchhofer, W.: Homogeneous temperature and precipitation series of Switzerland from 1864 to 2000, Int. J. Climatol., 25, 65-80, 2005. (Pubitemid 40233959)
8. Böhm, R., Auer, I., Brunetti, M., Maugeri, M., Nanni, T., and Schöner, W.: Regional temperature variability in the European Alps 1760-1998 from homogenized instrumental time series, Int. J. Climatol., 21, 1779-1801, 2001. (Pubitemid 34050128)
9. Brunet, M. and Jones, P.: Data rescue initiatives: bringing historical climate data into the 21st century, Clim. Res., 47, 29-40, 2011.
10. Brunet, M., Asin, J., Sigró, J., Banón, M., García, F., Aguilar, E., Esteban Palenzuela, J., Peterson, T. C., and Jones, P.: The minimization of the screen bias from ancient Western Mediterranean air temperature records: an exploratory statistical analysis, Int. J. Climatol., 31, 1879-1895, 2011.
11. Brunetti, M., Maugeri, M., Monti, F., and Nanni, T.: Temperature and precipitation variability in Italy in the last two centuries from homogenized instrumental time series, Int. J. Climatol., 26, 345-381, 2006. (Pubitemid 43355826)
12. Buishand, T. A.: Some methods for testing the homogeneity of rainfall records, J. Hydrol., 58, 11-27, 1982.
13. Caussinus, H. and Mestre, O.: Detection and correction of artificial shifts in climate series, Appl. Statist., 53, 405-425, 2004. (Pubitemid 38882885)
14. Cleveland, W. S. and Devlin, S. J.: Locally weighted regression: An approach to regression analysis by local fitting, J. Am. Stat. Assoc., 83, 596-610, 1998.
15. Conrad, V.: Homogenitätsbestimmung meteorologischer Beobachtungsreihen, Meteorol. Z., 42, 482-485, 1925.
16. Conrad, V.: Methods in climatology, Havard University Press, p. 228, 1944.
17. Conrad, V. and Pollak, C.: Methods in climatology, Harvard University Press, Cambridge, MA, p. 459, 1950.
18. Craddock, J. M.: Methods of comparing annual rainfall records for climatic purposes, Weather, 34, 332-346, 1979.
19. DeGaetano, A. T.: Attributes of several methods for detecting discontinuities in mean temperature series, J. Climate, 19, 838-853, 2006.
20. Della-Marta, P. M., Collins, D., and Braganza, K.: Updating Australia's high quality annual temperature dataset, Austr. Meteor. Mag., 53, 277-292, 2004.
21. Domonkos, P.: Testing of homogenisation methods: purposes, tools and problems of implementation. Proceedings of the 5th Seminar and Quality Control in Climatological Databases, edited by: Lakatos, M., Szentimrey, T., Bihari, Z. and Szalai, S., WCDMPNo. 71, WMO/TD-NO. 1493, 126-145, 2008.
22. Domonkos, P.: Efficiency evaluation for detecting inhomogeneities by objective homogenization methods, Theor. Appl. Climatol., 105, 455-467, doi:10.1007/s00704-011-0399-7, 2011a.
23. Domonkos, P.: Adapted Caussinus-Mestre Algorithm for homogenising Networks of Temperature series (ACMANT), Int. J. Geosci., 2, 293-309, doi:10.4236/ijg.2011.23032, 2011b.
24. Domonkos, P. and Štepánek, P.: Statistical characteristics of detectable inhomogeneities in observed meteorological time series, Stud. Geophys. Geod., 53, 239-260, 2009.
25. Domonkos, P., Poza, R., and Efthymiadis, D.: Newest developments of ACMANT, Adv. Sci. Res., 6, 7-11, doi:10.5194/asr- 6-7-2011, 2011.
26. Ducré-Robitaille, J.-F., Vincent, L. A., and Boulet, G.: Comparison of techniques for detection of discontinuities in temperature series, Int. J. Climatol., 23, 1087-1101, 2003. (Pubitemid 37008062)
27. Easterling, D. R. and Peterson, T. C.: A new method for detecting undocumented discontinuities in climatological time series, Int. J. Climatol., 15, 369-377, 1995.
28. Guijarro, J. A.: User's guide to climatol. An R contributed package for homogenization of climatological series, Report, State Meteorological Agency, Balearic Islands Office, Spain, available at: http://webs.ono.com/climatol/ climatol.html, 2011.
29. Gullett, D. W., Vincent, L., and Sajecki, P. J. F.: Testing for homogeneity in temperature time series at Canadian climate stations. CCC Report No. 90-4, Atmospheric Environment Service, Downsview, Ontario, p. 43, 1990.
30. Hansen, J., Ruedy, R., Sato, M., Imhoff, M., Lawrence, W., Easterling, D. R., Peterson, T. C., and Karl, T. R.: A closer look at United States and global surface temperature change, J. Geophys. Res., 106, 23947-23963, 2001.
31. Heidke, P.: Quantitative Begriffsbestimmung homogener Temperatur- und Niederschlagsreihen, Meteorol. Z., 40, 114-115, 1923.
32. Helmert, F. R.: Die Ausgleichrechnung nach der Methode der kleinsten Quadrate, 2. Auflage, Teubner Verlag, 1907.
33. HOME: Homepage of the COST Action ES0601 - Advances in Homogenisation Methods of Climate Series: an Integrated Approach (HOME), available at: http://www.homogenisation.org, last access: 22 December 2011, 2011.
34. HMS: Hungarian Meteorological Service. Proceedings of the First Seminar for homogenization of Surface Climatological Data, Budapest, Hungary, 6-12 October 1996, p. 44, 1996.
35. IPCC: Climate Change 2007: The physical science basis. Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Solomon, S., Qin, D., Manning, M., Chen, Z., Marquis, M., Averyt, K. B., Tignor, M., and Miller, H. L., Cambridge University Press, Cambridge, United Kingdom, p. 996, 2007.
36. Kohler, M. A.: Double-mass analysis for testing the consistency of records and for making adjustments, B. Am. Meteorol. Soc., 30, 188-189, 1949.
37. Kreil, K.: Mehrjährige Beobachtungen in Wien vom Jahre 1775 bis 1850, Jahrbücher der k.k. Central-Anstalt für Meteorologie und Erdmagnetismus, I. Band - Jg. 1848 und 1849, 35-74, 1854a.
38. Kreil, K.: Mehrjährige Beobachtungen in Mailand vom Jahre 1763 bis 1850, Jahrbücher der k.k. Central-Anstalt für Meteorologie und Erdmagnetismus, I. Band - Jg. 1848 und 1849, 75-114, 1854b.
39. Menne, M. J. and Williams, C. N. Jr.: Detection of undocumented changepoints using multiple test statistics and composite reference series, J. Climate, 18, 4271-4286, 2005. (Pubitemid 41701408)
40. Menne, M. J., Williams, C. N. Jr., and Vose, R. S.: The U.S. historical climatology network monthly temperature data, version 2, B. Am. Meteorol. Soc., 90, 993-1007, doi:10.1175/2008BAMS2613.1, 2009.
41. Menne, M. J., Williams, C. N. Jr., and Palecki M. A.: On the reliability of the US surface temperature record, J. Geophys. Res. Atmos., 115, D11108, doi:10.1029/2009JD013094, 2010.
42. Mestre, O.: Step-by-step procedures for choosing a model with change-points. In Proceedings of the second seminar for homogenisation of surface climatological data, Budapest, Hungary, WCDMP-No.41, WMO-TD No. 962, 15-26,1999.
43. OMSZ: Third Seminar for homogenization and Quality Control in climatological Databases, Budapest, available at: http://omsz. met.hu/omsz.php?almenu id=omsz&pid=seminars&pri=16, last access: 22 December 2011, 2001.
44. Perreault, L., Bernier, J., Bobée, B., and Parent, E.: Bayesian change-point analysis in hydrometeorological time series, Part. 1. The Normal model revisited, J. Hydrol., 235, 221-241, 2000.
45. Peterson, T. C.: Assessment of urban versus rural in situ surface temperatures in the contiguous United States: No difference found, J. Climate, 16, 2941-2959, 2003. (Pubitemid 37358613)
46. Peterson, T. C., Easterling, D. R., Karl, T. R., Groisman, P., Nicholls, N., Plummer, N., Torok, S., Auer, I., Boehm, R., Gullett, D., Vincent, L., Heino, R., Tuomenvirta, H., Mestre, O., Szentimrey, T., Salingeri, J., Førland, E. J., Hanssen-Bauer, I., Alexandersson, H., Jones, P., and Parker, D.: Homogeneity adjustments of in situ atmospheric climate data: A review, Int. J. Climatol., 18, 1493-1517, 1998. (Pubitemid 29122954)
47. Reeves, J., Chen, J., Wang, X. L., Lund, R., and Lu, Q.: A review and comparison of changepoint detection techniques for climate data, J. Appl. Meteorol. Climatol., 46, 900-915, 2007. (Pubitemid 47108795)
48. Rust, H. W., Mestre, O., and Venema, V. K. C.: Less jumps, less memory: homogenized temperature records and long memory, J. Geophys. Res. Atmos., 113, D19110, doi:10.1029/2008JD009919, 2008.
49. Schreiber, T. and Schmitz, A.: Improved surrogate data for nonlinearity tests, Phys. Rev. Lett., 77, 635-638, 1996. (Pubitemid 126624517)
50. Sherwood, S. C., Titchner, H. A., Thorne, P. W., and McCarthy, M. P.: How do we tell which estimates of past climate change are correct?, Int. J. Climatol., 29, 1520-1523, 2009.
51. Sim, S. E., Easterbrook, S., and Holt, R. C.: Using benchmarking to advance research: A challenge to software engineering. Proceedings of the 25th International Conference on Software Engineering ICSE '03, IEEE Computer Society Washington, DC, USA, ISBN: 0-7695-1877-X, 74-83, 2003.
52. Štěpánek, P., Zahradníček, P., and Skalák, P.: Data quality control and homogenization of the air temperature and precipitation series in the Czech Republic in the period 1961-2007, Adv. Sci. Res., 3, 23-26, 2009.
53. Szentimrey, T.: Multiple Analysis of Series for homogenization (MASH). Proceedings of the second seminar for homogenization of surface climatological data, Budapest, Hungary, WMO, WCDMP-No. 41, 27-46, 1999.
54. Szentimrey, T.: Manual of homogenization software MASHv3.02, Hungarian Meteorological Service, p. 65, 2007.
55. Szentimrey, T.: Development of MASH homogenization procedure for daily data. Proceedings of the fifth seminar for homogenization and quality control in climatological databases, Budapest, Hungary, 2006, WCDMP-No. 71, 123-130, 2008.
56. Thorne, P. W., Willett, K. M., Allan, R. J., Bojinski, S., Christy, J. R., Fox, N., Gilbert, S., Jolliffe, I., Kennedy, J. J., Kent, E., Klein Tank, A., Lawrimore, J., Parker, D. E., Rayner, N., Simmons, A., Song, L., Stott, P. A., and Trewin, B.: Guiding the creation of a comprehensive surface temperature resource for 21st century climate science, B. Am. Meteorol. Soc., 92, ES40-ES47, doi:10.1175/2011BAMS3124.1, 2011.
57. Trewin, B.: Exposure, instrumentation, and observing practice effects on land temperature measurements, WIREs Clim. Change, 1, 490-506, doi:10.1002/wcc.46, 2010.
58. Venema, V. K. C., Bachner, S., Rust. H.W., and Simmer, C.: Statistical characteristics of surrogate data based on geophysical measurements, Nonlin. Proc. Geophys., 13, 449-466, 2006a. (Pubitemid 44386618)
59. Venema, V. K. C., Ament, F., and Simmer, C.: A stochastic iterative amplitude adjusted Fourier transform algorithm with improved accuracy, Nonlin. Proc. Geophys., 13, 247-363, 2006b.
60. Venema, V. K. C., Mestre, O., Aguilar, E., Auer, I., Guijarro, J. A., Domonkos, P., Vertacnik, G., Szentimrey, T., Stepanek, P., Zahradnicek, P., Viarre, J., Müller-Westermeier, G., Lakatos, M., Williams, C. N., Menne, M., Lindau, R., Rasol, D., Rustemeier, E., Kolokythas, K., Marinova, T., Andresen, L., Acquaotta, F., Fratianni, S., Cheval, S., Klancar, M., Brunetti, M., Gruber, C., Prohom Duran, M., Likso, T., Esteban, P., and Brandsma, T.: Description of the COST-HOME monthly benchmark dataset and the submitted homogenized contributions. Report, Meteorological Institute, University of Bonn, Germany, available at: http://www2.meteo.uni-bonn.de/venema/ articles/2011/report home.pdf, 2011.
61. Vincent, L. A.: A technique for the identification of inhomogeneities in Canadian temperature series, J. Climate, 11, 1094-1104, 1998. (Pubitemid 28426412)
62. Wang, X. L. L.: Accounting for autocorrelation in detecting meanshifts in climate data series using the penalized maximal t or F test, J. Appl. Meteor. Climatol., 47, 2423-2444, 2008.
63. WMO: Proceedings of the Second Seminar for homogenization of Surface Climatological Data. Budapest, Hungary, 9-13 November 1998, p. 214, 1999.
64. WMO: Fourth Seminar for homogenization and Quality Control in Climatological Databases. Budapest, Hungary, 6-10 October 2003, WCDMP-No 56, WMO-TD No. 1236, p. 243, 2004.
65. WMO: Proceedings of the Fifth Seminar for homogenization and Quality Control in Climatological Databases. Budapest, Hungary, 29 May-2 June 2006. Climate Data and Monitoring WCDMP- No 71, WMO/TD- No. 1493, 2006.
66. WMO: Proceedings of the Sixth Seminar for homogenization and Quality Control in Climatological Databases. Budapest, Hungary, 26-30 2008, edited by: Lakatos, M., Szentimrey, T., Bihari, Z., and Szalai, S., WCDMP-No. 76, WMO/TD-NO. 1576, 2011.