The ACCENT-protocol: A framework for benchmarking and model evaluation

Geoscientific Model Development

Volumn 5, Issue 3, 2012, Pages 611-618

  Grewe, V ^a   Moussiopoulos, N ^b   Builtjes, P ^c,d   Borrego, C ^e   Isaksen, I S A ^f   Volz Thomas, A ^g  

^a GERMAN AEROSPACE CENTER DLR   (Germany)

^b ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^c TNO   (Netherlands)

^d FREIE UNIVERSITÄT BERLIN   (Germany)

^e UNIVERSITY OF AVEIRO   (Portugal)

^f CENTER FOR INTERNATIONAL CLIMATE AND ENVIRONMENTAL RESEARCH OSLO CICERO   (Norway)

^g FORSCHUNGSZENTRUM JÜLICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; DATA SET; EUROPEAN UNION; MODEL VALIDATION; NUMERICAL MODEL; QUALITY CONTROL; SENSITIVITY ANALYSIS; UNCERTAINTY ANALYSIS;

EID: 84861130030     PISSN: 1991959X     EISSN: 19919603     Source Type: Journal    
DOI: 10.5194/gmd-5-611-2012     Document Type: Article

References (32)

1. ACCENT (Atmospheric Composition Change the European Network of Excellence): Answers to the Urbino Questions, ACCENTs first policy-driven synthesis, edited by: Raes F. and Hjorth J., published by: ACCENT Secretariat, University Urbino, Italy, ISBN 92-79-02413-2, http://www4.nilu.no/portal/ publications/accent-series-reports, 2006.
2. ACCENT (Atmospheric Composition Change the European Network of Excellence): Editorial, edited by: Fuzzi, S. and Maione, M., Atmos. Environm., 43, 5136-5137, 2009.
3. Aghedo, A. M., Bowman, K. W., Shindell, D. T., and Faluvegi, G.: The impact of orbital sampling, monthly averaging and vertical resolution on climate chemistry model evaluation with satellite observations, Atmos. Chem. Phys., 11, 6493-6514, doi:10.5194/acp-11-6493-2011, 2011.
4. AIAA (American Institute of Aeronautics and Astronautics): Guide for the Verification and Validation of Computational Fluid Dynamics Simulations, American Institute of Aeronautics and Astronautics, AIAA-G-077-1998, Reston, VA, USA, 1998.
5. Braesicke, P. and Pyle, J.: Sensitivity of dynmaics and ozone to different representations of SSTs in the Unified Model, Q. J. Roy. Meteor. Soc., 130, 2033-2045, 2004.
6. Britter, R. and Schatzmann, M.: Model evaluation guidance and protocol document, COST Action 732, 28 pp., ISBN 3-00- 018312-4, Hamburg, Germany, 2007a.
7. Britter, R. and Schatzmann, M.: Background and justification document to support the model evaluation guidance and protocol, COST Action 732, p. 88, ISBN 3-00-018312-4, Hamburg, Germany, 2007b.
8. Burkhardt, U. and Kärcher, B.: Global radiative forcing from contrail cirrus, Nature Climate Change, 1, 54-58, 2011.
9. Crutzen, P. J. and Arnold, F.: Nitric acid cloud formation in the cold Antarctic stratosphere: A major cause for the springtime "ozone hole", Nature, 324, 651-655, 1986.
10. Douglass, A. R., Prather, M. J., Hall, T. M., Strahan, S. E., Rasch, P. J., Sparling, L. C., Coy, L., and Rodriguez, J. M.: Choosing meteorological input for the global modeling initiative assessment of high-speed aircraft, J. Geophys. Res., 104, 27545-27564, 1999.
11. Garny, H., Dameris, M., and Stenke, A.: Impact of prescribed SSTs on climatologies and long-term trends in CCM simulations, Atmos. Chem. Phys., 9, 6017-6031, doi:10.5194/acp-9-6017-2009, 2009.
12. Grewe, V.: Impact of climate variability on tropospheric ozone, Sci. Total Environ., 374, 167-181, 2007.
13. Grewe, V. and Sausen, R.: Comment on "Quantitative performance metrics for stratospheric-resolving chemistry-climate models" by Waugh and Eyring (2008), Atmos. Chem. Phys., 9, 9101- 9110, doi:10.5194/acp-9-9101-2009, 2009.
14. x emissions. Part 1: Interactively coupled climatechemistry simulations and sensitivities to climate-chemistry feedback, lightning and model resolution, Meteorol. Z., 3, 177-186, 2002.
15. Jöckel, P., Kerkweg, A., Pozzer, A., Sander, R., Tost, H., Riede, H., Baumgaertner, A., Gromov, S., and Kern, B.: Development cycle 2 of the Modular Earth Submodel System (MESSy2), Geosci. Model Dev., 3, 717-752, doi:10.5194/gmd-3-717-2010, 2010.
16. Kawa, S. R., Anderson, J. G., Baughcum, S. L., Brock, C. A., Brune, W. H., Cohen, R. C., Kinnison, D. E., Newman, P. A., Rodriguez, J. M., Stolarski, R. S., Waugh, D., and Wofsy, S. C.: Assessment of the Effects of High-Speed Aircraft in the Stratosphere: 1998, NASA-Report, NASA/TP-1999-209237, 1999.
17. Lary, D. J. and Aulov, O.: Space-based measurements of HCl: Intercomparison and historical context, J. Geophys. Res., 113, D15S04, doi:10.1029/2007JD008715, 2008.
18. Lee, D. S., Pitari, ,G., Grewe, V., Gierens, K., Penner, J. E., Petzold, A., Prather, M. J., Schumann, U., Bais, A., Berntsen, T., Iachetti, D., Lim, L. L., and Sausen, R.: Transport impacts on atmosphere and climate: Aviation, Atmos. Environm. 44, 4678-4734, 2010.
19. Moussiopoulos, N. and Isaksen, I.: Proceedings of the Workshop on Model Benchmarking and Quality Assurance, ACCENT Series Reports 2.2007, 60 p., http: //www4.nilu.no/farcry accent/download.cfm?DownloadFile= 3DCD0697-17A4-8DB2- 8C63CCDF7478BCB6, 2007.
20. Park, J. H., Ko, M. K. W., Jackman, C. H., Plumb, R. A., Kaye, J. A., and Sage, K. H.: M&M-2, NASA: Models and Measurements Intercomparison II. TM-1999-209554, 502 pp., 1999.
21. Parrish, D. D., Millet, D. B., and Goldstein, A. H.: Increasing ozone in marine boundary layer inflow at the west coasts of North America and Europe, Atmos. Chem. Phys., 9, 1303-1323, doi:10.5194/acp-9-1303-2009, 2009.
22. Penner, J. E., Lister, D. H., Griggs, D. J., Dokken, D. J., and McFarland, M.: Aviation and the Global Atmosphere. A special report of IPCC Working Groups I and III, 373, Cambridge Univ. Press, Cambridge, UK, 1999.
23. 2 from GOME measurements, Adv. Space Res., 29, 1673-1683, 2002.
24. Russell III, J. M., Gordley, L. L., Park, J. H., Drayson, S. R., Hesketh, D. H., Cicerone, R. J., Tuck, A. F., Frederick, J. E., Harries, J. E., and Crutzen, P.: The Halogen Occultation Experiment, J. Geophys. Res., 98, 10777-10797, 1993.
25. Saltelli, A., Chan, K., and Scott, E. M.: Sensitivity Analysis, John Wiley & Sons, Chichester, New York, 2000.
26. Schlesinger, S., Crosbie, R. E., Gagńne, R. E., Innis, G. S., Lalwani, C. S., Loch, J., Sylvester, R. J., Wright, R. D., Kheir, N., and Bartos, D.: Terminology for Model Credibility, Simulation, 32, 103-104, 1979.
27. Stevenson, D. S., Dentener, F. J., Schultz, M. G., Ellingsen, K., van Noije, T. P. C., Wild, O., Zeng, G., Amann, M., Atherton, C. S., Bell, N., Bergmann, D. J., Bey, I., Butler, T., Cofala, J., Collins, W. J., Derwent, R. G., Doherty, R. M., Drevet, J., Eskes, H. J., Fiore, A. M., Gauss, M., Hauglustaine, D. A., Horowitz, L. W., Isaksen, I. S. A., Krol, M. C., Lamarque, J.-F., Lawrence,M. G., Montanaro, V.,Müller, J.-F., Pitari, G., Prather, M. J., Pyle, J. A., Rast, S., Rodriguez, J. M., Sanderson, M. G., Savage, N. H., Shindell, D. T., Strahan, S. E., Sudo, K., and Szopa, S.: Multimodel ensemble simulations of present-day and near-future tropospheric ozone, J. Geophys. Res., 111, D08301, doi:10.1029/2005JD006338, 2006.
28. SPARC Report on the Evaluation of Chemistry-Climate Models: SPARC Report No. 5, edited by: Eyring, V., Shepherd, T. G., and Waugh, D. W., WCRP-132, WMO/TD-No. 1526, http://www. atmosp.physics.utoronto.ca/SPARC, 2010.
29. Taylor, K. E.: Summarizing multiple aspects of model performance in a single diagram, J. Geophys. Res., 106, 7183-7192, 2001.
30. 2 compared with GOME retrievals for the year 2000, Atmos. Chem. Phys., 6, 2943-2979, doi:10.5194/acp-6- 2943-2006, 2006.
31. Waugh, D. W. and Eyring, V.: Quantitative performance metrics for stratospheric-resolving chemistry-climate models, Atmos. Chem. Phys., 8, 5699-5713, doi:10.5194/acp-8-5699-2008, 2008.
32. WMO: Scientific assessment of ozone depletion: 2010, World Meteorological Organisation, Geneva, 2011.