A tool to evaluate air quality model performances in regulatory applications

Environmental Modelling and Software

Volumn 38, Issue , 2012, Pages 220-230

  Thunis, Philippe ^a   Georgieva, Emilia ^a   Pederzoli, Anna ^a  

^a UNIVERSITY OF BRESCIA   (Italy)

Author keywords

Air quality modelling; Benchmarking; Model evaluation; Performance

Indexed keywords

AIR QUALITY MODELLING; AIR QUALITY MODELS; BENCHMARKING SERVICES; CORRELATION COEFFICIENT; MODEL APPLICATION; MODEL EVALUATION; MODEL PERFORMANCE; MODEL RESULTS; PERFORMANCE; PERFORMANCE INDICATORS; REGULATORY APPLICATIONS; SUMMARY STATISTIC;

AIR QUALITY; QUALITY ASSURANCE; TIME SERIES;

BENCHMARKING;

AIR QUALITY; ATMOSPHERIC MODELING; MODEL VALIDATION; PERFORMANCE ASSESSMENT; REGULATORY APPROACH; SOFTWARE; TIME SERIES;

EUROPE;

EID: 84864028044     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2012.06.005     Document Type: Article

References (32)

1. Alexandrov G.A., Ames D., Bellocchi G., Bruen Michael, Crout N., Erechtchoukova M., Hildebrandt A., Hoffman F., Jackisch C., Khaiter P., Mannina G., Matsunaga T., Purucker S.T., Rivington M., Samaniego L. Technical assessment and evaluation of environmental models and software: letter to the Editor. Environmental Modelling and Software 2011, 26(3):328-336.
2. Appel K.W., Gilliam R.C., Davis N., Zubrow A. Overview of the atmospheric model evaluation tool (AMET) v1.1 for evaluating meteorological and air quality models. Environmental Modelling and Software 2011, 26(4).
3. AQD Directive 2008/50/EC of the European Parliament 2008, Available at:. http://ec.europa.eu/environment/air/quality/legislation/directive.htm.
4. ASTM Standard Standard Guide for Statistical Evaluation of Atmospheric Dispersion Model Performance 2005, ASTM International, West Conshohocken, PA. http://www.astm.org, 10.1520/D6589-05.
5. Boylan J., Russel A. PM and light extinction model performance metrics, goals, and criteria for three-dimensional air quality models. Atmospheric Environment 2006, 40:4946-4959.
6. Carnevale C., Finzi G., Guariso G., Pisoni E., Volta M. Design and validation of a multiphase 3D model to simulate tropospheric pollution. Science of the Total Environment 2008, 390:166-176.
7. Carslaw D.C., Ropkins K. Openair - an R package for air quality data analysis. Environmental Modelling and Software 2011, 10.1016/j.envsoft.2011.09.008.
8. Chang J.C., Hanna S.R. Air quality model performance evaluation. Meteorology and Atmospheric Physics 2004, 87:167-196.
9. Chemel C., Sokhi R.S., Yu Y., Hayman G.D., Vincent K.J., Dore A.J., Tang Y.S., Prain H.D., Fisher B.E.A. Atmospheric Environment August 2010, 44(24):2927-2939.
10. Cuvelier C., Thunis P., Vautard R., Amann M., Bessagnet B., Bedogni M., Berkowicz R., Brandt J., Brocheton F., Builtjes P., Carnavale C., Coppalle A., Denby B., Douros J., Graf A., Hellmuth O., Hodzic A., Honoré C., Jonson J., Kerschbaumer A., et al. CityDelta: a model intercomparison study to explore the impact of emission reductions in European cities in 2010. Atmospheric Environment 2007, 41(1):189-207.
11. Denby B., et al. Guidance on the Use of Models for the European Air Quality Directive (A FAIRMODE working Document) 2010, ETC/ACC report, ver 6.2. http://fairmode.ew.eea.europa.eu/.
12. Dennis R., Fox T., Fuentes M., Gilliland A., Hanna S., Hogrefe C., Irwin J., Rao S.T., Scheffe R., Schere K., Steyn D., Venkatram A. A framework for evaluating regional-scale numerical photochemical modeling systems. Environmental Fluid Mechanics 2010, 10.1007/s10652-009-9163-2.
13. Derwent D., Fraser A., Abbott J., Jenkin M., Willis P., Murrells T. Evaluating the Performance of Air Quality Models, DEFRA Report 2010, Issue 3/June 2010. http://www.airquality.co.uk/reports/cat05/1006241607_100608_MIP_Final_Version.pdf.
14. Emery C., Tai E., Yarwood G. Enhanced Meteorological Modeling and Performance Evaluation for Two Texas Ozone Episodes 2001, Report to the Texas Natural Resources Conservation Commission, prepared by ENVIRON, International Corp, Novato, CA.
15. Galmarini S., Bianconi R., Klug W., Mikkelsen T., Addis R., Andronopoulos S., Astrup P., Baklanov A., Bartniki J., Bartzis J.C., Bellasio R., Bompay F., Buckley R., Bouzom M., Champion H., D'Amours R., Davakis E., Eleveld H., Geertsema G.T., Glaab H., Kollax M., Ilvonen M., Manning A., Pechinger U., Persson C., Polreich E., Potemski S., Prodanova M., Saltbones J., Slaper H., Sofiev M.A., Syrakov D., Sørensen J.H., Van der Auwera L., Valkama I., Zelazny R. Ensemble dispersion forecasting, Part 1: concept, approach and indicators. Atmospheric Environment 2004, 38(28):4607-4617.
16. Galmarini S., Bianconi R., Klug W., Mikkelsen T., Addis R., Andronopoulos S., Astrup P., Baklanov A., Bartniki J., Bartzis J.C., Bellasio R., Bompay F., Buckley R., Bouzom M., Champion H., D'Amours R., Davakis E., Eleveld H., Geertsema G.T., Glaab H., Kollax M., Ilvonen M., Manning A., Pechinger U., Persson C., Polreich E., Potemski S., Prodanova M., Saltbones J., Slaper H., Sofiev M.A., Syrakov D., Sørensen J.H., Van der Auwera L., Galmarini S., Bianconi R., de Vries G., Bellasio R. Real-time monitoring data for real-time multi-model validation: coupling ENSEMBLE and EURDEP. Journal of Environmental Radioactivity 2008, 99:1233-1241.
17. Irwin J.S., Civerolo K., Hogrefe C., Appel W., Foley K., Swall J. A procedure for inter-comparing the skill of regional-scale air quality model simulations of daily maximum 8- hour ozone concentrations. Atmospheric Environment 2008, 42:5403-5412.
18. Jakeman A.J., Letcher R.A., Norton J.P. Ten iterative steps in development and evaluation of environmental models. Environmental Modelling and Software 2006, 21:602-614.
19. Jolliff J.K., Stow C.A., McGillicuddy D.J., Doney S.C., Allen J.I., Rose K.A., Wallhead P. Skill assessment for coupled biological/physical models of marine systems. Journal of Marine Systems 2009, 76:4-15.
20. Olesen H.R., 2005. User's Guide to the Model Validation Kit. Research Note No. 226. 72 pp.
21. Pederzoli, A., Thunis, P., Georgieva, E., Borge, R., Carruthers, D., 2011. Performance criteria for the benchmarking of air quality model regulatory applications: the " Target" approach. Proceedings of the 14th International Conference on Harmonisation within Atmospheric Dispersion Modelling for Regulatory Purposes, Kos Island, Greece, October 2011.
22. Pernigotti D., Georgieva E., Thunis P., Cuvelier C., de Meij A. The impact of meteorology on air quality simulations over the Po Valley in Northern Italy. Air Pollution Modeling and Its Application XXI NATO Science for Peace and Security Series C: Environmental Security, 2012 2010, vol. 4:485-490. Springer, (Part 4). 10.1007/978-94-007-1359-8_81.
23. Piuleac C.G., Rodrigo M.A., Canizares P., Curteanu S., Saez C. Ten steps modeling of electrolysis processes by using neural networks. Environmental Modelling and Software 2010, 25:74-81.
24. Stern J., Flemming R. Formulation of Criteria to be Used for the Determination of the Accuracy of Model Calculations According to the Requirements of the EU Directives for Air Quality - Examples Using the Chemical Transport Model REM-CALGRID 2004, Freie Universität Berlin, Institut für Meteorologie.
25. Taylor K.E. Summarizing multiple aspects of model performance in a single diagram. Journal of Geophysical Research 2001, 106(D7):7183-7192.
26. Tesche T.W., Morris R., Tonnesenc G., McNallya D., Boylan D., Brewere P. CMAQ/CAMx annual 2002 performance evaluation over the eastern US. Atmospheric Environment 2006, 40:4906-4919.
27. Thunis P., Rouil L., Cuvelier C., Stern R., Kerschbaumer A., Bessagnet B., Schaap M., Builtjes P., Tarrason L., Douros J., Moussiopoulos N., Pirovano G., Bedogni M. Analysis of model responses to emission-reduction scenarios within the CityDelta project. Atmospheric Environment January 2007, 41(1):208-220.
28. Thunis P., Triacchini1 G., White L., Maffeis G., Volta M. Air pollution and emission reductions over the Po-valley. Air Quality Modelling and Integrated Assessment, 18th world IMACS Congress and MODSIM09 International Congress on Modeling and Simulation 2009, 2335-2341. Interfacing Modeling and Simulation with Mathematical and Computational Sciences.
29. Thunis P., Georgieva E., Galmarini S. A Procedure for Air Quality Models Benchmarking 2010, http://fairmode.ew.eea.europa.eu/fol404948/WG2_SG4_benchmarking_V1.pdf.
30. Thunis P., Georgieva E., Pederzoli A. The DELTA Tool and Benchmarking Report Template 2010, Concepts and User guide, version 2. Available at:. http://aqm.jrc.it/DELTA/data/DELTA_SG4_V2.pdf.
31. US-EPA Guidance on the Development, Evaluation and Application of Environmental Models, EPA/100/K-09/003 March 2009, http://www.epa.gov/crem/library/cred_guidance_0309.pdf.
32. Willmott C.J., Ackleson S.G., Davis R.E., Feddema J.J., Klink K.M., Legates D.R., O'Donnell J., Rowe C.M. Statistics for the evaluation and comparison of models. Journal of Geophysical Research September 20, 1985, 90(C5):8995-9005.