Air quality model performance evaluation

Meteorology and Atmospheric Physics

Volumn 87, Issue 1-3, 2004, Pages 167-196

  Chang, J C ^a   Hanna, S R ^a  

^a George Mason University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AEROSOL; AIR QUALITY; ATMOSPHERIC POLLUTION; NUMERICAL MODEL; PERFORMANCE ASSESSMENT;

EID: 3342987585     PISSN: 01777971     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00703-003-0070-7     Document Type: Article

References (59)

1. Allwine KJ, Shinn JH, Streit GE, Clawson KL, Brown M (2002) Overview of Urban 2000. Bull Am Meteor Soc 83(4): 521-536
2. Anthes RA, Kuo Y-H, Hsie E-Y, Low-Nam S, Bettge TW (1989) Estimation of skill and uncertainty in regional numerical models. Quart J Royal Meteor Soc 115: 763-806
3. ASTM (2000) Standard guide for statistical evaluation of atmospheric dispersion model performance. American Society for Testing and Materials, Designation D 658900. ASTM, 100 Barr Harbor Drive, West Conshohocken, PA 19428-2959
4. Beck MB, Ravetz JR, Mulkey LA, Barnwell TO (1997) On the problem of model validation for predictive exposure assessments. Stoch Hydrol Hydraulics 11: 229-254
5. Britter RE, Hanna SR (2003) Flow and dispersion in urban areas. Ann Rev Fluid Mech 35: 469-496
6. Chang JC (2002) Methodologies for evaluating performance and assessing uncertainty of atmospheric dispersion models. Ph.D. thesis, George Mason University, Fairfax, 277 pp. Available from: www.lib.umi.com/dissertations/search. The abstract can be seen by selecting "Pub Number (PN)" from the first pull-down menu and entering 3068631. The full document can be ordered on-line at $34 per unbound copy
7. Chang JC, Franzese P, Chayantrakom K, Hanna SR (2003) Evaluations of CALPUFF, HPAC, and VLSTRACK with two mesoscale field data sets. J Appl Meteor 42: 453-466
8. Cullen AC, Frey HC (1998) Probabilistic techniques in exposure assessment: A handbook for addressing variability and uncertainty in models and inputs. Plenum, 352 pp
9. Efron B (1987) Better bootstrap confidence intervals. J Am Stat Assoc 82: 171-185
10. Efron B, Tibshirani RJ (1993) An introduction to bootstrap. Monographs on Statistics and Applied Probability, vol. 57. New York: Chapman & Hall, 436 pp
11. EPA (1999) User Manual for the EPA Third-Generation Air Quality Modeling System (Models-3 Version 3.0). Office of Research and Development, U.S. Environmental Protection Agency, Washington, D.C. 20460. EPA-600/R-99/055. Report available from: www.epa.gov/ asmdnerl/models3/doc/user/user.html
12. EPA (2002) Example application of modeling toxic air pollutants in an urban area. EPA-454/R-02-003, OAQPS/EPA, RTP, NC 27711, www.epa.gov/scram001/ tt25htm#toxics (91pages + appendix)
13. Fox DG (1984) Uncertainty in air quality modeling. B Amer Meteor Soc 65: 27-36
14. Gates WL, Boyle JS, Covey C, Dease CG, Doutriaux CM, Drach RS, Fiorino M, Gleckler PJ, Hnilo JJ, Marlais SM, Phillips TJ, Potter GL, Santer BD, Sperber KR, Taylor KE, Williams DN (1999) An overview of the results of the Atmospheric Model Intercomparison Project (AMIP I). Bull Amer Meteor Soc 80: 29-55
15. Grell GA, Dudhia J, Stauffer DR (1994) A description of the Fifth-Generation Penn State/NCAR mesoscale model (MM5). NCAR Tech. Note NCAR/TN 398 + STR, 138 pp. Available from NCAR, P.O. Box 3000, Boulder, CO 80307
16. Hamill TM, Mullen SL, Snyder C, Toth Z, Baumhefner DP (2000) Ensemble forecasting in the short to medium range: Report from a workshop. Bull Amer Meteor Soc 81: 2653-2664
17. Hanna SR (1988) Air quality model evaluation and uncertainty. J Air Poll Control Assoc 38: 406-412
18. Hanna SR (1989) Confidence limits for air quality model evaluations as estimated by bootstrap and jackknife resampling methods. Atmos Environ 23: 1385-1398
19. Hanna SR (1993) Uncertainties in air quality model predictions. Bound Layer Meteorol 62: 3-20
20. Hanna SR, Britter RE, Franzese P (2003) A baseline urban dispersion model evaluated with Salt Lake City and Los Angeles Tracer data. Atmos Environ (submitted)
21. Hanna SR, Chang JC, Strimaitis DG (1993) Hazardous gas model evaluation with field observations. Atmos Environ 27A: 2265-2285
22. Hanna SR, Egan BA, Purdum J, Wagler J (2000) Evaluation of the ADMS, AERMOD, and ISC3 Dispersion Models with the Kincaid, Indianapolis, Lovett, Sweeny, and Duke Forest Field Data Sets. Int J Environ Poll
23. Hanna SR, Strimaitis DG, Chang JC (1991) Hazard response modeling uncertainty (A quantitative method), vol. I: User's guide for software for evaluating hazardous gas dispersion models; vol. II: Evaluation of commonly-used hazardous gas dispersion models; vol. III: Components of uncertainty in hazardous gas dispersion models. Report no. A119/A120, prepared by Earth Tech, Inc., 196 Baker Avenue, Concord, MA 01742, for Engineering and Services Laboratory, Air Force Engineering and Services Center, Tyndall Air Force Base, FL 32403; and for American Petroleum Institute, 1220 L Street, N.W., Washington, D.C., 20005
24. Hanna SR, Yang R (2001) Evaluations of mesoscale model predictions of near-surface winds, temperature gradients, and mixing depths. J Appl Meteor 40: 1095-1104
25. Hanna SR, Davis JM (2002) Evaluation of a photochemical grid model using estimates of concentration probability density functions. Atmos Environ 36: 1793-1798
26. Helton JC (1997) Uncertainty and sensitivity analysis in the presence of stochastic and subjective uncertainty. J Stat Comp Simul 1997: 3-76
27. Hodur RM (1997) The Naval Research Laboratory's Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS). Mon Wea Rev 125: 1414-1430
28. Ichikawa Y, Sada K (2002) An atmospheric dispersion model for the environmental impact assessment of thermal power plants in Japan - A method for evaluating topographical effects. J Air Waste Manage Assoc 52: 313-323
29. Klug W, Graziani G, Grippa G, Pierce D, Tassone C (1992) Evaluation of long range atmospheric transport models using environmental radioactivity data from the chernobyl accident. The ATMES Report. Elsevier Science Publishing
30. Lewellen WS, Sykes RI, Parker SF (1985) An evaluation technique which uses the prediction of both concentration mean and variance. Proc. DOE/AMS Air Pollution Model Evaluation Workshop, Savannah River Lab. Report No. DP-1701-1, Section 2, 24 pp
31. Lewellen WS, Sykes RI (1986) Analysis of concentration fluctuations from lidar observations of atmospheric plumes. J Clim Appl Meteor 25: 1145-1154
32. Lewellen WS, Sykes RI (1989) Meteorological data needs for modeling air quality uncertainties. J Ocean Atmos Tech 6: 759-768
33. Lorenz E (1963) Deterministic nonperiodic flow. J Atmos Sci 20: 130-141
34. Lumley JL, Panofsky HA (1964) The structure of atmospheric turbulence. New York: Wiley Interscience, 239 pp
35. McNally D, Tesche TW (1993) MAPS sample products. Alpine Geophysics, 16225 W. 74th Dr., Golden, CO 80403
36. Morgan MG, Henrion M (1990) Uncertainty. A guide to dealing with uncertainty in quantitative risk and policy analysis (with a chapter from M. Small). Cambridge University Press, 332 pp
37. Mosca S, Graziani G, Klug W, Bellasio R, Bianconi R (1998) A statistical methodology for the evaluation of long-range dispersion models: an application to the ETEX exercise. Atmos Environ 24: 4307-4324
38. Nappo CJ, Essa KSM (2001) Modeling dispersion from near-surface tracer releases at Cape Canaveral, FL. Atmos Environ 35: 3999-4010
39. Nasstrom JS, Sugiyama G, Ermak D, Leone JM Jr (2000) A real-time atmospheric dispersion modeling system. Proc. 11th Joint Conf. on the Application of Air Pollution Meteorology with the A&WMA, Amer Meteor Soc, Boston, MA
40. Olesen HR (2001) Ten years of harmonization activities: past, present, and future. 7th Int. Conf. on Harmonisation within Atmospheric Dispersion Modelling for Regulatory Purposes, Belgirate, Italy. National Environmental Research Institute, Roskilde, Denmark (www.harmo.org )
41. Oreskes N, Shrader-Frechette K, Belitz K (1994) Verification, validation, and confirmation of numerical models in the earth sciences. Science 263: 641-646
42. Paine RJ, Lee RF, Brode R, Wilson RB, Cimorelli AJ, Perry SG, Weil JC, Venkatram A, Peters WD (1998) Model evaluation results for AERMOD. USEPA, RTP. NC 27711
43. Pielke RA (2002) Mesoscale meteorological modeling, 2nd ed. Academic Press, 676 pp
44. Pielke RA, Pearce RP (1994) Mesoscale modeling of the atmosphere. Meteorological Monographs No. 47. Amer Meteor Soc, Boston, MA, 167 pp
45. Saltelli A, Chan K, Scott EM (2000) Sensitivity analysis. Wiley, 475 pp
46. Seaman NL (2000) Meteorological modeling for air quality assessments. Atmos Environ 34: 2231-2259
47. Seigneur C, Pun B, Pai P, Louis J-F, Solomon P, Emery C, Morris R, Zahniser M, Worsnop D, Koutrakis P, White W, Tombach I (2000) Guidance for the performance evaluation of three-dimensional air quality modeling systems for particulate matter and visibility. J Air Waste Manage Assoc 50: 588-599
48. Sykes RI (1984) The variance in time-averaged samples from an intermittent plume. Atmos Environ 18: 121-123
49. Sykes RI (2002) The use of concentration fluctuation variance predictions in model evaluation. Proc. 12th Joint Conf. on the Applications of Air Pollution Meteorology with A&WMA, 20-24 May 2002, Norfolk, VA, Amer Meteor Soc, Boston, MA
50. Sykes RI, Parker SF, Henn DS, Cerasoli CP, Santos LP (1998) PC-SCIPUFF Version 1.2PD, Technical Documentation. Titan Corporation, Titan Research and Technology Division, ARAP Group, P.O. Box 2229, Princeton, NJ 08543-2229, 172 pp
51. Taylor KE (2001) Summarizing multiple aspects of model performance in a single diagram. J Geophys Res 106(D7): 7183-7192
52. Venkatram A (1979) The expected deviation of observed concentrations from predicted ensemble means. Atmos Environ 13: 1547-1549
53. Venkatram A (1984) The uncertainty in estimating dispersion in the convective boundary layer. Atmos Environ 18: 307-310
54. Venkatram A (1988) Topics in applied dispersion modeling. Lectures on Air Pollution Modeling, chap. 6. Amer Meteor Soc, Boston, MA, 390 pp
55. Warner S, Platt N, Heagy JF, Bradley S, Bieberbach G, Sugiyama G, Nasstrom JS, Foster KT, Larson D (2001) User-oriented measures of effectiveness for the evaluation of transport and dispersion models. Institute for Defense Analyses, IDA Paper P-3554, 815 pp. IDA, 1801 N. Beauregard Street, Alexandria, VA 22311-1772
56. Weil JC, Sykes RI, Venkatram A (1992) Evaluating air-quality models: review and outlook. J Appl Meteor 31: 1121-1145
57. Wilks DS (1995) Statistical methods in the atmospheric sciences. New York: Academic Press, 467 pp
58. Willmott CJ (1982) Some comments on the evaluation of model performance. Bull Amer Meteor Soc 63: 1309-1313
59. Wilson DJ (1995) Concentration fluctuations and averaging times in vapor clouds. American Institute of Chemical Engineers, 345 East 47th Street, New York, NY 10017, 208 pp