User-based skill assessment techniques for operational hydrodynamic forecast systems

Journal of Operational Oceanography

Volumn 3, Issue 2, 2010, Pages 11-24

  Zhang, A ^a   Hess, K W ^a   Aikman, F ^a  

^a NOAA EARTH SYSTEM RESEARCH LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COASTAL ZONE; ESTUARINE DYNAMICS; FORECASTING METHOD; HYDRODYNAMICS; HYDROLOGICAL MODELING; LAKE ECOSYSTEM; MARITIME TRANSPORTATION; NOAA SATELLITE; OPERATIONS TECHNOLOGY; SOFTWARE;

UNITED STATES;

EID: 79956311004     PISSN: 1755876X     EISSN: 17558778     Source Type: Journal    
DOI: 10.1080/1755876X.2010.11020114     Document Type: Article

References (43)

1. Aikman III F, Vincent M and Patchen R. 2007.Development and evolution of operational forecast systems for the coastal and estuarine environment in NOAA’s National Ocean Service. Estuarine and Coastal Modeling, American Society of Civil Engineers, ML. Spaulding (Ed), Proceedings of the 10th International Conference, Newport, RI, November 5-7, 2007, 671-684.
2. Parker BB. 1998. Development of model-based regional nowcasting/forecasting systems. In: Spaulding ML and Blumberg AF (Eds), Estuarine and Coastal Modeling, American Society of Civil Engineers, New York, refereed proceedings of the 5th International Conference, Alexandria, VA, p 355-373.
3. Aikman III F and Rao DB. 1999. A NOAA perspective on a coastal forecast system. Coastal Ocean Prediction. Christopher NK Mooers (ed), American Geophysical Union, Coastal & Estuarine Studies, 56, 467-499.
4. Bosley KT and Hess KW. 2001. Comparison of statistical and model-based hindcasts of subtidal water levels in Chesapeake Bay. Journal of Geophysical Research, Oceans, 106(8), 869-885.
5. Gross TF, Bosley KT and Hess KW. 2000. The Chesapeake Bay Operational Forecast System (CBOFS): Technical Documentation. NOS Technical Report OCS/CO- OPS 1, 69p.
6. Hess KW. 2000. MECCA 2 program documentation. NOAA Technical Report NOS CS 5. 49p.
7. Wei E. 2003. The New Port of New York and New Jersey Operational Forecast System NYOFS. Bulletin of the American Meteorological Society, 84(94), 1184-1186.
8. Wei E and Chen M. 2002. NOS experimental nowcast/forecast system for the Port of New York/New Jersey (NYEFS): Requirements, overview and skill assessment. NOAA Technical Report NOS CS 15, 53p.
9. Blumberg AF and Mellor GL. 1987. A description of a three-dimensional coastal ocean circulation model. Threedimensional coastal ocean models, Heaps (ed), American Geophysical Union, Washington, DC. 1-16.
10. Schmalz RA and Richardson PH. 2002. Evaluation of the NOS experimental nowcast/forecast system for Galveston Bay. NOAA Technical Report NOS CS 14, 107p.
11. Myers E, Aikman III F and Zhang A. 2004. Afore- cast circulation model for the St Johns River, Florida. Proceedings, 8th International Estuarine and Coastal Modeling Conference, ASCE, Malcolm Spaulding (ed), 144-156.
12. Hamrick JM. 1992. A three-dimensional environmental fluid dynamics computational code: Theoretical and computational aspects. Special Rept. 317, The College of William and Mary, Virginia Institute of Marine Sciences, VA.
13. Sucsy PV and Morris FW. 2001. Calibration of a three-dimensional circulation and mixing model of the Lower St Johns River. Technical Memorandum, St Johns River Water Management District, Palatka, Florida, 97p.
14. Schwab DJ and Bedford KW. 1994. Initial implementation of the Great Lakes forecasting system: a real-time system for predicting lake circulation and thermal structure. Water Pollution Research Journal of Canada, 29(2/3), 203-220.
15. Schwab D J and Bedford KW. 1999. The Great Lakes forecasting system. Coastal Ocean Prediction. Christopher NK Mooers (ed), American Geophysical Union, Coastal & Estuarine Studies, 56, 157-173.
16. Zhang Y-L, Baptista AM and Myers EP. 2004. A cross-scale model for 3D baroclinic circulation in estuary- plume-shelf systems: I. Formulation and skill assessment. Continental Shelf Research, 24, 2187-2214.
17. Shchepetkin AF and McWilliams JC. 2004. The regional oceanic modeling system: a split-explicit, free-sur- face, topography-following-coordinate ocean model. Ocean Modelling, 9 (4), 347-404.
18. Haidvogel DP, Arango H, Budgell WP, Cornuell BD, Curchister E, Di Lorenzo E, Fennel K, Geyer WR, Hermann AJ, Lanerolle L, Levin J, McWilliams JC, Miller AJ, Moore AM, Powell TM, Shchepetkin AF, Sherwood CR, Signell RP, Warner JC and Wilkin J. 2008. Ocean forecasting in terrain- following coordinates: Formulation and skill assessment of the regional ocean modeling system. Journal of Computational Physics, 227 (7), 3595-3624.
19. Vincent M, Hess KW and Kelley JG. 2003. NOS procedures for developing and implementing operational nowcast and forecast hydrodynamic model systems. NOAA Technical Report NOS CO-OPS 39, 17 p.
20. ASCE. 2009. Verification and validation of 3D free- surface flow models. Edited by Sam SY Wang et al. American Society of Civil Engineers (ASCE) Environmental and Water Resources Institute (EWRI). 1801 Alexander Bell Drive, Reston, VA 20191-4400.
21. Dee DP. 1995. A pragmatic approach to model validation. In: Lynch DR and Davies AM (eds), Quantitative skill assessment of coastal ocean models, AGU, Washington. p1-13.
22. Refsgaard JC. 2001. Towards a formal approach to calibration and validation of models using spatial data. In: Grayson R and Bloschi G (eds), Spatial patterns in catchment hydrology: Observations and modeling, Cambridge University Press, p329-354.
23. Refsgaard JC and Henriksen HJ. 2004. Modeling guidelines - terminology and guiding principles. Advances in Water Resources, 27(1), 71-82.
24. Vested HJ, Nielson JW, Jensen HR and Kristensen KB. 1995. Skill assessment of an operational hydrodynamic forecast system for the North Sea and Danish Belts. In: Lynch DR and Davies AM (eds), Quantitative Skill Assessment of Coastal Ocean Models, AGU, Washington. p373-396.
25. Wilmott CJ. 1981. On the validation of models. Physical Geography, 2, 184-194.
26. Wilmott CJ, Ackleson SG, Davis RT, Feddema JJ, Klink KM, Legates DR, O’Donnell J and Rowe CM. 1985. Statistics for evaluation and comparison of models. Journal of Geophysical Research, 90, C5, 8995-9005.
27. Warner JC, Geyer WR and Lerczak JA. 2005. Numerical modeling of an estuary: A comprehensive skill assessment. Journal of Geophysical Research, 110(5), C05001.
28. Dingman JS and Bedford KW. 1986. Skill tests and parametric statistics for model evaluation. Journal of Hydraulic Engineering, 112 (2), 124-141.
29. Werner FE. 1995. A field test case for tidally forced flows: a review of the tidal forum. In: Lynch DR and Davies AM (eds), Quantitative Skill Assessment of Coastal Ocean Models, AGU, Washington. p269-283.
30. Robinson AR, Lermusiaux PFJ, Haley Jr PJ and Leslie WG. 2002. Predictive skill, predictive capability and predictability in ocean forecasting. Proc. Oceans 2002 IEEE/MITS Conf, 787-794.
31. Lynch DR, McGillicuddy Jr DJ and Werner FE. 2009. Skill assessment for coupled biological/physical models of marine systems. Journal of Marine Systems, 76, 1-3.
32. Stow CA, Jolliff J, McGillicuddy DJ, Doney SC, Allen JI, Friedrichs MAM, Rose KA and Wallhead P. 2009. Skill assessment for coupled biological/physical models of marine systems. Journal of Marine Systems, 76, 4-15.
33. Gregg WW, Friedrichs MAM, Robinson AR, Rose KA, Schlitzer R, Thompson KR and Doney SC. 2009. Skill assessment in ocean biological data assimilation. Journal Marine Systems, 76, 16-33.
34. Wallhead PJ, Martin AP, Srokosz MA and Franks PJS. 2009. Skill assessment via cross-validation and Monte Carlo simulation: An application to Georges Bank. Journal of Marine Systems, 76, 134-150.
35. Stumpf RP, Tomlinson MC, Calkins JA, Kirkpatrick B, Fisher K, Nierenberg K, Currier R and Wynne TT. 2009. Skill assessment for an operational algal bloom forecast system. Journal of Marine Systems, 76, 151-161.
36. Fitzpatrick JJ. 2009. Assessment skill of estuarine and coastal eutrophication models for water quality managers. Journal of Marine Systems, 76, 195-211.
37. Sheng P and Kim T. 2009. Skill assessment of an integrated modeling system for shallow coastal and estuarine ecosystems. Journal of Marine Systems, 76, 212-243.
38. Williams RG, Bethem TD and Frey HR. 1989. Tampa Bay current prediction quality assurance miniproject. NOAA Technical Memorandum NOS OMA 50, National Ocean Service, Office of Oceanography and Marine Assessment, Rockville, Maryland, 11p.
39. Zhang A, Hess KW, Wei E and Myers E. 2006. Implementation of model skill assessment software for water level and current in tidal regions. NOAA Technical Report, NOS CS 24, 61p.
40. Zervas C. 1999. Tidal current analysis procedures and associated computer programs. NOAA Technical Report NOS CO-OPS 21, 101p.
41. Dennis RE and Long EE. 1971. A user’s guide to a computer program for harmonic analysis of data at tidal frequencies. NOAA Technical Report, NOS 41, 31p.
42. Kelley JGW, Zhang A, Chu P and Lang G. 2008. Skill assessment of NOS Lake Ontario Operational Forecast System (LOOFS). NOAA Technical Memorandum NOS CS 13 40p.
43. Preisendorfer RW. 1988. Principal component analysis in meteorology and oceanography. Developments in Atmospheric Science, v17. Elsevier, Amsterdam. p425.Volume 3 No. 2 2010