The definition of 'truth' for Numerical Weather Prediction error statistics

Quarterly Journal of the Royal Meteorological Society

Volumn 137, Issue 654, 2011, Pages 84-98

  Frehlich, Rod ^a  

^a UNIVERSITY OF COLORADO   (United States)

Author keywords

Data assimilation; Ensemble forecasts; Observation sampling error; Observations

Indexed keywords

ASSIMILATION ALGORITHMS; ATMOSPHERIC VARIABLES; ATMOSPHERIC VARIATIONS; DATA ASSIMILATION; DIRECT MEASUREMENT; ENSEMBLE AVERAGES; ENSEMBLE DATA ASSIMILATION; ENSEMBLE FORECASTS; IMPRECISE KNOWLEDGE; INFINITE NUMBERS; KALMAN-FILTERING; LINEAR AVERAGES; MAXIMUM LIKELIHOOD METHODS; MINIMUM MEAN-SQUARE-ERROR; NUMERICAL WEATHER PREDICTION; NWP MODEL; OBSERVATION ERRORS; OBSERVATION SAMPLING ERROR; OBSERVATIONS; OBSERVING SYSTEMS; RANDOM FLUCTUATION; SAMPLING ERRORS; SAMPLING FUNCTIONS; SPATIAL FILTERS; SPATIAL STATISTICS; SPATIAL VARIATIONS; TURBULENCE FIELDS; TURBULENCE STATISTICS; TURBULENT FIELDS; VARIATIONAL DATA ASSIMILATION;

ALGORITHMS; ATMOSPHERIC THERMODYNAMICS; ATMOSPHERIC TURBULENCE; CONVOLUTION; DATA PROCESSING; MAXIMUM LIKELIHOOD; SAMPLING; WEATHER FORECASTING;

ERROR STATISTICS;

ALGORITHM; CLIMATE MODELING; COMPUTER SIMULATION; DATA ASSIMILATION; ENSEMBLE FORECASTING; ERROR ANALYSIS; KALMAN FILTER; MAXIMUM LIKELIHOOD ANALYSIS; NUMERICAL MODEL; OBSERVATIONAL METHOD; SPATIAL VARIATION; WEATHER FORECASTING;

EID: 79251477597     PISSN: 00359009     EISSN: 1477870X     Source Type: Journal    
DOI: 10.1002/qj.738     Document Type: Article

References (108)

1. Anderson JL. 2001. An ensemble adjustment Kalman filter for data assimilation. Mon. Weather Rev. 129: 2884-2903.
2. Anderson JL. 2007. An adaptive covariance inflation error correction algorithm for ensemble filters. Tellus 59A: 210-224.
3. Atlas R. 1997. Atmospheric observations and experiments to assess their usefulness in data assimilation. J. Meteorol. Soc. Jpn 75: 111-130.
4. Baker WE, Emmitt GD, Robertson P, Atlas RM, Molinari JE, Bowdle DA, Paegle J, Hardesty RM, Menzies RT, Krishnamurti TN, Brown RA, Post MJ, Anderson JR, Lorenc AC, Miller TL, McElroy J. 1995. Lidar measured winds from space: an essential component for weather and climate prediction. Bull. Am. Meteorol. Soc. 76: 869-888.
5. Benjamin SG, Schwartz BE, Cole RE. 1999. Accuracy of ACARS wind and temperature observations determined by collocation. Weather and Forecasting. 14: 1032-1038.
6. Benjamin SG, Schwartz BE, Szoke EJ, Koch SE. 2004. The value of wind profiler data in U. S. weather forecasting. Bull. Am. Meteorol. Soc. 85: 1871-1886.
7. Bishop CH, Etherton BJ, Majumdar SJ. 2001. Adaptive sampling with the ensemble transform Kalman filter. Part I. Theoretical aspects. Mon. Weather Rev. 129: 420-436.
8. Burgers G, Van Leeuwen PJ, Evensen G. 1998. Analysis scheme in the ensemble Kalman filter. Mon. Weather Rev. 126: 1719-1724.
9. Chen M, Huang X. 2006. Digital Filter Initialization for MM5. Mon. Weather Rev. 134: 1222-1236.
10. Chen SY, Huang CY, Kuo YH, Guo YR, Sokolovskiy S. 2009. Assimilation of GPS refractivity from FORMOSAT-3/COSMIC using a nonlocal operator with WRF 3DVAR and its impact on the prediction of a typhoon event. Terr. Atmos. Ocean Sci. 20: 133-154.
11. Chiles JP, Delfiner P. 1999. Geostatistics: Modeling Spatial Uncertainty. Wiley: New York.
12. Cho JYN, Lindborg E. 2001. Horizontal velocity structure functions in the upper troposphere and lower stratosphere 1. Observations. J. Geophys. Res. 106: 10223-10232.
13. Cohn SE. 1997. An introduction to estimation theory. J. Meteorol. Soc. Jpn 75: 257-288.
14. Daley R. 1991. Atmospheric Data Analysis. Cambridge University Press: New York; 457 pp.
15. Daley R. 1992. Estimating model-error covariances for application to atmospheric data assimilation. Mon. Weather Rev. 120: 1735-1746.
16. Daley R. 1993. Estimating observation-error statistics for atmospheric data assimilation. Ann. Geophys. 11: 634-647.
17. Daley R. 1997. Atmospheric data assimilation. J. Meteorol. Soc. Jpn 75: 319-329.
18. Deardorff JW. 1970. A numerical study of three-dimensional turbulent channel flow at large Reynolds numbers. J. Fluid. Mech. 41: 453-480.
19. Dee D. 1995. On-line estimation of error covariance parameters for atmospheric data assimilation. Mon. Weather Rev. 123: 1128-1145.
20. Dee DP, Da Silva A M. 1999. Maximum-likelihood estimation of forecast and observation-error covariance parameters. Part I. Methodology. Mon. Weather Rev. 127: 1822-1834.
21. Dee DP, Gaspari G, Redder C, Rukhovets L, Da Silva A M. 1999. Maximum-likelihood estimation of forecast and observation-error covariance parameters. Part II. Applications. Mon. Weather Rev. 127: 1835-1849.
22. de Finetti B. 2008. Philosophical Lecture on Probability, Mura A (ed). Springer: Berlin.
23. Desroziers G, Berre L, Chapnik B, Poli P. 2005. Diagnosis of observation, background, and analysis-error statistics in observation space. Q. J. R. Meteorol. Soc. 131: 3385-3396.
24. Doviak RJ, Zrnic DS. 1993. Doppler Radar and Weather Observations. Academic Press: San Diego.
25. Ehrendorfer M. 2007. A review of issues in ensemble-based Kalman filtering. Meteorol. Zeitschrift 16: 795-818.
26. Evensen G. 1994. Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast-error statistics. J. Geophys. Res. 99: 10143-10161.
27. Fathalla A, Collier CG, Ballard SP, Swarbrick SJ. 2008. Assimilation of Doppler radial winds into a 3D-Var system: Errors and impact of radial velocities on the variational analysis and model forecasts. Q. J. R. Meteorol. Soc. 134: 1701-1716.
28. Frehlich R. 1997. Effects of wind turbulence on coherent Doppler lidar performance. J. Atmos. Oceanic Technol. 14: 54-75.
29. Frehlich R. 2000. Simulation of coherent Doppler lidar performance for space-based platforms. J. Appl. Meteorol. 39: 245-262.
30. Frehlich R. 2001. Errors for space-based Doppler lidar wind measurements: definition, performance, and verification. J. Atmos. Oceanic Technol. 18: 1749-1771.
31. Frehlich R. 2006. Adaptive data assimilation including the effect of spatial variations in observation error. Q. J. R. Meteorol. Soc. 132: 1225-1257.
32. Frehlich R. 2008. Atmospheric turbulence component of the innovation covariance. Q. J. R. Meteorol. Soc. 134: 931-940.
33. Frehlich R, Kelley N. 2008. Measurements of wind and turbulence profiles with scanning Doppler lidar for wind energy applications. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (J-STARS) 1: 42-47.
34. Frehlich R, Sharman R. 2004. Estimates of turbulence from numerical weather prediction model output with applications to turbulence diagnosis and data assimilation. Mon. Weather Rev. 132: 2308-2324.
35. Frehlich R, Sharman R. 2008. The use of structure functions and spectra from numerical model output to determine effective model resolution. Mon. Weather Rev. 136: 1537-1553.
36. Frehlich R, Sharman R. 2010. Climatology of velocity and temperature turbulence statistics determined from rawinsonde and ACARS/AMDAR data. J. Appl. Meteorol. Climatol. 49: 1149-1169.
37. Frehlich R, Meillier Y, Jensen ML, Balsley B, Sharman R. 2006. Measurements of boundary layer profiles in an urban environment. J. Appl. Meteorol. Climatol. 45: 821-837.
38. -5/3 law inertial range in mesoscale two-dimensional turbulence. J. Atmos. Sci. 36: 1950-1954.
39. Goodman JW. 1985. Statistical Optics. Wiley: New York; 550 pp.
40. Hamill TM, Snyder C. 2000. A hybrid ensemble Kalman filter-3D variational analysis scheme. Mon. Weather Rev. 128: 2905-2919.
41. Healy SB, Thépaut J-N. 2006. Assimilation experiments with CHAMP GPS radio occultation measurements. Q. J. R. Meteorol. Soc. 132: 605-623.
42. Heemink AW, Verlaan M, Segers AJ. 2001. Variance reduced ensemble Kalman filtering. Mon. Weather Rev. 129: 1718-1728.
43. Helstrom CW. 1968. Statistical Theory of Signal Detection. Pergamon Press: Oxford, UK; 470 pp.
44. Hollingsworth A, Lonnberg P. 1986. The statistical structure of short-range forecast errors as determined from radiosonde data. Part I. The wind field. Tellus 38A: 111-136.
45. Houtekamer PL, Mitchell HL. 1998. Data assimilation using an ensemble Kalman filter technique. Mon. Weather Rev. 126: 796-811.
46. Houtekamer PL, Mitchell HL. 2001. A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Weather Rev. 129: 123-137.
47. Houtekamer PL, Mitchell HL. 2005. Ensemble Kalman filtering. Q. J. R. Meteorol. Soc. 131: 3269-3289.
48. Huang X, Lynch P. 1993. Diabatic digital filtering initialization: application to the HIRLAM model. Mon. Weather Rev. 121: 589-603.
49. Ide K, Courtier P, Ghil M, Lorenc AC. 1997. Unified notation for data assimilation. Operational, sequential and variational. J. Meteorol. Soc. Jpn 75: 181-189.
50. Jaatinen J, Elms JB. 2000. On the windfinding accuracy of Loran-C, GPS and radar. Vaisala News 152: 30-33.
51. Jaynes ET. 2003. Probability Theory the Logic of Science, Bretthosrt GL (ed). Cambridge University Press: Cambridge, UK.
52. Kalnay E. 2003. Atmospheric Modeling, Data Assimilation and Predictability. Cambridge University Press: Cambridge, UK; 342 pp.
53. Koch R, Weissmann M, Ehrendorfer M. 2007. Key analysis errors and airborne wind lidar observations. Meteorol. Zeitschrift 16: 709-721.
54. Kolmogorov AN. 1933. Foundations of the Theory of Probability. Chelsea publishing: New York.
55. Kuo YH, Wee TK, Sokolovskiy S, Rocken C, Schreiner W, Hunt D, Anthes RA. 2004. Inversion and error estimation of GPS radio occultation data. J. Meteorol. Soc. Jpn 82: 507-531.
56. Kursinski ER, Haji G, Schofield JT, Linfield RP, Hardy KR. 1997. Observing Earth's atmosphere with radio occultation measurements using the Global Positioning System. J. Geophys. Res. 102: 23429-23465.
57. Laprise R. 1992. The resolution of global spectral models. Bull. Am. Meteorol. Soc. 73: 1454.
58. Lenschow DH, Sun J. 2007. The spectral composition of fluxes and variances over land and sea out to the mesoscale. Boundary-Layer Meteorol. 125: 63-84.
59. Li H, Kalnay E, Miyoshi T. 2009. Simultaneous estimation of covariance inflation and observation errors within an ensemble Kalman filter. Q. J. R. Meteorol. Soc. 135: 523-533.
60. Lilly DK. 1962. On the numerical simulation of buoyant convection. Tellus 14: 148-172.
61. Lindborg E. 1999. Can the atmospheric kinetic energy spectrum be explained by two-dimensional turbulence? J. Fluid Mech. 388: 259-288.
62. Lindborg E, Cho JYN. 2001. Horizontal velocity structure functions in the upper troposphere and lower stratosphere 2. Theoretical considerations. J. Geophys. Res. 106: 233-241.
63. Liu Z-Q, Rabier F. 2003. The potential of high-density observations for numerical weather prediction. A study with simulated observations. Q. J. R. Meteorol. Soc. 129: 3013-3035.
64. Liu J, Kalnay E, Miyoshi T, Cardinali C. 2009. Analysis sensitivity calculation in an ensemble Kalman filter. Q. J. R. Meteorol. Soc., 135: 1842-1851.
65. Lonnberg P, Hollingsworth A. 1986. The statistical structure of short-range forecast errors as determined from radiosonde data. Part II: the covariance of height and wind errors. Tellus 38A: 137-161.
66. Lorenc AC. 1986. Analysis methods for numerical weather prediction. Q. J. R. Meteorol. Soc. 112: 1177-1194.
67. Lorenc AC. 2003. The potential of the ensemble Kalman filter for NWP-a comparison with 4D-Var. Q. J. R. Meteorol. Soc. 129: 3183-3203.
68. Lu H, Xu Q. 2009. Trade-offs between measurement accuracy and resolutions in configuring phased-array radar velocity scans for ensemble-based storm-scale data assimilation. J. Appl. Meteorol. Climatol. 48: 1230-1244.
69. Lumley JL. 1970. Stochastic Tools in Turbulence. Academic Press: New York.
70. Lynch P, Huang X. 1992. Initialization of the HIRLAM model using a digital filter. Mon. Weather Rev. 120: 1019-1034.
71. Ma Z, Kuo YH, Wang B, Wu WS, Sokolovskiy S. 2009. Comparison of local and nonlocal observation operators for the assimilation of GPS RO data with the NCEP GSI system: An OSSE study. Mon. Weather Rev. 137: 3575-3587.
72. Marseille G-J, Stoffelen A. 2003. Simulation of wind profiles from a space-borne Doppler wind lidar. Q. J. R. Meteorol. Soc. 129: 3079-3098.
73. Marseille G-J, Stoffelen A, Barkmeijer J. 2008. Sensitivity observing system experiment (SOSE)-a new effective NWP-based tool in designing the global observing system. Tellus 60A: 216-233.
74. McLay JG, Bishop CH, Reynolds CA. 2007. The ensemble-transform scheme adapted for the generation of stochastic forecast perturbations. Q. J. R. Meteorol. Soc. 133: 1257-1266.
75. Mitchell HL, Houtekamer PL. 2000. An adaptive ensemble Kalman filter. Mon. Weather Rev. 128: 416-433.
76. Mitchell HL, Houtekamer PL, Pellerin G. 2002. Ensemble size, balance, and model-error representation in an ensemble Kalman filter. Mon. Weather Rev. 130: 2791-2808.
77. Monin AS, Yaglom AM. 1975a. Statistical Fluid Mechanics: Mechanics of Turbulence, Volume 1. MIT Press: London; 769 pp.
78. Monin AS, Yaglom AM. 1975b. Statistical Fluid Mechanics: Mechanics of Turbulence, Volume 2. MIT Press: London; 874 pp.
79. Nastrom GD, Gage KS. 1985. A climatology at atmospheric wavenumber spectra of wind and temperature observed by commercial aircraft. J. Atmos. Sci. 42: 950-960.
80. Papoulis A. 1965. Probability, Random Variables, and Stochastic Processes. McGraw-Hill: New York; 583 pp.
81. Parrish DF, Derber, J. 1992. The National Meteorological Center's spectral statistical interpolation analysis system. Mon. Weather Rev. 120: 1747-1763.
82. Pielke RA Sr. 1991. A recommended specific definition of 'Resolution'. Bull. Am. Meteorol. Soc. 72: 1914.
83. Pielke RA Sr. 2001. Further comments on 'The differentiation between grid spacing and resolution and their application to numerical modeling'. Bull. Am. Meteorol. Soc. 82: 699.
84. Pielke RA Sr. 2002. Mesoscale Meteorological Modeling. Academic Press: New York; 676 pp.
85. Rabier F. 2005. Overview of global data assimilation developments in numerical weather-prediction centres. Q. J. R. Meteorol. Soc. 131: 3215-3233.
86. Rabier F, McNally A, Andersson E, Courtier P, Unden P, Eyre J, Hollingsworth A, Bouttier F. 1998. The ECMWF implementation of three-dimensional variational assimilation (3D-Var): II Structure functions. Q. J. R. Meteorol. Soc. 124: 1809-1829.
87. Rao MM. 1995. Stochastic Processes: General Theory. Kluwer Academic Publishers: Dordrecht.
88. Raynaud L, Berre L, Desroziers G. 2008. Spatial averaging of ensemble-based background-error variances. Q. J. R. Meteorol. Soc. 134: 1003-1014.
89. Raynaud L, Berre L, Desroziers G. 2009. Objective filtering of ensemble-based background-error variances. Q. J. R. Meteorol. Soc. 135: 1177-1199.
90. Riishojgaard LP, Atlas R, Emmitt GD. 2004. The impact of Doppler lidar wind observations on a single-level meteorological analysis. J. Appl. Meteorol. 43: 810-820.
91. Riley JJ, Lindborg E. 2008. Stratified turbulence: A possible interpretation of some geophysical turbulence measurements. J. Atmos. Sci. 65: 2416-2424.
92. Rohaly GD, Krishnamurti TN. 1993. An observing system simulation experiment for the laser atmospheric wind sounder (LAWS). J. Appl. Meteorol. 32: 1452-1471.
93. Skamarock WC. 2004. Evaluating mesoscale NWP models using kinetic energy spectra. Mon. Weather Rev. 132: 3019-3032.
94. Snyder C, Zhang F. 2003. Assimilation of simulated Doppler radar observations with an ensemble Kalman filter. Mon. Weather Rev. 131: 1663-1677.
95. Stoffelen A, Flamant P, Kallen E, Pailleux J, Vaughan JM, Wergen W, Andersson E, Schyberg H, Culoma A, Endemann M, Ingmann P, Meynart R. 2005. The Atmospheric Dynamics Mission for global wind field measurement. Bull. Am. Meteorol. Soc. 86: 73-87.
96. Tippett MK, Anderson JL, Bishop CH, Hamill TM, Whitaker JS. 2003. Ensemble square root filters. Mon. Weather Rev. 131: 1485-1490.
97. Tong M, Xue M. 2005. Ensemble Kalman filter assimilation of Doppler radar data with a compressible nonhydrostatic model: OSS experiments. Mon. Weather Rev. 133: 1789-1807.
98. Toth Z. Kalnay E. 1997. Ensemble forecasting at NCEP and the breeding method. Mon. Weather Rev. 125: 3297-3319.
99. Van Leeuwen PJ, Evensen G. 1996. Data assimilation and inverse methods in terms of a probabilistic formulation. Mon. Weather Rev. 124: 2898-2913.
100. Van Trees HL. 1968. Detection, Estimation, and Modulation Theory, Part I. John Wiley and Sons: New York; 697 pp.
101. Velden C, Daniels J, Stettner D, Santek D, Key J, Dunion J, Holmlund K, Dengel G, Bresky W, Menzel P. 2005. Recent innovations in deriving tropospheric winds from meteorological satellites. Bull. Am. Meteorol. Soc. 86: 205-223.
102. Weissmann M, Cardinali C. 2007. Impact of airborne Doppler lidar observations on ECMWF forecasts. Q. J. R. Meteorol. Soc. 133: 107-116.
103. Whitaker JS, Hamill TM, Wei X. 2008. Ensemble data assimilation with the NCEP global forecast system. Mon. Weather Rev. 136: 463-482.
104. Wikle CK, Milliff RF, Large WG. 1999. Surface wind variability on spatial scales from 1 to 1000 km observed during TOGA COARE. J. Atmos. Sci. 56: 2222-2231.
105. Wolff J, Sharman R. 2008. Climatology of upper-level turbulence over the continental United States. J. Appl. Meteorol. Climatol. 47: 2198-2214.
106. Zhang S, Anderson JL. 2003. Impact of spatially and temporally varying estimates of error covariance on assimilation in a simple atmospheric model. Tellus 55A: 126-147.
107. Zupanski M. 2005. Maximum likelihood ensemble filter: theoretical aspects. Mon. Weather Rev. 133: 1710-1726.
108. Zupanski M, Fletcher SJ, Navon IM, Uzunoglu B, Heikes RP, Randall DA, Ringler TD, Daescu D. 2006. Initiation of ensemble data assimilation. Tellus 58A: 159-170.