Error covariance sensitivity and impact estimation with adjoint 4D-Var: Theoretical aspects and first applications to NAVDAS-AR

Quarterly Journal of the Royal Meteorological Society

Volumn 139, Issue 670, 2013, Pages 226-241

  Daescu, Dacian N ^a   Langland, Rolf H ^b  

^a PORTLAND STATE UNIVERSITY   (United States)

^b NAVAL RESEARCH LABORATORY   (United States)

Author keywords

Error correlations; Estimation theory; Observing system experiments; Optimization

Indexed keywords

ADJOINT APPROACH; ADJOINTS; ASSIMILATION SYSTEM; BACKGROUND-ERROR COVARIANCES; COMPUTATIONALLY EFFICIENT; DESIGN PARAMETERS; ERROR CORRELATION; ERROR COVARIANCES; ESTIMATION THEORY; FORECAST ERRORS; FORECAST SENSITIVITY; IMPACT ASSESSMENTS; MATHEMATICAL PROPERTIES; NAVAL RESEARCH LABORATORY; NAVY OPERATIONAL GLOBAL ATMOSPHERIC PREDICTION SYSTEMS; OBSERVING SYSTEM EXPERIMENTS; POSTERIORI; RADIANCE DATA; SENSITIVITY VECTORS; THEORETICAL ASPECTS; VARIANCE ESTIMATE; VARIATIONAL DATA ASSIMILATION;

FORECASTING; ITERATIVE METHODS; OPTIMIZATION; RESEARCH LABORATORIES; VALUE ENGINEERING;

ESTIMATION;

ERROR ANALYSIS; ERROR CORRECTION; FOUR-DIMENSIONAL MODELING; NAVAL APPLICATION; OPTIMIZATION; SENSITIVITY ANALYSIS;

EID: 84873299439     PISSN: 00359009     EISSN: 1477870X     Source Type: Journal    
DOI: 10.1002/qj.1943     Document Type: Article

References (63)

1. Anderson JL. 2007. An adaptive covariance inflation error correction algorithm for ensemble filters. Tellus 59A: 210-224.
2. Andersson E, Fisher M, Munro R, McNally AP. 2000. Diagnosis of background errors for radiances and other observable quantities in a variational data assimilation scheme, and the explanation of a case of poor convergence. Q. J. R. Meteorol. Soc. 126: 1455-1472.
3. Atlas R. 1997. Atmospheric observations and experiments to assess their usefulness in data assimilation. J. Meteorol. Soc. Japan 75: 111-130.
4. Baker NL, Daley R. 2000. Observation and background adjoint sensitivity in the adaptive observation-targeting problem. Q. J. R. Meteorol. Soc. 126: 1431-1454.
5. Baker NL, Langland RH. 2009. Diagnostics for evaluating the impact of satellite observations. In Data Assimilation for Atmospheric, Oceanic and Hydrologic Applications. Park SK, Xu L. (eds) Springer: Berlin. 177-196.
6. Bannister RN. 2008a. A review of forecast-error covariance statistics in atmospheric variational data assimilation. I: Characteristics and measurements of forecast-error covariances. Q. J. R. Meteorol. Soc. 134: 1951-1970.
7. Bannister RN. 2008b. A review of forecast-error covariance statistics in atmospheric variational data assimilation. II: Modelling the forecast-error covariance statistics. Q. J. R. Meteorol. Soc. 134: 1971-1996.
8. Bishop CH, Hodyss D, Steinle P, Sims H, Clayton AM, Lorenc AC, Barker DM, Buehner M. 2011. Efficient ensemble covariance localization in variational data assimilation. Mon. Weather Rev. 139: 573-580.
9. Bormann N, Bauer P. 2010. Estimates of spatial and interchannel observation-error characteristics for current sounder radiances for numerical weather prediction. I: Methods and applications to ATOVS data. Q. J. R. Meteorol. Soc. 136: 1036-1050.
10. Bormann N, Collard AD, Bauer P. 2010. Estimates of spatial and interchannel observation-error characteristics for current sounder radiances for numerical weather prediction. II: applications to AIRS and IASI data. Q. J. R. Meteorol. Soc. 136: 1051-1063.
11. Bormann N, Geer AJ, Bauer P. 2011. Estimates of observation-error characteristics in clear and cloudy regions for microwave imager radiances from numerical weather prediction. Q. J. R. Meteorol. Soc. 137: 2014-2023.
12. Brousseau P, Berre L, Bouttier F, Desroziers G. 2012. Flow-dependent background-error covariances for a convective-scale data assimilation system. Q. J. R. Meteorol. Soc. 138: 310-322.
13. Buehner M. 2005. Ensemble-derived stationary and flow-dependent background-error covariances: evaluation in a quasi-operational NWP setting. Q. J. R. Meteorol. Soc. 131: 1013-1043.
14. Buehner M, Gauthier P, Liu Z. 2005. Evaluation of new estimates of background- and observation-error covariances for variational assimilation. Q. J. R. Meteorol. Soc. 131: 3373-3383.
15. Cardinali C. 2009. Monitoring the observation impact on the short-range forecast. Q. J. R. Meteorol. Soc. 135: 239-250.
16. Cardinali C, Prates F. 2011. Performance measurement with advanced diagnostic tools of all-sky microwave imager radiances in 4D-Var. Q. J. R. Meteorol. Soc. 137: 2038-2046.
17. Cardinali C, Pezzulli S, Andersson E. 2004. Influence matrix diagnostics of a data assimilation system. Q. J. R. Meteorol. Soc. 130: 2767-2786.
18. Chapnik B, Desroziers G, Rabier F, Talagrand O. 2004. Properties and first application of an error-statistics tuning method in variational data assimilation. Q.J.R. Meteorol. Soc. 130: 2253-2275.
19. Chapnik B, Desroziers G, Rabier F, Talagrand O. 2006. Diagnosis and tuning of observational error in a quasi-operational data assimilation setting. Q.J.R. Meteorol. Soc. 132: 543-565.
20. Collard AD, McNally AP, Hilton FI, Healy SB, Atkinson NC. 2010. The use of principal component analysis for the assimilation of high-resolution infrared sounder observations for numerical weather prediction. Q. J. R. Meteorol. Soc. 136: 2038-2050.
21. Daescu DN. 2008. On the sensitivity equations of four-dimensional variational (4D-Var) data assimilation. Mon. Weather Rev. 136: 3050-3065.
22. Daescu DN, Todling R. 2009. Adjoint estimation of the variation in model functional output due to the assimilation of data. Mon. Weather Rev. 137: 1705-1716.
23. Daescu DN, Todling R. 2010. Adjoint sensitivity of the model forecast to data assimilation system error covariance parameters. Q. J. R. Meteorol. Soc. 136: 2000-2012.
24. Daley R, Barker E. 2001. NAVDAS-formulation and diagnostics. Mon. Weather Rev. 129: 869-883.
25. Dee DP. 1995. On-line estimation of error covariance parameters for atmospheric data assimilation. Mon. Weather Rev. 123: 1128-1145.
26. Dee DP, Da Silva AM. 1999. Maximum-likelihood estimation of forecast and observation-error covariance parameters. Part I: Methodology. Mon. Weather Rev. 127: 1822-1834.
27. Derber JC, Bouttier F. 1999. A reformulation of the background-error covariance in the ECMWF global data assimilation system. Tellus 51A: 195-221.
28. Desroziers G, Ivanov S. 2001. Diagnosis and adaptive tuning of observation-error parameters in a variational assimilation. Q. J. R. Meteorol. Soc. 127: 1433-1452.
29. Desroziers G, Berre L, Chapnik B, Poli P. 2005. Diagnosis of observation-, background- and analysis-error statistics in observation space. Q. J. R. Meteorol. Soc. 131: 3385-3396.
30. Desroziers G, Berre L, Chabot V, Chapnik B. 2009. A posteriori diagnostics in an ensemble of perturbed analyses. Mon. Weather Rev. 137: 3420-3436.
31. Fisher M. 2003. 'Background-error covariance modelling'. In Proceedings of seminar on recent developments in data assimilation for atmosphere and ocean. ECMWF: Reading, UK. 45-64.
32. Frehlich R. 2011. The definition of 'truth' for numerical weather prediction error statistics. Q. J. R. Meteorol. Soc. 137: 84-98.
33. Garand L, Heilliette S, Buehner M. 2007. Interchannel error correlation associated with AIRS radiance observations: Inference and impact in data assimilation. J. Appl. Meteorol. 46: 714-725.
34. Gaspari G, Cohn SE. 1999. Construction of correlation functions in two and three dimensions. Q. J. R. Meteorol. Soc. 125: 723-757.
35. Gelaro R, Zhu Y. 2009. Examination of observation impacts derived from observing system experiments (OSEs) and adjoint models. Tellus 61A: 179-193.
36. Gelaro R, Langland RH, Pellerin S, Todling R. 2010. The THORPEX observation impact intercomparison experiment. Mon. Weather Rev. 138: 4009-4025.
37. Goldberg MD, Crosby DS, Zhou L. 2001. The limb adjustment of AMSU-A observations: methodology and validation. J. Appl. Meteorol. 40: 70-83.
38. Gorin VE, Tsyrulnikov MD. 2011. Estimation of multivariate observation-error statistics for AMSU-A data. Mon. Weather Rev. 139: 3765-3780.
39. Hamill TM, Snyder C. 2000. A hybrid ensemble Kalman filter-3D variational analysis scheme. Mon. Weather Rev. 128: 2905-2919.
40. Hogan TF, Rosmond TE. 1991. The description of the Navy Operational Global Atmospheric Prediction System's spectral forecast model. Mon. Weather Rev. 119: 1786-1815.
41. Jazwinski AH. 1970. Stochastic Processes and Filtering Theory. Academic Press: New York, NY.
42. Joiner J, Brin E, Treadon R, Derber J, Van Delst P, Da Silva A, Le Marshall J, Poli P, Atlas R, Bungato D, Cruz C. 2007. Effects of data selection and error specification on the assimilation of AIRS data. Q. J. R. Meteorol. Soc. 133: 181-196.
43. Kelly G, Thépaut J-N, Buizza R, Cardinali C. 2007. The value of observations. I: Data denial experiments for the Atlantic and the Pacific. Q. J. R. Meteorol. Soc. 133: 1803-1815.
44. Lahoz WA, Khattatov B, Menard R. (eds) 2010. Data Assimilation: Making sense of observations. Springer: Berlin.
45. Langland RH, Baker NL. 2004. Estimation of observation impact using the NRL atmospheric variational data assimilation adjoint system. Tellus 56A: 189-201.
46. Langland RH, Maue RN, Bishop CH. 2008. Uncertainty in atmospheric temperature analyses. Tellus 60A: 598-603.
47. Le Dimet FX, Navon IM, Daescu DN. 2002. Second-order information in data assimilation. Mon. Weather Rev. 130: 629-648.
48. Li H, Kalnay E, Miyoshi T. 2009. Simultaneous estimation of covariance inflation and observation errors within an ensemble Kalman filter. Q. J. R. Meteorol. Soc. 135: 523-533.
49. Liu J, Kalnay E. 2008. Estimating observation impact without adjoint model in an ensemble Kalman filter. Q. J. R. Meteorol. Soc. 134: 1327-1335.
50. Liu J, Kalnay E, Miyoshi T, Cardinali C. 2009. Analysis sensitivity calculation in an ensemble Kalman filter. Q. J. R. Meteorol. Soc. 135: 1842-1851.
51. Lorenc AC. 2003. Modelling of error covariances by 4D-Var data assimilation. Q. J. R. Meteorol. Soc. 129: 3167-3182.
52. Lupu C, Gauthier P, Laroche S. 2011. Evaluation of the impact of observations on analyses in 3D- and 4D-Var based on information content. Mon. Weather Rev. 139: 726-737.
53. Ménard R, Yang Y, Rochon Y. 2009. Convergence and stability of estimated error variances derived from assimilation residuals in observation space. In Proceedings of the ECMWF Workshop on Diagnostics of Data Assimilation System Performance. 133-143. ECMWF: Reading, UK.
54. Raynaud L, Berre L, Desroziers G. 2011. An extended specification of flow-dependent background error variances in the Météo-France global 4D-Var system. Q. J. R. Meteorol. Soc. 137: 607-619.
55. Rosmond T, Xu L. 2006. Development of NAVDAS-AR: non-linear formulation and outer loop tests. Tellus 58A: 45-58.
56. Talagrand O. 1999. 'A posteriori evaluation and verification of the analysis and assimilation algorithms'. In Proceedings of Workshop on Diagnosis of Data Assimilation Systems, ECMWF: Reading, UK. 17-28.
57. Trémolet, Y. 2007. Model-error estimation in 4D-Var. Q. J. R. Meteorol. Soc. 133: 1267-1280.
58. Trémolet Y. 2008. Computation of observation sensitivity and observation impact in incremental variational data assimilation. Tellus 60A: 964-978.
59. Wahba G, Johnson DR, Gao F, Gong J. 1995. Adaptive tuning of numerical weather prediction models: randomized GCV in three- and four-dimensional data assimilation. Mon. Weather Rev. 123: 3358-3369.
60. Xu L, Rosmond T, Daley R. 2005. Development of NAVDAS-AR: formulation and initial tests of the linear problem. Tellus 57A: 546-559.
61. Zhang S, Anderson JL. 2003. Impact of spatially and temporally varying estimates of error covariance on assimilation in a simple atmospheric model. Tellus 55A: 126-147.
62. Zhu Y, Gelaro R. 2008. Observation sensitivity calculations using the adjoint of the Gridpoint Statistical Interpolation (GSI) analysis system. Mon. Weather Rev. 136: 335-351.
63. Zupanski D, Zupanski M. 2006. Model error estimation employing an ensemble data assimilation approach. Mon. Weather Rev. 134: 1337-1354.