The maximum likelihood ensemble filter as a non-differentiable minimization algorithm

Quarterly Journal of the Royal Meteorological Society

Volumn 134, Issue 633 B, 2008, Pages 1039-1050

  Zupanski, Milija ^a   Navon, I Michael ^b   Zupanski, Dusanka ^a  

^a Department of Environmental and Radiological Health Sciences   (United States)

^b FLORIDA STATE UNIVERSITY   (United States)

Author keywords

Ensemble data assimilation; Unconstrained minimization

Indexed keywords

ALGORITHMS; BLOCK CODES; CONJUGATE GRADIENT METHOD; MATHEMATICAL MODELS; MATRIX ALGEBRA; MAXIMUM LIKELIHOOD; NEWTON-RAPHSON METHOD; STANDARDS; WAVE FILTERS; COST FUNCTIONS; OPTIMIZATION; PROBABILITY DENSITY FUNCTION;

BURGERS MODEL; DIFFERENTIABILITY; ENSEMBLE DATA ASSIMILATION; FIRST ORDERS; GRADIENT-BASED; HESSIAN MATRICES; MAXIMUM LIKELIHOOD ENSEMBLE FILTER; MINIMIZATION ALGORITHMS; OBSERVATION OPERATORS; ONE-DIMENSIONAL; PREDICTION MODELING; QUASI-NEWTON METHODS; ROBUST PERFORMANCE; SECOND ORDERS; SIMULATED OBSERVATIONS; SYMMETRIC MATRICES; UNCONSTRAINED MINIMIZATION; BURGERS MODELS; GENERALIZED GRADIENTS; HESSIAN MATRIXES; MAXIMUM LIKELIHOOD ENSEMBLE FILTERS; MINIMIZATION METHODS; PREDICTION MODELS; ROBUST PERFORMANCES; SYMMETRIC MATRIXES;

GRADIENT METHODS; CONJUGATE GRADIENT METHOD;

ALGORITHM; DATA ASSIMILATION; ENSEMBLE FORECASTING; MATRIX; MAXIMUM LIKELIHOOD ANALYSIS; NUMERICAL MODEL; FILTER; OPTIMIZATION;

EID: 48649088191     PISSN: 00359009     EISSN: None     Source Type: Journal    
DOI: 10.1002/qj.251     Document Type: Article

References (51)

1. Abramov R, Majda AJ. 2004. Quantifying uncertainty for non-Gaussian ensembles in complex systems. SIAM J. Sci. Stat. Comput. 26: 411-447.
2. Akella S, Navon IM. 2006. A comparative study of the performance of high resolution advection schemes in the context of data assimilation. Int. J. Numer. Meth. Fluids 51: 719-748.
3. Anderson JL. 2003. A local least squares framework for ensemble filtering. Mon. Weather Rev. 131: 634-642.
4. Axelsson O, Barker VA. 1984. Finite-element solution of boundary-value problems: Theory and computation. Academic Press.
5. Bishop B, Etherton J, Majumdar SJ. 2001. Adaptive sampling with the ensemble transform Kalman filter. Part I: Theoretical aspects. Mon. Weather Rev. 129: 420-436.
6. Burgers JM. 1948. A mathematical model illustrating the theory of turbulence. Pp. 171-199 in Advances in Applied Mechanics 1. Academic Press: New York.
7. Carrio GG, Cotton WR, Zupanski D, Zupanski M. 2008. Development of an aerosol retrieval method: Description and preliminary tests. J. Appl. Meteorol. Climatol. In press.
8. Clarke FH. 1983. Optimization and Non-smooth Analysis. John Wiley & Sons: NewYork.
9. Derber JC. 1989. A variational continuous assimilation technique. Mon. Weather Rev. 117: 2437-2446.
10. Evensen G. 1994. Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte-Carlo methods to forecast error statistics. J. Geophys. Res. 99(C5): 10143-10162.
11. Fisher M, Courtier P. 1995. 'Estimating the covariance matrices of analysis and forecast errors in variational data assimilation'. Tech. Memo. 220 ECMWF: Reading, UK.
12. Fletcher CAJ. 1991. Computational Techniques for Fluid Dynamics: Fundamental and General Techniques. Springer: Berlin.
13. Fletcher SJ, Zupanski M. 2006a. A data assimilation method for log-normally distributed observation errors. Q. J. R. Meteorol. Soc. 132: 2505-2520.
14. Fletcher SJ, Zupanski M. 2006b. A hybrid multivariate normal and log-normal distribution for data assimilation. Atmos. Sci. Lett. 7: 43-46.
15. Gejadze I, Le Dimet FX, Shutyaev V. 2007. On error covariances in variational data assimilation. J. Num. Anal. Math. Model. 22: 163-175.
16. Gill PE, Murray W, Wright MH. 1981. Practical Optimization. Academic Press: San Diego.
17. Greenwald TJ, Hertenstein R, Vukicevic T. 2002. An all-weather observational operator for radiance data assimilation with mesoscale forecast models. Mon. Weather Rev. 130: 1882-1897.
18. Haven K, Majda A, Abramov R. 2005. Quantifying predictability through information theory: Small-sample estimation in a non-Gaussian framework. J. Comput. Phys. 206: 334-362.
19. Homescu C, Navon IM. 2003. Optimal control of flow with discontinuities. J. Comput. Phys. 187: 660-682.
20. Houtekamer PL, Mitchell HL. 1998. Data assimilation using ensemble Kalman filter technique. Mon. Weather Rev. 126: 796 - 811.
21. Jazwinski AH. 1970. Stochastic Processes and Filtering Theory. Academic Press: San Diego.
22. LeDimet FX, Talagrand O. 1986. Variational algorithms for analysis and assimilation of meteorological observations: Theoretical aspects. Tellus 38A: 91-110.
23. Lemarechal C. 1977. Bundle methods in non-smooth optimization. Pp. 79-103 in Proceedings of the IIASA Series 3. Lemarechal C, Mifflin R. (eds.) Pergamon Press: Oxford, UK.
24. Lemarechal C, Zowe J. 1994. A condensed introduction to bundle methods in nonsmooth optimization. Pp. 357-382 in Algorithms for Continuous Optimization. Spedicato E. (ed.) Kluwer Academic Publishers: Dordrecht, The Netherlands.
25. Liu DC, Nocedal J. 1989. On the limited memory BFGS method for large scale optimization. Math. Programming 45: 503-528.
26. Lorenc AC. 1986. Analysis methods for numerical weather prediction. Q. J. R. Meteorol. Soc. 112: 1177-1194.
27. Luenberger DL. 1984. Linear and Non-linear Programming. Addison-Wesley.
28. Luksan L, Vlcek J. 2001. Algorithm 811: NDA: Algorithms for Nondifferentiable Optimization. ACM Trans. Math. Software 27: 193-213.
29. Nesterov Y. 2005. Smooth minimization of non-smooth functions. Math. Program. 103: 127-152.
30. Nocedal J. 1980. Updating quasi-Newton matrices with limited storage. Math. Comput. 35: 773-782.
31. Nocedal J, Wright SJ. 1999. Numerical optimization. Springer-Verlag: New York.
32. Ott E, Hunt BR, Szunyogh I, Zimin AV, Kostelich EJ, Corazza M, Kalnay E, Patil DJ, Yorke JA. 2004. A Local Ensemble Kalman Filter for atmospheric data assimilation. Tellus 56A: 273-277.
33. Pham DT, Verron J, Roubaud MC. 1998. A singular evolutive extended Kalman filter for data assimilation in oceanography. J. Marine Sys. 16: 323-340.
34. Rozier D, Birol F, Cosme E, Brasseur P, Brankart JM, Verron J. 2007. A reduced-order Kalman filter for data assimilation in physical oceanography. SIAM Rev. 49: 449-465.
35. Tsuyuki T. 1997. Variational data assimilation in the tropics using precipitation data. Part III: Assimilation of SSM/I precipitation rates. Mon. Weather Rev. 125: 1447-1464.
36. Uzunoglu B, Fletcher SJ, Zupanski M, Navon IM. 2007. Adaptive ensemble size inflation and reduction. Q. J. R. Meteorol. Soc. 133: 1281-1294.
37. van Leeuwen PJ. 2003. A variance-minimizing filter for large-scale applications. Mon. Weather Rev. 131: 2071-2084.
38. Veersé F. 1999. Variable-storage quasi-Newton operators as inverse forecast/analysis error covariance matrices in variational data assimilation. INRIA Research Report 3685. http://hal.inria.fr /docs/00/07/29/84/PDF/RR-3685.pdf.
39. Verlinde J, Cotton WR. 1993. Fitting microphysical observations of non-steady convective clouds to a numerical model: An application of the adjoint technique of data assimilation to a kinematic model. Mon. Weather Rev. 121: 2276-2793.
40. Wang X, Bishop CH, Julier SJ. 2004, Which is better, an ensemble of positive/negative pairs or a centered spherical simplex ensemble? Mon. Weather Rev. 132: 1590-1605.
41. Wang Z, Navon IM, Zou X, LeDimet FX. 1995. A truncated Newton optimization algorithm in meteorological applications with analysis Hessian/vector products. Comput. Opt. Appl. 4: 241-262.
42. Wei M, Toth Z, Wobus R, Zhu Y, Bishop CH, Wang X. 2006. Ensemble Transform Kalman Filter-based ensemble perturbations in an operational global prediction system at NCEP. Tellus 58A: 28-44.
43. Whitaker JS, Hamill TM. 2002. Ensemble data assimilation without perturbed observations. Mon. Weather Rev. 130: 1913-1924.
44. Xu Q, Gao J. 1999. Generalized adjoint for physical processes with parameterized discontinuities. Part VI: Minimization problems in multidimensional space. J. Atmos. Sci. 56: 994-1002.
45. Zhang S, Zou X, Ahlquist J, Navon IM, Sela JG. 2000. Use of differentiable and non-differentiable optimization algorithms for variational data assimilation with discontinuous cost functions. Mon. Weather Rev. 128: 4031-4044.
46. Zupanski D. 1993. The effects of discontinuities in the Betts - Miller cumulus convection scheme on four-dimensional variational data assimilation in a quasi-operational forecasting environment. Tellus 45A: 511-524.
47. Zupanski M. 2005. Maximum Likelihood Ensemble Filter: Theoretical aspects. Mon. Weather Rev. 133: 1710-1726.
48. Zupanski D, Zupanski M. 2006. Model error estimation employing ensemble data assimilation approach. Mon. Weather Rev. 134: 1337-1354.
49. Zupanski M, Fletcher SJ, Navon IM, Uzunoglu B, Heikes RP, Randall DA, Ringler TD, Daescu DN. 2006. Initiation of ensemble data assimilation. Tellus 58A: 159-170.
50. Zupanski D, Denning AS, Uliasz M, Zupanski M, Schuh AE, Rayner PJ, Peters W, Corbin KD. 2007a. Carbon flux bias estimation employing Maximum Likelihood Ensemble Filter (MLEF). J. Geophys. Res. 112: D17107, DOI: 10.1029/2006JD008371.
51. Zupanski D, Hou AY, Zhang SQ, Zupanski M, Kummerow CD, Cheung SH. 2007b. Applications of information theory in ensemble data assimilation. Q. J. R. Meteorol. Soc. 133: 1533-1545.