Graphical models for statistical inference and data assimilation

Physica D: Nonlinear Phenomena

Volumn 230, Issue 1-2, 2007, Pages 72-87

  Ihler, Alexander T ^a   Kirshner, Sergey ^b   Ghil, Michael ^c,d   Robertson, Andrew W ^e   Smyth, Padhraic ^a  

^a Ringgold Standard Institution Informatics   (United States)

^b UNIVERSITY OF ALBERTA   (Canada)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d ECOLE NORMALE SUPÉRIEURE   (France)

^e Earth Institute   (United States)

Author keywords

Data assimilation; Graphical models; Hidden Markov models; Kalman filtering; Statistical inference

Indexed keywords

ALGORITHMS; COMPUTATIONAL EFFICIENCY; DYNAMICAL SYSTEMS; KALMAN FILTERS; MATHEMATICAL MODELS; STATISTICAL METHODS;

DATA ASSIMILATION; GRAPHICAL MODELS; STATISTICAL INFERENCE;

SYSTEMS ANALYSIS;

EID: 34248644043     PISSN: 01672789     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physd.2006.08.023     Document Type: Article

References (88)

1. Epstein E.S. Stochastic dynamic prediction. Tellus 21 6 (1969) 739-759
2. Bengtsson T., Snyder C., and Nychka D. Toward a nonlinear ensemble filter for high-dimensional systems. J. Geophys. Res.-Atmos. 108 D24 (2003)
3. Berliner L.M. Physical-statistical modeling in geophysics. J. Geophys. Res.-Atmos. 108 D24 (2003)
4. Lorenc A.C. The potential of the ensemble Kalman filter for NWP-a comparison with 4D-VAR. Q. J. R. Meteorol. Soc. 129 (2003) 3183-3203
5. Kalman R.E. A new approach to linear filtering and prediction problems. Trans. ASME, D 82 (1960) 35-45
6. In: Gelb A. (Ed). Applied Optimal Estimation (1974), MIT Press, Cambridge
7. Bucy R.S., and Joseph P.D. Filtering for Stochastic Processes with Applications to Guidance. 2nd ed. (1987), Chelsea
8. Lorenz E.N. The mechanics of vacillation. J. Atmos. Sci. 20 (1963) 448-464
9. Veronis G. An analysis of wind-driven ocean circulation with a limited number of Fourier components. J. Atmos. Sci. 20 (1963) 577-593
10. Ghil M., and Childress S. Topics in Geophysical Fluid Dynamics: Atmospheric Dynamics, Dynamo Theory and Climate Dynamics (1987), Springer-Verlag, Berlin
11. In: Sorenson H.W. (Ed). Kalman Filtering: Theory and Application (1985), IEEE Press
12. In: Jazwinski A.H. (Ed). Stochastic Processes and Filtering Theory (1970), Academic Press, New York
13. Miller R.N., Ghil M., and Gauthiez F. Advanced data assimilation in strongly nonlinear dynamical systems. J. Atmos. Sci. 51 8 (1994) 1037-1056
14. Ide K., and Ghil M. Extended Kalman filtering for vortex systems. Part I: Methodology and point vortices. Dyn. Atmos. Oceans 27 1-4 (1998) 301-332
15. Ide K., and Ghil M. Extended Kalman filtering for vortex systems. Part II: Rankine vortices and observing-system design. Dyn. Atmos. Oceans 27 1-4 (1998) 333-350
16. Evensen G. Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res. 99 C5 (1994) 10143-10162
17. Moradkhani H., Hsu K.-L., Gupta H., and Sorooshian S. Uncertainty assessment of hydrologic model states and parameters: sequential data assimilation using the particle filter. Water Resour. Res. 41 (2005)
18. Miller R.N., Carter E.F., and Blue S.T. Data assimilation into nonlinear stochastic models. Tellus A 51 2 (1999) 167-194
19. Fukumori I. Assimilation of TOPEX sea level measurements with a reduced-gravity, shallow water model of the tropical Pacific Ocean. J. Geophys. Res.-Oceans 100 C12 (1995) 25027-25039
20. Fukumori I. A partitioned Kalman filter and smoother. Mon. Weather Rev. 130 5 (2002) 1370-1383
21. Lyster P.M., Cohn S.E., Menard R., Chang L.-P., Lin S.-J., and Olsen R. Parallel implementation of a Kalman filter for constituent data assimilation. Mon. Weather Rev. 125 2 (1997) 1674-1686
22. Keppenne C.L. Data assimilation into a primitive-equation model with a parallel ensemble Kalman filter. Mon. Weather Rev. 128 6 (2000) 1971-1981
23. Ghil M., and Malanotte-Rizzoli P. Data assimilation in meteorology and oceanography. In: Saltzmann B. (Ed). Adv. in Geophys., vol. 33 (1991), Academic Press 141-266
24. In: Ghil M., Ide K., Bennett A.F., Courtier P., Kimoto M., and Sato N. (Eds). Data Assimilation in Meteorology and Oceanography: Theory and Practice (1997), Meteorological Society of Japan and Universal Academy Press, Tokyo
25. Panel on Model-Assimilated Data Sets,. Johnson D.R., et al. National Research Council, Four-Dimensional Model Assimilation of Data: A Strategy for the Earth System Sciences (1991), National Academy Press, Washington, DC
26. Kao J., Flicker D., Henninger R., Frey S., Ghil M., and Ide K. Data assimilation with an extended Kalman filter for impact-produced shock-wave dynamics. J. Comput. Phys. 196 2 (2004) 705-723
27. Stephenson D.B., Coelho C.A.S., Doblas-Reyes F.J., and Balmaseda M. Forecast assimilation: A unified framework for the combination of multi-model weather and climate predictions. Tellus A 57 3 (2005) 253-264
28. Thomson M.C., Doblas-Reyes F.J., Mason S.J., Hagedorn R., Connor S.J., Phindela T., Morse A.P., and Palmer T.N. Malaria early warnings based on seasonal climate forecasts from multi-model ensembles. Nature 439 (2006) 576-579
29. Lauritzen S., and Spiegelhalter D. Local computations with probabilities on graphical structures and their applications to expert systems. J. R. Stat. Soc. B 50 (1988) 157-224
30. Pearl J. Probabilistic Reasoning in Intelligent Systems (1988), Morgan Kaufman, San Mateo
31. Whittaker J. Graphical Models in Applied Multivariate Statistics (1990), John Wiley & Sons, New York
32. In: Jordan M.I. (Ed). Learning in Graphical Models (1998), MIT Press, Cambridge
33. Cowell R.G., Dawid A.P., Lauritzen S.L., and Spiegelhalter D.J. Probabilistic Networks and Expert Systems (1999), Springer-Verlag, New York
34. Jordan M.I. Graphical models. Stat. Sci. 19 (2004) 140-155
35. Lauritzen S.L., and Sheehan N.A. Graphical models for genetic analyses. Stat. Sci. 18 (2003) 489-514
36. Fishelson M., and Geiger D. Exact genetic linkage computations for general pedigrees. Bioinformatics 18 (2002) 189-198
37. McEliece R., Mackay D., and Cheng J. Turbo decoding as an instance of Pearl's "belief propagation" algorithm. IEEE J. Sel. Areas Commun. 16 2 (1998) 140-152
38. Rabiner L.R. A tutorial in hidden Markov models and selected applications in speech recognition. Proc. IEEE 77 2 (1989) 257-286
39. Freeman W.T., Pasztor E.C., and Carmichael O.T. Learning low-level vision. IJCV 40 1 (2000) 25-47
40. Beal M., Jojic N., and Attias H. A graphical model for audiovisual object tracking. IEEE Trans. PAMI 25 7 (2003) 828-836
41. Tu Z.W., Chen X.R., Yuille A.L., and Zhu S.C. Image parsing: Unifying segmentation, detection and recognition. IJCV 63 2 (2005) 113-140
42. Segal E., Shapira M., Regev A., Peér D., Botstein D., Koller D., and Friedman N. Module networks: Identifying regulatory modules and their condition-specific regulators from gene expression data. Nature Gene. 34 2 (2003) 166-176
43. Raval A., Ghahramani Z., and Wild D.L. A Bayesian network model for protein fold and remote homologue recognition. Bioinformatics 18 (2002) 788-801
44. Chin T.M., Mariano A., and Chassignet E. Spatial regression and multiscale approximations for sequential data assimilation in ocean models. J. Geophys. Res. 104 C4 (1999) 7991-8014
45. J.S. Yedidia, W.T. Freeman, Y. Weiss, Understanding belief propagation and its generalizations, in: IJCAI, 2001
46. Kschischang F., Frey B., and Loeliger H.-A. Factor graphs and the sum-product algorithm. IEEE Trans. IT 47 2 (2001) 498-519
47. Clifford P. Markov random fields in statistics. In: Grimmett G.R., and Welsh D.J.A. (Eds). Disorder in Physical Systems (1990), Oxford University Press, Oxford 19-32
48. Cox D.R., and Wermuth N. Multivariate Dependencies - Models, Analysis and Interpretation. Monographs on Statistics and Applied Probability vol. 67 (1996), Chapman & Hall
49. R.M. Neal, Probabilistic inference using Markov Chain Monte Carlo methods, Tech. Rep. CRG-TR-93-1, Dept. of Comp. Sci., Univ. of Toronto, 1993
50. MacKay D. Introduction to monte carlo methods. In: Jordan M.I. (Ed). Learning in Graphical Models (1998), MIT Press
51. Lauritzen S.L. Graphical Models (1996), Oxford University Press, Oxford
52. Baum L.E., Petrie T., Soules G., and Weiss N. A maximization technique occurring in statistical analysis of probabilistic functions of Markov chains. Ann. Math. Stat. 41 1 (1970) 164-171
53. In: Doucet A., de Freitas N., and Gordon N. (Eds). Sequential Monte Carlo in Practice (2001), Springer-Verlag
54. Ristic B., Arulampalam S., and Gordon N. Beyond the Kalman Filter: Particle Filters for Tracking Applications (2004), Artech House, Boston
55. E.B. Sudderth, A.T. Ihler, W.T. Freeman, A.S. Willsky, Nonparametric belief propagation, in: CVPR, 2003
56. Wainwright M.J., Jaakkola T.S., and Willsky A.S. Tree-based reparameterization analysis of sum-product and its generalizations. IEEE Trans. IT 49 5 (2003) 1120-1146
57. McEliece R., and Aji S.M. The generalized distributive law. IEEE Trans. Inform. Theory 46 2 (2000) 325-343
58. Wainwright M.J., Jaakkola T., and Willsky A.S. Tree consistency and bounds on the performance of the max-product algorithm and its generalizations. Stat. Comput. 14 (2004) 143-166
59. Bertsekas D.P. Dynamic Programming and Optimal Control vol. 1 (1995), Athena Scientific, Belmont, MA
60. Viterbi A.J. Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Trans. IT 13 2 (1967) 260-269
61. K. Murphy, Y. Weiss, M. Jordan, Loopy belief propagation for approximate inference: An empirical study, in: UAI 15, 1999, pp. 467-475
62. J.S. Yedidia, W.T. Freeman, Y. Weiss, Constructing free energy approximations and generalized belief propagation algorithms, Tech. Rep. 2004-040, MERL, May 2004
63. R. Dechter, K. Kask, R. Mateescu, Iterative join-graph propagation, in: UAI, 2002, pp. 128-136
64. M.J. Wainwright, M.I. Jordan, Graphical models, exponential families, and variational inference, Tech. Rep. 629, UC Berkeley Dept. of Statistics, September 2003
65. N. Srebro, Maximum likelihood bounded tree-width Markov networks, in: UAI 17, 2001
66. Brown D. A note on approximations to discrete probability distributions. Inform. Control 2 (1959) 386-392
67. Chow C.K., and Liu C.N. Approximating discrete probability distributions with dependence trees. IEEE Trans. IT 14 3 (1968) 462-467
68. Dempster A.P., Laird N.M., and Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. B 39 1 (1977) 1-38
69. Dee D.P., Cohn S.E., Dalcher A., and Ghil M. An efficient algorithm for estimating noise covariances in distributed systems. IEEE Trans. AC 30 11 (1985) 1057-1065
70. Willsky A. Multiresolution Markov models for signal and image processing. Proc. IEEE 90 8 (2002) 1396-1458
71. Robertson A.W., Kirshner S., and Smyth P. Downscaling of daily rainfall occurrence over northeast Brazil using a hidden Markov model. J. Climate 17 22 (2004) 4407-4424
72. Robertson A.W., Kirshner S., Smyth P., Charles S.P., and Bates B.B. Subseasonal-to-interdecadal variability of the Australian monsoon over North Queensland. Q. J. Royal Meteor. Soc. 132 (2006) 519-542
73. Fieguth P.W., Karl W.C., Willsky A.S., and Wunsch C. Multiresolution optimal interpolation and statistical analysis of TOPEX/POSEIDON satellite altimetry. IEEE Trans. Geosci. Remote Sens. 33 2 (1995) 280-292
74. Bhatia M., Karl W.C., and Willsky A.S. Tomographic reconstruction and estimation based on multi-scale natural pixel bases. IEEE Trans. IP 6 (1997) 463-478
75. M. Schneider, P.W. Fieguth, W.C. Karl, A.S. Willsky, Multiscale methods for the segmentation of images, in: ICASSP, vol. 4, 1996, pp. 2247-2250
76. Jet Propulsion Laboratory. The PO.DAAC Ocean ESIP Tool. http://poet.jpl.nasa.gov/
77. Reynolds R.W., and Smith T.M. Improved global sea surface temperature analyses using optimal interpolation. J. Climate 7 (1994) 929-948
78. Irving W.W., Fieguth P.W., and Willsky A.S. An overlapping tree approach to multiscale stochastic modeling and estimation. IEEE Trans. IP 6 11 (1997) 1517-1529
79. Wainwright M.J., Sudderth E.B., and Willsky A.S. Tree-based modeling and estimation of Gaussian processes on graphs with cycles. NIPS vol. 13 (2000), MIT Press 661-667
80. Daniel M.M., and Willsky A.S. The modeling and estimation of statistically self-similar processes in a multiresolution framework. IEEE Trans. IT 45 3 (1999) 955-970
81. Hughes J.P., Guttorp P., and Charles S.P. A non-homogeneous hidden Markov model for precipitation occurrence. J. R. Stat. Soc. C 48 1 (1999) 15-30
82. Hughes J.P., and Guttorp P. A class of stochastic models for relating synoptic atmospheric patterns to regional hydrologic phenomena. Water Resour. Res. 30 (1994) 1535-1546
83. Zucchini W., and Guttorp P. A hidden Markov model for space-time precipitation. Water Resour. Res. 27 8 (1991) 1917-1923
84. Hughes J.P., and Guttorp P. Incorporating spatial dependence and atmospheric data in a model of precipitation. J. Appl. Meteorol. 33 12 (1994) 1503-1515
85. Meilǎ M., and Jordan M.I. Learning with mixtures of trees. J. Mach. Learn. Research 1 1 (2000) 1-48
86. Kirshner S., Smyth P., and Robertson A.W. Conditional Chow-Liu tree structures for modeling discrete-valued vector time series. In: Chickering M., and Halpern J. (Eds). Proceedings of the Twentieth Conference on Uncertainty in Artificial Intelligence. UAI-04 (2004), AUAI Press 317-324
87. Cover T.M. Learning in pattern recognition. In: Watanabe S. (Ed). Methodologies of Pattern Recognition (1969), Academic Press, New York 111-132
88. Acock M.C., and Pachepsky Y.A. Estimating missing weather data for agricultural simulations using group method of data handling. J. Appl. Meteorol. 39 (2000) 1176-1184