Automated model reduction for complex systems exhibiting metastability

Multiscale Modeling and Simulation

Volumn 5, Issue 3, 2006, Pages 802-827

  Horenko, Illia ^a   Dittmer, Evelyn ^a   Fischer, Alexander ^b   Schütte, Christof ^a  

^a FREIE UNIVERSITÄT BERLIN   (Germany)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

Bayesian networks; Biomolecular conformations; Hidden Markov model; Maximum likelihood principle; Metastability; Stochastic differential equations

Indexed keywords

AMINO ACIDS; BAYESIAN NETWORKS; DIFFERENTIAL EQUATIONS; MARKOV PROCESSES; MAXIMUM LIKELIHOOD; MOLECULAR DYNAMICS; TIME SERIES ANALYSIS;

BIOMOLECULAR CONFORMATION; STOCHASTIC DIFFERENTIAL EQUATION;

LARGE SCALE SYSTEMS;

EID: 34247380700     PISSN: 15403459     EISSN: 15403467     Source Type: Journal    
DOI: 10.1137/050623310     Document Type: Article

References (54)

1. L. E. BAUM, An inequality and associated maximization technique in statistical estimation for probabilistic functions of Markov processes, Inequalities, 3 (1972), pp. 1-8.
2. A. BESKOS, O. PAPASPILIOPOULOS, G. ROBERTS, AND P. FEARNHEAD, Exact and computational efficient likelihood-based estimation for discretely observed diffusion processes, J. R. Statist. Soc. B, 68 (2006), pp. 1-29.
3. J. A. BILMES, A Gentle Tutorial of the EM Algorithm and Its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models, Tech. report, International Computer Science Institute, Berkeley, CA, 1998.
4. J. P. N. BISHWAL, Maximum likelihood estimation in partially observed stochastic differential. system driven by a fractional Brownian motion, Stochastic Anal. Appl., 21 (2003), pp. 995-1007.
5. P. G. BLACKWELL, Bayesian inference for Markov processes with diffusion and discrete components, Biometrica, 90 (2003), pp. 613-627.
6. G. E. P. BOX AND G. M. JENKINS, Time Series Analysis: Forecasting and Control, Holden-Day, San Francisco, 1976.
7. A. BRASS, B. J. PENDLETON, Y. CHEN, AND B. ROBSON, Hybrid Monte Carlo simulations theory and initial comparison with molecular dynamics, Biopolymers, 33 (1993), pp. 1307-1315.
8. T. E. DABBOUS, Filtering of linear partially observe stochastic systems: The fuzzy logic approach, Dynam. Control, 11 (2001), pp. 315-331.
9. T. E. DABBOUS, Fuzzy optimal control for bilinear stochastic systems with fuzzy parameters, Dynam. Control, 11 (2001), pp. 243-259.
10. M. DELLNITZ AND O. JUNGE, On the approximation of complicated dynamical behavior, SIAM J. Numer. Anal., 36 (1999), pp. 491-515.
11. M. DELLNITZ AND R. PREIS, Congestion and almost invariant sets in dynamical systems, in Proceedings of Symbolic and Numerical Scientific Computation (SNSC'01), Lecture Notes in Comput. Sci. 2630, Springer, Berlin, 2003, pp. 183-209.
12. P. DEUFLHARD, W. HUISINGA, A. FISCHER, AND C. SCHÜTTE, Identification of almost invariant aggregates in reversible nearly uncoupled Markov chains, Linear Algebra Appl., 315 (2000), pp. 39-59.
13. P. DEUFLHARD AND M. WEBER, Robust Perron cluster analysis in conformation dynamics, Linear Algebra Appl., 398 (2005), pp. 161-184.
14. E. DITTMER, Projizierte Hidden-Markov-Modelle in der Metastabilitätsanalyse hochdimensionaler Zeitreihen. Diploma thesis, Department of Mathematics and Computer Science, Free University Berlin, Berlin, Germany, 2004.
15. R. ELBER AND M. KARPLUS, Multiple conformational states of proteins: A molecular dynamics analysis of myoglobin, Science, 235 (1987), pp. 318-321.
16. E. FAOU AND C. LUBICH, A Poisson integrator for Gaussian wavepacket dynamics, Comput. Vis. Sci., 9 (2006), pp. 45-55.
17. A. FISCHER, S. WALDHAUSEN, AND C. SCHOTTE, Identification of biomolecular conformations from incomplete torsion angle observations by hidden Markov Models, J. Comput. Phys., submitted.
18. H. FRAUENFELDER, P. J. STEINBACH, AND R. D. YOUNG, Conformational relaxation in proteins, Chem. Soc., 29 (1989), pp. 145-150.
19. H. FRYDMAN AND P. LAKNER, Maximum likelihood estimation of hidden Markov processes, Ann. Appl. Probab., 13 (2003), pp. 1296-1312.
20. A. R. GALLANT AND G. TAUCHEN, Reprojecting partially observed systems with application to interest rate diffusions, J. Amer. Statist. Assoc., 93 (1998), pp. 10-24.
21. Z. GHAHRAMANI, An introduction to hidden Markov models and Bayesian networks, Int. J. Pattern Recognition and Artificial Intelligence, 15 (2001), pp. 9-42.
22. J. D. HAMILTON, A new approach to the economic analysis of nonstationary time series and the business cycle, Econometrica, 57 (1989), pp. 357-384.
23. I. HORENKO, E. DITTMER, AND C. SCHÜTTE, Reduced stochastic models for complex molecular systems, Comput. Vis. Sci., 9 (2006), pp. 89-102.
24. I. HORENKO, E. DITTMER, AND C. SCHÜTTE, Stochastic Model Reduction for Complex Metastable Systems: The Problem of Dimensionality, manuscript.
25. M. HRISTACHE, A. JUDITSKI, J. POLZEHL, AND V. SPOKOINY, Structure adaptive approach for dimension reduction, Ann. Statist., 29 (2001), pp. 1537-1566.
26. M. R. JAMES, V. KRISHNAMURTHY, AND F. LEGLAND, Time discretization of continuous-time filters and smoothers for hmm parameter estimation, IEEE Trans. Inform. Theory, 42 (1996), pp. 593-605.
27. T. N. KASEKE AND M. E. THOMPSON, Estimation for rainfall-runoff modeled as a partially observed Markov process, Stochastic Hydrology and Hydraulics, 11 (1997), pp. 1-16.
28. D. KORENBLUM AND D. SHALLOWAY, Macrostate data clustering, Phys. Rev. E(3), 67 (2003), 056704.
29. S. C. KOU, X. S. XIE, AND J. S. LIU, Bayesian analysis of single-molecule experimental data, Appl. Statist., 54 (2005), pp. 469-506.
30. N. R. KRISTENSEN, H. MADSEN, AND S. B. JORGENSEN, Parameter estimation in stochastic grey-box models, Automatica, 40 (2004), pp. 225-237.
31. E. LINDAHL, B. HESS, AND D. VAN DER SPOEL, Gromacs 3.0: A package for molecular simulation and trajectory analysis, J. Mol. Mod., 7 (2001), pp. 306-317.
32. L. A. LIPORACE, Maximum, likelihood estimation for multivariate observations of Markov sources, IEEE Trans. Inform. Theory, 28 (1982), pp. 729-734.
33. A. LOGOTHETIS AND V. KRISHNAMURTHY, Expectation maximization algorithms for map estimation of jump markov linear systems, IEEE Trans. Signal Process., 47 (1999), pp. 2139-2156.
34. G. MCLACHLAN, The EM Algorithm and Extensions, 2nd ed., Wiley, New York, 2005.
35. G. MCLACHLAN AND D. PEEL, Finite Mixture Models, Wiley, New York, 2000.
36. C. R. NELSON AND C. J. KIM, State-space models with regime switching: Classical and gibbs-sampling approaches with applications, MIT Press, Cambridge, MA, 1999.
37. G. U. NIENHAUS, J. R. MOURANT, AND H. FRAUENFELDER, Spectroscopic evidence for conformational relaxation in myoglobin, Proc. Natl. Acad. Sci. USA, 89 (1992), pp. 2902-2906.
38. M. ORESIC AND D. SHALLOWAY, Hierarchical characterization of energy landscapes using Gaussian packet states, J. Chem. Phys., 101 (1994), pp. 9844-9857.
39. K. PADBERG, R. PREIS, AND M. DELLNITZ, Integrating Multilevel Graph Partitioning with Hierarchical Set Oriented Methods for the Analysis of Dynamical Systems, Preprint 152, DFG Schwerpunktprogramm 1095, DFG, Bonn, Germany, 2004.
40. J. PILLARDY AND L. PIELA, Molecular dynamics on deformed energy hypersurfaces, J. Phys. Chem., 99 (1995), pp. 11805-11812.
41. J. PILLARDY AND L. PIELA, Smoothing techniques of global optimization: Distance scaling method in searches for most stable Lennard-Jones atomic clusters, J. Phys. Chem., 18 (1997), pp. 2040-2049.
42. Y. POKERN, A. M. STUART, AND P. WIBERG, Parameter Estimation for Partially Observed Hypoelliptic Diffusion, http:// www.maths.warwick.ac.uk/~stuart (2004), submitted.
43. L. R. RABINER, A tutorial on hidden Markov models and selected applications in speech recognition, Proc. IEEE, 77 (1989), pp. 257-286.
44. A. SAMAROV, V. SPOKOINY, AND C. VIAL, Component identification and estimation in nonlinear high-dimensional regression models by structural adaptation, J. Amer. Statist. Assoc., 100 (2005), pp. 429-445.
45. C. SCHÜTTE, A. FISCHER, W. HUISINGA, AND P. DEUFLHARD, A direct approach to conformational dynamics based on hybrid Monte Carlo, J. Comput. Phys., 151 (1999), pp. 146-168.
46. C. SCHÜTTE AND W. HUISINGA, Biomolecular conformations can be identified as metastable sets of molecular dynamics, in Handbook of Numerical Analysis, P. G. Ciarlet and J.-L. Lions, eds., North-Holland, Amsterdam, 2003.
47. S. L. SCOTT, Bayesian methods for hidden Markov models: Recursive computing in the 21st century, J. Amer. Statist. Assoc., 97 (2002), pp. 337-352.
48. I. SHOJI AND T. OZAKI, Comparative study of estimation methods for continuous time stochastic processes, J. Time Ser. Anal., 18 (1997), pp. 485-506.
49. V. N. SMELYANSKIY, D. A. TIMUCIN, A. BRANDRIVSKYY, AND D. G. LUCHINSKY, Model reconstruction of nonlinear dynamical systems driven by noise, Phys. Rev. Lett., submitted.
50. J. E. STRAUB, J. MA, AND P. AMARA, Simulated annealing using coarse grained classical dynamics: Smoluchowski dynamics in the Gaussian density approximation, J. Phys. Chem., 103 (1995), pp. 1574-1581.
51. A. J. VITERBI, Error bounds for convolutional codes and an asymptotically optimum decoding algorithm, IEEE Trans. Inform. Theory, 13 (1967), pp. 260-269.
52. C. F. J. WU, On the convergence properties of the EM algorithm, Ann. Statist., 11 (1983), pp. 95-103.
53. L. WU AND M. I. JORDAN, On the convergence properties of the EM algorithm for Gaussian mixtures, Neural Comput., 8 (1996), pp. 129-151.
54. Q. ZHANG, Nonlinear filtering and control of a switching diffusion with small observation noise, SIAM J. Control Optim., 36 (1998), pp. 1638-1668.