Bounding the equilibrium distribution of Markov population models

Numerical Linear Algebra with Applications

Volumn 18, Issue 6, 2011, Pages 931-946

  Dayar, Tuǧrul ^a   Hermanns, Holger ^b   Spieler, David ^b   Wolf, Verena ^b  

^a BILKENT UNIVERSITY   (Turkey)

^b SAARLAND UNIVERSITY   (Germany)

Author keywords

Continuous time Markov chain; Equilibrium probability distribution; Geometric bounds; Lyapunov function; Stochastic complement

Indexed keywords

EID: 82455162420     PISSN: 10705325     EISSN: 10991506     Source Type: Journal    
DOI: 10.1002/nla.795     Document Type: Article

References (35)

1. Ball K, Kurtz TG, Popovic L, Rempala G. Asymptotic analysis of multiscale approximations to reaction networks. The Annals of Applied Probability 2006; 16(4):1925-1961.
2. Engblom S. Numerical solution methods in stochastic chemical kinetics. PhD Thesis, Uppsala University, Division of Scientific Computing, Numerical Analysis, 2008.
3. Grassmann WK. Finding transient solutions in Markovian event systems through randomization. In Numerical Solution of Markov Chains, Stewart WJ (ed.). Marcel Dekker: New York, 1991; 357-371.
4. Heegaard PE, Sandmann W. Ant-based approach for determining the change of measure in importance sampling. In Proceedings of the Winter Simulation Conference, WSC 2007, IEEE Press: Piscataway, New Jersey, 2007;412-420.
5. Henzinger TA, Jobstmann B, Wolf V. Formalisms for specifying Markovian population models. In Proceedings of the 3rd International Workshop on Reachability Problems, Vol. 5797, LNCS. Springer-Verlag: Berlin, Heidelberg, 2009.
6. Kurtz TG. The relationship between stochastic and deterministic models for chemical reactions. Journal of Chemical Physics 1972; 57(7):2976-2978.
7. Henzinger TA, Mateescu M, Mikeev L, Wolf V. Hybrid numerical solution of the chemical master equation. In Proceedings of the 8th International Conference on Computational Methods in Systems Biology, CMSB '10. ACM Digital Library: New York, 2010.
8. Thattai M, van Oudenaarden A. Intrinsic noise in gene regulatory networks. Proceedings of the National Academy of Sciences of the United States of America 2001; 98(15):8614-8619.
9. Swain PS, Elowitz MB, Siggia ED. Intrinsic and extrinsic contributions to stochasticity in gene expression. Proceedings of the National Academy of Sciences of the United States of America 2002; 99(20):12795-12800.
10. Paulsson J. Summing up the noise in gene networks. Nature 2004; 427(6973):415-418.
11. Jahnke T, Huisinga W. Solving the chemical master equation for monomolecular reaction systems analytically. Journal of Mathematical Biology 2007; 54(1):1-26.
12. Ramsey S, Orrell D, Bolouri H. Dizzy: stochastic simulation of large-scale genetic regulatory networks. Journal of Bioinformatics and Computational Biology 2005; 3(2):415-436.
13. Didier F, Henzinger TA, Mateescu M, Wolf V. Fast adaptive uniformization of the chemical master equation. IET Systems Biology Journal 2010. To appear.
14. Hegland M, Burden C, Santoso L, MacNamara S, Booth H. A solver for the stochastic master equation applied to gene regulatory networks. Journal of Computational and Applied Mathematics 2007; 205(2):708-724.
15. Sidje RB, Burrage K, MacNamara S. Inexact uniformization method for computing transient distributions of Markov chains. SIAM Journal on Scientific Computing 2007; 29(6):2562-2580.
16. Meyer CD. Stochastic complementation, uncoupling Markov chains, and the theory of nearly reducible systems. SIAM Review 1989; 31(2): 240-272. DOI: 10.1137/1031050.
17. Courtois P-J, Semal P. Bounds for the positive eigenvectors of nonnegative matrices and for their approximations by decomposition. Journal of the ACM 1984; 31(4):804-825. DOI: 10.1145/1634.1637.
18. Halmos PR. A Hilbert Space Problem Book, 2nd ed., Graduate Texts in Mathematics, Springer: New York, Berlin, Heidelberg, 1982.
19. Tweedie RL. Sufficient conditions for regularity, recurrence and ergodicity of Markov processes. Mathematical Proceedings of the Cambridge Philosophical Society 1975; 78(01):125-136. DOI: 10.1017/S0305004100051562.
20. Riska A. Aggregate matrix-analytic techniques and their applications. PhD Thesis, The College of William and Mary, 2002. AAI3081205.
21. Ramaswami V, Taylor PG. Some properties of the rate operators in level dependent quasi-birth-and-death processes with countable number of phases. Communications in Statistics. Stochastic Models 1996; 12(1):143-164.
22. Seneta E. Non-negative matrices; an introduction to theory and applications. Allen & Unwin: London, 1973.
23. Schur J. Über lineare Transformationen in der Theorie der unendlichen Reihen. Journal für die reine und angewandte Mathematik (Crelle's Journal) 1921; 1921(151):79-111. .
24. Banach S. Théorie des opérations linéaires. Chelsea Publishing Company: New York, 1955.
25. Duff IS, Reid JK. An implementation of Tarjan's algorithm for the block triangularization of a matrix. ACM Transactions on Mathematical Software 1978; 4(2):137-147. DOI: 10.1145/355780.355785.
26. Courtois P-J. Analysis of large Markovian models by parts. Applications to queueing network models, Messung, Modellierung und Bewertung von Rechensystemen, 3. GI/NTG-Fachtagung, 1985; 1-10.
27. Dayar T, Stewart WJ. Quasi lumpability, lower-bounding coupling matrices, and nearly completely decomposable Markov chains. SIAM Journal on Matrix Analysis and Applications 1997; 18(2):482-498. DOI: 10.1137/S0895479895294277.
28. Muntz RR, de Souza e Silva E, Goyal A. Bounding availability of repairable computer systems. In Sigmetrics '89: Proceedings of the 1989 ACM Sigmetrics International Conference on Measurement and Modeling of Computer Systems. ACM: New York, NY, USA, 1989; 29-38, DOI: 10.1145/75108.75376.
29. Geobound., Last site access on 9 March 2011.
30. Lee TL, Li TY, Tsai CH. HOM4PS-2.0: A software package for solving polynomial systems by the polyhedral homotopy continuation method. Computing 2008; 83(2-3):109-133. DOI: 10.1007/s00607-008-0015-6.
31. Demmel JW, Eisenstat SC, Gilbert JR, Li XS, Liu JWH. A supernodal approach to sparse partial pivoting. SIAM Journal on Matrix Analysis and Applications 1999; 20(3):720-755.
32. Loinger A, Lipshtat A, Balaban NQ, Biham O. Stochastic simulations of genetic switch systems. Physical Review E 2007; 75(2):021904.
33. Lipshtat A, Loinger A, Balaban NQ, Biham O. Genetic toggle switch without cooperative binding. Physical Review Letters 2006; 96(18):188101. DOI: 10.1103/PhysRevLett.96.188101.
34. Gardner TS, Cantor CR, Collins JJ. Construction of a genetic toggle switch in Escherichia coli. Nature 2000; 403(6767):339-342. DOI: 10.1038/35002131.
35. Goss PJE, Peccoud J. Quantitative modeling of stochastic systems in molecular biology by using stochastic Petri nets. Proceedings of the National Academy of Sciences of the United States of America 1998; 95(12):6750-6755.