Perturbation analysis of continuous-time absorbing Markov chains

Numerical Linear Algebra with Applications

Volumn 18, Issue 6, 2011, Pages 901-917

  Caswell, Hal ^a  

^a WOODS HOLE OCEANOGRAPHIC INSTITUTION   (United States)

Author keywords

Absorbing Markov chains; Demography; Disease progression models; Fundamental matrix; Matrix calculus; Perturbation analysis

Indexed keywords

EID: 82455187988     PISSN: 10705325     EISSN: 10991506     Source Type: Journal    
DOI: 10.1002/nla.791     Document Type: Article

References (44)

1. Kemeny JG, Snell JL. Finite Markov chains. Van Nostrand: New York, 1960. 1960.
2. Kemeny JG, Snell JL. Finite continuous time Markov chains. Theory of Probability and its Applications 1961; 6:101-105.
3. Iosifescu M. Finite Markov processes and their applications. Wiley: New York, 1980.
4. Schweitzer PJ. Perturbation theory and finite Markov chains. Journal of Applied Probability 1968; 5:401-413.
5. Meyer CD. The role of the group generalized inverse in the theory of finite Markov chains. SIAM Review 1975; 17:443-464.
6. Funderlic RE, Meyer CD. Sensitivity of the stationary distribution vector for an ergodic Markov chain. Linear Algebra and its Applications 1986; 76:1-17.
7. Golub GH, Meyer CD. Using the QR factorization and group inversion to compute, differentiate, and estimate the sensitivity of stationary probabilities for Markov chains. SIAM Journal on Algebraic and Discrete Methods 1986; 7:273-281.
8. Hunter JJ. Stationary distributions and mean first passage times of perturbed Markov chains. Linear Algebra and its Applications 2005; 410:217-243.
9. Cho GE, Meyer CD. Comparison of perturbation bounds for the stationary distribution of a Markov chain. Linear Algebra and its Applications 2000; 335:137-150.
10. Seneta E. Sensitivity of finite Markov chains under perturbation. Statistics and Probability Letters 1993; 17:163-168.
11. Altman E, Avrachenkov K, Núñez-queija R. Perturbation analysis for denumerable Markov chains with application to queueing models. Advances in Applied Probability 2004; 36:839-853.
12. Ramesh AV, Trivedi K. On the sensitivity of transient solutions of Markov models. Proceedings of the 1993 ACM SIGMETRICS Conference on measurement and modeling of computer systems, 1993; 122-134. DOI: 10.1145/166955.166998.
13. Mitrophanov AY. The spectral gap and perturbation bounds for reversible continuous-time Markov chains. Journal of Applied Probability 2004; 41:1219-1222.
14. Cao X-R. Estimates of performance sensitivity of a stochastic system. IEEE Transactions on Information Theory 1989; 35:1058-1068.
15. Glasserman P. Derivative estimates from simulation of continuous-time Markov chains. Operations Research 1992; 40:292-308.
16. Cao X-R, Yuan X-M, Qiu L. A single sample path-based performance sensitivity formula for Markov chains. IEEE Transactions on Automatic Control 1996; 41:1814-1817.
17. Magnus JR, Neudecker H. Matrix differential calculus with applications to simple, Hadamard, and Kronecker products. Journal of Mathematical Psychology 1985; 29:474-492.
18. Magnus JR, Neudecker H. Matrix differential calculus with applications in statistics and econometrics. John Wiley & Sons: New York, 1988.
19. Abadir KM, Magnus JR. Matrix algebra. Econometric exercises 1. Cambridge University Press: Cambridge, 2005.
20. Caswell H. Sensitivity analysis of transient population dynamics. Ecology Letters 2007; 10:1-15.
21. Caswell H. Perturbation analysis of nonlinear matrix population models. Demographic Research 2008; 18:59-116.
22. Caswell H. Stage, age, and individual stochasticity in demography. Oikos 2009; 118:1763-1782.
23. Roth WE. On direct product matrices. Bulletin of the American Mathematical Society 1934; 40:461-468.
24. Caswell H, Neubert MG, Hunter CM. Demography and dispersal: invasion speeds and sensitivity analysis in periodic and stochastic environments. Theoretical Ecology 2010. DOI: 10.1007/s12080-010-0091-z.
25. Samuelson PA. Foundations of Economic Analysis. Harvard University Press: Cambridge, 1947.
26. Caswell H. Applications of Markov chains in demography. In MAM2006: Markov Anniversary Meeting, A.N. Langville AN, Stewart WJ (eds). Boson Books: Raleigh, North Carolina, 2006; 319-334.
27. Caswell H. Perturbation analysis of longevity using matrix calculus. Population Association of America Annual Meeting 2010. (Available from: .) [Accessed 17 April 2011].
28. Caswell H. Matrix Population Models: Construction, Analysis, and Interpretation, Second edition. Sinauer Associates: Sunderland, Massachusetts, 2001.
29. Horvitz CC, Tuljapurkar S. Stage dynamics, period survival, and mortality plateaus. American Naturalist 2008; 172:203-215.
30. Keyfitz N. A Markov chain model for calculating the durability of marriage. Mathematical Population Studies 1988; 1:101-121.
31. Hoem JM. Markov chain models in life insurance. Sonderdruck aus Blatter der Deutschen Gelellschaft fur Versicherungsmathematik 1969; 9:91-107.
32. Rogers A. Multiregional Demography: Principles, Methods, and Extensions. Wiley: New York, 1995.
33. Keyfitz N, Caswell H. Applied Mathematical Demography. Springer-Verlag: New York, 2005.
34. Al Mamun A, Peeters A, Barendregt J, Willekens F, Nusselder W, Bonneux L. Smoking decreases the duration of life lived with and without cardiovascular disease: a life course analysis of the Framingham Heart Study. European Heart Journal 2004; 25:409-415.
35. Fix E, Neyman J. A simple stochastic model of recovery, relapse, death and loss of patients. Human Biology 1951; 23:205-241.
36. Kay R. A Markov model for analysing cancer markers and disease states in survival studies. Biometrics 1986; 42:855-865.
37. Kuo HS, Chang HJ, Chou P, Teng L, Chan TH-H. A Markov chain model to assess the efficacy of screening for non-insulin dependent diabetes mellitus (NIDDM). International Journal of Epidemiology 1999; 28:233-240.
38. Chen TH-H, Yen M-F, Lai S-S, Koong S-L, Wang C-Y, Wong J-M, Prevost TC, Duffy SW. Evaluation of a selective screening for colorectal carcinoma: the Taiwan Multicenter Cancer Screening (TAMCAS) Project. Cancer 1999; 86:1116-1128.
39. Wu GH-M, Wang Y-M, Yen M-F, Wong J-M, Lai H-C, Warwick J, Chen TH-H. Cost-effectiveness analysis of colorectal cancer screening with stool DNA testing in intermediate-incidence countries. BMC Cancer 2006; 6:136. DOI: 10.1186/1471-2407-6-136.
40. Sonnenberg FA, Beck R. Markov models in medical decision making: a practical guide. Medical Decision Making 1993; 13:322-338.
41. van den Hout A, Matthews FE. A piecewise constant Markov model and the effects of study design on the estimation of life expectancies in health and ill health. Statistical Methods in Medical Research 2008; 18:145-162.
42. van den Hout A, Matthews FE. Estimating dementia-free life expectancy for Parkinson's patients using Bayesian inference and microsimulation. Biostatistics 2009; 10:729-743.
43. Wilmoth JR, Horiuchi S. Rectangularization revisited: variability of age at death within human populations. Demography 1999; 36:475-495.
44. Edwards RD, Tuljapurkar S. Inequality in life spans and a new perspective on mortality convergence across industrialized countries. Population and Development Review 2005; 31:645-674.