A mathematical approach for evaluating Markov models in continuous time without discrete-event simulation

Medical Decision Making

Volumn 33, Issue 6, 2013, Pages 767-779

  Van Rosmalen, Joost ^a   Toy, Mehlika ^a,b   O'Mahony, James F ^a,c  

^a ERASMUS MEDICAL CENTER   (Netherlands)

^b HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

^c TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

Cohort analysis; Continuous time Markov model; Discrete event simulation; Discrete time Markov model; Microsimulation

Indexed keywords

ARTICLE; COHORT ANALYSIS; CONTINUOUS-TIME MARKOV MODEL; DISCRETE-EVENT SIMULATION; DISCRETE-TIME MARKOV MODEL; MICROSIMULATION; PROBABILITY; THEORETICAL MODEL;

COHORT ANALYSIS; CONTINUOUS-TIME MARKOV MODEL; DISCRETE-EVENT SIMULATION; DISCRETE-TIME MARKOV MODEL; MICROSIMULATION;

MARKOV CHAINS; MODELS, THEORETICAL;

EID: 84884636871     PISSN: 0272989X     EISSN: 1552681X     Source Type: Journal    
DOI: 10.1177/0272989X13487947     Document Type: Article

References (48)

1. Beck JR, Pauker SG. The Markov process in medical prognosis. Med Decis Making. 1983;3(4):419-58.
2. Sonnenberg FA, Beck JR. Markov models in medical decision making: a practical guide. Med Decis Making. 1993;13(4):322-38.
3. Briggs A, Sculpher M. An introduction to Markov modelling for economic evaluation. Pharmacoeconomics. 1998;13(4):397-409.
4. Hunink MGM, Glasziou PP, Siegel JE, et al. Decision Making in Health and Medicine: Integrating Evidence and Values. Cambridge (UK): Cambridge University Press; 2001.
5. Rutter CM, Zaslavsky AM, Feuer EJ. Dynamic microsimulation models for health outcomes: a review. Med Decis Making. 2011; 31(1):10-8.
6. Craig BA, Sendi PP. Estimation of the transition matrix of a discrete-time Markov chain. Health Econ. 2002;11(1):33-42.
7. Naimark DM, Bott M, Krahn M. The half-cycle correction explained: two alternative pedagogical approaches. Med Decis Making. 2008;28(5):706-12.
8. Barendregt JJ. The half-cycle correction: banish rather than explain it. Med Decis Making. 2009;29(4):500-2.
9. Cooper K, Brailsford SC, Davies R. Choice of modelling technique for evaluating health care interventions. J Oper Res Soc. 2007;58:168-76.
10. Cooper K, Brailsford SC, Davies R, Raftery J. Areview of health care models for coronary heart disease interventions. Health Care Manag Sci. 2006;9(4):311-24.
11. Kim SY, Goldie SJ, Salomon JA. Exploring model uncertainty in economic evaluation of health interventions: the example of rotavirus vaccination in Vietnam. Med Decis Making. 2010;30(5): E1-E28.
12. Varas-Lorenzo C, Maguire A, Castellsague J, Perez-Gutthann S. Quantitative assessment of the gastrointestinal and cardiovascular risk-benefit of celecoxib compared to individualNSAIDs at the population level. Pharmacoepidemiol Drug Saf. 2007;16(4):366-76.
13. Karnon J. Alternative decision modelling techniques for the evaluation of health care technologies: Markov processes versus discrete event simulation. Health Econ. 2003;12(10):837-48.
14. Elbasha EE, Szucs T, Chaudhary MA, et al. Cost-effectiveness of raltegravir in antiretroviral treatment-experienced HIV-1-infected patients in Switzerland. HIV Clin Trials. 2009;10(4): 233-53.
15. Hazen GB. Factored stochastic trees: a tool for solving complex temporal medical decision models. Med Decis Making. 1993;13(3): 227-36.
16. Habbema JD, van Oortmarssen GJ, Lubbe JT, van der Maas PJ. The MISCAN simulation program for the evaluation of screening for disease. Comput Methods Programs Biomed. 1985;20(1):79-93.
17. Welton NJ, Ades AE. Estimation of Markov chain transition probabilities and rates from fully and partially observed data: uncertainty propagation, evidence synthesis, and model calibration. Med Decis Making. 2005;25(6):633-45.
18. Armitage P, Doll R. The age distribution of cancer and a multistage theory of carcinogenesis. Br J Cancer. 1954;8(1):1-12.
19. Uhry Z, Hedelin G, Colonna M, et al. Multi-state Markov models in cancer screening evaluation: a brief review and case study. Stat Methods Med Res. 2010;19(5):463-86.
20. Satten GA, Longini IM. Markov chains with measurement error: estimating the "true" course of a marker of the progression of human immunodeficiency virus disease. Appl Stat. 1996; 45(3):275-309.
21. Miller DK, Homan SM. Determining transition probabilities: confusion and suggestions. Med Decis Making. 1994;14(1):52-8.
22. Singer B, Spilerman S. The representation of social processes by Markov models. Am J Sociol. 1976;82(1):1-54.
23. Israel RB, Rosenthal JS, Wei JZ. Finding generators for Markov chains via empirical transition matrices, with applications to credit ratings. Mathematical Finance. 2001;11(2):245-65.
24. Cox DR, Miller HD. The Theory of Stochastic Processes. London: Chapman and Hall; 1965.
25. Moler C, Van Loan C. Nineteen dubious ways to compute the exponential of a matrix, twenty-five years later. SIAM Rev. 2003; 45(1):3-49.
26. Van Loan C. Computing integrals involving the matrix exponential. IEEE Trans Automat Contr. 1978;23(3):395-404.
27. Tataru P, Hobolth A. Comparison of methods for calculating conditional expectations of sufficient statistics for continuous time Markov chains. BMC Bioinformatics. 2011;12:465.
28. Castella F, Dujardin G, Sericola B. Moments' analysis in homogeneous Markov reward models. Methodol Comput Appl Probab. 2009;11(4):583-601.
29. Telek M, Horváth A, Horváth G. Analysis of inhomogeneous Markov reward models. Linear Algebra Appl. 2004;386:383-405.
30. Hawkins N, Sculpher M, Epstein D. Cost-effectiveness analysis of treatments for chronic disease: using R to incorporate time dependency of treatment response. Med Decis Making. 2005; 25(5):511-9.
31. Asmussen S, Nerman O, Olsson M. Fitting phase-type distributions via the EM algorithm. Scand J Stat. 1996;23(4):419-41.
32. Ross SM. Introduction to Probability Models. Amsterdam: Academic Press; 2007.
33. Neuts MF. Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. Baltimore (MD): John Hopkins University Press; 1981.
34. Asmussen S. Applied Probability and Queues. Berlin: Springer; 2003.
35. Fackrell M. Modelling healthcare systems with phase-type distributions. Health Care Manag Sci. 2009;12(1):11-26.
36. Thümmler A, Buchholz P, Telek M. A novel approach for phase-type fitting with the EM algorithm. IEEE Transactions on Dependable and Secure Computing. 2006;3(3):245-58.
37. Toy M, van Rosmalen J, O'Mahony JF, Redelop WK, Veldhuijzen IK, Richardus JH, Schalm SW. Modelling age-specific health gain and costs of antiviral therapy for active chronic hepatitis B. In submission [World Journal of Gastroenterology].
38. Toy M, Veldhuijzen IK, de Man RA, Richardus JH, Schalm SW. Potential impact of long-term nucleoside therapy on the mortality and morbidity of active chronic hepatitis B. Hepatology. 2009; 50(3):743-51.
39. Levy AR, Kowdley KV, Iloeje U, et al. The impact of chronic hepatitis B on quality of life: a multinational study of utilities from infected and uninfected persons. Value Health. 2008;11(3): 527-38.
40. Dutch Health Care Insurance Board (CVZ). Available from: URL: http://www.medicijnkosten.nl/
41. Putter H, Fiocco M, Geskus RB. Tutorial in biostatistics: competing risks and multi-state models. Stat Med. 2007;26(11): 2389-430.
42. Kalbfleisch JD, Lawless JF. The analysis of panel data under a Markov assumption. J Am Stat Assoc. 1985;80(392):863-71.
43. Oostenbrink JB, Rutten-van Molken MP, Monz BU, FitzGerald JM. Probabilistic Markov model to assess the cost-effectiveness of bronchodilator therapy in COPD patients in different countries. Value Health. 2005;8(1):32-46.
44. Groot Koerkamp B, Weinstein MC, Stijnen T, Heijenbrok-Kal MH, Hunink MG. Uncertainty and patient heterogeneity in medical decision models. Med Decis Making. 2010;30(2):194-205.
45. Stout NK, Knudsen AB, Kong CY, McMahon PM, Gazelle GS. Calibrationmethods used in cancer simulation models and suggested reporting guidelines. Pharmacoeconomics. 2009;27(7):533-45.
46. Tan SYGL, Van Oortmarssen GJ, Piersma N. Estimating parameters of a microsimulation model for breast cancer screening using the score function method. Ann Oper Res. 2003;119:43-61.
47. Rutter CM, Miglioretti DL, Savarino JE. Bayesian calibration of microsimulation models. J Am Stat Assoc. 2009;104(488):1338-50.
48. Kong CY, McMahon PM, Gazelle GS. Calibration of disease simulation model using an engineering approach. Value Health. 2009;12(4):521-9.