Performability assessment by model checking of Markov reward models

Formal Methods in System Design

Volumn 36, Issue 1, 2010, Pages 1-36

  Baier, Christel ^a   Cloth, Lucia ^b   Haverkort, Boudewijn R ^b,c   Hermanns, Holger ^d   Katoen, Joost Pieter ^e  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^b UNIVERSITY OF TWENTE   (Netherlands)

^c EMBEDDED SYSTEMS INSTITUTE   (Netherlands)

^d SAARLAND UNIVERSITY   (Germany)

^e RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

Markov reward models; Model checking; Performability

Indexed keywords

MARKOV REWARD MODEL; MARKOV REWARD MODELS; MODEL-CHECKING ALGORITHMS; NUMERICAL ALGORITHMS; NUMERICAL EVALUATIONS; PERFORMABILITY;

COMMUNICATION SYSTEMS; COMPUTATIONAL COMPLEXITY; MATHEMATICAL OPERATORS; SPECIFICATIONS;

MODEL CHECKING;

EID: 77949430149     PISSN: 09259856     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10703-009-0088-7     Document Type: Article

References (66)

1. Ajmone Marsan M, Balbo G, Conte G, Donatelli S, Franceschinis G (1995) Modeling with generalised stochastic Petri nets. Wiley, New York
2. Andova S, Hermanns H, Katoen J-P (2003) Discrete-time rewards model-checked. In: Proceedings of the international workshop on formal modeling and analysis of timed systems (FORMATS'03). Lecture notes in computer science, vol 2791. Springer, Berlin, pp 88-104
3. Arns M, Buchholz P, Panchenko A (2008) On the numerical analysis of inhomogeneous continuous-time Markov chains. Technical report, University of Dortmund
4. Aziz A, Sanwal K, Singhal V, Brayton R (1996) Verifying continuous-time Markov chains. In: Proceedings of the 8th international conference on computer aided verification (CAV'96). Lecture notes in computer science, vol 1102. Springer, Berlin, pp 269-276
5. A Aziz K Sanwal V Singhal R Brayton 2000 Model-checking continuous-time Markov chains ACM Trans Comput Logic 1 1 162 170 10.1145/343369.343402 1858826
6. Baier C, Katoen J-P (2008) Principles of model checking. MIT Press, Cambridge
7. Baier C, Katoen J-P, Hermanns H (1999) Approximate symbolic model checking of continuous-time Markov chains. In: Proceedings of the 10th international conference on concurrency theory (CONCUR'99). Lecture notes in computer science, vol 1664. Springer, Berlin, pp 146-161
8. Baier C, Haverkort BR, Hermanns H, Katoen J-P (2000) Model checking continuous-time Markov chains by transient analysis. In: Proceedings of the 12th international conference on computer aided verification (CAV'00). Lecture notes in computer science, vol 1855. Springer, Berlin, pp 358-372
9. Baier C, Haverkort BR, Hermanns H, Katoen J-P (2000) On the logical characterisation of performability properties. In: Proceedings of the 27th international colloquium on automata, languages and programming (ICALP'00). Lecture notes in computer science, vol 1853. Springer, Berlin, pp 780-792
10. C Baier BR Haverkort H Hermanns J-P Katoen 2003 Model-checking algorithms for continuous-time Markov chains IEEE Trans Softw Eng 29 6 524 541 10.1109/TSE.2003.1205180
11. C Baier L Cloth BR Haverkort M Kuntz M Siegle 2007 Model checking Markov chains with actions and state labels IEEE Trans Softw Eng 33 4 209 224 10.1109/TSE.2007.36 (Pubitemid 46523212)
12. MD Beaudry 1978 Performance-related reliability measures for computing systems IEEE Trans Comput 27 6 540 547 0377.68006 10.1109/TC.1978.1675145
13. A Bobbio L Roberti 1992 Distribution of the minimal completion time of parallel tasks in multi-reward semi-Markov models Perform Eval 14 239 256 0751.68007 10.1016/0166-5316(92)90007-4 1160279
14. Bobbio A, Telek M (1995) Markov regenerative SPN with non-overlapping activity cycles. In: Proceedings of the international IEEE performance and dependability symposium (PDS'95), pp 124-133
15. Clarke E, Grumberg O, Peled D (1999) Model checking. MIT Press, Cambridge
16. Cloth L (2006) Model checking algorithms for Markov reward models. PhD thesis, University of Twente
17. Cloth L, Haverkort BR (2006) Five performability algorithms: A comparison. In: Proceedings of the Markov anniversary meeting (MAM'06). Boson Books, Raleigh, pp 39-54
18. Cloth L, Katoen J-P, Khattri M, Pulungan R (2005) Model checking Markov reward models with impulse rewards. In: International conference on dependable systems and networks (DSN'05). IEEE Press, New York, pp 722-731
19. Cloth L, Jongerden MR, Haverkort BR (2007) Computing battery lifetime distributions. In: Proceedings of the international conference on dependable systems and networks (DSN'07), pp 780-789
20. Conway A, Georganas N (1989) Queueing networks: exact computational analysis. MIT Press, Cambridge
21. MC Diniz E de Souza e Silva HR Gail 2002 Calculating the distribution of a linear combination of uniform order statistics INFORMS J Comput 14 2 124 131 10.1287/ijoc.14.2.124.121 1902176
22. S Edwards L Lavagno E Lee A Sangiovanni-Vincentelli 1997 Design of embedded systems: formal models, validation and synthesis Proc IEEE 85 3 366 390 10.1109/5.558710
23. E Emerson E Clarke 1982 Using branching time temporal logic to synthesize synchronization skeletons Sci Comput Program 2 241 266 0514.68032 10.1016/0167-6423(83)90017-5 (Pubitemid 14566074)
24. Etessam K, Kwiatkowska M, Vardi MY, Yannakakis M (2008) Multi-objective model checking of Markov decision processes. Log Methods Comput Sci 4(4)
25. BL Fox PW Glynn 1988 Computing Poisson probabilities Commun ACM 31 4 440 445 10.1145/42404.42409 933227 (Pubitemid 18593345)
26. German R (2000) Performance analysis of communication systems: modeling with non-Markovian stochastic Petri nets. Wiley, New York
27. A Goyal A Tantawi 1988 A measure of guaranteed availability and its numerical evaluation IEEE Trans Comput 37 25 32 10.1109/12.75148 (Pubitemid 18595991)
28. Grassmann WK (1991) Finding transient solutions in Markovian event systems through randomization. In: Stewart W (ed) Numerical solution of Markov chains. Dekker, New York, pp 357-371
29. D Gross DR Miller 1984 The randomization technique as a modeling tool and solution procedure for transient Markov processes Oper Res 32 2 343 361 0536.60078 10.1287/opre.32.2.343 747747
30. Gröer M, Norman G, Baier C, Ciesinski F, Kwiatkowska MZ, Parker D (2006) On reduction criteria for probabilistic reward models. In: Foundations of software technology and theoretical computer science (FSTTCS). Lecture notes in computer science, vol 4337. Springer, Berlin, pp 309-320
31. H Hansson B Jonsson 1994 A logic for reasoning about time and reliability Form Asp Comput 6 512 535 0820.68113 10.1007/BF01211866
32. BR Haverkort 1993 Approximate performability and dependability analysis using generalized stochastic Petri nets Perform Eval 18 1 61 78 0848.68008 10.1016/0166-5316(93)90027-R (Pubitemid 23710401)
33. Haverkort BR, Hermanns H, Katoen J-P (2000) On the use of model checking techniques for dependability evaluation. In: Proceedings of the 19th IEEE symposium on reliable distributed systems (SRDS'00). IEEE Press, New York, pp 228-237
34. Haverkort BR, Hermanns H, Katoen J-P, Baier C (2001) Model checking CSRL-specified performability properties. In: Proceedings of the 5th international workshop on performability modeling of computer and communications systems (PMCCS'01), pp 105-109
35. Haverkort BR, Marie R, Rubino G, Trivedi KS (eds) (2001) Performability modelling. Wiley, New York
36. Haverkort BR, Cloth L, Hermanns H, Katoen J-P, Baier C (2002) Model checking performability properties. In: Proceedings of the international conference on dependable systems and networks (DSN'02). IEEE Press, New York, pp 102-112
37. H Hermanns U Herzog J-P Katoen 2002 Process algebra for performance evaluation Theor Comput Sci 274 1-2 43 87 0992.68149 10.1016/S0304-3975(00) 00305-4 1887146 (Pubitemid 34189250)
38. Hillston J (1996) A compositional approach to performance modeling. Cambridge University Press, Cambridge
39. G Horton VG Kulkarni DM Nicol KS Trivedi 1998 Fluid stochastic Petri nets: Theory, applications, and solution techniques Eur J Oper Res 105 184 201 0957.90011 10.1016/S0377-2217(97)00028-3
40. Horvath A, Gribaudo M (2002) Matrix geometric solution of fluid stochastic Petri nets. In: Proceedings of the 4th international conference on matrix analytic methods in stochastic models. World Scientific, Singapore
41. Huth M, Ryan M (2004) Logic in computer science, 2nd edn. Cambridge University Press, Cambridge
42. Katoen J-P, Khattri M, Zapreev IS (2005) A Markov reward model checker. In: Proceedings of the 2nd international conference on the quantitative evaluation of systems (QEST'05). IEEE Press, New York, pp 243-244
43. Katoen J-P, Kemna T, Zapreev I, Jansen DN (2007) Bisimulation minimisation mostly speeds up probabilistic model checking. In: Tools and algorithms for the construction and analysis of systems (TACAS). Lecture notes in computer science, vol 4424. Springer, Berlin, pp 87-101
44. Kwiatkowska M, Norman G, Parker D (2007) Stochastic model checking. In: Formal methods for performance evaluation. Lecture notes in computer science, vol 4486. Springer, Berlin, pp 220-270
45. Lam VV, Buchholz P, Sanders WH (2004) A structured path-based approach for computing transient rewards of large ctmcs. In: Quantitative evaluation of systems (QEST). IEEE Comput Soc, Los Alamitos, pp 136-145
46. T Matsunawa 1985 The exact and approximate distributions of linear combinations of selected order statistics from uniform distributions Ann Inst Stat Math 37 1 16 0577.62016 10.1007/BF02481076 790371
47. Mereacre A, Katoen J-P (2008) Model checking HML on piecewise-constant inhomogeneous Markov chains. In: Formal modeling and analysis of timed systems (FORMATS). Lecture notes in computer science, vol 5215. Springer, Berlin, pp 203-218
48. JF Meyer 1980 On evaluating the performability of degradable computing systems IEEE Trans Comput 29 8 720 731 0435.68007 10.1109/TC.1980.1675654
49. JF Meyer 1982 Closed-form solutions of performability IEEE Trans Comput 31 7 648 657 10.1109/TC.1982.1676062
50. JF Meyer 1992 Performability: a retrospective and some pointers to the future Perform Eval 14 3 139 156 0749.68014 10.1016/0166-5316(92)90002-X
51. Meyer JF, Sanders WH (2001) Specification and construction of performability models. In: Performability modelling. Wiley, New York
52. Neuts MF (1994) Matrix-geometric solutions in stochastic models. An algorithmic approach. Dover, New York
53. G Norman D Parker MZ Kwiatkowska SK Shukla R Gupta 2005 Using probabilistic model checking for dynamic power management Form Asp Comput 17 2 160 176 1080.68601 10.1007/s00165-005-0062-0 (Pubitemid 41165027)
54. WD Obal II WH Sanders 1999 State-space support for path-based reward variables Perform Eval 35 3-4 233 251 1051.68527 10.1016/S0166-5316(99)00010-3
55. Pattipati KR, Mallubhatla R, Gopalakrishna V, Viswanatham N (2001) Markov-reward models and hyperbolic systems. In: Performability modelling. Wiley, New York, pp 83-106
56. Qureshi MA (1992) Reward model solution methods with impulse and rate rewards: An algorithm and numerical results. Master's thesis, University of Arizona
57. MA Qureshi WH Sanders 1994 Reward model solution methods with impulse and rate rewards: an algorithm and numerical results Perform Eval 20 4 413 436 0941.68518 10.1016/0166-5316(94)90061-2
58. Remke A, Haverkort BR, Cloth L (2005) Model checking infinite-state Markov chains. In: Proceedings of the 11th international conference on tools and algorithms for the construction and analysis of systems (TACAS'05). Lecture notes in computer science, vol 2440. Springer, Berlin, pp 237-252
59. Remke A, Cloth L, Haverkort BR (2006) Uniformization with representatives-comprehensive transient analysis of infinite-state QBDs. In: First international conference on performance evaluation methodologies and tools. ACM, New York, pp 7-16
60. WH Sanders JF Meyer 1991 Reduced base model construction methods for stochastic activity networks IEEE J Sel Areas Commun 9 1 25 36 10.1109/49.64901
61. B Sericola 2000 Occupation times in Markov processes Commun Stat Stochastic Models 16 5 479 510 0966.60063 10.1080/15326340008807601 1796344
62. R Smith KS Trivedi A Ramesh 1988 Performability analysis: Measures, an algorithm and a case study IEEE Trans Comput 37 4 406 417 10.1109/12.2184 (Pubitemid 18638798)
63. Sokolsky O, Philippou A, Lee I, Christou K (2003) Modeling and analysis of power-aware systems. In: Proceedings of the 9th international conference on tools and algorithms for the construction and analysis of systems (TACAS'03). Lecture notes in computer science, vol 2619. Springer, Berlin, pp 409-425
64. Stewart WJ (1994) Introduction to the numerical solution of Markov chains. Princeton University Press, Princeton
65. H Tijms R Veldman 2000 A fast algorithm for the transient reward distribution in continuous-time Markov chains Oper Res Lett 26 155 158 0954.90064 10.1016/S0167-6377(00)00023-7 1759208
66. H Weisberg 1971 The distribution of linear combinations of order statistics from the uniform distribution Ann Inst Stat 42 2 704 709 0226.62046 286230