How fast and fat is your probabilistic model checker? An experimental performance comparison

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4899 LNCS, Issue , 2008, Pages 69-85

  Jansen, David N ^a,c   Katoen, Joost Pieter ^a,b   Oldenkamp, Marcel ^b   Stoelinga, Mariëlle ^b   Zapreev, Ivan ^a,b  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b UNIVERSITY OF TWENTE   (Netherlands)

^c RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

PATIENT MONITORING; PRISMS; PROBABILITY; SOFTWARE TESTING; STANDARDS; VERIFICATION;

CASE STUDIES; EXPERIMENTAL PERFORMANCE; HARDWARE AND SOFTWARE; HYBRID MODES; MEMORY USAGE; MODEL CHECKERS; NUMERICAL TOOLS; ORDERS-OF-MAGNITUDE; PROBABILISTIC MODEL; PROBABILISTIC SYSTEMS; RUN TIMES; STATISTICAL MODELLING;

MODEL CHECKING;

EID: 49949091129     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-77966-7_9     Document Type: Conference Paper

References (41)

1. Agha, G., Meseguer, J., Sen, K.: PMaude: Rewrite-based specification language for probabilistic object systems. ENTCS 153(2), 213-239 (2006)
2. Andova, S., Hermanns, H., Katoen, J.-P.: Discrete-time rewards model-checked. In: Larsen, K.G., Niebert, P. (eds.) FORMATS 2003. LNCS, vol. 2791, pp. 88-104. Springer, Berlin (2004)
3. Aziz, A., Sanwal, K., Singhal, V., Brayton, R.K.: Verifying continuous time Markov chains. In: Alur, R., Henzinger, T.A. (eds.) CAV 1996. LNCS, vol. 1102, pp. 269-276. Springer, Heidelberg (1996)
4. Baier, C., Ciesinski, F., Größer, M.: ProbMela and verification of Markov decision processes. SIGMETRICS Perform. Eval. Rev. 32(4), 22-27 (2005)
5. Baier, C., Haverkort, B., Hermanns, H., Katoen, J.-P.: Model-checking algorithms for continuous-time Markov chains. IEEE Trans. on Softw. Eng. 29(6), 524-541 (2003)
6. Bode, E., Herbstritt, M., Hermanns, H., Johr, S., Peikenkamp, T., Pulungan, R., Wimmer, R., Becker, B.: Compositional Performability Evaluation for STATEMATE. In: Quantitative Evaluation of Systems: QEST, pp. 167-178. IEEE CS, Los Alamitos (2006)
7. Changuion, B., Davies, I., Nelte, M.: DaNAMiCS: A Petri net editor (2007), http://www.cs.uct.ac.za/Research/DNA/microweb/danamics/DNAFrameH.html
8. Cox, D.R.: A use of complex probabilities in the theory of stochastic processes. In: Proc. Cambridge Philosophical Society, vol. 51, pp. 313-319 (1955)
9. D'Aprile, D., Donatelli, S., Sproston, J.: CSL model checking for the GreatSPN tool. In: Aykanat, C., Dayar, T., Körpeoǧlu, İ. (eds.) ISCIS 2004. LNCS, vol. 3280, pp. 543-552. Springer, Heidelberg (2004)
10. Dijkstra, E.W.: Hierarchical ordering of sequential processes. Acta Informatica 1, 115-138 (1971)
11. Fokkink, W., Pang, J.: Simplifying Itai-Rodeh leader election for anonymous rings. ENTCS 128(6), 53-68 (2005)
12. Gupta, R., Smolka, S.A., Bhaskar, S.: On randomization in sequential and distributed algorithms. ACM Comput. Surv. 26(1), 7-86 (1994)
13. Hansson, H., Jonsson, B.: A logic for reasoning about time and reliability. Formal Aspects of Computing 6(5), 512-535 (1994)
14. Hartonas-Garmhausen, V., Campos, S., Clarke, E.M.: ProbVerus: probabilistic symbolic model checking. In: Katoen, J.-P. (ed.) AMAST-ARTS 1999, ARTS 1999, and AMAST-WS 1999. LNCS, vol. 1601, pp. 96-110. Springer, Heidelberg (1999)
15. Hermanns, H., Herzog, U., Klehmet, U., Mertsiotakis, V., Siegle, M.: Compositional performance modelling with the TIPPtool. Performance Evaluation 39(1-4), 5-35 (2000)
16. Hermanns, H., Katoen, J.-P., Meyer-Kayser, J., Siegle, M.: A Markov chain model checker. In: Schwartzbach, M.I., Graf, S. (eds.) ETAPS 2000 and TACAS 2000, LNCS, vol. 1785, pp. 347-362. Springer, Heidelberg (2000)
17. Hermanns, H., Meyer-Kayser, J., Siegle, M.: Multi-terminal binary decision diagrams to represent and analyse continuous-time Markov chains. In: Plateau, B., Stewart, W.J., Silva, M. (eds.) Num. Sol. of Markov Chains, Zaragoza, Prensas Universitarias, pp. 188-207 (1999)
18. Hillston, J.: A Compositional Approach to Performance Modelling. Cambridge University Press, New York (1996)
19. Hogg, R.V., Craig, A.T.: Introduction to Mathematical Statistics, 4th edn. Macmillan, New York (1978)
20. Ibe, O.C., Trivedi, K.S.: Stochastic Petri net models of polling systems. IEEE J. on Sel. Areas in Comm. 8(9), 1649-1657 (1990)
21. Itai, A., Rodeh, M.: Symmetry breaking in distributed networks. Inf. and Comp. 88(1), 60-87 (1990)
22. Karlin, S., McGregor, J.L.: The differential equations of birth-and-death processes, and the Stieltjes moment problem. Trans. of the AMS 85(2), 489-546 (1957)
23. Katoen, J.-P., Khattri, M., Zapreev, I.S.: A Markov reward model checker. In: Quantitative Evaluation of Systems, pp. 243-244. IEEE CS, Los Alamitos (2005)
24. Katoen, J.-P., Zapreev, I.S.: Safe on-the-fly steady-state detection for time-bounded reachability. In: Quantitative Evaluation of Systems: QEST, pp. 301-310. IEEE CS, Los Alamitos (2006)
25. Kwiatkowska, M., Norman, G., Parker, D.: PRISM: Probabilistic symbolic model checker. In: Field, T., et al. (eds.) TOOLS 2002. LNCS, vol. 2324, pp. 200-204. Springer, Heidelberg (2002)
26. Kwiatkowska, M., Norman, G., Parker, D.: Stochastic model checking. In: Bernardo, M., Hillston, J. (eds.) Formal methods for performance evaluation. LNCS, vol. 4486, pp. 220-270. Springer, Heidelberg (2007)
27. Lassaigne, R., Peyronnet, S.: Approximate verification of probabilistic systems. In: Hermanns, H., Segala, R. (eds.) PROBMIV 2002, PAPM-PROBMIV 2002, and PAPM 2002. LNCS, vol. 2399, pp. 213-214. Springer, Heidelberg (2002)
28. Lecca, P., Priami, C.: Cell cycle control in eukaryotes: A BioSpi model. Technical Report DIT-03-045, Informatica e Telecommunicazioni: University of Trento (2003)
29. Mohanty, S.G., Montazer-Haghighi, A., Trueblood, R.: On the transient behavior of a finite birth-death process with an application. Computers and Operations Research 20(3), 239-248 (1993)
30. Norman, G., Shmatikov, V.: Analysis of probabilistic contract signing. J. of Computer Security 14(6), 561-589 (2006)
31. Oldenkamp, M.: Probabilistic model checking: A comparison of tools. MSc thesis, Univ. of Twente, Netherlands (2007), http://www.cs.utwente.nl/ ~oldenkampha/
32. Penna, G.D., Intrigila, B., Melatti, I., Tronci, E., Zilli, M.V.: Finite horizon analysis of Markov chains with the Murphi verifier. STTT 8(4-5), 397-409 (2006)
33. Pnueli, A., Zuck, L.D.: Verification of multiprocess probabilistic protocols. Distributed Comput. 1(1), 53-72 (1986)
34. PRISM: Probabilistic symbolic model checker (2006), http://www.cs.bham. ac.uk/~dxp/prism/
35. Sen, K., Viswanathan, M., Agha, G.: Statistical model checking of black-box probabilistic systems. In: Alur, R., Peled, D.A. (eds.) CAV 2004. LNCS, vol. 3114, pp. 202-215. Springer, Heidelberg (2004)
36. Sen, K., Viswanathan, M., Agha, G.: On statistical model checking of stochastic systems. In: Etessami, K., Rajamani, S.K. (eds.) CAV 2005. LNCS, vol. 3576, pp. 266-280. Springer, Heidelberg (2005)
37. Shedler, G.S.: Regenerative Stochastic Simulation. Academic Pr, London (1993)
38. Somenzi, F.: CUDD: CU decision diagram package. Public software (1997), http://vlsi.colorado.edu/~fabio/CUDD/
39. Younes, H.L.S.: Ymer: A statistical model checker. In: Etessami, K., Rajamani, S.K. (eds.) CAV 2005. LNCS, vol. 3576, pp. 429-433. Springer, Heidelberg (2005)
40. Younes, H.L.S., Kwiatkowska, M., Norman, G., Parker, D.: Numerical vs. statistical probabilistic model checking. STTT 8(3), 216-228 (2006)
41. Younes, H.L.S., Simmons, R.G.: Probabilistic verification of discrete event systems using acceptance sampling. In: Brinksma, E., Larsen, K.G. (eds.) CAV 2002. LNCS, vol. 2404, pp. 223-235. Springer, Heidelberg (2002)