Reachability in recursive Markov decision processes

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4137 LNCS, Issue , 2006, Pages 358-374

  Brázdil, Tomáš ^a   Brožek, Václav ^a   Forejt, Vojtěch ^a   Kučera, Antonín ^a  

^a MASARYK UNIVERSITY   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION THEORY; FINITE AUTOMATA; GAME THEORY; GRAPHIC METHODS; MATHEMATICAL MODELS; POLYNOMIALS; PROBABILITY;

MARKOV DECISION PROCESSES; MODEL-CHECKING PROBLEMS; POLYNOMIAL TIME; RECURSIVE STATE MACHINES;

MARKOV PROCESSES;

EID: 33749573429     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11817949_24     Document Type: Conference Paper

References (11)

1. C. Baier and M. Kwiatkowska. Model checking for a probabilistic branching time logic with fairness. Distributed Computing, 11(3):125-155, 1998.
2. A. Bianco and L. de Alfaro. Model checking of probabalistic and nondeterministic systems. In Proceedings of FST&TCS'95, vol. 1026 of LNCS, pp. 499-513. Springer, 1995.
3. T. Brázdil, A. Kučera, and O. Strazovsky. On the decidability of temporal properties of probabilistic pushdown automata. In Proceedings of STACS'2005, vol. 3404 of LNCS, pp. 145-157. Springer, 2005.
4. J. Esparza, A. Kučera, and R. Mayr. Model-checking probabilistic pushdown automata. In Proceedings of LICS 2004, pp. 12-21. IEEE, 2004.
5. J. Esparza, A. Kučera, and S. Schwoon. Model-checking LTL with regular valuations for pushdown systems. I&C, 186(2):355-376, 2003.
6. K. Etessami and M. Yannakakis. Recursive Markov decision processes and recursive stochastic games. In Proceedings of ICALP 2005, vol. 3580 of LNCS. Springer, 2005.
7. K. Etessami and M. Yannakakis. Efficient qualitative analysis of classes of recursive Markov decision processes and simple stochastic games. In Proceedings of STACS'2006, LNCS. Springer, 2006.
8. E. Feinberg and A. Shwartz, editors. Handbook of Markov Decision Processes. Kluwer, 2002.
9. H. Hansson and B. Jonsson. A logic for reasoning about time and reliability. Formal Aspects of Computing, 6:512-535, 1994.
10. A. Hinton, M. Kwiatkowska, G. Norman, and D. Parker. PRISM: a tool for automatic verification of probabilistic systems. In Proceedings of TACAS 2006, LNCS. Springer, 2006. To appear.
11. M.L. Puterman. Markov Decision Processes. Wiley, 1994.