Regularization of bellman equations for infinite-horizon probabilistic properties

HSCC'12 - Proceedings of the 15th ACM International Conference on Hybrid Systems: Computation and Control

Volumn , Issue , 2012, Pages 227-236

  Tkachev, Ilya ^a   Abate, Alessandro ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Absorbing sets; Bellman equations; Markov processes; Probabilistic properties

Indexed keywords

ABSORBING SET; APPROXIMATION ERRORS; BELLMAN EQUATIONS; DISCRETE TIME; EXPLICIT BOUNDS; INFINITE HORIZONS; MEAN EXIT TIME; PROBABILISTIC PROPERTIES; PROBABILISTIC VERIFICATION; REACHABILITY; STATE SPACE; WORK STUDY;

DYNAMIC PROGRAMMING; HYBRID SYSTEMS; INTEGRAL EQUATIONS;

MARKOV PROCESSES;

EID: 84860602489     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2185632.2185666     Document Type: Conference Paper

References (14)

1. A. Abate, J.-P. Katoen, J. Lygeros, and M. Prandini. Approximate model checking of stochastic hybrid systems. European Journal of Control, 16:624-641, December 2010.
2. K.E. Atkinson. The numerical solution of integral equations of the second kind, volume 4. Cambridge University Press, 1997.
3. C. Baier and J.-P. Katoen. Principles of model checking. The MIT Press, 2008.
4. D. Chatterjee, E. Cinquemani, and J. Lygeros. Maximizing the probability of attaining a target prior to extinction. Nonlinear Analysis: Hybrid Systems, 5(2):367 - 381, 2011.
5. E.B. Dynkin. Markov processes, volume 1, 2. Springer-Verlag, 1965.
6. O. Hernández-Lerma and J. B. Lasserre. Discrete-time Markov control processes, volume 30 of Applications of Mathematics (New York). Springer-Verlag, New York, 1996.
7. A. Hinton, M. Kwiatkowska, G. Norman, and D. Parker. PRISM: A tool for automatic verification of probabilistic systems. In H. Hermanns and J. Palsberg, editors, Tools and Algorithms for the Construction and Analysis of Systems, volume 3920 of Lecture Notes in Computer Science, pages 441-444. Springer Verlag, Berlin Heidelberg, 2006. (Pubitemid 44019387)
8. J.K. Hunter and B. Nachtergaele. Applied analysis. World Scientific Pub Co Inc, 2001.
9. J.-P. Katoen, M. Khattri, and I. S. Zapreev. A Markov reward model checker. In IEEE Proceedings of the International Conference on Quantitative Evaluation of Systems, pages 243-244, 2005.
10. J.R. Norris. Markov chains. Cambridge series in statistical and probabilistic mathematics. Cambridge University Press, 1998.
11. F. Ramponi, D. Chatterjee, S. Summers, and J. Lygeros. On the connections between PCTL and dynamic programming. In Proceedings of the 13th ACM international conference on Hybrid Systems: Computation and Control, pages 253-262, 2010.
12. W. Rudin. Principles of mathematical analysis, volume 275. McGraw-Hill New York, 1976.
13. S. Summers and J. Lygeros. Verification of discrete time stochastic hybrid systems: A stochastic reach-avoid decision problem. Automatica, 46(12):1951-1961, 2010.
14. I. Tkachev and A. Abate. On infinite-horizon probabilistic properties and stochastic bisimulation functions. In Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference, pages 526-531, Orlando, FL, December 2011.