Probabilistic verification of uncertain systems using bounded-parameter Markov Decision Processes

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3885 LNAI, Issue , 2006, Pages 283-294

  Wu, Di ^a   Koutsoukos, Xenofon ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; DECISION THEORY; MARKOV PROCESSES; PROBABILISTIC LOGICS; PROBLEM SOLVING; REAL TIME SYSTEMS;

BOUNDED-PARAMETER MARKOV DECISION PROCESSES; DISCRETE APPROXIMATION METHODS; ITERATIVE ALGORITHMS; PROBABILISTIC VERIFICATIONS;

UNCERTAIN SYSTEMS;

EID: 33745613809     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11681960_28     Document Type: Conference Paper

References (14)

1. Givan, R., Leach, S., Dean, T.: Bounded-parameter Markov decision process. Artificial Intelligence 122 (2000) 71-109
2. Courcoubetis, C., Yannakakis, M.: Markov decision processes and regular events. IEEE Transaction on Automatic Control 43 (1998) 1399-1418
3. de Alfaro, L.: Computing minimum and maximum reachability times in probabilistic systems. In: CONCUR '99: Proceedings of the 10th International Conference on Concurrency Theory, London, UK, Springer-Verlag (1999) 66-81
4. Koutsoukos, X.D.: Optimal control of stochastic hybrid systems based on locally consistent Markov decision processes. International Journal of Hybrid Systems 4 (2004) 301-318
5. Puterman, M.L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons, Inc., New York, NY, USA (1994)
6. Satia, J.K., Lave, R.E.: Markovian decision processes with uncertain transition probabilities. Operations Research 39 (1953) 1095-1100
7. White, C.C., Eldeib, H.K.: Parameter imprecision in finite state, finite action dynamic programs. Operations Research 34 (1986) 120-129
8. White, C.C., Eldeib, H.K.: Markov decision processes with imprecise transition probabilities. Operations Research 43 (1994) 739-749
9. Tang, H., Liang, X., Gao, J., Liu, C.: Robust control policy for semi-Markov decision processes with dependent uncertain parameters. In: WCICA 04': Proceedings of the Fifth World Congress on Intelligent Control and Automation. (2004)
10. Kalyanasundaram, S., Chong, E.K.P., Shroff, N.B.: Markovian decision processes with uncertain transition rates: Sensitivity and robust control. In: CDC '02: Proceedings of the 41th IEEE Conference on Decision and Control. (2002)
11. Kushner, H.J., Dupuis, P.: Numerical Methods for Stochastic Control Problems in Continuous Time, 2nd ed. Springer-Verlag, New York, NY, USA (2001)
12. Wu, D., Koutsoukos, X.D.: Probabilistic verification of bounded-parameter Markov decision processes. Technical Report ISIS-05-607, Institute for Software Integrated Systems, Vanderbilt University, Nashville, TN, USA (2005)
13. Dean, T., Givan, R., Leach, S.: Model reduction techniques for computing approximately optimal solutions for Markov decision processes. In: Proceedings of the 13th Annual Conference on Uncertainty in Artificial Intelligence (UAI-97), San Francisco, CA, Morgan Kaufmann Publishers (1997) 124-131
14. Rudin, W.: Real and Complex Analysis, 3rd Edition. McGraw-Hill, New York, NY, USA (1994)