Control of Markov decision processes from PCTL specifications

Proceedings of the American Control Conference

Volumn , Issue , 2011, Pages 311-316

  Lahijanian, M ^a   Andersson, S B ^a   Belta, C ^a  

^a Boston University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; COMPUTER CIRCUITS; LEARNING ALGORITHMS; MARKOV PROCESSES; MODEL CHECKING; SPECIFICATIONS;

AUTOMATIC DEPLOYMENTS; MARKOV DECISION PROCESSES; MODEL CHECKING ALGORITHM; PROBABILISTIC COMPUTATION TREE LOGIC (PCTL); TEMPORAL LOGIC SPECIFICATIONS;

PROCESS CONTROL;

EID: 80053157372     PISSN: 07431619     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/acc.2011.5990952     Document Type: Conference Paper

References (19)

1. C. Baier, "On algorithmic verification methods for probabilistic systems,"Ph.D. dissertation, University of Mannheim, Germany, 1998.
2. H. Hansson and B. Jonsson, "A logic for reasoning about time and reliability," Formal Aspects of Computing, vol. 6, pp. 102-111, 1994.
3. C. Courcoubetis and M. Yannakakis, "Markov decision processes and regular events," IEEE Trans. on Automatic Control, vol. 43, no. 10, pp. 1399-1418, 1998. (Pubitemid 128737412)
4. J. Barnat, L. Brim, I. Cern, M. Ceka, and J. Tumov, "Distributed qualitative ltl model checking of markov decision processes," in In Proceedings of 5th International Workshop on Parallel and Distributed Methods in verifiCation, Bonn, Germany, 2006, pp. 1-15.
5. K. Etessami, M. Kwiatkowska, M. Vardi, and M. Yannakakis, "Multiobjective model checking of Markov decision processes," Logical Methods in Computer Science, vol. 4, no. 4, pp. 1-21, 2008.
6. J. Rutten, M. Kwiatkowska, G. Norman, and D. Parker, Mathematical Techniques for Analyzing Concurrent and Probabilistic Systems, P. Panangaden and F. van Breugel (eds.), ser. CRM Monograph Series. American Mathematical Society, 2004, vol. 23.
7. C. Baier and M. Kwiatkowska, "Model checking for a probabilistic branching time logic with fairness," Distributed Computing, vol. 11, pp. 125-155, 1998. (Pubitemid 128492665)
8. S. G. Loizou and K. J. Kyriakopoulos, "Automatic synthesis of multiagent motion tasks based on LTL specifications," in Proceedings of the IEEE Conference on Decision and Control, 2004.
9. M. M. Quottrup, T. Bak, and R. Izadi-Zamanabadi, "Multi-robot motion planning: A timed automata approach," in Proceedings of the 2004 IEEE International Conference on Robotics and Automation, New Orleans, LA, April 2004, pp. 4417-4422.
10. H. K. Gazit, G. Fainekos, and G. J. Pappas, "Where's waldo? sensorbased temporal logic motion planning," in IEEE Conference on Robotics and Automation, Rome, Italy, 2007.
11. G. E. Fainekos, S. G. Loizou, and G. J. Pappas, "Translating temporal logic to controller specifications," in Proceedings of the IEEE Conference on Decision and Control, 2006.
12. M. Kloetzer and C. Belta, "A fully automated framework for control of linear systems from temporal logic specifications," IEEE Transactions on Automatic Control, vol. 53, no. 1, pp. 287-297, 2008.
13. E. M. M. Clarke, D. Peled, and O. Grumberg, Model checking. MIT Press, 1999.
14. E. A. Emerson, Handbook of Theoretical Computer Science: Formal Models and Semantics. North-Holland Publishing Company and MIT Press, 1990, vol. B, ch. Temporal and Modal Logic, pp. 995-1072.
15. N. Piterman, A. Pnueli, and Y. Saar, "Synthesis of reactive(1) designs,"in VMCAI, Charleston, SC, 2006, pp. 364-380.
16. M.Kloetzer and C. Belta, "Dealing with non-determinism in symbolic control," in Hybrid Systems: Computation and Control: 11th International Workshop, ser. Lecture Notes in Computer Science, M. Egerstedt and B. Mishra, Eds. Springer Berlin / Heidelberg, 2008, pp. 287-300.
17. M. Lahijanian, J. Wasniewski, S. Andersson, and C. Belta, "Motion planning and control from temporal logic specifications with probabilistic satisfaction guarantees," in IEEE International Conference on Robotics and Automation, Anchorage, Alaska, 2010.
18. "Robotic indoor environment (ride)." [Online]. Available: hyness.bu.edu/ride/
19. L. De Alfaro, "Formal verification of probabilistic systems," Ph.D. dissertation, Stanfod University, 1994.