MDP optimal control under temporal logic constraints

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2011, Pages 532-538

  Ding, Xu Chu ^a   Smith, Stephen L ^b   Belta, Calin ^a   Rus, Daniela ^c  

^a Boston University   (United States)

^b UNIVERSITY OF WATERLOO   (Canada)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER CIRCUITS; DYNAMICAL SYSTEMS; MARKOV PROCESSES; SPECIFICATIONS; TEMPORAL LOGIC;

CONTROL SPECIFICATIONS; DYNAMIC PROGRAMMING ALGORITHM; ENVIRONMENTAL MONITORING; LINEAR TEMPORAL LOGIC; LOGIC CONSTRAINTS; MARKOV DECISION PROCESSES; OPTIMIZATION CRITERIA; ROBOTIC APPLICATIONS;

DYNAMIC PROGRAMMING;

EID: 84860692005     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2011.6161122     Document Type: Conference Paper

References (20)

1. H. Kress-Gazit, G. Fainekos, and G. J. Pappas, "Where's Waldo? Sensor-based temporal logic motion planning," in Proc ICRA, Rome, Italy, 2007, pp. 3116-3121.
2. S. Karaman and E. Frazzoli, "Sampling-based motion planning with deterministic μ-calculus specifications," in Proc CDC, Shanghai, China, 2009, pp. 2222-2229.
3. S. G. Loizou and K. J. Kyriakopoulos, "Automatic synthesis of multiagent motion tasks based on LTL specifications," in Proc CDC, Paradise Island, Bahamas, 2004, pp. 153-158.
4. T. Wongpiromsarn, U. Topcu, and R. M. Murray, "Receding horizon temporal logic planning for dynamical systems," in Proc CDC, Shanghai, China, 2009, pp. 5997-6004.
5. E. M. Clarke, D. Peled, and O. Grumberg, Model checking. MIT Press, 1999.
6. N. Piterman, A. Pnueli, and Y. Saar, "Synthesis of reactive(1) designs," in International Conference on Verification, Model Checking, and Abstract Interpretation, Charleston, SC, 2006, pp. 364-380.
7. M. Kloetzer and C. Belta, "A fully automated framework for control of linear systems from temporal logic specifications," IEEE Trans Automatic Ctrl, vol. 53, no. 1, pp. 287-297, 2008.
8. M. Kloetzer and C. Belta, "Dealing with non-determinism in symbolic control," in Hybrid Systems: Computation and Control, ser. Lect. Notes Comp. Science, M. Egerstedt and B. Mishra, Eds. Springer Verlag, 2008, pp. 287-300.
9. L. De Alfaro, "Formal verification of probabilistic systems," Ph.D. dissertation, Stanford University, 1997.
10. C. Baier, J.-P. Katoen, and K. G. Larsen, Principles of Model Checking. MIT Press, 2008.
11. M. Vardi, "Probabilistic linear-time model checking: An overview of the automata-theoretic approach," Formal Methods for Real-Time and Probabilistic Systems, pp. 265-276, 1999.
12. X. C. Ding, S. L. Smith, C. Belta, and D. Rus, "LTL control in uncertain environments with probabilistic satisfaction guarantees," in Proc IFAC World C, Milan, Italy, Aug. 2011, to appear.
13. C. Courcoubetis and M. Yannakakis, "Markov decision processes and regular events," IEEE Trans Automatic Ctrl, vol. 43, no. 10, pp. 1399-1418, 1998.
14. C. Baier, M. Größer, M. Leucker, B. Bollig, and F. Ciesinski, "Controller synthesis for probabilistic systems," in Proceedings of IFIP TCS'2004. Kluwer, 2004.
15. S. L. Smith, J. Tůmová, C. Belta, and D. Rus, "Optimal path planning for surveillance with temporal logic constraints," Int J Robotic Research, 2011, In press.
16. X. C. Ding, S. L. Smith, C. Belta, and D. Rus, "Optimal control under probabilistic temporal logic constraints," March 2011, available at http://arxiv.org/abs/1103.4342.
17. J. Klein, "ltl2dstar - LTL to deterministic Streett and Rabin automata," http://www.ltl2dstar.de/, 2007, viewed September 2010.
18. D. Bertsekas, Dynamic programming and optimal control, vol. II. Athena Scientific, 2007.
19. M. L. Puterman, Markov decision processes: Discrete stochastic dynamic programming. John Wiley and Sons, 1994.
20. M. Lahijanian, J. Wasniewski, S. B. Andersson, and C. Belta, "Motion planning and control from temporal logic specifications with probabilistic satisfaction guarantees," in Proc ICRA, Anchorage, AK, 2010, pp. 3227 - 3232.