Optimal control of partially observable discrete time stochastic hybrid systems for safety specifications

Proceedings of the American Control Conference

Volumn , Issue , 2013, Pages 6231-6236

  Ding, Jerry ^a   Abate, Alessandro ^b   Tomlin, Claire ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

DYNAMIC PROGRAMMING; HYBRID SYSTEMS; OPTIMAL CONTROL SYSTEMS; PROBABILITY DISTRIBUTIONS; SPECIFICATIONS; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC SYSTEMS;

AUGMENTED STATE SPACE; BINARY RANDOM VARIABLES; CONDITIONAL DISTRIBUTION; DYNAMIC PROGRAMMING ALGORITHM; OPTIMAL CONTROL POLICY; OPTIMAL CONTROL PROBLEM; STOCHASTIC HYBRID SYSTEMS; STOCHASTIC OPTIMAL CONTROL PROBLEM;

DISCRETE TIME CONTROL SYSTEMS;

EID: 84876778310     PISSN: 07431619     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/acc.2013.6580815     Document Type: Conference Paper

References (28)

1. C. Tomlin, G. Pappas, and S. Sastry, "Conflict resolution for air traffic management: A study in multiagent hybrid systems, " IEEE Transactions on Automatic Control, vol. 43, no. 4, pp. 509-521, 2002.
2. J. Lygeros, D. Godbole, and S. Sastry, "Verified hybrid controllers for automated vehicles, " IEEE Transactions on Automatic Control, vol. 43, no. 4, pp. 522-539, 1998.
3. E. Frazzoli, M. Dahleh, and E. Feron, "Robust hybrid control for autonomous vehicle motion planning, " in Proceedings of the 39th IEEE Conference on Decision and Control, vol. 1, December 2000, pp. 821-826.
4. J. Hu, J. Lygeros, and S. Sastry, "Towards a theory of stochastic hybrid systems, " in Hybrid Systems: Computation and Control, ser. Lecture Notes in Computer Science, N. Lynch and B. Krogh, Eds. Springer Berlin / Heidelberg, 2000, vol. 1790, pp. 160-173.
5. C. G. Cassandras and J. Lygeros, Eds., Stochastic Hybrid Systems. Boca Raton, FL: CRC Press, 2006.
6. A. Aswani, N. Master, J. Taneja, V. Smith, A. Krioukov, D. Culler, and C. Tomlin, "Identifying models of HVAC systems using semiparametric regression, " in Proceedings of the American Control Conference, June 2012, pp. 3675-3680.
7. "MoVeS website, " http://www. movesproject. eu.
8. "Thermal Environmental Conditions for Human Occupancy, " ANSI/ASHRAE Standard 55-2010, 2010.
9. E. Asarin, O. Bournez, T. Dang, O. Maler, and A. Pnueli, "Effective synthesis of switching controllers for linear systems, " Proceedings of the IEEE, vol. 88, no. 7, pp. 1011-1025, 2000.
10. A. Kurzhanski and P. Varaiya, "Ellipsoidal techniques for reachability analysis, " in Hybrid Systems: Computation and Control, ser. Lecture Notes in Computer Science, N. Lynch and B. Krogh, Eds. Springer Berlin / Heidelberg, 2000, vol. 1790, pp. 202-214.
11. J.-P. Aubin, J. Lygeros, M. Quincampoix, S. Sastry, and N. Seube, "Impulse differential inclusions: A viability approach to hybrid systems, " IEEE Transactions on Automatic Control, vol. 47, no. 1, pp. 2-20, 2002.
12. X. Koutsoukos and D. Riley, "Computational methods for reachability analysis of stochastic hybrid systems, " in Hybrid Systems: Computation and Control, ser. Lecture Notes in Computer Science, J. Hespanha and A. Tiwari, Eds. Springer Berlin / Heidelberg, 2006, vol. 3927, pp. 377-391.
13. A. Girard and C. Le Guernic, "Zonotope/hyperplane intersection for hybrid systems reachability analysis, " in Hybrid Systems: Computation and Control, ser. Lecture Notes in Computer Science, M. Egerstedt and B. Mishra, Eds. Springer Berlin / Heidelberg, 2008, vol. 4981, pp. 215-228.
14. A. Abate, M. Prandini, J. Lygeros, and S. Sastry, "Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems, " Automatica, vol. 44, no. 11, pp. 2724-2734, 2008.
15. S. Summers and J. Lygeros, "Verification of discrete time stochastic hybrid systems: A stochastic reach-avoid decision problem, " Automatica, vol. 46, no. 12, pp. 1951-1961, 2010.
16. R. Cieslak, C. Desclaux, A. Fawaz, and P. Varaiya, "Supervisory control of discrete-event processes with partial observations, " IEEE Transactions on Automatic Control, vol. 33, no. 3, pp. 249-260, 1988.
17. F. Lin and W. Wonham, "On observability of discrete-event systems, " Information Sciences, vol. 44, no. 3, pp. 173-198, 1988.
18. K. Chatterjee, L. Doyen, T. Henzinger, and J.-F. Raskin, "Algorithms for omega-regular games with imperfect information, " in Computer Science Logic, ser. Lecture Notes in Computer Science, Z. ́ Esik, Ed. Springer Berlin / Heidelberg, 2006, vol. 4207, pp. 287-302.
19. H. Wong-Toi, "The synthesis of controllers for linear hybrid automata, " in Proceedings of the 36th IEEE Conference on Decision and Control, vol. 5, December 1997, pp. 4607-4612.
20. M. De Wulf, L. Doyen, and J.-F. Raskin, "A lattice theory for solving games of imperfect information, " in Hybrid Systems: Computation and Control, ser. Lecture Notes in Computer Science, J. Hespanha and A. Tiwari, Eds. Springer Berlin / Heidelberg, 2006, vol. 3927, pp. 153-168.
21. D. Del Vecchio, M. Malisoff, and R. Verma, "A separation principle for a class of hybrid automata on a partial order, " in Proceedings of the American Control Conference, June 2009, pp. 3638-3643.
22. R. Verma and D. Del Vecchio, "Safety control of hidden mode hybrid systems, " IEEE Transactions on Automatic Control, vol. 57, no. 1, pp. 62-77, 2012.
23. D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete Time Case. New York, NY: Academic Press, 1978.
24. K. Kuratowski and A. Mostowski, Set Theory: With an Introduction to Descriptive Set Theory. Amsterdam: North-Holland, 1976.
25. S. J. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 2nd Ed. Englewood Cliffs, NJ: Prentice Hall, 2002.
26. S. Thrun, W. Burgard, and D. Fox, Probabilistic Robotics. Cambridge, MA: MIT Press, 2005.
27. C. H. Papadimitriou and J. N. Tsitsiklis, "The complexity of Markov Decision Processes, " Mathematics of Operations Research, vol. 12, no. 3, pp. 441-450, 1987.
28. J. Ding, "Methods for reachability-based hybrid controller design, " Ph. D. dissertation, University of California, Berkeley, 2012. [Online]. Available: http://www. eecs. berkeley. edu/Pubs/TechRpts/2012/EECS-2012-80. html