Symbolic control of stochastic systems via approximately bisimilar finite abstractions

IEEE Transactions on Automatic Control

Volumn 59, Issue 12, 2015, Pages 3135-3150

  Zamani, Majid ^a   Esfahani, Peyman Mohajerin ^b   Majumdar, Rupak ^c   Abate, Alessandro ^d   Lygeros, John ^b  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b ETH ZURICH   (Switzerland)

^c MAX PLANCK INSTITUTE FOR SOFTWARE SYSTEMS   (Germany)

^d UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Automated synthesis; bisimulation; incremental stability; linear temporal logic; stochastic systems

Indexed keywords

EID: 84914165841     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2014.2351652     Document Type: Article

References (47)

1. A. Abate, "A contractivity approach for probabilistic bisimulations of diffusion processes," in Proc. 48th IEEE Conf. Decision and Control, Dec. 2009, pp. 2230-2235.
2. A. Abate, S. Amin, M. Prandini, J. Lygeros, and S. Sastry, "Computational approaches to reachability analysis of stochastic hybrid systems," in Proc. 10th Int. Conf. Hybrid Systems: Computation and Control, Apr. 2007, pp. 4-17.
3. A. Abate, A. D'Innocenzo, and M. D. Di Benedetto, "Approximate abstractions of stochastic hybrid systems," IEEE Trans. Autom. Control, vol. 56, no. 11, pp. 2688-2694, Nov. 2011.
4. D. Angeli, "A Lyapunov approach to incremental stability properties," IEEE Trans. Autom. Control, vol. 47, no. 3, pp. 410-421, Mar. 2002.
5. S. I. Azuma and G. J. Pappas, "Discrete abstraction of stochastic nonlinear systems: A bisimulation function approach," in Proc. American Control Conf., Jun. 2010, pp. 1035-1040.
6. C. Baier and J. P. Katoen, Principles of Model Checking. Cambridge, MA: The MIT Press, Apr. 2008.
7. C. Belta and L. C. G. J. M. Habets, "Controlling a class of nonlinear systems on rectangles," IEEE Trans. Autom. Control, vol. 51, no. 11, pp. 1749-1759, Nov. 2006.
8. A. Biere, A. Cimatti, E. M. Clarke, and Y. Zhu, "Symbolic model checking without bdds," in Proc. 5th Inte. Conf. Tools and Algorithms for Construction and Analysis of Systems, Mar. 1999, pp. 193-207.
9. A. Borri, G. Pola, and M. D. Di Benedetto, "Symbolic models for nonlinear control systems affected by disturbances," Int. J. Control, vol. 85, no. 10, pp. 1422-1432, May 2012.
10. D. Chatterjee and D. Liberzon, "Stability analysis of deterministic and stochastic switched systems via a comparison principle and multiple Lyapunov functions," SIAM J. Control and Optimiz., vol. 45, no. 1, pp. 174-206, Mar. 2006.
11. G. Chesi and Y. S. Hung, "Establishing convexity of polynomial Lyapunov functions and their sublevel sets," IEEE Trans. Autom. Control, vol. 53, no. 10, pp. 2431-2436, Nov. 2008.
12. J. Desharnais, A. Edalat, and P. Panangaden, "Bisimulation for labeled Markov processes," Inform. and Comput., vol. 179, no. 2, pp. 163-193, Dec. 2002.
13. J. Desharnais, F. Laviolette, and M. Tracol, "Approximate analysis of probabilistic processes: Logic, simulation and games," in Proc. Int. Conf. Quantitative Evaluation of Systems, Sep. 2008, pp. 264-273.
14. J. J. Duistermaat and J. A. C. Kolk, Multidimensional Real Analysis I: Differentiation, vol. 1. Cambridge, MA: Cambridge University Press, 2004.
15. A. Girard and G. J. Pappas, "Approximation metrics for discrete and continuous systems," IEEE Trans. Autom. Control, vol. 25, no. 5, pp. 782-798, May 2007.
16. A. Girard, G. Pola, and P. Tabuada, "Approximately bisimilar symbolic models for incrementally stable switched systems," IEEE Trans. Autom. Control, vol. 55, no. 1, pp. 116-126, Jan. 2010.
17. L. C. G. J. M. Habets, P. J. Collins, and J. H. Van Schuppen, "Reachability and control synthesis for piecewise-affine hybrid systems on simplices," IEEE Trans. Autom. Control, vol. 51, no. 6, pp. 938-948, Jun. 2006.
18. G. Holzmann, The SPIN Model Checker: Primer and Reference Manual, 1st ed. Reading, MA: Addison-Wesley, 2003.
19. A. A. Julius and G. J. Pappas, "Approximations of stochastic hybrid systems," IEEE Trans. Autom. Control, vol. 54, no. 6, pp. 1193-1203, Jun. 2009.
20. H. J. Kushner, Stochastic Stability and Control. New York: Academic Press, 1967, ser. Mathematics in Science and Engineering.
21. H. J. Kushner and P. G. Dupuis, NumericalMethods for Stochastic Control Problems in Continuous Time. New York: Springer-Verlag, 2001.
22. M. Lahijanian, S. B. Andersson, and C. Belta, "A probabilistic approach for control of a stochastic system from LTL specifications," in Proc. 48th IEEE Conf. Decision and Control, Dec. 2009, pp. 2236-2241.
23. M. Lazar and A. I. Doban, "On infinity norms as Lyapunov functions for continuous-time dynamical systems," in Proc. 50th IEEE Conf. Decision and Control and European Control Conf., Dec. 2011, pp. 7567-7572.
24. J. Liu, U. Topcu, N. Ozay, and R. M. Murray, "Reactive controllers for differentially flat systems with temporal logic constraints," in Proc. 51st IEEE Conf. Decision and Control, Dec. 2012, pp. 7664-7670.
25. R. Majumdar and M. Zamani, "Approximately bisimilar symbolic models for digital control systems," in Computer Aided Verification (CAV), vol. 7358, LNCS, M. Parthasarathy and S. A. Seshia, Eds., July 2012, pp. 362-377, Springer-Verlag.
26. O. Maler, A. Pnueli, and J. Sifakis, "On the synthesis of discrete controllers for timed systems," in Symp. Theoret. Aspects of Comput. Sci., vol. 900, LNCS, E. W. Mayr and C. Puech, Eds., 1995, pp. 229-242, Springer-Verlag.
27. M. Mazo, Jr., A. Davitian, and P. Tabuada, "PESSOA: A tool for embedded control software synthesis," in Computer Aided Verification (CAV), vol. 6174, LNCS, T. Touili, B. Cook, and P. Jackson, Eds., Jul. 2010, pp. 566-569, Springer-Verlag.
28. B. Messner and D. Tilbury, Control Tutorial for Matlab and Simulink. [Online]. Available: http://www.library.cmu.edu/ctms/ctms/
29. R. Milner, Communication and Concurrency. Upper Saddle River, NJ: Prentice-Hall, 1989.
30. B. K. Oksendal, Stochastic Differential Equations: An Introduction With Applications, 5th ed. New York: Springer, Nov. 2002.
31. A. Papachristodoulou, J. Anderson, G. Valmorbida, S. Prajna, P. Seiler, and P. A. Parrilo, SOSTOOLS Version 3.00 Sum of Squares Optimization Toolbox for MATLAB, Oct. 2013, arXiv: 1310.4716.
32. A. Pavlov, N. van de Wouw, and H. Nijmeijer, Uniform Output Regulation of Nonlinear Systems: A Convergent Dynamics Approach. Berlin, Germany: Springer, 2005.
33. G. Pola, A. Borri, and M. D. Di Benedetto, "Integrated design of symbolic controllers for nonlinear systems," IEEE Trans. Autom. Control, vol. 57, no. 2, pp. 534-539, Feb. 2012.
34. G. Pola, A. Girard, and P. Tabuada, "Approximately bisimilar symbolic models for nonlinear control systems," Automatica, vol. 44, no. 10, pp. 2508-2516, Oct. 2008.
35. G. Pola and P. Tabuada, "Symbolic models for nonlinear control systems: Alternating approximate bisimulations," SIAM J. Control and Optimiz., vol. 48, no. 2, pp. 719-733, Feb. 2009.
36. G. Reißig, "Computing abstractions of nonlinear systems," IEEE Trans. Autom. Control, vol. 56, no. 11, pp. 2583-2598, Nov. 2011.
37. J. Spiliotis and J. Tsinias, "Notions of exponential robust stochastic stability, ISS and their Lyapunov characterizations," Int. J. Robust and Nonlin. Control, vol. 13, no. 12, pp. 173-187, Feb. 2003.
38. J. Sproston, "Discrete-time verification and control for probabilistic rectangular hybrid automata," in Proc. 8th Int. Conf. Quantitative Evaluation of Systems, Sep. 2011, pp. 79-88.
39. P. Tabuada, Verification and Control of Hybrid Systems, A Symbolic Approach, 1st ed. New York: Springer, Jun. 2009.
40. Y. Tazaki and J. Imura, "Discrete-state abstractions of nonlinear systems using multi-resolution quantizer," in Proc. 12th Int. Conf. Hybrid Systems: Computation and Control, Apr. 2009, vol. 5469, pp. 351-365.
41. J. Yeh, Martingales and Stochastic Analysis. Singapore: World Scientific, 1995, ser. Multivariate Analysis.
42. M. Zamani and A. Abate, "Symbolic control of stochastic switched systems via finite abstractions," in Quantitative Evaluation of Systems, vol. 8054, Lecture Notes in Computer Science, K. Joshi, M. Siegle, M. Stoelinga, and P. R. D'Argenio, Eds., Aug. 2013, pp. 305-321.
43. M. Zamani and A. Abate, "Approximately bisimilar symbolic models for randomly switched stochastic systems," Syst. and Control Lett., vol. 69, pp. 38-46, July 2014.
44. M. Zamani, P. Mohajerin Esfahani, A. Abate, and J. Lygeros, "Symbolic models for stochastic control systems without stability assumptions," in Proc. European Control Conf., Jul. 2013, pp. 4257-4262.
45. M. Zamani, G. Pola, M. Mazo, Jr., and P. Tabuada, "Symbolic models for nonlinear control systems without stability assumptions," IEEE Trans. Autom. Control, vol. 57, no. 7, pp. 1804-1809, Jul. 2012.
46. M. Zamani and P. Tabuada, "Backstepping design for incremental stability," IEEE Trans. Autom. Control, vol. 56, no. 9, pp. 2184-2189, Sep. 2011.
47. M. Zamani, I. Tkachev, and A. Abate, "Bisimilar symbolic models for stochastic control systems without state-space discretization," in Proc. 17th Int. Conf. Hybrid Systems: Computation and Control, Apr. 2014, pp. 41-50.