Computational methods for verification of stochastic hybrid systems

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 38, Issue 2, 2008, Pages 385-396

  Koutsoukos, Xenofon D ^a   Riley, Derek ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

Reachability analysis; Stochastic hybrid systems (SHSs); Verification

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; COMPUTATIONAL METHODS; EMBEDDED SYSTEMS; FINITE DIFFERENCE METHOD; SYSTEMS ANALYSIS; VERIFICATION;

COMPLEX EMBEDDED SYSTEMS; REACHABILITY ANALYSIS; STOCHASTIC HYBRID SYSTEMS;

LARGE SCALE SYSTEMS;

EID: 41149083423     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2007.914777     Document Type: Article

References (35)

1. D. Kozen, "A probabilistic PDL," J. Comput. Syst. Sci., vol. 30. no. 2. pp. 162-178, Apr. 1985.
2. L. de Alfaro, T. Henzinger, and R. Majumdar, "Discounting the future in systems theory," in Proc. ICALP, J. Baeten, J. Lenstra, J. Parrow, and G. Woeginger, Eds. Springer-Verlag, 2003, vol. 2719, pp. 1022-1037.
3. H. Kushner and P. Dupuis, Numerical Methods for Stochastic Control Problems in Continuous Time. New York: Springer-Verlag, 2001.
4. W. Fleming and H. Soner, Controlled Markov Processes and Viscosity Solutions. New York: Springer-Verlag, 1993.
5. A. Fehnker and F. Ivančić, "Benchmarks for hybrid systems verification," in Proc. HSCC, R. Alur and G. Pappas, Eds. Springer-Verlag, 2004, vol. 2993, pp. 326-341.
6. X. Koutsoukos and D. Riley, "Computational methods for reachability analysis of stochastic hybrid systems," in Proc. HSCC, J. Hespanha and A. Tiwari, Eds. Springer-Verlag, 2006, vol. 3927, pp. 377-391.
7. M. Bujorianu and J. Lygeros, "General stochastic hybrid systems: Modelling and optimal control," in Proc. 43rd IEEE Conf. Decision Control, Dec. 2004, pp. 1872-1877.
8. J. Hu, J. Lygeros, and S. Sastry, "Towards a theory of stochastic hybrid systems," in Proc. HSCC, N. Lynch and B. Krogh, Eds. Springer-Verlag, 2000, vol. 1790, pp. 160-173.
9. J. Hespanha, "Stochastic hybrid systems: Application to communication networks," in Proc. HSCC, R. Alur and G. Pappas, Eds. Springer-Verlag, 2004, vol. 2993, pp. 387-401.
10. M. Bernadskiy, R. Sharykin, and R. Alur, "Structured modeling of concurrent stochastic hybrid systems," in Proc. FORMATS/FTRTFT, Y. Lakhnech and S. Yovine, Eds. Springer-Verlag, 2004, vol. 3253, pp. 309-324.
11. S. Amin, A. Abate, M. Prandini, J. Lygeros, and S. Sastry, "Reachability analysis for controlled discrete time stochastic hybrid systems," in Proc. HSCC, J. Hespanha and A. Tiwari, Eds. Springer-Verlag, 2006, vol. 3927, pp. 49-63.
12. M. Bujorianu, "Extended stochastic hybrid systems and their reachability problem," in Proc. HSCC, R. Alur and G. Pappas, Eds. Springer-Verlag, 2004, vol. 2993, pp. 234-249.
13. S. Prajna, A. Jadbabaie, and G. Pappas, "Stochastic safety verification using barrier certificates," in Proc. 43rd IEEE Conf. Decision Control, Dec. 2004, pp. 929-934.
14. M. Davis, Markov Models and Optimization. London, U.K.: Chapman & Hall, 1993.
15. M. Bujorianu and J. Lygeros, "Reachability questions in piecewise deterministic Markov processes," in Proc. HSCC, O. Maler and A. Pnueli, Eds. Springer-Verlag, 2003, vol. 2623, pp. 126-140.
16. S. Strubbe, A. Julius, and A. van der Schaft, "Communicating piecewise deterministic Markov processes," in Proc. IFAC Conf. ADHS, Jun. 2003, pp. 349-354.
17. M. Davis and M. Farid, "Piecewise-deterministic processes and viscosity solutions," in Stochastic Analysis, Control, Optimization and Applications: A Volume in Honor of W. H. Fleming, W. McEneaney, G. Yin, and Q. Zhang, Eds. Boston, MA: Birkhauser, 1999, pp. 249-268.
18. J. Lugeros, "On reachability and minimum cost optimal control," Automatica, vol. 40, no. 6, pp. 917-927, Jun. 2004.
19. I. Mitchell, A. Bayen, and C. Tomlin, "A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games," IEEE Trans. Autom. Control, vol. 50, no. 7, pp. 947-957, Jul. 2005.
20. I. Mitchell and J. Templeton, "A toolbox of Hamilton-Jacobi solvers for analysis of nondeterministic continuous and hybrid systems," in Proc. HSCC, M. Morari and L. Thiele, Eds. Springer-Verlag, 2005, vol. 3414, pp. 480-494.
21. M. Puterman, Markov Decision Processes. Hoboken, NJ: Wiley, 2005.
22. C. Courcoubetis and M. Yannakakis, "The complexity of probabilistic verification," J. ACM, vol. 42, no. 4, pp. 857-907, Jul. 1995.
23. L. de Alfaro, "Computing minimum and maximum reachability times in probabilistic systems," in Proc. CONCUR, J. Baeten and S. Mauw, Eds. Springer-Verlag, 1999, vol. 1664, pp. 66-81.
24. X. Koutsoukos, "Optimal control of stochastic hybrid systems based on locally consistent Markov decision processes," Int. J. Hybrid Syst. vol. 4, pp. 301-318, 2004.
25. J. Hu, M. Prandini, and S. Sastry, "Probabilistic safety analysis in three dimensional aircraft flight," in Proc. 42nd IEEE Conf. Decision Control, Maui, III, Dec. 2003, pp. 5335-5340.
26. C. Tomlin, I. Mitchell, A. Bayen, and M. Oishi, "Computational techniques for the verification of hybrid systems," Proc. IEEE, vol. 91, no. 7, pp. 986-1001, Jul. 2003.
27. E. Asarin, O. Bournez, T. Dang, and O. Maler, "Approximate reach-ability analysis of piecewise-linear dynamical systems," in Proc. HSCC, N. Lynch and B. Krogh, Eds. Springer-Verlag, 2000, vol. 1790, pp. 21-31.
28. A. Chutinan and B. Krogh, "Computational techniques for hybrid system verification," IEEE Trans. Autom. Control, vol. 48, no. 1, pp. 64-75, Jan. 2003.
29. O. Botchkarev and S. Tripakis, "Verification of hybrid systems with linear differential inclusions using ellipsoidal approximations," in Proc. HSCC, N. Lynch and B. Krogh, Eds. Springer-Verlag, 2000, vol. 1790, pp. 73-88.
30. R. Alur, T. Dang, J. Esposito, Y. Hur, F. Ivančić, V. Kumar, I. Lee, P. Mishra, G. Pappas, and O. Sokolsky, "Hierarchical modeling and analysis of embedded systems," Proc. IEEE, vol. 91, no. 1, pp. 11-28, Jan. 2003.
31. D. Riley, X. Koutsoukos, and K. Riley, "Safety analysis of sugar cataract development using stochastic hybrid systems," in Proc. HSCC A. Bemporad, A. Bicchi, and G. Buttazzo, Eds. Springer-Verlag, 2007, vol. 4416, pp. 758-761.
32. D. Bertsekas and J. Tsitsildis, Parallel and Distributed Computation: Numerical Methods. Englewood Cliffs, NJ: Prentice-Hall, 1989.
33. A. Jazwinski, Stochastic Processes and Filtering Theory. New York: Academic, 1970.
34. D. Bertsekas and S. Shreve, Stochastic Optimal Control: The Discrete Time Case. New York: Academic, 1978.
35. P. Tseng, "Solving H-horizon, stationary Markov decision problems in time proportional to log(H)," Oper. Res. Lett., vol. 9, no. 5, pp. 287-297, Sep. 1990.