Approximate abstractions of stochastic hybrid systems

IEEE Transactions on Automatic Control

Volumn 56, Issue 11, 2011, Pages 2688-2694

  Abate, Alessandro ^a   D'Innocenzo, Alessandro ^b   Di Benedetto, Maria D ^b  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b UNIVERSITY OF L'AQUILA   (Italy)

Author keywords

Markov Chains; stochastic hybrid systems

Indexed keywords

APPROXIMATION ERRORS; CONCRETE MODEL; CONTROLLABLE PARAMETERS; DISCRETE-TIME; ERGODIC PROPERTY; FINITE ABSTRACTION; MARKOV SET-CHAIN; STATE SPACE; STOCHASTIC HYBRID MODELS; STOCHASTIC HYBRID SYSTEMS;

ABSTRACTING; HYBRID COMPUTERS; HYBRID SENSORS; HYBRID SYSTEMS; MARKOV PROCESSES; STOCHASTIC SYSTEMS;

STOCHASTIC MODELS;

EID: 80455156398     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2011.2160595     Document Type: Article

References (23)

1. C. Cassandras and J. Lygeros, Stochastic Hybrid Systems, ser. Automation and Control Engineering. London, U.K.: Taylor & Francis Group/CRC Press, 2006.
2. C. Courcoubetis and M. Yannakakis, "The complexity of probabilistic verification," J. ACM, vol. 42, no. 4, pp. 857-907, 1995.
3. A. Girard and G. J. Pappas, "Approximation metrics for discrete and continuous systems," IEEE Trans. Autom. Control, vol. 52, no. 5, pp. 782-798, May 2007.
4. R. Alur, T. Henzinger, G. Lafferriere, and G. Pappas, "Discrete abstractions of hybrid systems," Proc. IEEE, vol. 88, no. 2, pp. 971-984, July 2000.
5. G. P. A. Girard and P. Tabuada, "Approximately bisimilar symbolic models for incrementally stable switched systems," IEEE Trans. Autom. Control, vol. 55, no. 1, pp. 116-126, Jan. 2010.
6. A. A. Julius and G. J. Pappas, "Approximations of stochastic hybrid systems," IEEE Trans. Autom. Control, vol. 54, no. 6, pp. 1193-1203, Jun. 2009.
7. C. Baier, J. Katoen, H. Hermanns, and V. Wolf, "Comparative branching-time semantics for Markov Chains," Inform. Comput., vol. 200, no. 2, pp. 149-214, 2005.
8. K. Larsen and A. Skou, "Bisimulation through probabilistic testing," Inform. Comput., vol. 94, pp. 1-28, 1991.
9. J. Desharnais, A. Edalat, and P. Panangaden, "Bisimulation for labeled Markov processes," Inform. Comput., vol. 179, no. 2, pp. 163-193, 2002.
10. H. Hermanns, Interactive Markov Chains, and the Quest for Quantified Quality, ser. Lecture Notes in Computer Science. New York: Springer Verlag, 2002, vol. 2428.
11. H. J. Kushner, Approximation and Weak Convergence Methods for Random Processes With Applications to Stochastic Systems Theory. Cambridge, MA: MIT Press, 1984.
12. X. Koutsoukos, "Optimal control of stochastic hybrid systems based on locally consistent Markov decision processes," Int. J. Hybrid Syst., vol. 4, pp. 301-318, 2004.
13. M. Prandini and J. Hu, "A numerical approximation scheme for reachability analysis of stochastic hybrid systems with state-dependent switchings," in Proc. IEEE Int. Conf. Decision Control, New Orleans, LA, Dec. 2007, pp. 4662-4667.
14. C. Guihenneuc-Jouyaux and C. Robert, "Discretization of continuous Markov Chains and Markov Chain Monte Carlo convergence assessment," J. Amer. Stat. Assoc., vol. 93, no. 443, pp. 1055-1067, 1998.
15. M. Sarich, F. Noe, and C. Schütte, "On the approximation quality of Markov state models," Multiscale Modeling Simul., vol. 8, no. 4, pp. 1154-1177, 2010.
16. A. Abate, M. Prandini, J. Lygeros, and S. Sastry, "Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems," Automatica, vol. 44, no. 11, pp. 2724-2734, Nov. 2008.
17. H. J. Hartfiel, Markov Set-Chains, ser. Lecture Notes in Mathematics. Berlin, Germany: Springer-Verlag, 1998, vol. 1695.
18. D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete- Time Case. Cambridge, MA: Athena Scientific, 1996.
19. J. Cohen, "Random evolutions in discrete and continuous time," Stoch. Processes Appl., vol. 9, no. 4, pp. 245-251, 1979.
20. M. Keepler, "Random evolutions processes induced by discrete time Markov Chains," Port. Math., vol. 55, no. 4, pp. 391-400, 1998.
21. I. Kozine and L. Utkin, "Interval-valued finite Markov Chains," Reliable Computing, vol. 8, pp. 97-113, 2002.
22. D. P. Bertsekas, "Convergence of discretization procedures in dynamic programming," IEEE Trans. Autom. Control, vol. AC-20, no. 3, pp. 415-419, Jun. 1975.
23. S. Meyn and R. Tweedie, Markov Chains and Stochastic Stability. Berlin, Germany: Springer Verlag, 1993.