Reachability for partially observable discrete time stochastic hybrid systems

Automatica

Volumn 50, Issue 8, 2014, Pages 1989-1998

  Lesser, Kendra ^a   Oishi, Meeko ^a  

^a MSC01 1070   (United States)

Author keywords

Hybrid systems; Optimal control; Reachability; Stochastic control

Indexed keywords

DYNAMIC PROGRAMMING; HYBRID SYSTEMS; OPTIMIZATION; STOCHASTIC SYSTEMS;

MAXIMUM PROBABILITY; OPTIMAL CONTROLS; OPTIMIZATION PROBLEMS; PERFECT INFORMATIONS; REACHABILITY; STOCHASTIC CONTROL; STOCHASTIC HYBRID SYSTEMS; SUFFICIENT STATISTICS;

CONTROLLERS;

EID: 84905241860     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2014.05.012     Document Type: Article

References (30)

1. A. Abate, M. Prandini, J. Lygeros, and S. Sastry Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems Automatica 44 11 2008 2724 2734
2. M. Aoki Optimization of stochastic systems: topics in discrete-time dynamics 1989 Academic Press, Inc
3. H. Bai, D. Hsu, W. Lee, and V.A. Ngo Monte Carlo value iteration for continuous-state POMDPs Algorithmic foundations of robotics IX Vol. 68 2011 175 191
4. D.P. Bertsekas, and S.E. Shreve Stochastic optimal control: the discrete-time case 1996 Athena Scientific
5. E. Brunskill, L. Kaelbling, T. Lozano-Perez, and N. Roy Planning in partially-observable switching-mode continuous domains Annals of Mathematics and Artificial Intelligence 58 2010 185 216
6. Bujorianu, M.L. (2010). Variational inequalities for the stochastic reachability problem. In IEEE conference on decision and control (pp. 1854-1859).
7. T. Caldwell, and T. Murphy Switching mode generation and optimal estimation with application to skid-steering Automatica 47 2011 50 64
8. Ding, J.; Abate, A.; Tomlin, C. (2013a). Optimal control of partially observable discrete time stochastic hybrid systems for safety specifications. In American control conference (pp. 6231-6236).
9. J. Ding, M. Kamgarpour, S. Summers, A. Abate, J. Lygeros, and C. Tomlin A stochastic games framework for verification and control of discrete time stochastic hybrid systems Automatica 49 9 2013 2665 2674
10. R.J. Elliot A general recursive discrete-time filter Journal of Applied Probability 30 3 1993 575 588
11. Esfahani, P.M.; Chaterjee, D.; Lygeros, J. (2011). On a problem of stochastic reach-avoid set characterization. In IEEE conference on decision and control and European control conference (pp. 7069-7074).
12. E. Fernandez-Gaucherand, and S.I. Marcus Risk-sensitive optimal control of hidden Markov models: Structural results IEEE Transactions on Automatic Control 42 10 1997 1418 1422
13. M.W. Hofbaur, and B.C. Williams Hybrid estimation of complex systems IEEE Transactions on Systems, Man, and Cybernetics 34 5 2004 2178 2191
14. J. Hu, J. Lygeros, and S. Sastry Towards a theory of stochastic hybrid systems Hybrid systems: computation and control 2000 160 173
15. M.R. James, J.S. Baras, and R.J. Elliot Risk-sensitive control and dynamic games for partially observed discrete-time nonlinear systems IEEE Transactions on Automatic Control 39 4 1994 780 792
16. Kariotoglou, N.; Summers, S.; Summers, T.; Kamgarpour, M.; Lygers, J. (2013). Approximate dynamic programming for stochastic reachability. In European control conference (pp. 584-589).
17. X. Koutsoukos, J. Kurien, and F. Zhao Estimation of distributed hybrid systems using particle filtering methods Hybrid Systems: Computation and Control 2003 298 313
18. Liu, W.; Hwang, I. (2012). A stochastic approximation based state estimation algorithm for stochastic hybrid systems. In American control conference (pp. 312-317).
19. I. Mitchell The flexible, extensible and efficient toolbox of level set methods Journal of Scientific Computing 35 2008 300 329 10.1007/s10915-007-9174- 4
20. J.M. Porta, N. Vlassis, M.T. Spain, and P. Poupart Point-based value iteration for continuous POMDPs Journal of Machine Learning Research 7 2006 2329 2367
21. M. Prandini, and J. Hu Stochastic reachability: theoretical foundations and numerical approximation Lecture notes in control and information sciences 2006 Springer Verlag 107 139
22. M. Sanjeev Arulampalam, N.G. SimonMaskell, and T. Clapp A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking IEEE Transactions on Signal Processing 50 2 2002
23. A. Shiryaev On Markov sufficient statistics in nonadditive Bayes problems of sequential analysis Theory of Probability and its Applications 9 4 1964 604 618
24. S. Soudjani, and A. Abate Adaptive and sequential gridding procedures for the abstraction and verification of stochastic processes SIAM Journal on Applied Dynamical Systems 12 2 2013 921 956
25. E. Stein, and R. Shakarchi Real analysis: measure theory, integration, and Hilbert spaces Princeton lectures in analysis 2005 Princeton University Press
26. S. Summers, and J. Lygeros Verification of discrete time stochastic hybrid systems: a stochastic reach-avoid decision problem Automatica 46 12 2010 1951 1961
27. I. Tkachev, J.P. Katoen, A. Mereacre, and A. Abate Quantitative automata-based controller synthesis for non-autonomous stochastic hybrid systems Hybrid systems: computation and control 2013 293 302
28. C. Tomlin, I. Mitchell, A. Bayen, and M. Oishi Computational techniques for the verification and control of hybrid systems Proceedings of the IEEE 91 2003 986 1001
29. R. Verma, and D. del Vecchio Safety control of hidden mode hybrid systems IEEE Transactions on Automatic Control 57 2012 62 77
30. M. Vrakopoulou, K. Margellos, J. Lygeros, and G. Andersson Probabilistic guarantees for the n-1 security of systems with wind power generation Reliability and risk evaluation of wind integrated power systems 2013 Springer, India 59 73