Verification of discrete time stochastic hybrid systems: A stochastic reach-avoid decision problem

Automatica

Volumn 46, Issue 12, 2010, Pages 1951-1961

  Summers, Sean ^a   Lygeros, John ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Dynamic programming; Hybrid systems; Optimal control; Reachability; Safety; Stochastic systems; Target hitting

Indexed keywords

CONTROL POLICY; DECISION PROBLEMS; DISCRETE TIME; FINITE TIME HORIZON; OPTIMAL CONTROL; OPTIMAL CONTROL PROBLEM; PRACTICAL PROBLEMS; REACHABILITY; RECURSIONS; SAFETY; STOCHASTIC HYBRID SYSTEMS; STOCHASTIC OPTIMAL CONTROL; TARGET HITTING; TIME STEP;

CONTROL; COST FUNCTIONS; ELECTRIC GROUNDING; HYBRID COMPUTERS; HYBRID SENSORS; HYBRID SYSTEMS; OPTIMIZATION; RESOURCE VALUATION; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC SYSTEMS;

DYNAMIC PROGRAMMING;

EID: 78249282613     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2010.08.006     Document Type: Article

References (42)

1. A. Abate, S. Amin, M. Prandini, J. Lygeros, and S. Sastry Computational approaches to reachability analysis of stochastic hybrid systems A. Bemporad, A. Bicchi, G.C. Buttazzo, Hybrid systems: computation and control Lecture notes in computer science Vol. 4416 2007 Springer 4 17
2. A. Abate, M. Prandini, J. Lygeros, and S. Sastry Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems Automatica 44 11 2008 2724 2734
3. J.-P. Aubin Viability theory 1991 Birkhauser Boston Inc. Cambridge, MA, USA
4. D.P. Bertsekas, and S.E. Shreve Stochastic optimal control: the discrete-time case 2007 Athena Scientific
5. K. Boda, J.A. Filar, Y. Lin, and L. Spanjers Stochastic target hitting time and the problem of early retirement IEEE Transactions on Automatic Control 49 3 2004 409 419
6. Brasao, A. (2000). Stochastic bio-economic model of northern atlantic and mediterranean bluefin tuna. Technical report.
7. M.L. Bujorianu, and J. Lygeros Reachability questions in piecewise deterministic Markov processes O. Maler, A. Pnueli, Hybrid systems: computation and control Lecture notes in computer science Vol. 2623 2003 Springer 126 140
8. J. Cai Discrete time risk models under rates of interest Probability in the Engineering and Informational Sciences 16 3 2002 309 324
9. J. Cai, and D.C. Dickson Ruin probabilities with a Markov chain interest model Insurance: Mathematics and Economics 35 3 2004 513 525
10. D.-R. Chae, and S. Pascoe Use of simple bioeconomic models to estimate optimal effort levels in the Korean coastal flounder fisheries Aquatic Living Resources 18 2 2005 93 101
11. C.W. Clark Mathematical bioeconomics: the optimal management of renewable resources 2nd ed. 1990 Wiley-Interscience
12. J.M. Conrad The bioeconomics of marine sanctuaries Journal of Bioeconomics 1 2 1999 205 217
13. C. Costello, and S. Polasky Optimal harvesting of stochastic spatial resources Journal of Environmental Economics and Management 56 1 2008 1 18
14. M. Davis Markov models and optimization 1993 Chapman & Hall London
15. T.G. de Kok Ruin probabilities with compounding assets for discrete time finite horizon problems, independent period claim sizes and general premium structure Insurance: Mathematics and Economics 33 3 2003 645 658
16. Y. Gao, J. Lygeros, and M. Quincampoix On the reachability problem for uncertain hybrid systems IEEE Transactions on Automatic Control 52 9 2007 1572 1586
17. M.K. Ghosh, A. Arapostathis, and S.I. Marcus Ergodic control of switching diffusions SIAM Journal on Control and Optimization 35 6 1997 1952 1988
18. J. Hu, J. Lygeros, and S. Sastry Towards a theory of stochastic hybrid systems N.A. Lynch, B.H. Krogh, Hybrid systems: computation and control Lecture notes in computer science Vol. 1790 2000 Springer 160 173
19. Hu, J., Prandini, M., & Sastry, S. (2003). Probabilistic safety analysis in three dimensional aircraft flight. In 42nd IEEE conference on decision and control: Vol. 5. December (pp. 53355340).
20. J. Hu, M. Prandini, and S. Sastry Aircraft conflict prediction in the presence of a spatially correlated wind field IEEE Transactions on Intelligent Transportation Systems 6 3 2005 326 340
21. X.D. Koutsoukos, and D. Riley Computational methods for reachability analysis of stochastic hybrid systems J.P. Hespanha, A. Tiwari, Hybrid systems: computation and control Lecture notes in computer science Vol. 3927 2006 Springer 377 391
22. X.D. Koutsoukos, and D. Riley Computational methods for verification of stochastic hybrid systems IEEE Transactions on Systems, Man, and CyberneticsPart A: Systems and Humans 38 2 2008 385 396
23. H.J. Kushner, and P.G. Dupuis Numerical methods for stochastic control problems in continuous time 1992 Springer-Verlag London, UK
24. T. Lauck, C.W. Clark, M. Mangel, and G.R. Munro Implementing the precautionary principle in fisheries management through marine reserves Ecological Applications 8 sp1 1998 S72 S78
25. F. Lundberg Approximerad framstilling av sannolikhetsfunktionen II. Aterforsaekring av kollektivrisker 1903 Almquist & Wiksell Uppsala
26. J. Lygeros On reachability and minimum cost optimal control Automatica 40 6 2004 917 927
27. I. Mitchell The flexible, extensible and efficient toolbox of level set methods Journal of Scientific Computing 35 23 2008 300 329
28. I. Mitchell, and C. Tomlin Level set methods for computation in hybrid systems Hybrid systems: computation and control 2000 Springer-Verlag London, UK 310 323
29. L. Nostbakken Stochastic modelling of the north sea herring fishery under alternative management regimes Marine Resource Economics 23 1 2008
30. H. Nyrhinen On the ruin probabilities in a general economic environment Stochastic Processes and their Applications 83 2 1999 319 330
31. J. Paulsen Ruin theory with compounding assets a survey Insurance: Mathematics and Economics 22 1 1998 3 16 [special issue on the interplay between insurance, finance and control]
32. J. Paulsen Ruin models with investment income Probability Surveys 5 2008 416
33. J.W. Pitchford, E.A. Codling, and D. Psarra Uncertainty and sustainability in fisheries and the benefit of marine protected areas Ecological Modelling 207 24 2007 286 292
34. W. Rudin Real and complex analysis 3rd ed. 1987 McGraw-Hill, Inc. New York, NY, USA
35. K.J. Sainsbury, A.E. Punt, and A.D.M. Smith Design of operational management strategies for achieving fishery ecosystem objectives ICES Journal of Marine Science 57 3 2000 731 741
36. M. Schael Control of ruin probabilities by discrete-time investments Mathematical Methods of Operations Research 62 1 2005 141 158
37. G. Sethi, C. Costello, A. Fisher, M. Hanemann, and L. Karp Fishery management under multiple uncertainty Journal of Environmental Economics and Management 50 2 2005 300 318
38. Q. Tang, and G. Tsitsiashvili Precise estimates for the ruin probability in finite horizon in a discrete-time model with heavy-tailed insurance and financial risks Stochastic Processes and their Applications 108 2 2003 299 325
39. C. Tomlin, J. Lygeros, and S. Sastry A game theoretic approach to controller design for hybrid systems Proceedings of the IEEE 88 2000 949 969
40. X. Wei, and Y. Hu Ruin probabilities for discrete time risk models with stochastic rates of interest Statistics & Probability Letters 78 6 2008 707 715
41. C. White, B. Kendall, S. Gaines, D. Siegel, and C. Costello Marine reserve effects on fishery profit Ecology Letters 11 4 2008 370 379
42. H. Yang, and L. Zhang Ruin problems for a discrete time risk model with random interest rate Mathematical Methods of Operations Research 63 2 2006 287 299