New insights on stochastic reachability

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2007, Pages 6172-6177

  Bujorianu, Manuela L ^a   Lygeros, John ^b  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b ETH ZURICH   (Switzerland)

Author keywords

Markov processes; Optimal stopping problem; Reduite; Stochastic hybrid systems; Stochastic reachability

Indexed keywords

CONTROL THEORY; MARKOV PROCESSES; OPTIMAL CONTROL SYSTEMS; PROBLEM SOLVING;

POTENTIAL THEORY; STOCHASTIC HYBRID SYSTEMS; VARIATIONAL INEQUALITIES;

STOCHASTIC CONTROL SYSTEMS;

EID: 62749087743     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2007.4434784     Document Type: Conference Paper

References (26)

1. Bingham, N.H., Peskir, G.: Optimal Stopping and Dynamic Programming. Lecture Notes 1 (2006), Probab. Statist. Group Manchester.
2. Blom, H.A.P.: Stochastic Hybrid Processes with Hybrid Jumps. Proc. IFAC Conference ADHS, (2003): 361-365.
3. Blom, H.A.P., Lygeros, J. (Eds.): "Stochastic Hybrid Systems: Theory and Safety Critical Applications". LNCIS 337 (2006).
4. Bujorianu, M.L., Lygeros, J.: Towards Modelling of General Stochastic Hybrid Systems. In [3]: 3-30.
5. Bujorianu, M.L., Lygeros, J.: Reachability Questions in Piecewise Deterministic Markov Processes. Hybrid Systems: Computation and Control, 6th International Workshop, LNCS 2623 (2003): 126-140.
6. Bujorianu, M.L. Extended Stochastic Hybrid Systems and their Reachability Problem. Hybrid Systems: Computation and Control 7th International Workshop, LNCS 2993 (2004): 234-249.
7. Bujorianu, M.L., Blom, H.A.P., Hermanns, H.: Functional Abstractions of Stochastic Hybrid System. In Proc. of IFAC ADHS, (2006): 160-165.
8. Bujorianu, M.L., Lygeros, J.: General Stochastic Hybrid Systems: Modelling and Optimal Control. Proc. 43th CDC, IEEE Press (2004): 182-187.
9. Ceci, C.: Regularity of the value function and viscosity solutions in optimal stopping problems for general Markov processes. Stoch. Stoch. Rep. 74(3-4) (2002): 633-649.
10. Davis, M.H.A.: "Markov Models and Optimization", London, (1993).
11. Dellacherie, C., Maisonneuve, B., Meyer, P.-A.: " Probabilités et Potentiel. Ch. XVII à XXIV Processus de Markov (fin). Complements de calcul stochastique". Hermann, Paris (1992).
12. Doob, J.L.: "Classical Potential Theory and Its Probabilistic Counter-part". Berlin (1984).
13. Doob, J.L.: "Stochastic Processes". Wiley, New York (1953).
14. Dynkin, E.B.: The optimum choice of the instant for stopping a Markov process. Soviet. Math. Dokl. 4 (1963): 627-629.
15. Dynkin, E.B.: "Markov processes". Moscow (1963), Vol. II of English translation. Springer (1965).
16. El Karoui, N., Lepeltier, J.-P.; Millet, A.: A Probabilistic Approach to the Reduite in Optimal Stopping. Probab. Math. Statist. 13 (1992), no.1, 97-121.
17. Ethier, S.N., Kurtz, T.G.: "Markov Processes: Characterization and Convergence". New York: John Wiley and Sons, (1986).
18. Hespanha, J.P., Singh, A.: Stochastic Models for Chemically Reacting Systems using Polynomial Stochastic Hybrid Systems. Int. J. on Robust Control Special Issue on Control at Small Scales: Issue 1, 15(15) (2005): 669-689.
19. Hespanha, J.P.: Stochastic Hybrid Systems: Application to Communication Network. Hybrid Systems: Computation and Control 7th International Workshop, LNCS 2993 (2004): 387-401.
20. Hu, J., Lygeros, J., Sastry, S.: Towards a Theory of Stochastic Hybrid Systems. In N. Lynch and B. Krogh (Eds.), Proc. of Hybrid Systems: Computation and Control, LNCS 1790 (2000): 160-173.
21. Hunt, G.A.: Markov Processes and Potentials I, II, III. Illinois J. Math. 1: 1 (1957): 44-93;
22. 1: 3 (1957): 316-369;
23. 2: 2 (1958): 151-213.
24. Kolokoltsov, VN.: On Markov Processes with Decomposable Pseudo-Differential Generators. Stoch. and Stoch. Rep. 76(1) (2004): 1-44.
25. Pola, G., Bujorianu, M.L., Lygeros, J., Di Benedetto, M. D.: Stochastic Hybrid Models: An Overview with applications to Air Traffic Management. Proc. ADHS, (2003): 45-50.
26. Ville, J.: "Etude Critique de la Notion de Collectif". Gauthier-Villars, Paris (1939).