Hamilton-jacobi formulation for reach-avoid differential games

IEEE Transactions on Automatic Control

Volumn 56, Issue 8, 2011, Pages 1849-1861

  Margellos, Kostas ^a   Lygeros, John ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Differential game theory; Hamilton Jacobi equations; hybrid systems; optimal control; Reachability

Indexed keywords

CONTINUOUS DYNAMICS; DIFFERENTIAL GAME THEORY; DIFFERENTIAL GAMES; GENERAL CLASS; HAMILTON JACOBI EQUATIONS; HAMILTON-JACOBI; NUMERICAL SOLUTION; OPTIMAL CONTROL; OPTIMAL CONTROL PROBLEM; REACHABILITY; REACHABILITY PROBLEM; SAFETY PROBLEMS; STATE CONSTRAINTS; UNDERACTUATED; UNDERWATER VEHICLES; VALUE FUNCTIONS;

CONTROL; DYNAMICS; HAMILTONIANS; HYBRID COMPUTERS; HYBRID SYSTEMS; LINEAR SYSTEMS; OPTIMIZATION; SUBMERSIBLES; WATER CRAFT;

GAME THEORY;

EID: 80051517659     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2011.2105730     Document Type: Article

References (36)

1. C. Tomlin, J. Lygeros, and S. Sastry, "A game theoretic approach to controller design for hybrid systems," Proc. IEEE, vol. 88, no. 7, pp. 949-969, Jul. 2000.
2. C. Tomlin, G. Pappas, and S. Sastry, "Conflict resolution for air traffic management: A study in multiagent hybrid systems," IEEE Trans. Autom. Control, vol. 43, no. 4, pp. 509-521, Apr. 1998. (Pubitemid 128737375)
3. K. Margellos and J. Lygeros, "Air traffic management with target windows: An approach using reachability," in Proc. IEEE Conf. Decision Control, 2009, pp. 145-150.
4. C. Tomlin, J. Lygeros, and S. Sastry, "Aerodynamic envelope protection using hybrid control," in Proc. Amer. Control Conf., 1998, pp. 1793-1796.
5. J. Lygeros, C. Tomlin, and S. Sastry, "Controllers for reachability specifications for hybrid systems," Automatica, vol. 35, pp. 349-370, 1999.
6. A. M. Bayen, I. M. Mitchell, M. Oishi, and C. Tomlin, "Aircraft autolander safety analysis through optimal control-based reach set computation," J. Guidance, Control, Dynam., vol. 30, no. 1, pp. 68-77, 2007. (Pubitemid 46219873)
7. I. Kitsios and J. Lygeros, "Final glide-back envelope computation for reusable launch vehicle using reachability," in Proc. IEEE Conf. Decision Control, 2005, pp. 4059-4064. (Pubitemid 46297605)
8. C. Livadas and N. Lynch, "Formal verification of safety-critical hybrid systems," Hybrid Syst., Comput. Control, vol. 1386, LNCS, pp. 253-272, 1998. (Pubitemid 128055521)
9. J. Lygeros, D. N. Godbole, and S. Sastry, "Verified hybrid controllers for automated vehicles," IEEE Trans. Autom. Control, vol. 43, no. 4, pp. 522-539, Apr. 1998. (Pubitemid 128737376)
10. J. Aubin, Viability Theory. Boston, MA: Birkhauser, 1991.
11. P. Cardaliaguet, "A differential game with two players and one target," SIAM J. Control Optimiz., vol. 34, no. 4, pp. 1441-1460, 1996. (Pubitemid 126562722)
12. P. Cardaliaguet, M. Quincampoix, and P. Saint-Pierre, "Pursuit differential games with state constraints," SIAM J. Control Optimiz., vol. 39, no. 5, pp. 1615-1632, 2001. (Pubitemid 32991786)
13. J. P. Aubin, J. Lygeros, M. Quincampoix, S. Sastry, and N. Seube, "Impulse differential inclusions: A viability approach to hybrid systems," IEEE Trans. Autom. Control, vol. 47, no. 1, pp. 2-20, Jan. 2002. (Pubitemid 34504319)
14. Y. G. Gao, J. Lygeros, and M. Quincampoix, "On the reachability problem for uncertain hybrid systems," IEEE Trans. Autom. Control, vol. 52, no. 9, pp. 1572-1586, Sep. 2007. (Pubitemid 47456069)
15. P. Cardaliaguet, M. Quincampoix, and P. Saint-Pierre, "Set valued numerical analysis for optimal control and differential games," in Annals of the International Society of Dynamic Games, M. Bardi, T. Raghaven, and T. Papasarathy, Eds. Boston, MA: Birkhauser, 1999, pp. 177-247.
16. J. Lygeros, "On reachability and minimum cost optimal control," Automatica, vol. 40, no. 6, pp. 917-927, 2004.
17. L. Evans and P. Souganidis, "Differential games and representation formulas for solutions of Hamilton-Jacobi-Isaacs equations," Indiana Univ. Math. J., vol. 33, no. 5, pp. 773-797, 1984.
18. I. Mitchell, A. M. Bayen, and C. Tomlin, "Validating a Hamilton Jacobi approximation to hybrid reachable sets," in Hybrid Systems: Computation and Control, M. Di Benedetto and A. Sangiovanni-Vincentelli, Eds. New York: Springer-Verlag, 2001, pp. 418-432. (Pubitemid 33256434)
19. S. Osher and J. Sethian, "Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulations," J. Comput. Phys., vol. 79, pp. 12-49, 1988.
20. J. A. Sethian, Level Set Methods: Evolving Interfaces in Geometry, Fluid Mechanics, Computer Vision, and Materials Science. New York: Cambridge Univ. Press, 1996.
21. I. Mitchell and C. Tomlin, "Level set methods for computations in hybrid systems," in Hybrid Systems: Computation and Control, M. Di Benedetto and A. Sangiovanni-Vincentelli, Eds. New York: Springer-Verlag, 2000, pp. 310-323.
22. C. Tomlin, "Hybrid control of air traffic management systems," Ph.D. dissertation, Dept. Elect. Eng. Comput. Sci., University of California, Berkeley, CA, 1998.
23. I. M. Mitchell, "Application of level set methods to control and reachability problems in continuous and hybrid systems," Ph.D. dissertation, Stanford University, Stanford, CA, 2002.
24. M. Oishi, "Recovery from error in flight management systems: Applications of hybrid reachability," presented at the Adv. Process Control Appl. Ind. Workshop, 2006.
25. A. B. Kurzhanski and P. Varaiya, "Ellipsoidal techniques for reachability under state constraints," SIAM J. Control Optimiz., vol. 45, no. 4, pp. 1369-1394, 2006. (Pubitemid 47109329)
26. A. B. Kurzhanski, I. M. Mitchell, and P. Varaiya, "Optimization techniques for state-constrained control and obstacle problems," J. Optimiz. Theory Appl., vol. 128, no. 3, pp. 499-521, 2006. (Pubitemid 44631549)
27. A. B. Kurzhanski and P. Varaiya, "Optimization methods for target problems of control," in Proc. Math. Theory Netw. Syst. Conf., 2002, pp. 1-10.
28. O. Bokanowski, N. Forcadel, and H. Zidani, "Reachability and minimal times for state constrained nonlinear problems without any controllability assumption," 2009 [Online]. Available: http://hal.archives-ouvertes. fr/docs/00/39/55/89/PDF/BFZ-Obstacle.pdf
29. I. J. Fialho and T. Georgiou, "Worst case analysis of nonlinear systems," IEEE Trans. Autom. Control, vol. 44, no. 6, pp. 1180-1196, Jun. 1999.
30. E. Barron and H. Ishii, "The Bellman equation for minimizing the maximum cost," Nonlinear Anal, Theory, Methods Appl., vol. 13, no. 9, pp. 1067-1090, 1989.
31. D. Panagou, K. Margellos, S. Summers, J. Lygeros, and K. Kyriakopoulos, "A viability approach for the stabilization of an underactuated underwater vehicle in the presence of current disturbances," in Proc. IEEE Conf. Decision Control, 2009, pp. 8612-8617.
32. P. P. Varaiya, "On the existence of solutions to a differential game," SIAM J. Control Optimiz., vol. 5, no. 1, pp. 153-162, 1967.
33. I. Mitchell, A. M. Bayen, and C. Tomlin, "A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games," IEEE Trans. Autom. Control, vol. 50, no. 7, pp. 947-957, Jul. 2005. (Pubitemid 41078397)
34. J. Lygeros, "Reachability, viability and invariance: An approach based on minimum cost optimal control," Dept. Eng., University of Cambridge, Cambridge, U.K., Tech. rep. CUED/F-INFENG/TR.444, 2002.
35. L. Evans, Partial Differential Equations. Providence, RI: Amer. Math. Soc., 1998.
36. S. Sastry, Nonlinear Systems: Analysis, Stability and Control. New York: Springer-Verlag, 1999.