Dynamic approximate solutions of the hj inequality and of the hjb equation for input-affine nonlinear systems

IEEE Transactions on Automatic Control

Volumn 57, Issue 10, 2012, Pages 2490-2503

  Sassano, Mario ^a   Astolfi, Alessandro ^b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF ROME TOR VERGATA   (Italy)

Author keywords

cal L 2 disturbance attenuation; Hamilton Jacobi Bellman partial differential equation; nonlinear systems; optimal Control

Indexed keywords

APPROXIMATE SOLUTION; AUGMENTED SYSTEMS; CLOSED FORM SOLUTIONS; DISTURBANCE ATTENUATION; DYNAMIC CONTROLLER; HAMILTON-JACOBI; HAMILTON-JACOBI-BELLMAN; HAMILTON-JACOBI-BELLMAN EQUATIONS; HJB EQUATIONS; INPUT-AFFINE; NONLINEAR CONTROL PROBLEMS; OPTIMAL CONTROL PROBLEM; OPTIMAL CONTROLS; OPTIMALITY; POSITIVE DEFINITE; STATE-SPACE; STORAGE FUNCTION; TIME VARYING; VALUE FUNCTIONS;

ASYMPTOTIC STABILITY; NONLINEAR SYSTEMS; OPTIMAL CONTROL SYSTEMS;

PARTIAL DIFFERENTIAL EQUATIONS;

EID: 84866936317     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2012.2186716     Document Type: Article

References (32)

1. K. M. Anstreicher and M. H. Wright, "A note on the augmented Hessian when the reduced Hessian is semidefinite," SIAM J. Optimiz., vol. 11, no. 1, pp. 243-253, 2000. (Pubitemid 33235763)
2. A. Astolfi, "Singular control for nonlinear systems," Int. J. Robust Nonlinear Control, vol. 7, pp. 727-740, 1997.
3. M. Bardi and I. Capuzzo-Dolcetta, Optimal Control and Viscosity Solutions to Hamilton-Jacobi-Bellman Equations. Boston, MA: Birkhauser, 1997.
4. R. W. Beard, G. N. Saridis, and J. T.Wen, "Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation," Automatica, vol. 33, no. 12, pp. 2159-2177, 1997.
5. D. P. Bertsekas, Dynamic Programming and Optimal Control. Nashua, NH: Athena Scientific, 1995.
6. A. E. Bryson and Y. C. Ho, Applied Optimal Control: Optimization, Estimation and Control. New York: Taylor & Francis, 1975.
7. F. Camilli, M. Falcone, P. Lanucara, and A. Seghini, "A domain decomposition method for Bellman equation," Contemporary Math., vol. 180, pp. 477-483, 1994.
8. D. Carnevale and A. Astolfi, "Integrator forwarding without PDEs," in Proc. 48th IEEE Conf. Decision Control and 28th Chinese Control Conf., Shanghai, China, 2009, pp. 33-38.
9. M. G. Crandall and P. L. Lions, "Viscosity solutions of Hamilton- Jacobi equations," Trans. Amer. Math. Soc., vol. 227, pp. 1-42, 1983.
10. C. A. Desoer and M. Vidyasagar, Feedback Systems: Input-Output Properties. New York: Academic, 1975.
11. L. C. Evans, Partial Differential Equations. Providence, RI: American Mathematical Society, 1998.
12. M. Falcone, "A numerical approach to the infinite horizon problem of deterministic control theory," Appl. Math. Optimiz., vol. 15, pp. 1-13, 1987. (Pubitemid 17513401)
13. R. A. Freeman and P. V. Kokotovic, "Inverse optimality in robust stabilization," SIAM J. Control Optimiz., vol. 34, no. 4, pp. 1365-1391, 1996. (Pubitemid 126562718)
14. Y. Huang and W. M. Lu, "Nonlinear optimal control: Alternatives to Hamilton-Jacobi equation," in Proc. 35th Conf. Decision Control, Kobe, Japan, Dec. 1996, vol. 4, pp. 3942-3947.
15. T. Hunt and A. J. Krener, "Improved patchy solution to the Hamilton- Jacobi-Bellman equations," in Proc. 49th Conf. Decision Control, Atlanta, GA, 2010.
16. A. Isidori, Nonlinear Control Systems. New York: Springer-Verlag, 1995.
17. R. Johansson, "Quadratic optimization of motion coordination and control," IEEE Trans. Autom. Control, vol. 35, no. 11, pp. 1197-1208, Nov. 1990.
18. D. Karagiannis, M. Sassano, and A. Astolfi, "Dynamic scaling and observer design with application to adaptive control," Automatica, vol. 45, no. 12, pp. 2883-2889, 2009.
19. A. J. Krener, "The existence of optimal regulators," in Proc. 37th Conf. Decision Control, Tampa, FL, 1998, vol. 3, pp. 3081-3086.
20. W. M. Lu and J. C. Doyle, " control of nonlinear systems: A convex characterization," IEEE Trans. Autom. Control, vol. 40, no. 9, pp. 1668-1675, Sep. 1995.
21. D. L. Lukes, "Optimal regulation of nonlinear dynamical systems," SIAM J. Control, vol. 7, no. 1, pp. 75-100, 1969.
22. W. C. A. Maas and A. J. van der Schaft, "Singular nonlinear optimal control by state feedback," in Proc. 33rd Conf. Decision Control, Orlando, FL, Dec. 1994, vol. 2, pp. 1415-1420.
23. W. M. McEneaney, "A curse-of-dimensionality-free numerical method for solution of certain HJB PDEs," SIAM J. Control Optimiz., vol. 46, no. 4, pp. 1239-1276, 2007.
24. R. Ortega, A. Loria, P. J. Nicklasson, and H. Sira-Ramirez, Passivity- Based Control of Euler-Lagrange Systems. London, U.K.: Springer- Verlag, 1998.
25. L. Praly, D. Carnevale, and A. Astolfi, "Integrator forwarding via dynamic scaling," in Proc. 49th IEEE Conf. Decision Control, Atlanta, GA, 2010, pp. 5955-5960.
26. L. Rosier and E. D. Sontag, "Remarks regarding the gap between continuous, Lipschitz and differentiable storage functions for dissipation inequalities appearing in control," Syst. Control Lett., vol. 41, pp. 237-249, 2000.
27. M. Sassano and A. Astolfi, "Dynamic solution of the Hamilton-Jacobi inequality in the- -disturbance attenuation problem," in Proc. 8th IFAC Symp. Nonlinear Control Syst., Bologna, Italy, 2010, pp. 3081-3086.
28. M. Sassano and A. Astolfi, "Dynamic solution of the HJB equation and the optimal control of nonlinear systems," in Proc. 49th Conf. Decision Control, Atlanta, GA, 2010.
29. M. Sassano and A. Astolfi, "Dynamic disturbance attenuation and approximate optimal control for fully actuated mechanical systems," in Proc. Amer. Control Conf., San Francisco, CA, 2011.
30. A. J. van der Schaft, "- -gain analysis of nonlinear systems and nonlinear state-feedback control," IEEE Trans. Autom. Control, vol. 37, no. 6, pp. 770-784, Jun. 1992.
31. R. B. Vinter, Optimal Control. Boston, MA: Birkhauser, 2000.
32. A.Wernli and G. Cook, "Successive control for the nonlinear quadratic regulator problem," Automatica, vol. 11, pp. 75-84, 1975.