Computationally efficient simultaneous policy update algorithm for nonlinear H∞ state feedback control with Galerkin's method

International Journal of Robust and Nonlinear Control

Volumn 23, Issue 9, 2013, Pages 991-1012

  Luo, Biao ^a   Wu, Huai Ning ^a  

^a BEIHANG UNIVERSITY   (China)

Author keywords

convergence; Galerkin's method; H state feedback control; Hamilton Jacobi Isaacs equation; simultaneous policy update algorithm

Indexed keywords

APPROXIMATE SOLUTION; COMPUTATIONALLY EFFICIENT; CONVERGENCE; FIXED POINT EQUATION; HAMILTON-JACOBI-ISAACS; HAMILTON-JACOBI-ISAACS EQUATIONS; NONLINEAR PARTIAL DIFFERENTIAL EQUATIONS; UPDATE ALGORITHMS;

ALGORITHMS; COMPUTATIONAL EFFICIENCY; FEEDBACK CONTROL; GALERKIN METHODS; LYAPUNOV FUNCTIONS; NONLINEAR EQUATIONS; PARTIAL DIFFERENTIAL EQUATIONS; STATE FEEDBACK;

ITERATIVE METHODS;

EID: 84876816423     PISSN: 10498923     EISSN: 10991239     Source Type: Journal    
DOI: 10.1002/rnc.2814     Document Type: Article

References (31)

1. ∞ Optimal Control and Related Minimax Design Problems: A Dynamic Game Approach, 2nd edn. Birkhäuser: Boston, 1995.
2. 2-gain and Passivity Techniques in Nonlinear Control. Springer-Verlag: Berlin, 1996.
3. Zhou K, Doyle JC, Glover K,. Robust and Optimal Control. Prentice Hall Upper Saddle River: NJ, 1996.
4. ∞ control via measurement feedback in nonlinear systems. IEEE Transactions on Automatic Control 1992; 37 (9): 1283-1293.
5. ∞ control via measurement feedback for general nonlinear systems. IEEE Transactions on Automatic Control 1995; 40 (3): 466-472.
6. ∞ controllers for a class of nonlinear systems. IEEE Transactions on Automatic Control 2004; 49 (2): 244-249.
7. Ankelhed D, Helmersson A, Hansson A,. A quasi-Newton interior point method for low order H-infinity controller synthesis. IEEE Transactions on Automatic Control 2011; 56 (6): 1462-1467.
8. ∞ control. IEEE Transactions on Automatic Control 1992; 6 (37): 770-784.
9. Saridis GN, Lee CG,. An approximation theory of optimal control for trainable manipulators. IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics 1979; 9 (3): 152-159.
10. Beard R, Saridis GN, Wen J,. Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation. Automatica 1997; 33 (12): 2159-2177.
11. Beard R, Saridis GN, Wen J,. Approximate solutions to the time-invariant Hamilton-Jacobi-Bellman equation. Journal of Optimization Theory and Applications 1998; 96 (3): 589-626.
12. Vamvoudakis KG, Lewis FL,. Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem. Automatica 2010; 46 (5): 878-888.
13. Beard RW, Mclain TW,. Successive Galerkin approximation algorithms for nonlinear optimal and robust control. International Journal of Control 1998; 71 (5): 717-743.
14. Vamvoudakis KG, Lewis FL,. Multi-player non-zero-sum games: Online adaptive learning solution of coupled Hamilton-Jacobi equations. Automatica 2011; 47 (8): 1556-1569.
15. ∞ state feedback control with input saturation. IEEE Transactions on Automatic Control 2006; 51 (12): 1989-1995.
16. Abu-Khalaf M, Lewis FL, Huang J,. Neurodynamic programming and zero-sum games for constrained control systems. IEEE Transactions on Neural Networks 2008; 19 (7): 1243-1252.
17. Zhang H, Wei Q, Liu D,. An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games. Automatica 2011; 47 (1): 207-214.
18. ∞ control. Automatica 2009; 45 (4): 881-888.
19. Lanzon A, Feng Y, Anderson BDO, Rotkowitz M,. Computing the positive stabilizing solution to algebraic Riccati equations with an indefinite quadratic term via a recursive method. IEEE Transactions on Automatic Control 2008; 53 (10): 2280-2291.
20. Albrecht EG,. On the optimal stabilization of nonlinear systems. PMM-Journal of Applied Mathematics Mechanics 1961; 25: 1254-1266.
21. Navasca CL, Krener A,. Solutions of Hamilton-Jacobi-Bellman equations. Proceedings of the IEEE Conference on Decision and Control, Sydney Convention and Exhibition Centre Sydney, NSW Australia, 2000.
22. Zeidler E,. Nonlinear Functional Analysis vol.1: Fixed Point Theorems. Springer-Verlag: New York, 1985.
23. Kantorovitch L,. The method of successive approximation for functional equations. Acta Mathematica 1939; 71 (1): 63-97.
24. Tapia RA,. The Kantorovich theorem for Newton's method. The American Mathematical Monthly 1971; 78 (4): 389-392.
25. Rall LB,. A note on the convergence of Newton's method. SIAM Journal on Numerical Analysis 1974; 11 (1): 34-36.
26. Finlayson BA,. The Method of Weighted Residuals and Variational Principles. Academic Press: New York, 1972.
27. McKay MD, Beckman RJ, Conover WJ,. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 1979; 21 (2): 239-245.
28. Vrabie D, Lewis FL,. Adaptive dynamic programming for online solution of a zero-sum differential game. Journal of Control Theory and Applications 2011; 9 (3): 353-360.
29. Vrabie D, Lewis FL,. Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems. Neural Networks 2009; 22 (3): 237-246.
30. 2 disturbance attenuation solution to the nonlinear benchmark problem. International Journal of Robust and Nonlinear Control 1998; 8 (4-5): 311-330.
31. Cheng T, Lewis FL,. Neural network solution for finite-horizon H-infinity constrained optimal control of nonlinear systems. Journal of Control Theory and Applications 2007; 5 (1): 1-11.