Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation

Automatica

Volumn 33, Issue 12, 1997, Pages 2159-2177

  Beard, Randal W ^a   Saridis, George N ^b   Wen, John T ^b  

^a Department of Electrical and Computer Engineering   (United States)

^b RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

Feedback synthesis; Galerkin approximation; Generalized; Hamilton Jacobi Bellman equation; Nonlinear control; Optimal control

Indexed keywords

COMPUTATIONAL COMPLEXITY; CONVERGENCE OF NUMERICAL METHODS; LINEARIZATION; NONLINEAR CONTROL SYSTEMS; OPTIMAL CONTROL SYSTEMS;

FEEDBACK SYNTHESIS; GALERKIN APPROXIMATIONS; GENERALIZED HAMILTON JACOBI BELLMAN EQUATION;

CONTROL SYSTEM SYNTHESIS;

EID: 0031332446     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0005-1098(97)00128-3     Document Type: Article

References (72)

1. Aeyels, D. (1985). Stabilization of a class of nonlinear systems by a smooth feedback control. System Control Lett., 5, 289-294.
2. Aeyels, D. (1986). Local and global stabilizability for nonlinear systems. In Theory and Applications of Nonlinear Control Systems, eds C. I. Byrnes and A. Lindquist, pp. 93-105. Elsevier, North-Holland.
3. Aganovic, Z. and Z. Gajic (1994). The successive approximation procedure for finite-time optimal control of bilinear systems. IEEE Trans. Automat. Control, 39(9), 1932-1935.
4. Al'brekht, E. G. (1961). On the optimal stabilization of nonlinear systems. J. Appl. Math. Mech., 25(5), 836-844.
5. Anderson, B. D. O. and J. B. Moore (1971). Linear Optimal Control. Prentice-Hall, Englewood Cliffs, NJ.
6. Apostol, T. M. (1974). Mathematical Analysis. Addison-Wesley, Reading, MA.
7. Battilotti, S. (1996). Global output regulation and disturbance attenuation with global stability via measurement feedback for a class of nonlinear systems. IEEE Trans. Automat. Control, 41(3), 315-327.
8. Baumann, W. T. and W. J. Hugh (1986). Feedback control of nonlinear systems by extended linearization. IEEE Trans. Automat. Control, 31(1), 40-46.
9. Beard, R. (1995). Improving the closed-loop performance of nonlinear systems. PhD Thesis. Rensselaer Polytechnic Institute. Troy, New York.
10. Beard, R., G. Saridis and J. Wen (1996). Improving the performance of stabilizing control for nonlinear systems. Control Systems Mag., 16(5), 27-35.
11. Beard, R., G. Saridis and J. Wen (1998). Approximate solutions to the time-invariant Hamilton-Jacobi-Bellman equation. J. Optim. Theory Appl., to appear.
12. Bellman, R. and S. Dreyfus (1962). Applied Dynamic Programming. Princeton University Press, Princeton, NJ.
13. Bittanti, S., A. Laub and J. C. Willems (1991). The Riccati Equation. Springer, New York.
14. Bosarge, W. E., O. G. Johnson, R. S. McKnight and W. P. Timlake (1973). The Ritz-Galerkin procedure for nonlinear control problems. SIAM J. Numer. Anal., 10(1), 94-110.
15. Bryson, A. E. and Y. C. Ho (1975). Applied Optimal Control. Hemisphere, New York.
16. Capuzzo Dolcetta, I. (1983). On a discrete approximation of the Hamilton-Jacobi equation of dynamic programming. Appl. Math. Optim., 10, 367-377.
17. Capuzzo Dolcetta, I. and H. Ishii (1984). Approximate solutions of the Bellman equation of deterministic control theory., Appl. Math. Optim. 11, 161-181.
18. Capuzzo Dolcetta, I. and M. Falcone (1989). Discrete dynamic programming and viscosity solutions of the Bellman equation., Annales Institut Henri Poincare Anal. Nonlinear (suppl.) 6, 161-184.
19. Cebuhar, W. A. and V. Costanza (1984). Approximation procedures for the optimal control of bilinear and nonlinear systems. J. Optim. Theory Appl., 43(4), 615-627.
20. Chapman, J. W., M. D. Ilic, C. A. King, L. Eng and H. Kaufman (1993). Stabilizing a multimachine power system via decentralized feedback linearizing excitation control. IEEE Trans. Power Systems, 8(3), 830-839.
21. ∞ control via the state-dependent Riccati equation technique. In 'IFAC World Congress', San Francisco, California.
22. Crandall, M. G., H. Ishii and P.-L. Lions (1992). User's guide to viscosity solutions of second order partial differential equations. Bull. Am. Math. Soc., 27(1), 1-67.
23. Falcone, M. (1987). A numerical approach to the infinite horizon problem of deterministic control theory. Appl. Math. Optim., 15, 1-13.
24. Falcone, M. and R. Ferretti (1994). Discrete time high-order schemes for viscosity solutions of Hamilton-Jacobi-Bellman equations. Numer. Math., 67, 315-344.
25. Finlayson, B. A. (1972). The Method of Weighted Residuals and Variational Principles. Academic Press, New York.
26. Fleming, W. H. and H. Mete Soner (1993). Controlled Markov Processes and Viscosity Solutions. Springer, Berlin, Germany.
27. Freeman, R. A. and P. V. Kokotovic (1995). Optimal nonlinear controllers for feedback linearizable systems. In Proc. American Control Conf., Seattle, Washington, pp. 2722-2726.
28. Gao, L., Lin Chen, Yushun Fan and Haiwu Ma (1992). A nonlinear control design for power systems. Automatica, 28, 975-979.
29. Garrard, W. L. and J. M. Jordan (1977). Design of nonlinear automatic flight control systems. Automatica, 13, 497-505.
30. Genesio, R., M. Tartaglia, and A. Vicino, (1985). On the estimation of asymptotic stability regions: state of the art and new proposals.IEEE Trans. Automat. Control 30(8), 747-755.
31. Glad, S. T. (1987). Robustness of nonlinear state feedback - a survey. Automatica, 23(4), 425-435.
32. Glad, T. (1985). Robust nonlinear regulators based on Hamilton-Jacobi theory and Lyapunov functions. In IEE Control Conf., Cambridge, pp. 276-280.
33. Goh, C. J. (1993). On the nonlinear optimal regulator problem. Automatica, 29, 751-756.
34. Gonzalez, R. and E. Rofman (1985a). On deterministic control problems: An approximation procedure for the optimal cost i: the stationary problem. SIAM J. Control Optim. 23(2), 242-266.
35. Gonzalez, R. and E. Rofman (1985b). On deterministic control problems: an approximation procedure for the optimal cost ii: The nonstationary problem. SIAM J. Control Optim. 23(2), 267-285.
36. Halme, A. and R. P. Hamalainen (1975). On the nonlinear regulator problem. J. Optim. Theory Appl., 16, 255-275.
37. Hofer, E. P. and B. Tibken (1988). An iterative method for the finite-time bilinear-quadratic control problem. J. Optim. Theory Appl., 57(3), 411-427.
38. Hunt, L. R., R. Su and G. Meyer (1983a). Design for multi-input nonlinear systems. Differential Geometric Control Theory, eds, R. W. Brockett, R. S. Millman and H. Sussmann, pp. 268-298. Birkhaüser, Basal.
39. Hunt, L. R., R. Su and G. Meyer (1983b). Global transformations of nonlinear systems. IEEE Trans. Automat. Control, 28(1), 24-31.
40. Isidori, A. (1989). Nonlinear Control Systems. Communication and Control Engineering, 2nd ed. Springer, New York.
41. Johansson, R. (1990). Quadratic optimization of motion coordination and control. IEEE Trans. Automat. Control, 35(11), 1197-1208.
42. Kantorovich, L. V. and V. I. Krylov (1958). Approximate Methods of Higher Analysis. Interscience Publishers, Inc, New York.
43. Khalil, H. K. (1992). Nonlinear Systems. Macmillan, New York.
44. Kirk, D. E. (1970). Optimal Control Theory. Prentice-Hall, Englewood Cliffs, NJ.
45. Kushner, H. J. (1990). Numerical methods for stochastic control problems in continuous time. SIAM J. Control Optim., 28(5), 999-1048.
46. Leake, R. J. and R.-W. Liu (1967). Construction of suboptimal control sequences. SIAM J. Control Optim., 5(1), 54-63.
47. Lee, C. S. G. and M. H. Chen (1983). A suboptimal control design for mechanical manipulators. In American Control Conf., Sheraton-Palace Hotel, San Fransico, CA, pp. 1056-1061.
48. Lewis, F. L. (1986). Optimal Control. Wiley, New York.
49. Loparo, K. A. and G. L. Blankenship (1978). Estimating the domain of attraction of nonlinear feedback systems. IEEE Trans. Automat. Control, 23(4), 602-608.
50. Lu, P. (1993). A new nonlinear optimal feedback control law. Control Theory Adv. Technol., 9(4), 947-954.
51. Lukes, D. L. (1969). Optimal regulation of nonlinear dynamical systems. SIAM J. Control Optim., 7(1), 75-100.
52. Marino, R. (1984). An example of a nonlinear regulator. IEEE Trans. Automat. Control, 29(3), 276-279.
53. Mikhlin, S. G. (1964). Variational Methods in Mathematical Physics. MacMillan, New York.
54. Mikhlin, S. G. and K. L. Smolitskiy (1967). Approximate Methods for Solution of Differential and Integral Equations. American Elsevier, New York.
55. Mil'shtein, G. N. (1964). Successive approiximations for solution of one optimal problem. Automation Remote Control, 25, 298-306.
56. Nijmeijer, H. and A. J. van der Schaft, (1990). Nonlinear Dynamical Control Systems. Springer, New York.
57. Nishikawa, Y., N. Sannomiya and H. Itakura (1971). A method for suboptimal design of nonlinear feedback systems. Automatica, 7, 703-712.
58. Petryshyn, W. V. (1965). On a class of k-pdand non-k-pdoperators and operator equations. J. Math. Anal. Appl., 10, 1-24.
59. Rosen, O. and R. Luus (1992). Global optimization approach to nonlinear optimal control. J. Optim. Theory Appl., 73(3), 547-562.
60. Ryan, E. P. (1984). Optimal feedback control of bilinear systems. J. Optim. Theory Appl., 44(2), 333-362.
61. Sage, A. P. and C. C. White III (1977). Optimum Systems Control, 2nd ed. Prentice-Hall, Englewood Cliffs, NJ.
62. Saridis, G. N. and C.-S. G. Lee (1979). An approximation theory of optimal control for trainable manipulators. IEEE Trans. Systems Man Cybernet., 9(3), 152-159.
63. Saridis, G. N. and F. Y. Wang (1994). Suboptimal control of nonlinear stochastic systems. Control Theory Adv. Technol., 10(4), 847-871.
64. Saridis, G. N. and J. Balaram (1986). Suboptimal control for nonlinear systems. Control Theory Adv. Technol., 2(3), 547-562.
65. Tsitsiklis, J. N. and M. Athans (1984). Guaranteed robustness properties of multivariable nonlinear stochastic optimal regulators. IEEE Trans. Automat. Control, 29(8), 690-696.
66. Tzafestas, S. G., K. E. Anagnostou and T. G. Pimenides (1984). Stabilizing optimal control of bilinear systems with a generalized cost. Opt. Control Appl. Methods, 5, 111-117.
67. Vaisbord, E. M. (1963). An approximate method for the synthesis of optimal control. Automat. Remote Control, 24, 1626-1632.
68. Wang, Y. , D. J. Hill, R. H. Middleton and L. Gao (1993). Transient stability enhancement and voltage regulation of power systems. IEEE Trans. Power Systems, 8(2), 620-627.
69. Wang, Y. , D. J. Hill, R. H. Middleton and L. Gao (1994). Transient stabilization of power systems with an adaptive control law. Automatica, 30(9), 1409-1413.
70. Werner, R. A. and J. B. Cruz (1968). Feedback control which preserves optimality for systems with unknown parameters. IEEE Trans. Automat. Control, 13(6), 621-629.
71. Zeidler, E. (1990a). Nonlinear Functional Analysis and its Applications, II/A: Linear Monotone Operators. Springer, Berlin, Germany.
72. Zeidler, E. (1990b). Nonlinear Functional Analysis and its Applications, II/B: Nonlinear Monotone Operators. Springer, Berlin, Germany.