Approximate solutions to the time-invariant Hamilton-Jacobi-Bellman equation

Journal of Optimization Theory and Applications

Volumn 96, Issue 3, 1998, Pages 589-626

  Beard, R W ^a   Saridis, G N ^b   Wen, J T ^b  

^a Department of Electrical and Computer Engineering   (United States)

^b RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

Feedback synthesis; Galerkin approximation; Hamilton Jacobi Bellman equation; Nonlinear control; Optimal control; Successive approximation

Indexed keywords

APPROXIMATION THEORY; FEEDBACK; GALERKIN METHODS; NONLINEAR CONTROL SYSTEMS; NONLINEAR EQUATIONS; PARTIAL DIFFERENTIAL EQUATIONS;

APPROXIMATE SOLUTION; FEEDBACK SYNTHESIS; GALERKIN SPECTRAL METHOD; GALERKIN'S APPROXIMATION; HAMILTON JACOBI BELLMAN EQUATION; LINEAR PARTIAL DIFFERENTIAL EQUATIONS; NON LINEAR CONTROL; OPTIMAL CONTROLS; SUCCESSIVE APPROXIMATIONS; TIME INVARIANTS;

DYNAMIC PROGRAMMING;

EID: 0032387028     PISSN: 00223239     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1022664528457     Document Type: Article

References (72)

1. ANDERSON, B. D. O., and MOORE, J. B., Linear Optimal Control, Prentice-Hall, Englewood Cliffs, New Jersey, 1971.
2. BRYSON, A. E., and Ho, Y. C., Applied Optimal Control, Hemisphere, New York, New York, 1975.
3. KIRK, D. E., Optimal Control Theory, Prentice-Hall, Englewood Cliffs, New Jersey, 1970.
4. LEWIS, F. L., Optimal Control, John Wiley and Sons, New York, New York, 1986.
5. SAGE, A. P., and WHITE, C. C., III, Optimum Systems Control, 2nd Edition, Prentice-Hall, Englewood Cliffs, New Jersey, 1977.
6. BOSARGE, W. E., JOHNSON, O. G., MCKNIGHT, R. S., and TIMLAKE, W. P., The Ritz-Galerkin Procedure for Nonlinear Control Problems, SIAM Journal on Numerical Analysis, Vol. 10, pp. 94-110, 1973.
7. HOFER, E. P., and TIBKEN, B., An Iterative Method for the Finite-Time Bilinear-Quadratic Control Problem, Journal of Optimization Theory and Applications, Vol. 57, pp. 411-427, 1988.
8. AGANOVIC, Z., and GAJIC, Z., The Successive Approximation Procedure for Finite-Time Optimal Control of Bilinear Systems, IEEE Transactions on Automatic Control, Vol. 39, pp. 1932-1935, 1994.
9. CEBUHAR, W. A., and COSTANZA, V., Approximation Procedures for the Optimal Control of Bilinear and Nonlinear Systems, Journal of Optimization Theory and Applications, Vol. 43, pp. 615-627, 1984.
10. ROSEN, O., and LUUS, R., Global Optimization Approach to Nonlinear Optimal Control, Journal of Optimization Theory and Applications, Vol. 73, pp. 547-562, 1992.
11. ALBREKHT, E. G., On the Optimal Stabilization of Nonlinear Systems, Journal of Applied Mathematics and Mechanics, Vol. 25, pp. 836-844, 1961.
12. LUKES, D. L., Optimal Regulation of Nonlinear Dynamical Systems, SIAM Journal on Control and Optimization, Vol. 7, pp. 75-100, 1969.
13. GARRARD, W. L., and JORDAN, J. M., Design of Nonlinear Automatic Flight Control Systems, Automatica, Vol. 13, pp. 497-505, 1977.
14. NISHIKAWA, Y., SANNOMIYA, N., and ITAKURA, H., A Method for Suboptimal Design of Nonlinear Feedback Systems, Automatica, Vol. 7, pp. 703-712, 1971.
15. WERNER, R. A., and CRUZ, J. B., Feedback Control Which Preserves Optimality for Systems with Unknown Parameters, IEEE Transactions on Automatic Control, Vol. 13, pp. 621-629, 1968.
16. HALME, A., and HAMALAINEN, R. P., On the Nonlinear Regulator Problem, Journal of Optimization Theory and Applications, Vol. 16, pp. 255-275, 1975.
17. RYAN, E. P., Optimal Feedback Control of Bilinear Systems, Journal of Optimization Theory and Applications, Vol. 44, pp. 333-362, 1984.
18. TZASFESTAS, S. G., ANAGNOSTOU, K. E., and PIMENIDES, T. G., Stabilizing Optimal Control of Bilinear Systems with a Generalized Cost, Optimal Control Applications and Methods, Vol. 5, pp. 111-117, 1984.
19. LU, P., A New Nonlinear Optimal Feedback Control Law, Control Theory and Advanced Technology, Vol. 9, pp. 947-954, 1993.
20. FREEMAN, R. A., and KOKOTOVIC, P. V., Optimal Nonlinear Controllers for Feedback Linearizable Systems, Proceedings of the American Control Conference, Seattle, Washington, pp. 2722-2726, 1995.
21. CRANDALL, M. G., ISHII, H., and LIONS, P. L., User's Guide to Viscosity Solutions of Second-Order Partial Differential Equations, Bulletin of the American Mathematical Society, Vol. 27, pp. 1-67, 1992.
22. CAPUZZO DOLCETTA, I., On a Discrete Approximation of the Hamilton-Jacobi Equation of Dynamic Programming, Applied Mathematics and Optimization, Vol. 10, pp. 367-377, 1983.
23. CAPPUZZO DOLCETTA, I., and ISHII, H., Approximate Solutions of the Bellman Equation of Deterministic Control Theory, Applied Mathematics and Optimization, Vol. 11, pp. 161-181, 1984.
24. FALCONE, M., and FERRETTI, R., Discrete Time High-Order Schemes for Viscosity Solutions of Hamilton-Jacobi-Bellman Equations, Numerische Mathematik, Vol. 67, pp. 315-344, 1994.
25. CAPUZZO DOLCETTA, I., and FALCONE, M., Discrete Dynamic Programming and Viscosity Solutions of the Bellman Equation, Annales de l'Institut Henri Poincaré: Analyse Nonlineare, Vol. 6 (Supplement), pp. 161-184, 1989.
26. GONZALEZ, R., and ROFMAN, E., On Deterministic Control Problems: An Approximation Procedure for the Optimal Cost, I: The Stationary Problem, SIAM Journal on Control and Optimization, Vol. 23, pp. 242-266, 1985.
27. GONZALEZ, R., and ROFMAN, E., On Deterministic Control Problems: An Approximation Procedure for the Optimal Cost, II: The Nonstationary Problem, SIAM Journal on Control and Optimization, Vol. 23, pp. 267-285, 1985.
28. FALCONE, M., A Numerical Approach to the Infinite-Horizon Problem of Deterministic Control Theory, Applied Mathematics and Optimization, Vol. 15, pp. 1-13, 1987.
29. KUSHNER, H. J., Numerical Methods for Stochastic Control Problems in Continuous Time, SIAM Journal on Control and Optimization, Vol. 28, pp. 999-1048, 1990.
30. FLEMING, W. H., and SONER, H. M., Controlled Markov Processes and Viscosity Solutions, Springer Verlag, Berlin, Germany, 1993.
31. BAUMANN, W. T., and RUGH, W. J., Feedback Control of Nonlinear Systems by Extended Linearization, IEEE Transactions on Automatic Control, Vol. 31, pp. 40-46, 1986.
32. CLOUTIER, J. R., D'SOUZA, C. N., and MRACEK, C. P., Nonlinear Regulation and Nonlinear H x-Control Via the State-Dependent Riccati Equation Technique, IFAC World Congress, San Francisco, California, 1996.
33. GOH, C. J., On the Nonlinear Optimal Regulator Problem, Automatica, Vol. 29, pp. 751-756, 1993.
34. JOHANSSON, R., Quadratic Optimization of Motion Coordination and Control, IEEE Transactions on Automatic Control, Vol. 35, pp. 1197-1208, 1990.
35. KHALIL, H. K., Nonlinear Systems, Macmillan Publishing Company, New York, New York, 1992.
36. BELLMAN, R. E., Dynamic Programming, Princeton University Press, Princeton, New Jersey, 1957.
37. REKASIUS, Z. V., Suboptimal Design of Intentionally Nonlinear Controllers, IEEE Transactions on Automatic Control, Vol. 9, pp. 380-386, 1964.
38. HAUSSLER, R. L., On the Suboptimal Design of Nonlinear Control Systems, PhD Thesis, Purdue University, Lafayette, Indiana, 1963.
39. LEAKE, R. J., and LIU, R. W., Construction of Suboptimal Control Sequences, SIAM Journal on Control and Optimization, Vol. 5, pp. 54-63, 1967.
40. SARIDIS, G. N., and LEE, C. S. G., An Approximation Theory of Optimal Control for Trainable Manipulators, IEEE Transactions on Systems, Man, and Cybernetics, Vol. 9, pp. 152-159, 1979.
41. SARIDIS, G. N., and WANG, F., Suboptimal Control of Nonlinear Stochastic Systems, Control Theory and Advanced Technology, Vol. 10, pp. 847-871, 1994.
42. VAISBORD, E. M., An Approximate Method for the Synthesis of Optimal Control, Automation and Remote Control, Vol. 24, pp. 1626-1632, 1963.
43. MILSHTEIN, G. N., Successive Approximations for Solution of One Optimal Problem, Automation and Remote Control, Vol. 25, pp. 298-306, 1964.
44. SARIDIS, G. N., and BALARAM, J., Suboptimal Control for Nonlinear Systems, Control Theory and Advanced Technology, Vol. 2, pp. 547-462, 1986.
45. BERTSEKAS, D. P., On Error Bounds for Successive Approximation Methods, IEEE Transactions on Automatic Control, Vol. 21, pp. 394-396, 1976.
46. KLEINMAN, D. L., On an Iterative Technique for Riccati Equation Computations, IEEE Transactions on Automatic Control, Vol. 13, pp. 114-115, 1968.
47. KLEINMAN, D. L., An Easy Way to Stabilize a Linear Constant System, IEEE Transactions on Automatic Control, Vol. 15, 1970.
48. SANDELL, N. R., On Newton's Method for Riccati Equation Solution, IEEE Transactions on Automatic Control, Vol. 19, pp. 254-255, 1974.
49. MAGEIROU, E. F., Iterative Techniques for Riccati Game Equations, Journal of Optimization Theory and Applications, Vol. 22, pp. 51-61, 1977.
50. LAUB, A. J., Invariant Subspace Methods for the Numerical Solution of Riccati Equations, The Riccati Equation, Edited by S. Bittanti and W. Laub, Springer Verlag, New York, New York, pp. 163-196, 1991.
51. BALARAM, J., Suboptimal Control of Nonlinear Systems, PhD Thesis, Rensselaer Polytechnic Institute, Troy, New York, 1985.
52. BEARD, R., Improving the Closed-Loop Performance of Nonlinear Systems, PhD Thesis, Rensselaer Polytechnic Institute, Troy, New York, 1995.
53. GLAD, T., Robust Nonlinear Regulators Based on Hamilton-Jacobi Theory and Lyapunov Functions, IEEE Control Conference, Cambridge, Massachusetts, pp. 276-280, 1985.
54. GLAD, S. T., Robustness of Nonlinear State Feedback: A Survey, Automatica, Vol. 23, pp. 425-435, 1987.
55. TSITSIKLIS, J. N., and ATHANS, M., Guaranteed Robustness Properties of Multivariable Nonlinear Stochastic Optimal Regulators, IEEE Transactions on Automatic Control, Vol. 29, pp. 690-696, 1984.
56. KANTOROVICH, L. V., and KRYLOV, V. I., Approximate Methods of Higher Analysis, Interscience Publishers, New York, New York, 1958.
57. MIKHLIN, S. G., Variational Methods in Mathematical Physics, Macmillan Company, New York, New York, 1964.
58. MIKHLIN, S. G., and SMOLITSKIY, K. L., Approximate Methods for Solution of Differential and Integral Equations, American Elsevier Publishing Company, New York, New York, 1967.
59. PETRYSHYN, W. V., On a Class of K-p.d. and Non-K-p.d. Operators and Operator Equations, Journal of Mathematical Analysis and Applications, Vol. 10, pp. 1-24, 1965.
60. FINLAYSON, B. A., The Method of Weighted Residuals and Variational Principles, Academic Press, New York, New York, 1972.
61. ZEIDLER, E., Nonlinear Functional Analysis and Its Applications, II/A: Linear Monotone Operators, Springer Verlag, Berlin, Germany, 1990.
62. ZEIDLER, E., Nonlinear Functional Analysis and Its Applications, II/B: Nonlinear Monotone Operators, Springer Verlag, Berlin, Germany, 1990.
63. BITTANTI, S., LAUB, A., and WILLEMS, J. C., The Riccati Equation, Springer Verlag, New York, New York, 1991.
64. BEARD, R. W., SARIDIS, G. N., and WEN, J. T., Galerkin Approximation of the Generalized Hamilton-Jacobi-Bellman Equation, Automatica, Vol. 33, 1997.
65. APOSTOL, T. M., Mathematical Analysis, Addison-Wesley, Reading, Massachusetts, 1974.
66. STEVENSON, W. D., Elements of Power System Analysis, McGraw-Hill, New York, New York, 1982.
67. WANG, Y., HILL, D. J., MIDDLETON, R. H., and GAO, L., Transient Stability Enhancement and Voltage Regulation of Power Systems, IEEE Transactions on Power Systems, Vol. 8, pp. 620-627, 1993.
68. KING, C. A., CHAPMAN, J. W., and ILIC, M. D., Feedback Linearizing Excitation Control on a Full-Scale Power System Model, IEEE Transactions on Power Systems, Vol. 9, pp. 1102-1109, 1994.
69. GAO, L., CHEN, L., FAN, Y., and MA, H., A Nonlinear Control Design for Power Systems, Automatica, Vol. 28, pp. 975-979, 1992.
70. MARINO, R., An Example of a Nonlinear Regulator, IEEE Transactions on Automatic Control, Vol. 29, pp. 276-279, 1984.
71. WANG, Y., HILL, D. J., MIDDLETON, R. H., and GAO, L., Transient Stabilization of Power Systems with an Adaptive Control Law, Automatica, Vol. 30, pp. 1409-1413, 1994.
72. CHAPMAN, J. W., ILIC, M. D., KING, C. A., ENG, L., and KAUFMAN, H., Stabilizing a Multimachine Power System via Decentralized Feedback Linearizing Excitation Control, IEEE Transactions on Power Systems, Vol. 8, pp. 830-839, 1993.