Adaptive approximately optimal control of unknown nonlinear systems based on locally weighted learning

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2009, Pages 345-350

  Dong, Wenjie ^a   Farrell, Jay A ^b  

^a UNIVERSITY OF TEXAS PAN AMERICAN   (United States)

^b University of California Riverside   (United States)

Author keywords

Approximately optimal control; Learning; Nonlinear system; Optimal control; Uncertain systems

Indexed keywords

CONTROLLERS; LEARNING SYSTEMS; NONLINEAR SYSTEMS; UNCERTAIN SYSTEMS;

LEARNING; LEARNING TECHNIQUES; LOCALLY WEIGHTED LEARNING; OPTIMAL CONTROLLER; OPTIMAL CONTROLS; UNKNOWN NONLINEAR SYSTEMS; VALUE FUNCTIONS;

ADAPTIVE CONTROL SYSTEMS;

EID: 77950838809     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2009.5400918     Document Type: Conference Paper

References (18)

1. L. S. Pontryagin, "Optimal control processes," Uspehi Mat. Nauk (in Russian), vol.14, pp. 3-20, 1959.
2. R. Bellman, "The theory of dynamic programming," Proc of Bat. Acad. Sci. USA, vol.38, 1952.
3. M. Athans, "The role and use of the stochastic linear- quadraticgaussian problem in control system design," IEEE Transactions on Automatic Control, vol.16, no.6, pp. 529-552, 1971.
4. J. C. Doyle, "Guaranteed margins for LQG regulators," IEEE Transactions on Automatic Control, vol.23, no.4, pp. 756-757, 1978.
5. 2 and H∞ control problems," IEEE Transactions on Automatic Control, vol.34, no.8, pp. 831-847, 1989.
6. D. Q. Mayne, J. B. Rawlings, C. V. Rao, and P. O. M. Scokaert, "Constrained model predictive control: Stability and optimality," Automatica, vol.36, pp. 789-814, 2000.
7. W. B. Powell, Approximate Dynamic Programming: Solving the Curses of Dimensionality. Wiley & Sons Inc.: Hobroken, New Jersey, 2007.
8. R. Beard, G. Saridis, and J. Wen, "Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation," Automatica, vol.33, no.12, pp. 2159-2177, 1997.
9. G. N. Saridis and C.-S. Lee, "An approximation theory of optimal control for trainable manipulators," IEEE Transactions on systems, Man, and Cybernetics, vol.9, no.3, pp. 152-158, 1979.
10. D. V. Prokhorov and D. C. I. Wunsch, "Adaptive critic designs," IEEE Transactions on Neural Networks, vol.8, no.5, pp. 997-1007, 1997.
11. R. J. Leake and R.-W. Liu, "Construction of suboptimal control sequences," J. SIAM Control, vol.5, no.1, pp. 54-63, 1967.
12. D. Vrabie and F. Lewis, "Adaptive optimal control algorithm for continuous-time nonlinear systems based on policy iteration," Proc. of the 47th IEEE conf. on Decision and Control, pp. 73-79, 2008.
13. D. Vrabie, O. Pastravanu, M. Abu-Khalaf, and F. Lewis, "Adaptive optimal control for continuous-time linear systems based on policy iteration," Automatica, vol.45, no.2, pp. 477-484, 2009.
14. J. Slotine, "Sliding controller design for nonlinear systems," International Journal of Control, vol.40, p. 421, 1984.
15. G. Cybenko, "Approximation by superposition of a sigmoidal function," Mathematics of Control, Signals, and Systems, vol.2, no.4, pp. 303-314, 1989.
16. J. Nakanishi, J. A. Farrell, and S. Schall, "A locally weighted learning composite adaptive controller with structure adaptation," IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 882-889, 2002.
17. J. Nakanishi, J. A. Farrell, and S. Schaal, "Composite adaptive control with locally weighted statistical learning," Neural Networks, vol.18, no.1, pp. 71-90, 2005.
18. Y. Zhao and J. A. Farrell, "Locally weighted online approximation-based control for nonaffine systems," IEEE Transactions on Neural Networks, vol.18, no.6, pp. 1709-1724, 2007.