Adaptive dynamic programming for discrete-time systems with infinite horizon and ε-error bound in the performance cost

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2009, Pages 1849-1854

  Liu, Derong ^a   Jin, Ning ^b  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b 1120 Science and Engineering Offices   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE DYNAMIC PROGRAMMING; DISCOUNT FACTORS; DISCRETE TIME SYSTEM; EQUILIBRIUM STATE; ERROR BOUND; INFINITE HORIZONS; LOWER BOUNDS; NUMERICAL EXPERIMENTS; OPTIMAL CONTROLLER; OPTIMAL COSTS; PERFORMANCE COSTS; SINGLE CONTROLLERS;

CONTINUOUS TIME SYSTEMS; CONTROL THEORY; CONTROLLERS; COSTS; DIGITAL CONTROL SYSTEMS; DISCRETE TIME CONTROL SYSTEMS; NEURAL NETWORKS; OPTIMIZATION; SYSTEMS ENGINEERING;

DYNAMIC PROGRAMMING;

EID: 70449429571     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2009.5178681     Document Type: Conference Paper

References (23)

1. M. Abu-Khalaf and F. Lewis, "Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach, " Automatica, vol. 41, no. 5, pp. 779-791, May 2005.
2. A. Al-Tamimi and F. Lewis "Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof, " Proc. IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning, Honolulu, HI, Apr. 1-4, 2007, pp. 38-43.
3. S. N. Balakrishnan and V. Biega, "Adaptive-critic-based neural networks for aircraft optimal control, " J. Guidance, Control, and Dynamics, vol. 19, pp. 893-898, July-Aug. 1996.
4. R. E. Bellman, Dynamic Programming, Princeton, NJ: Princeton University Press, 1957.
5. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming, Belmont, MA: Athena Scientific, 1996.
6. V. G. Boltyanskii, Optimal Control of Discrete Systems, New York, NY: John Wiley & Sons, 1978. This book is a translation from Russian of Optimal'noe Upravlenie Diskretnymi Sistemami, Moscow: Izdatel'stvo Nauka, 1973.
7. Jr. A. E. Bryson and Y.-C. Ho, Applied Optimal Control: Optimization, Estimation, and Control, New York, NY: Hemisphere-Wiley, 1975.
8. C. Cox, S. Stepniewski, C. Jorgensen, R. Seaks, and C. Lewis, "On the design of a neural network autolander, " Int. J. Robust and Nonlinear Control, vol. 9, pp. 1071-1096, Dec. 1999.
9. S. E. Dreyfus and A. M. Law, The Art and Theory of Dynamic Programming, New York, NY: Academic Press, 1977.
10. G. G. Lendaris, C. Cox, R. Seaks, and J. Murray, "A radial basis function implementation of the adaptive dynamic programming algorithm, " Proc. 45th Midwest Symposium on Circuits and Systems, Tulsa, OK, Aug. 2002, vol. 2, pp. II338-II341.
11. A. U. Levin and K. S. Narendra, "Control of nonlinear dynamical systems using neural networks: controllability and stabilization, " IEEE Trans. Neural Networks, vol. 4, no. 2, pp. 192-206, Mar. 1993.
12. D. Liu and N. Jin, "Finite horizon discrete-time approximate dynamic programming, " Porc. IEEE International Symposium on Intelligent Control, Munich, Germany, Oct. 2006, pp. 446-451.
13. D. Liu, Y Zhang, and H. Zhang, "A self-learning call admission control scheme for CDMA cellular networks, " IEEE Trans. Neural Networks, vol. 16, no. 5, pp. 1219-1228, Sept. 2005.
14. J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Seaks, "Adaptive dynamic programming, " IEEE Trans. Syst., Man, Cybern. - Part C: App & Reviews, vol. 32, no. 2, pp. 140-153, May 2002.
15. D. V. Prokhorov and D. C. Wunsch, "Adaptive critic designs, " IEEE Trans. Neural Networks, vol. 8, pp. 997-1007, Sept. 1997.
16. G. N. Saridis and F.-Y Wang, "Suboptimal control of nonlinear stochastic systems, " Control-Theory and Advanced Technology, vol. 10, no. 4, pp. 847-871, 1994.
17. J. Si and Y.-T. Wang, "On-line learning control by association and reinforcement, " IEEE Trans. Neural Networks, vol. 12, pp. 264-276, Mar. 2001.
18. P. J. Werbos, "Advanced forecasting methods for global crisis warning and models of intelligence, " General Systems Yearbook, vol. 22, pp. 25-38, 1977.
19. P. J. Werbos, "Stable adaptive control using new critic designs, " Mar. 1998 [Online]. Available: http://xxx.lanl.gov/abs/adap-org/9810001.
20. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling, " Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches (Chapter 13), D. A. White and D. A. Sofge, Ed. New York, NY: Van Nostrand Reinhold, 1992.
21. P. J. Werbos, "A menu of designs for reinforcement learning over time, " Neural Networks for Control (Chapter 3), Edited by W. T. Miller, R. S. Sutton, and P. J. Werbos, The MIT Press, Cambridge, MA, 1990.
22. P. J. Werbos, "Building and understanding adaptive systems: A statistical/numerical approach to factory automation and brain research, " IEEE Trans. Syst., Man, Cybern., vol. 17, pp. 7-20, Jan. /Feb. 1987.
23. P. J. Werbos, Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences, PhD. Thesis, Harvard Univ., Cambridge, MA, 1974.