∈-adaptive dynamic programming for discrete-time systems

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2008, Pages 1417-1424

  Liu, Derong ^a   Jin, Ning ^a  

^a University of Illinois at Chicago   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINUOUS TIME SYSTEMS; CONTROL THEORY; COSTS; DIGITAL CONTROL SYSTEMS; DYNAMIC PROGRAMMING; NEURAL NETWORKS; SYSTEMS ENGINEERING;

ADAPTIVE DYNAMIC PROGRAMMINGS; CONTROL ACTIONS; CURSE OF DIMENSIONALITIES; DISCRETE-TIME SYSTEMS; EQUILIBRIUM STATES; LOWER BOUNDS; OPTIMAL CONTROLLERS; OPTIMAL COSTS; OPTIMAL PERFORMANCES; PERFORMANCE COSTS; SINGLE CONTROLLERS; TOTAL COSTS;

DISCRETE TIME CONTROL SYSTEMS;

EID: 56349120789     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2008.4633983     Document Type: Conference Paper

References (27)

1. M. Abu-Khalaf and F. Lewis, "Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach," Automatica, vol. 41, no. 5, pp. 779-791, May 2005.
2. A. Al-Tamimi and F. Lewis "Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof," Proc. IEEE Symposium on ADP & RL, Hawaii, April 1-4, 2007, pp. 38-43.
3. S. N. Balakrishnan and V. Biega, "Adaptive-critic-based neural networks for aircraft optimal control," Journal of Guidance, Control, and Dynamics, vol. 19, pp. 893-898, July-Aug. 1996.
4. R. Beard, G. Saridis, and J. Wen, "Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation," Automatica, vol. 33, no. 12, pp. 2159-2177, Dec. 1997.
5. R. E. Bellman, Dynamic Programming, Princeton University Press, Princeton, 1957.
6. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming, Belmont, MA: Athena Scientific, 1996.
7. C. Cox, S. Stepniewski, C. Jorgensen, R. Seaks, and C. Lewis, "On the design of a neural network, autolander," International Journal of Robust and Nonlinear Control, vol. 9, pp. 1071-1096, Dec. 1999.
8. S. E. Dreyfus and A. M. Law, The Art and Theory of Dynamic Programming, Academic Press, New York, 1977.
9. G. G. Lendaris, C. Cox, R. Seaks, and J. Murray, "A radial basis function implementation of the adaptive dynamic programming algorithm," Proc. 45th Midwest Symposium on Circuits and Systems, Aug. 2002, vol. 2, pp. II338-II341.
10. A. U. Levin and K. S. Narendra, "Control of nonlinear dynamical systems using neural networks: controllability and stabilization," IEEE Trans. Neural Networks, vol. 4, no. 2, pp. 192-206, Mar. 1993.
11. F. L. Lewis and V. L. Syrmos, Optimal Control, John Wiley, New York, 1995.
12. D. Liu, "Approximate dynamic programming for self-learning control," ACTA Automatica Sinica, vol. 31, no. 1, pp. 13-18, Jan. 2005.
13. D. Liu and N. Jin, "Finite horizon discrete-time approximate dynamic programming," Porc. IEEE International Symposium on Intelligent Control, Munich, Germany, Oct. 2006, pp. 446-451.
14. D. Liu, Y. Zhang, and H. Zhang, "A self-learning call admission control scheme for CDMA cellular networks," IEEE Trans. Neural Networks, vol.16, no.5, pp. 1219-1228, Sept. 2005.
15. J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Seaks, "Adaptive Dynamic Programming," IEEE Trans. Syst., Man, Cybern. - Part C: App & Reviews. vol. 32, no. 2, pp. 140-153, May 2002.
16. D. V. Prokhorov and D. C. Wunsch, "Adaptive critic designs," IEEE Trans. Neural Networks, vol. 8, pp. 997-1007, Sept. 1997.
17. G. N. Saridis and F.-Y. Wang, "Suboptimal control of nonlinear stochastic systems," Control-Theory and Advanced Technology, vol. 10, no. 4, pp. 847-871, 1994.
18. J. Si and Y-T. Wang, "On-line learning control by association and reinforcement," IEEE Trans. Neural Networks, vol. 12, pp. 264-276, Mar. 2001.
19. P. J. Werbos, "Advanced forecasting methods for global crisis warning and models of intelligence," General Systems Yearbook, vol. 22, pp. 25-38, 1977.
20. P. J. Werbos, "Stable adaptive control using new critic designs," [Online]. Available: http://xxx.lanl.gov/abs/adap-org/9810001, Mar. 1998.
21. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling," Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches (Chapter 13), Edited by D. A. White and D. A. Sofge, New York, NY: Van Nostrand Reinhold, 1992.
22. P. J. Werbos, "A menu of designs for reinforcement learning over time," Neural Networks for Control (Chapter 3), Edited by W. T. Miller, R. S. Sutton, and P. J. Werbos, The MIT Press, Cambridge, MA, 1990.
23. P. J. Werbos, "Building and understanding adaptive systems: A statistical/numerical approach to factory automation and brain research," IEEE Trans. Syst., Man, Cybern., vol. 17, pp. 7-20, Jan./Feb. 1987.
24. P. J. Werbos, "Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences", PhD. Thesis, Harvard Univ., Cambridge, MA, 1974.
25. B. Widrow, N. Gupta, and S. Maitra, "Punish/reward: learning with a critic in adaptive threshold systems," IEEE Trans. Syst., Man, Cybern., vol. 3, no. 5, pp. 455-465, 1973.
26. B. Widrow and M. Lehr, "30 Years of adaptive neural networks: perceptron, madaline, and backpropagation," Proc. IEEE, vol. 78, no. 9, pp. 1415-1442, Sept. 1990.
27. W. M. Wonham, "Random differential equations in control theory," Probabilistic Methods in Applied Mathematics, Edited by A. T. Bharucha-Reid., New York: Academic Press, 1970.