Neural-network-based optimal control for a class of nonlinear cdiscrete-time systems with control constraints using the citerative GDHP algorithm

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2011, Pages 53-60

  Liu, Derong ^a   Wang, Ding ^a   Zhao, Dongbin ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE DYNAMIC PROGRAMMING; CONSTRAINED OPTIMAL CONTROL PROBLEMS; CONTROL CONSTRAINT; DUAL HEURISTIC PROGRAMMING; ITERATIVE ALGORITHM; NONLINEAR DISCRETE-TIME SYSTEMS; OPTIMAL CONTROL LAW; OPTIMAL CONTROL SCHEME; OPTIMAL CONTROLLER; OPTIMAL CONTROLS; SIMULATION STUDIES;

ALGORITHMS; CONTROL; CONVERGENCE OF NUMERICAL METHODS; DIGITAL CONTROL SYSTEMS; DYNAMIC PROGRAMMING; HEURISTIC PROGRAMMING; NEURAL NETWORKS; OPTIMIZATION;

DISCRETE TIME CONTROL SYSTEMS;

EID: 80054767702     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2011.6033199     Document Type: Conference Paper

References (37)

1. S. E. Lyshevski, "Constrained optimization and control of nonlinear systems: new results in optimal control," in Joint 35th IEEE Conference all Decision and Control, Kobe, Japan, Dec. 1996, pp. 541-546.
2. S. E. Lyshevski, "Nonlinear discrete-time systems: constrained optimization and application of nonquadratic costs," in Proc. Ama Control Conl, Philadelphia, PA, Jun. 1998, pp. 3699-3703.
3. R. E. Bellman, Dynamic Programming. Princeton University Press, Princeton, NJ, 1957.
4. S. Jagannathan, Neural Network COlllrol of Nonlinear Discrete-time SysTems. CRC Press, Boca Raton, FL, 2006.
5. w. Yu, Recenr Advances in Intelligent ConTrol Systems. SpringerVerlag, London, 2009.
6. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling," in Handbook of Intelligent Control, D. A. White and D. A. Sofge, Eds. Van Nostrand Reinhold,N ew York, 1992, ch. 13.
7. P. J. Werbos, "ADP: The key direction for future research in intelligent control and understanding brain intelligence," IEEE Trans. SYST., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 898-900, Aug. 2008.
8. P. J. Werbos, "Intelligence in the brain: a theory of how it works and how to build it," Neural Networks, vol. 22, no. 3, pp. 200-212, Apr. 2009.
9. J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Saeks, "Adaptive dynamic programming," IEEE Trans. SYST., Man, Cybern. C, Appl. Rev., vol. 32, no. 2, pp. 140-153, May 2002.
10. J. Si,A. G. Barto,W . B. Powell,and O. C. Wunsch, Eds.,Handbook of Learning and Approximate Dynamic Programmillg. IEEE Press/Wiley, New York, 2004.
11. D. P. Beltsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Athena Scientific, Belmont, MA, 1996.
12. J. Si and Y. T. Wang, "On-line learning control by association and reinforcement," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 264-276, Mar. 2001.
13. D. Y. Prokhorov and D. C. Wunsch, "Adaptive critic designs," IEEE Trans. Neural Netw., vol. 8, no. 5, pp. 997-1007, Sept. 1997.
14. R. S. Sutton and A. G. Barto, Reinforcernenr Learning: All Introduction. The M IT Press, Cambridge, MA, 1998.
15. F. Y. Wang, H. Zhang, and D. Liu, "Adaptive dynamic programming: an introduction," IEEE CompuTational Intelligence Magazine, vol. 4, no. 2, pp. 39-47, May 2009.
16. F. L. Lewis and D. Vrabie, "Reinforcement learning and adaptive dynamic programming for feedback control," IEEE Circuits and Systems Magazine, vol. 9, no. 3, pp. 32-50, July 2009.
17. D. Liu, X. Xiong, and Y. Zhang, "Action-dependent adaptive critic designs," in Proc. International joint Conference on Neural Networks, Washington, DC, July 2001, vol. 2, pp. 990-995.
18. G. K. Venayagamoorthy, R. G. Harley, and D. C. Wunsch, " Comparison of heuristic dynamic programming and dual heuristic programming adaptive critics for neurocontrol of a turbogenerator," IEEE Trans. Neural Netw., vol. 13, no. 3, pp. 764-773, May 2002.
19. G. K. Venayagamo, Olthy,R . G. Harley,and D. C. Wunsch," Implementation of adaptive critic-based neuwcontrollers for turbogenerators in a multimachine power system," IEEE Trans. Neural Netw., vol. 14, no. 5, pp. 1047-1064,Sept. 2003.
20. J. W. Park,R . G. Harley,and G. K. Venayagamoorthy," Adaptive-criticbased optimal neurocontrol for synchwnous generators in a power system using MLP/RBF neural networks," IEEE Trans. Ind. Appl., vol. 39, no. 5, pp. 1529-1540, Sept./Oct. 2003.
21. G. G. Yen and P. G. Delima, "Improving the performance of globalized dual heuristic programming for fault tolerant control through an online learning supervisor," IEEE Trans. Automation Science and Engineering, vol. 2, no. 2, pp. 121-131, Apr. 2005.
22. T. Cheng, F. L. Lewis, and M. Abu-Khalaf, "A neural network solution for fixed-final time optimal control of nonlinear systems," Automatica, vol. 43, no. 3, pp. 482-490, Mar. 2007.
23. S. N. Balakrishnan and Y. Biega, "Adaptive-critic based neural networks for aircraft optimal control," Journal of Guidance, Control, and Dynamics, vol. 19, no. 4, pp. 893-898, July-Aug. 1996.
24. S. N. Balakrishnan, J. Ding, and F. L. Lewis, "Issues on stability of ADP feedback controllers for dynamic systems," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 913-917, Aug. 2008.
25. R. Padhi,S . N. Balakrishnan,and T. Randolph," Adaptive-critic based optimal neuro control synthesis for distributed parameter systems," Automatica, vol. 37, no. 8, pp. 1223-1234, Aug. 2001.
26. D. Han and S. N. Balakrishnan," State-constrained agile missile control with adaptive critic-based neural networks," IEEE Trans. Conrrol Systerns Technology, vol. 10, no. 4, pp. 481-489, July 2002.
27. R. Padhi, N. Unnikrishnan, X. Wang, and S. N. BaJakrishnan, "A single network adaptive critic (SNAC) architecture for optimaJ control synthesis for a class of nonlinear systems," Neural Networks, vol. 19, no. 10, pp. 1648-1660, Dec. 2006.
28. A. AI-Tamimi, F. L. Lewis, and M. Abu-Khalaf, "Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 943-949, Aug. 2008.
29. H. Zhang, Q. Wei, and Y. Luo, "A novel infinite-time optimaJ tracking control scheme for a class of discrete-time nonlinear systems via the greedy HOP iteration algorithm," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 937-942, Aug. 2008.
30. D. V rabie, O. Pastravanu, M. Abu-Khalaf, and F. L. Lewis, "Adaptive optimal control for continuous-time linear systems based on policy iteration," Automatica, vol. 45, no. 2, pp. 477-484, Feb. 2009.
31. D. Liu and N. Jin, "c:-adaptive dynamic programming for discrete-time systems," in Proc. Inrernatiollal Joint Conference on Neural Networks, Hong Kong, June 2008, pp. 1417-1424.
32. M. Abu-Khalaf and F. L. Lewis, "Nearly optimaJ control laws for nonlinear systems with saturating actuators using a neural network HJB approach," Automatica, vol. 41, no. 5,779-791, May 2005.
33. H. Zhang, Y. Luo, and D. Liu, "Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints," IEEE Trans. Neural Netw., vol. 20, no. 9, pp. 1490-1503, Sept. 2009.
34. K. G. Vamvoudakis and F. L. Lewis, "Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem," Automatica, vol. 46, no. 5, pp. 878-888, May 2010.
35. Z. Sun, X. Chen, and Z. He, "Adaptive critic designs for energy minimization of portable video communication devices," IEEE Transactions on Circuits and Systems for Video Technology, vol. 20, no. 1, pp. 27-37, Jan. 2010.
36. F. L. Lewis and K. G. Vamvoudakis, "Reinforcement learning for paltially observable dynamic processes: adaptive dynamic programming using measured output data," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 1, pp. 14-25, Feb. 2011.
37. F. Y. Wang, N. Jin, O. Liu, and Q. Wei, "Adaptive dynamic programming for finite-horizon optimal control of discrete-time nonlinear systems with c:-error bound," IEEE Trans. Neural Netw., vol. 22, no. 1, pp. 24-36, Jan. 2011.