Decentralized optimal control of a class of interconnected nonlinear discrete-time systems by using online Hamilton-Jacobi-Bellman formulation

IEEE Transactions on Neural Networks

Volumn 22, Issue 11, 2011, Pages 1757-1769

  Mehraeen, Shahab ^a   Jagannathan, Sarangapani ^b  

^a LOUISIANA STATE UNIVERSITY   (United States)

^b Architectural and Environmental Engineering   (United States)

Author keywords

Decentralized control; Hamilton Jacobi Bellman equation; neural networks; optimal control

Indexed keywords

BOUNDED ERRORS; DIRECT NEURAL DYNAMIC PROGRAMMING; DISCRETE TIME SYSTEM; GAIN MATRICES; HAMILTON JACOBI BELLMAN EQUATION; HAMILTON-JACOBI-BELLMAN; LOCAL STATE VECTORS; LYAPUNOV TECHNIQUES; NONLINEAR DISCRETE-TIME SYSTEMS; OPTIMAL CONTROL; OPTIMAL CONTROLLER; OPTIMAL CONTROLS; SIMULATION RESULT; STATE VECTOR; UNIFORMLY ULTIMATELY BOUNDED;

CONTROL THEORY; CONTROLLERS; DECENTRALIZED CONTROL; DIGITAL CONTROL SYSTEMS; DYNAMIC PROGRAMMING; NEURAL NETWORKS; NONLINEAR EQUATIONS; ONLINE SYSTEMS; OPTIMAL CONTROL SYSTEMS; OPTIMIZATION;

DISCRETE TIME CONTROL SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; NONLINEAR SYSTEM; ONLINE SYSTEM; SIGNAL PROCESSING; STATISTICS; TIME;

ALGORITHMS; COMPUTER SIMULATION; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; ONLINE SYSTEMS; PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED; TIME FACTORS;

EID: 80455160265     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2160968     Document Type: Article

References (26)

1. S. Jagannathan, Neural Network Control of Nonlinear Discrete-Time Systems. Boca Raton, FL: CRC Press, Apr. 2006, p. 602.
2. F. L. Lewis and V. L. Syrmos, Optimal Control. New York: Wiley, 1995.
3. A. Isidori and A. Astolfi, "Disturbance attenuation and H8-control via measurement feedback in nonlinear systems," IEEE Trans. Autom. Control, vol. 37, no. 9, pp. 1283-1293, Sep. 1992.
4. W. Lin and C. I. Brynes, "H8-control of discrete-time nonlinear systems," IEEE Trans. Autom. Control, vol. 41, no. 4, pp. 494-510, Apr. 1996.
5. T. Hualin and W. J. Rugh, "Pseudolinearization and nonlinear optimal control," IEEE Trans. Autom. Control, vol. 43, no. 3, pp. 386-391, Mar. 1998.
6. J. Huang, "An algorithm to solve the discrete HJI equation arising in the L2 gain optimization problem," Int. J. Control, vol. 72, no. 1, pp. 49-57, Jan. 1999.
7. M. Abu-Khalaf, J. Huang, and F. L. Lewis, Nonlinear H2/Ha Constrained Feedback Control: A Practical Design Approach Using Neural Networks. New York: Springer-Verlag, 2006.
8. R. W. Beard and T. W. McLain, "Successive Galerkin approximation algorithms for nonlinear optimal and robust control," Int. J. Control, vol. 71, no. 5, pp. 717-743, Nov. 1998.
9. Z. Chen and S. Jagannathan, "Generalized Hamilton-Jacobi-Bellman formulation-based neural network control of affine nonlinear discretetime systems," IEEE Trans. Neural Netw., vol. 10, no. 1, pp. 90-106, Jan. 2008.
10. A. Al-Tamimi, F. L. Lewis, and M. Abu-Khalaf, "Discrete-time nonlinear HJB solution using approximate dynamic programming: Convergence proof," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 38, no. 4, pp. 943-949, Aug. 2008.
11. T. Cheng, F. L. Lewis, and M. Abu-Khalaf, "A neural network solution for fixed-final time optimal control of nonlinear systems," Automatica, vol. 43, no. 3, pp. 482-490, Mar. 2007.
12. J. Si, A. G. Barto,W. B. Powell, and D. Wunsch, Handbook of Learning and Approximate Dynamic Program. New York: Wiley, 2004.
13. J. Si and Y.-T. Wang, "Online learning control by association and reinforcement," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 264-276, Mar. 2001.
14. D. V. Prokhorov and D. C. Wunsch, "Adaptive critic designs," IEEE Trans. Neural Netw., vol. 8, no. 5, pp. 997-1007, Sep. 1997.
15. A. Al-Tamimi, M. Abu-Khalaf, and F. L. Lewis, "Adaptive critic designs for discrete-time zero-sum games with application to H8 control," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 37, no. 1, pp. 240-247, Feb. 2007.
16. S. N. Huang, K. K. Tan, and T. H. Lee, "Nonlinear adaptive control of interconnected systems using neural networks," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 243-246, Jan. 2006.
17. Y. Liu and X.-Y. Li, "Decentralized robust adaptive control of nonlinear systems with unmodeled dynamics," IEEE Trans. Autom. Control, vol. 47, no. 5, pp. 848-856, May 2002.
18. J. Zhou and C. Wen, "Decentralized backstepping adaptive output tracking of interconnected nonlinear systems," IEEE Trans. Autom. Control, vol. 53, no. 10, pp. 2378-2384, Nov. 2008.
19. S. Huang, K. K. Tan, and T. H. Lee, "Decentralized control design for large-scale systems with strong interconnections using neural networks," IEEE Trans. Autom. Control, vol. 48, no. 5, pp. 805-810, May 2003.
20. S. Jagannathan, "Decentralized discrete-time neural network controller for a class of nonlinear systems with unknown interconnections," in Proc. IEEE Int. Symp. Medit. Conf. Control Autom. Intell. Control, Limassol, Cyprus, Jun. 2005, pp. 268-273.
21. F. Lewis, S. Jagannathan, and A. Yesildirek, Neural Network Control of Robot Manipulators and Nonlinear Systems. New York: Taylor & Francis, 1998.
22. J. T. Spooner and K. M. Passino, "Decentralized adaptive control of nonlinear systems using radial basis neural networks," IEEE Trans. Autom. Control, vol. 44, no. 11, pp. 2050-2057, Nov. 1999.
23. T. Dierks and S. Jagannathan, "Optimal control of affine nonlinear discrete-time systems," in Proc. 17th IEEE Medit. Symp. Control Autom., Thessaloniki, Greece, Jun. 2009, pp. 1390-1395.
24. W. Rudin, Principles of Mathematical Analysis, 3rd ed. New York: McGraw-Hill, 1976.
25. H. K. Khalil, Nonlinear Systems. Englewood Cliffs, NJ: Prentice-Hall, 2002.
26. B. Igelnik and Y.-H. Pao, "Stochastic choice of basis functions in adaptive function approximation and the functional-link net," IEEE Trans. Neural Netw., vol. 6, no. 6, pp. 1320-1329, Nov. 1995.