Data-driven robust approximate optimal tracking control for unknown general nonlinear systems using adaptive dynamic programming method

IEEE Transactions on Neural Networks

Volumn 22, Issue 12 PART 2, 2011, Pages 2226-2236

  Zhang, Huaguang ^a   Cui, Lili ^b   Zhang, Xin ^b   Luo, Yanhong ^b  

^a NORTHEASTERN UNIVERSITY   (China)

^b STATE KEY LABORATORY OF SYNTHETICAL AUTOMATION FOR PROCESS INDUSTRIES   (China)

Author keywords

Adaptive dynamic programming; data driven model; neural networks; optimal tracking control; robust control

Indexed keywords

ADAPTIVE DYNAMIC PROGRAMMING; APPROXIMATION ERRORS; CONTROL INPUTS; CONTROL SCHEMES; DATA-DRIVEN; DATA-DRIVEN MODEL; INPUT-OUTPUT DATA; LYAPUNOV APPROACH; MODELING ERRORS; NUMERICAL EXAMPLE; OPTIMAL CONTROLS; OPTIMAL FEEDBACK; OPTIMAL TRACKING; OPTIMAL TRACKING CONTROL; STABILITY ANALYSIS; SYSTEM DYNAMICS; SYSTEM STATE;

CLOSED LOOP CONTROL SYSTEMS; CONTROLLERS; DYNAMIC PROGRAMMING; NAVIGATION; NEURAL NETWORKS; NONLINEAR SYSTEMS; OPTIMIZATION; RECURRENT NEURAL NETWORKS; ROBUST CONTROL; STATE FEEDBACK; SYSTEM THEORY;

ADAPTIVE CONTROL SYSTEMS;

ARTICLE; ARTIFICIAL INTELLIGENCE; DATA MINING; FACTUAL DATABASE; FEEDBACK SYSTEM; METHODOLOGY; SYSTEM ANALYSIS; THEORETICAL MODEL;

ARTIFICIAL INTELLIGENCE; DATA MINING; DATABASES, FACTUAL; FEEDBACK; MODELS, THEORETICAL; PROGRAMMING, LINEAR;

EID: 83655163786     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2168538     Document Type: Article

References (41)

1. F. L. Lewis and V. Syrmos, Optimal Control. New York: Wiley, 1995.
2. M. Abu-Khalaf and F. L. Lewis, "Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach," Automatica, vol. 41, no. 5, pp. 779-791, May 2005. (Pubitemid 40352391)
3. J. J. Murray, C. J. Cox, G. G. Lendaris, and R. Saeks, "Adaptive dynamic programming," IEEE Trans. Syst., Man, Cybern., Part C: Appl. Rev., vol. 32, no. 2, pp. 140-153, May 2002. (Pubitemid 35289398)
4. R. Beard, G. Saridis, and J. Wen, "Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation," Automatica, vol. 33, no. 12, pp. 2159-2177, Dec. 1997.
5. A. Al-Tamimi, F. L. Lewis, and M. Abu-Khalaf, "Discrete-time nonlinear HJB solution using approximate dynamic programming: Convergence proof," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 38, no. 4, pp. 943-949, Aug. 2008.
6. K. G. Vamvoudakis and F. L. Lewis, "Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem," Automatica, vol. 46, no. 5, pp. 878-888, May 2010.
7. F.-Y.Wang, N. Jin, D. Liu, and Q.Wei, "Adaptive dynamic programming for finite-horizon optimal control of discrete-time nonlinear systems with ?-error bound," IEEE Trans. Neural Netw., vol. 22, no. 1, pp. 24-36, Jan. 2011.
8. T. Hanselmann, L. Noakes, and A. Zaknich, "Continuous-time adaptive critics," IEEE Trans. Neural Netw., vol. 18, no. 3, pp. 631-647, May 2007. (Pubitemid 46778095)
9. H. Zhang, Q. Wei, and D. Liu, "An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games," Automatica, vol. 47, no. 1, pp. 207-214, Jan. 2011.
10. T. Dierks, B. T. Thumati, and S. Jagannathan, "Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence," Neural Netw., vol. 22, nos. 5-6, pp. 851-860, Jul.-Aug. 2009.
11. H. Zhang, Y. Luo, and D. Liu, "Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints," IEEE Trans. Neural Netw., vol. 20, no. 9, pp. 1490-1503, Sep. 2009.
12. J. Si, A. G. Barto, W. B. Powell, and D. Wunsch, Handbook of Learning and Approximate Dynamic Programming. New York: Wiley, 2004.
13. F.-Y. Wang, H. Zhang, and D. Liu, "Adaptive dynamic programming: An introduction," IEEE Comput. Intell. Mag., vol. 4, no. 2, pp. 39-47, May 2009.
14. F. L. Lewis and D. Vrabie, "Reinforcement learning and adaptive dynamic programming for feedback control," IEEE Circuits Syst. Mag., vol. 9, no. 3, pp. 32-50, Aug. 2009.
15. A. Al-Tamimi, F. L. Lewis, and M. Abu-Khalaf, "Model-free Q-learning designs for linear discrete-time zero-sum games with application to H control," Automatica, vol. 43, no. 3, pp. 473-481, Mar. 2007. (Pubitemid 46209050)
16. Q. Wei, H. Zhang, and L. Cui, "Data-based optimal control for discretetime zero-sum games of 2-D systems using adaptive critic designs," ACTA Autom. Sinica, vol. 35, no. 6, pp. 682-692, Jun. 2009.
17. D. Vrabie, O. Pastravanu, M. Abu-Khalaf, and F. L. Lewis, "Adaptive optimal control for continuous-time linear systems based on policy iteration," Automatica, vol. 45, no. 2, pp. 477-484, Feb. 2009.
18. D. Vrabie and F. L. Lewis, "Neural network approach to continuoustime direct adaptive optimal control for partially unknown nonlinear systems," Neural Netw., vol. 22, no. 3, pp. 237-246, Apr. 2009.
19. R. K. Lim and M. Q. Phan, "Identification of a multistep-ahead observer and its application to predictive control," J. Guid. Control Dyn., vol. 20, no. 6, pp. 1200-1206, 1997. (Pubitemid 127561126)
20. M. G. Safonov and T. C. Tsao, "The unfalsified control concept and learning," IEEE Trans. Autom. Control, vol. 42, no. 6, pp. 843-847, Jun. 1997. (Pubitemid 127760880)
21. R. L. Toussaint, J. C. Boissy, M. L. Norg, M. Steinbuch, and O. H. Bosgra, "Suppressing non-periodically repeating disturbances in mechanical servo systems," in Proc. IEEE Conf. Decis. Control, Tampa, FL, Dec. 1998, pp. 2541-2542.
22. J. M. Lee and J. H. Lee, "Approximate dynamic programming-based approaches for input-output data-driven control of nonlinear processes," Automatica, vol. 41, no. 7, pp. 1281-1288, Jul. 2005. (Pubitemid 40644867)
23. A. Lecchini, M. C. Campi, and S. M. Savaresi, "Virtual reference feedback tuning for two degrees of freedom controllers," Int. J. Adapt. Control Signal Process., vol. 16, no. 5, pp. 355-371, 2002. (Pubitemid 34711520)
24. F. L. Lewis and K. G. Vamvoudakis, "Reinforcement learning for partially observable dynamic processes: Adaptive dynamic programming using measured output data," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 41, no. 1, pp. 14-25, Feb. 2011.
25. Y. Zhang, L. Guo, H. Yu, and K. Zhao, "Fault tolerant control based on stochastic distributions via MLP neural networks," Neurocomputing, vol. 70, nos. 4-6, pp. 867-874, Jan. 2007. (Pubitemid 46043985)
26. L. Guo and H. Wang, "Fault detection and diagnosis for general stochastic systems using B-spline expansions and nonlinear filters," IEEE Trans. Circuits Syst. I, vol. 52, no. 8, pp. 1644-1652, Aug. 2005. (Pubitemid 41430881)
27. X. Wu, J. Zhang, and Q. Zhu, "A generalized procedure in designing recurrent neural network identification and control of time-varyingdelayed nonlinear dynamic systems," Neurocomputing, vol. 73, nos. 7-9, pp. 1376-1383, Mar. 2010.
28. J. Xu and Y. Tan, "Nonlinear adaptive wavelet control using constructive wavelet networks," IEEE Trans. Neural Netw., vol. 18, no. 1, pp. 115-127, Jan. 2007. (Pubitemid 46062921)
29. Z. Hou and J. Xu, "On data-driven control theory: The state of the art and perspective," ACTA Autom. Sinica, vol. 35, no. 6, pp. 650-667, 2009.
30. R. E. Skelton and G. Shi, "Markov data-based LQG control," J. Dyn. Syst., Meas., Control, vol. 122, no. 3, pp. 551-559, 2000.
31. W. Aangenent, D. Kostic, B. de Jager, R. de Molengraft, and M. Steinbuch, "Data-based optimal control," in Proc. Amer. Control Conf., vol. 2. Portland, OR, Jun. 2005, pp. 1460-1465. (Pubitemid 41189328)
32. Y. M. Park, M. S. Choi, and K. W. Lee, "An optimal tracking neurocontroller for nonlinear dynamic systems," IEEE Trans. Neural Netw., vol. 7, no. 5, pp. 1099-1110, Sep. 1996.
33. G. Tang, Y. Zhao, and B. Zhang, "Optimal output tracking control for nonlinear systems via successive approximation approach," Nonlin. Anal., vol. 66, no. 6, pp. 1365-1377, Mar. 2007. (Pubitemid 46027396)
34. H. Zhang, Q. Wei, and Y. Luo, "A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 38, no. 4, pp. 937-942, Aug. 2008.
35. T. Dierks and S. Jagannathan, "Optimal tracking control of affine nonlinear discrete-time systems with unknown internal dynamics," in Proc. 48th IEEE Conf. Decis. Control Conf. Chin. Control, Shanghai, Dec. 2009, pp. 6750-6755.
36. T. W. Mclain, C. A. Bailry, and R. W. Beard, "Synthesis and experimental testing of a nonlinear optimal tracking controller," in Proc. Amer. Control Conf., vol. 4. San Diego, CA, Jun. 1999, pp. 2847-2851.
37. V. Yadav, R. Padhi, and S. M. Balakrishnan, "Robust/optimal temperature profile control of a high-speed aerospace vehicle using neural networks," IEEE Trans. Neural Netw., vol. 18, no. 4, pp. 1115-1128, Jul. 2007. (Pubitemid 47098885)
38. J. D. J. Rubio and W. Yu, "Stability analysis of nonlinear system identification via delayed neural networks," IEEE Trans. Circuits Syst. II, vol. 54, no. 2, pp. 161-165, Feb. 2007. (Pubitemid 46477682)
39. T. Hayakawa, W. M. Haddad, and N. Hovakimyan, "Neural network adaptive control for a class of nonlinear uncertain dynamical systems with asymptotic stability guarantees," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 80-89, Jan. 2008. (Pubitemid 351279227)
40. V. Chellaboina and W. M. Haddad, "A unification between partial stability and stability theory for time-varying systems," IEEE Control Syst. Mag., vol. 22, no. 6, pp. 66-75, Dec. 2002.
41. H. K. Khalil, Nonlinear System. Englewood Cliffs, NJ: Prentice-Hall, 2002.