Event-based robust control for uncertain nonlinear systems using adaptive dynamic programming

IEEE Transactions on Neural Networks and Learning Systems

Volumn 29, Issue 1, 2018, Pages 37-50

  Zhang, Qichao ^a   Zhao, Dongbin ^a,b   Wang, Ding ^c  

^a INSTITUTE OF AUTOMATION   (China)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^c TIANJIN UNIVERSITY   (China)

Author keywords

Adaptive dynamic programming (ADP); event based control; neural network (NN); robust control; unmatched uncertainties

Indexed keywords

CLOSED LOOP SYSTEMS; CONTINUOUS TIME SYSTEMS; CONTROLLERS; COST FUNCTIONS; DYNAMIC PROGRAMMING; NONLINEAR SYSTEMS; OPTIMAL CONTROL SYSTEMS; ROBUST CONTROL; UNCERTAIN SYSTEMS; UNCERTAINTY ANALYSIS;

ADAPTIVE DYNAMIC PROGRAMMING; COMMUNICATION RESOURCES; CONTINUOUS TIME NONLINEAR SYSTEMS; OPTIMAL CONTROL POLICY; OPTIMAL CONTROL PROBLEM; ROBUST CONTROL PROBLEMS; UNCERTAIN NONLINEAR SYSTEMS; UNMATCHED UNCERTAINTY;

ADAPTIVE CONTROL SYSTEMS;

EID: 84992418851     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2016.2614002     Document Type: Article

References (37)

1. Y. Xia, Z. Zhu, M. Fu, and S. Wang, "Attitude tracking of rigid spacecraft with bounded disturbances, " IEEE Trans. Ind. Electron., vol. 58, no. 2, pp. 647-659, Feb. 2011.
2. G. Zames, "Feedback and optimal sensitivity: Model reference transformations, multiplicative seminorms, and approximate inverses, " IEEE Trans. Autom. Control, vol. 26, no. 2, pp. 301-320, Apr. 1981.
3. M. Rubagotti, D. M. Raimondo, A. Ferrara, and L. Magni, "Robust model predictive control with integral sliding mode in continuous-time sampled-data nonlinear systems, " IEEE Trans. Autom. Control, vol. 56, no. 3, pp. 556-570, Mar. 2011.
4. W.-J. Cao and J.-X. Xu, "Nonlinear integral-type sliding surface for both matched and unmatched uncertain systems, " IEEE Trans. Autom. Control, vol. 49, no. 8, pp. 1355-1360, Aug. 2004.
5. F. Lin, R. D. Brandt, and J. Sun, "Robust control of nonlinear systems: Compensating for uncertainty, " Int. J. Control, vol. 56, no. 6, pp. 1453-1459, 1992.
6. F. Lin and R. D. Brandt, "An optimal control approach to robust control of robot manipulators, " IEEE Trans. Robot. Autom., vol. 14, no. 1, pp. 69-77, Feb. 1998.
7. F. Lin, "An optimal control approach to robust control design, " Int. J. Control, vol. 73, no. 3, pp. 177-186, 2000.
8. F. L. Lewis and D. Liu, Reinforcement Learn. Approx. Dynamic Programming for Feedback Control. Hoboken, NJ, USA: Wiley, 2013.
9. P. J. Werbos, "Advanced forecasting methods for global crisis warning and models of intelligence, " General Syst. Yearbook, vol. 22, pp. 25-38, 1977.
10. H.-N. Wu and B. Luo, "Neural network based online simultaneous policy update algorithm for solving the HJI equation in nonlinear H? control, " IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 12, pp. 1884-1895, Dec. 2012.
11. Y. Jiang and Z. Jiang, "Robust adaptive dynamic programming, " in Proc. Reinforcement Learn. Approx. Dyn. Program. Feedback Control, 2012, pp. 281-302.
12. Y. Jiang and Z.-P. Jiang, "Robust adaptive dynamic programming with an application to power systems, " IEEE Trans. Neural Netw., vol. 24, no. 7, pp. 1150-1156, Jul. 2013.
13. D. Liu, D. Wang, F.-Y. Wang, H. Li, and X. Yang, "Neural-networkbased online HJB solution for optimal robust guaranteed cost control of continuous-time uncertain nonlinear systems, " IEEE Trans. Cybern., vol. 44, no. 12, pp. 2834-2847, Dec. 2014.
14. D. Wang, D. Liu, H. Li, and H. Ma, "Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming, " Inf. Sci., vol. 282, pp. 167-179, Oct. 2014.
15. X. Zhong, H. He, and D. V. Prokhorov, "Robust controller design of continuous-time nonlinear system using neural network, " in Proc. IEEE Int. Joint Conf. Neural Netw. (IJCNN), Aug. 2013, pp. 1-8.
16. D. Zhao and Y. Zhu, "MEC-A near-optimal online reinforcement learning algorithm for continuous deterministic systems, " IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 2, pp. 346-356, Feb. 2015.
17. D. Zhao, Q. Zhang, D. Wang, and Y. Zhu, "Experience replay for optimal control of nonzero-sum game systems with unknown dynamics, " IEEE Trans. Cybern., vol. 46, no. 3, pp. 854-865, Mar. 2016.
18. D. Zhao, Z. Hu, Z. Xia, C. Alippi, Y. Zhu, and D. Wang, "Full-range adaptive cruise control based on supervised adaptive dynamic programming, " Neurocomputing, vol. 125, pp. 57-67, Feb. 2014.
19. W. P. M. H. Heemels, M. C. F. Donkers, and A. R. Teel, "Periodic event-triggered control for linear systems, " IEEE Trans. Autom. Control, vol. 58, no. 4, pp. 847-861, Apr. 2013.
20. K. Hashimoto, S. Adachi, and D. V. Dimarogonas, "Self-triggered model predictive control for nonlinear input-affine dynamical systems via adaptive control samples selection, " IEEE Trans. Autom. Control, 2016, doi: 10. 1109 /TAC. 2016. 2537741.
21. X. Wang and M. D. Lemmon, "Event-triggering in distributed networked control systems, " IEEE Trans. Autom. Control, vol. 56, no. 3, pp. 586-601, Mar. 2011.
22. A. Hu, J. Cao, M. Hu, and L. Guo, "Cluster synchronization of complex networks via event-triggered strategy under stochastic sampling, " Phys. A, Statist. Mech. Appl., vol. 434, pp. 99-110, Sep. 2015.
23. H. Li, X. Liao, G. Chen, Z. Dong, D. J. Hill, and T. Huang, "Eventtriggered asynchronous intermittent communication strategy for synchronization in complex dynamical networks, " Neural Netw., vol. 66, pp. 1-10, Jun. 2015.
24. H. Li, X. Liao, T. Huang, W. Zhu, and Y. Liu, "Second-order global consensus in multiagent networks with random directional link failure, " IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 3, pp. 565-575, Mar. 2015.
25. Y. Fan, L. Liu, G. Feng, and Y. Wang, "Self-triggered consensus for multi-agent systems with Zeno-free triggers, " IEEE Trans. Autom. Control, vol. 60, no. 10, pp. 2779-2784, Oct. 2015.
26. W. Xu, D. W. C. Ho, L. Li, and J. Cao, "Event-triggered schemes on leader-following consensus of general linear multiagent systems under different topologies, " IEEE Trans. Cybern., 2015, doi:10. 1109/TCYB. 2015. 2510746.
27. H. Li, X. Liao, T. Huang, and W. Zhu, "Event-triggering sampling based leader-following consensus in second-order multi-agent systems, " IEEE Trans. Autom. Control, vol. 60, no. 7, pp. 1998-2003, Jul. 2015.
28. A. Hu, J. Cao, M. Hu, and L. Guo, "Event-triggered consensus of multi-agent systems with noises, " J. Franklin Inst., vol. 352, no. 9, pp. 3489-3503, 2015.
29. A. Sahoo, H. Xu, and S. Jagannathan, "Near optimal event-triggered control of nonlinear discrete-time systems using neurodynamic programming, " IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 29, pp. 1801-1815, 2016, doi. 10. 1109/TNNLS. 2015. 2453320.
30. A. Sahoo, H. Xu, and S. Jagannathan, "Neural network-based eventtriggered state feedback control of nonlinear continuous-time systems, " IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 3, pp. 497-509, 2016, doi: 10. 1109/TNNLS. 2015. 2416259.
31. K. G. Vamvoudakis, "Event-triggered optimal adaptive control algorithm for continuous-time nonlinear systems, " IEEE/CAA J. Autom. Sinica, vol. 1, no. 3, pp. 282-293, Jul. 2014.
32. X. Zhong, Z. Ni, H. He, X. Xu, and D. Zhao, "Event-triggered reinforcement learning approach for unknown nonlinear continuoustime system, " in Proc. IEEE Int. Joint Conf. Neural Netw., Jul. 2014, pp. 3677-3684.
33. M. Abu-Khalaf and F. L. Lewis, "Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach, " Automatica, vol. 41, no. 5, pp. 779-791, May 2005.
34. E. D. Sontag, "Input to state stability: Basic concepts and results, " in Nonlinear and Optimal Control Theory. Berlin, Germany: Springer, 2008.
35. H. K. Khalil and J. Grizzle, Nonlinear Systems. Englewood Cliffs, NJ, USA: Prentice Hall, 1996.
36. D. Wang, D. Liu, and Q. Zhang, "Data-based adaptive critic designs for nonlinear robust optimal control with uncertain dynamics, " IEEE Trans. Syst., Man, Cybern., Syst., 2015, doi: 10. 1109/TSMC. 2015. 2492941.
37. P. Tabuada, "Event-triggered real-time scheduling of stabilizing control tasks, " IEEE Trans. Autom. Control, vol. 52, no. 9, pp. 1680-1685, Sep. 2007.