Event-triggered reinforcement learning approach for unknown nonlinear continuous-time system

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2014, Pages 3677-3684

  Zhong, Xiangnan ^a   Ni, Zhen ^a   He, Haibo ^a   Xu, Xin ^b   Zhao, Dongbin ^c  

^a The University of Rhode Island   (United States)

^b NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^c INSTITUTE OF AUTOMATION   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINUOUS TIME SYSTEMS; NEURAL NETWORKS; NONLINEAR CONTROL SYSTEMS; REINFORCEMENT LEARNING;

ADAPTIVE DYNAMIC PROGRAMMING; COMPUTATIONAL COSTS; EVENT-TRIGGERED; NEURAL NETWORK TECHNIQUES; NONLINEAR CONTINUOUS-TIME SYSTEMS; REINFORCEMENT LEARNING APPROACH; SAMPLING PERIOD; SYSTEM DYNAMICS;

DYNAMIC PROGRAMMING;

EID: 84908479886     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2014.6889787     Document Type: Conference Paper

References (37)

1. W. Heemels, M. Donkers, and A. Teel, "Periodic event-triggered control for linear systems", Automatic Control, IEEE Transactions on, vol. 58, no. 4, pp. 847-861, 2013.
2. P. Tallapragada and N. Chopra, "On event triggered tracking for nonlinear systems", Automatic Control, IEEE Transactions on, vol. 58, no. 9, pp. 2343-2348, 2013.
3. M. Lemmon, "Event-triggered feedback in control, estimation, and optimization", in Networked Control Systems, pp. 293-358, Springer, 2010.
4. E. Garcia and P. J. Antsaklis, "Model-based event-triggered control with time-varying network delays", in Decision and Control and European Control Conference (CDC-ECC), 2011 50th IEEE Conference on, pp. 1650-1655, IEEE, 2011.
5. W. Heemels, K. H. Johansson, and P. Tabuada, "An introduction to event-triggered and self-triggered control", in Decision and Control (CDC), 2012 IEEE 51st Annual Conference on, pp. 3270-3285, IEEE, 2012.
6. A. Eqtami, D. V. Dimarogonas, and K. J. Kyriakopoulos, "Eventtriggered control for discrete-time systems", in American Control Conference (ACC), 2010, pp. 4719-4724, IEEE, 2010.
7. W. Heemels and M. Donkers, "Model-based periodic event-triggered control for linear systems", Automatica, 2013.
8. A. Sahoo, H. Xu, and S. Jagannathan, "Neural network-based adaptive event-triggered control of affine nonlinear discrete time systems with unknown internal dynamics", in American Control Conference (ACC), 2013, pp. 6418-6423, IEEE, 2013.
9. A. Sahoo, H. Xu, and S. Jagannathan, "Neural network-based adaptive event-triggered control of nonlinear continuous-time systems", in Intelligent Control (ISIC), 2013 IEEE International Symposium on, pp. 35-40, IEEE, 2013.
10. D. Tolic, R. Fierro, and S. Ferrari, "Optimal self-triggering for nonlinear systems via approximate dynamic programming", in Control Applications (CCA), 2012 IEEE International Conference on, pp. 879-884, IEEE, 2012.
11. J. Si, A. G. Barto, W. B. Powell, and D. C. Wunsch, eds., Handbook of Learning and Approximate Dynamic Programming. IEEE Press and John Wiley & Sons, 2004.
12. F. Lewis and D. Liu, eds., Reinforcement Learning and Approximate Dynamic Programming for Feedback Control. Wiley-IEEE Press, 2013.
13. H. Zhang, D. Liu, Y. Luo, and D. Wang, Adaptive Dynamic Programming for Control: Algorithms and Stability (Communications and Control Engineering). Springer, 2013.
14. F. L. Lewis, D. Liu, and G. G. Lendaris, "Special issue on adaptive dynamic programming and reinforcement learning in feedback control", IEEE Transactions on System, Man and Cybernetics, Part B, vol. 38, no. 4, pp. 896-897, 2008.
15. P. J. Werbos, "Adp: The key direction for future research in intelligent control and understanding brain intelligence", IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics, vol. 38, no. 4, pp. 898-900, 2008.
16. G. G. Lendaris, "Higher level application of adp: A next phase for the control field?", IEEE Transactions on System, Man and Cybernetics, Part B, vol. 38, no. 4, pp. 901-912, 2008.
17. W. Qiao, G. Venayagamoorthy, and R. Harley, "DHP-based wide-area coordinating control of a power system with a large wind farm and multiple FACTS devices", in Proc. IEEE Int. Conf. Neural Netw., pp. 2093-2098, 2007.
18. S. Ray, G. K. Venayagamoorthy, B. Chaudhuri, and R. Majumder, "Comparison of adaptive critics and classical approaches based wide area controllers for a power system", IEEE Trans. on Syst. Man, Cybern., Part B, vol. 38, no. 4, pp. 1002-1007, 2008.
19. J. Fu, H. He, and X. Zhou, "Adaptive learning and control for mimo system based on adaptive dynamic programming", IEEE Trans. Neural Networks, vol. 22, no. 7, pp. 1133-1148, 2011.
20. J. Fu, H. He, and Z. Ni, "Adaptive Dynamic Programming with Balanced Weights Seeking Strategy", in IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), IEEE Symposium Series on Computational Intelligence (SSCI), (Paris, France), 2011.
21. D. Liu, H. Javaherian, O. Kovalenko, and T. Huang, "Adaptive critic learning techniques for engine torque and air-fuel ratio control", IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics, vol. 38, no. 4, pp. 988-993, 2008.
22. D. Liu, Y. Zhang, and H. G. Zhang, "A self-learning call admission control scheme for cdma cellular networks", IEEE Transactions on Neural Networks, vol. 16, no. 5, pp. 1219-1228, 2005.
23. Y. Tang, H. He, Z. Ni, J. Wen, and X. Sui, "Reactive power control of grid-connected wind farm based on adaptive dynamic programming", Neurocomputing, vol. 125, pp. 125-133, Feb. 2014.
24. C. Lu, J. Si, and X. Xie, "Direct heuristic dynamic programming for damping oscillations in a large power system", IEEE Trans. Sys. Man Cyber. Part B, vol. 38, no. 4, pp. 1008-1013, 2008.
25. A. Al-Tamimi, F. L. Lewis, and M. Abu-Khalaf, "Discrete-time nonlinear hjb solution using approximate dynamic programming: Convergence proof", IEEE Transactions on System, Man and Cybernetics, Part B, vol. 38, no. 4, pp. 943-949, 2008.
26. D. Liu and Q. Wei, "Finite-approximation-error-based optimal control approach for discrete-time nonlinear systems", IEEE Transactions on Cybernetics, vol. 43, no. 2, pp. 779-789, 2013.
27. P. He and S. Jagannathan, "Reinforcement learning neural-networkbased controller for nonlinear discrete-time systems with input contraints", IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics, vol. 37, no. 2, pp. 425-436, 2007.
28. D. Liu and Q. Wei, "Policy iteration adaptive dynamic programming algorithm for discrete-time nonlinear systems", IEEE Trans. on Neural Networks and Learning Systems, in press.
29. D. Liu, D. Wang, and H. Li, "Decentralized stabilization for a class of continuous-time nonlinear interconnected systems using online learning optimal control approach", IEEE Trans. on Neural Networks and Learning Systems, in press.
30. X. Zhong, H. He, and D. V. Prokhorov, "Robust controller design of continuous-time nonlinear system using neural network", in The 2013 International Joint Conference on Neural Networks (IJCNN), Aug. 2013.
31. H. He, Self-Adaptive Systems for Machine Intelligence. Wiley, 2011.
32. H. He, Z. Ni, and J. Fu, "A three-network architecture for on-line learning and optimization based on adaptive dynamic programming", Neurocomputing, vol. 78, no. 1, pp. 3-13, 2012.
33. H. He, Z. Ni, and D. Zhao, Reinforcement Learning and Approximate Dynamic Programming for Feedback Control, ch. Learning and Optimization in Hierarchical Adaptive Critic Design, pp. 78-95. Wiley-IEEE Press, 2013.
34. Z. Ni, H. He, and J. Wen, "Adaptive learning in tracking control based on the dual critic network design", IEEE Trans. on Neural Networks and Learning Systems, vol. 6, no. 24, pp. 913-928, 2013.
35. Z. Ni, X. Fang, H. He, D. Zhao, and X. Xu, "Real-time tracking control on adaptive critic design with uniformly ultimately bounded condition", in IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL'13), IEEE Symposium Series on Computational Intelligence (SSCI), Apr. 2013.
36. Z. Ni, H. He, J. Wen, and X. Xu, "Goal representation heuristic dynamic programming on maze navigation", IEEE Trans. on Neural Networks and Learning Systems, vol. 24, no. 12, pp. 2038-2050, 2013.
37. Z. Ni and H. He, "Heuristic dynamic programming with internal goal representation", Soft Computing, vol. 17, pp. 2101-2108, 2013.