Online adaptive approximate optimal tracking control with simplified dual approximation structure for continuous-time unknown nonlinear systems

IEEE/CAA Journal of Automatica Sinica

Volumn 1, Issue 4, 2014, Pages 412-422

  Na, Jing ^a   Herrmann, Guido ^b  

^a KUNMING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Adaptive control; approximate dynamic programming; optimal control; system identification

Indexed keywords

CONTINUOUS TIME SYSTEMS; CONTROLLERS; DYNAMIC PROGRAMMING; IDENTIFICATION (CONTROL SYSTEMS); NAVIGATION; NONLINEAR SYSTEMS; ONLINE SYSTEMS;

ADAPTIVE CONTROL; APPROXIMATE DYNAMIC PROGRAMMING; CONTINUOUS TIME NONLINEAR SYSTEMS; HAMILTON-JACOBI-BELLMAN EQUATIONS; OPTIMAL CONTROLS; OPTIMAL TRACKING CONTROL; PARAMETER ESTIMATION ERRORS; UNKNOWN NONLINEAR SYSTEMS;

ADAPTIVE CONTROL SYSTEMS;

EID: 84921381070     PISSN: 23299266     EISSN: 23299274     Source Type: Journal    
DOI: 10.1109/JAS.2014.7004668     Document Type: Article

References (32)

1. Lewis F L, Vrabie D, Syrmos V L. Optimal Control. Wiley. com, 2012
2. Vrabie D, Lewis F L. Neural network approach to continuous-Time direct adaptive optimal control for partially unknown nonlinear systems. Neural Networks, 2009, 22(3): 237-246
3. Sastry S, Bodson M. Adaptive Control: Stability, Convergence, and Robustness. New Jersey: Prentice Hall, 1989
4. Ioannou P A, Sun J. Robust Adaptive Control. New Jersey: Prentice Hall, 1996
5. Sutton R S, Barto A G. Reinforcement Learning: An Introduction. Cambridge: Cambridge University Press, 1998
6. Doya K J. Reinforcement learning in continuous time and space. Neural computation, 2000, 12(1): 219-245
7. Sutton R S, Barto A G, Williams R J. Reinforcement learning is direct adaptive optimal control. IEEE Control Systems Magazine, 1992, 12(2): 19-22
8. Werbos P J. A menu of designs for reinforcement learning over time. Neural Networks for Control. MA, USA: MIT Press Cambridge, 1990. 67-95
9. Si J, Barto A G, Powell W B, Wunsch D C. Handbook of Learning and Approximate Dynamic Programming. Los Alamitos: IEEE Press, 2004
10. Wang F Y, Zhang H G, Liu D R. Adaptive dynamic programming: an introduction. IEEE Computational Intelligence Magazine, 2009, 4(2): 39-47
11. Lewis F L, Vrabie D. Reinforcement learning and adaptive dynamic programming for feedback control. IEEE Circuits and Systems Magazine, 2009 9(3): 32-50
12. Zhang H G, Zhang X, Luo Y H, Yang J. An overview of research on adaptive dynamic programming. Acata Automatica Sinica, 2013, 39(4): 303-311
13. Dierks T, Thumati B T, Jagannathan S. Optimal control of unknown affine nonlinear discrete-Time systems using offline-Trained neural networks with proof of convergence. Neural Networks, 2009, 22(5): 851-860
14. Al-Tamimi A, Lewis F L, Abu-Khalaf M. Discrete-Time nonlinear HJB solution using approximate dynamic programming: convergence proof. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2008, 38(4): 943-949
15. Wang D, Liu D R, Wei Q L, Zhao D B, Jin N. Optimal control of unknown nonaffine nonlinear discrete-Time systems based on adaptive dynamic programming. Automatica, 2012, 48(8): 1825-1832
16. Hanselmann T, Noakes L, Zaknich A. Continuous-Time adaptive critics. IEEE Transactions on Neural Networks, 2007, 18(3): 631-647
17. Abu-Khalaf M, Lewis F L. Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach. Automatica, 2005, 41(5): 779-791
18. Vrabie D, Pastravanu O, Abu-Khalaf M, Lewis F L. Adaptive optimal control for continuous-Time linear systems based on policy iteration. Automatica, 2009, 45(2): 477-484
19. Vamvoudakis K G, Lewis F L. Online actor-critic algorithm to solve the continuous-Time infinite horizon optimal control problem. Automatica, 2010, 46(5): 878-888
20. Bhasin S, Kamalapurkar R, Johnson M, Vamvoudakis K G, Lewis F L, Dixon W E. A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems. Automatica, 2013, 49(1): 82-92
21. Zhang H G, Cui L, Zhang X, Luo Y. Data-driven robust approximate optimal tracking control for unknown general nonlinear systems using adaptive dynamic programming method. IEEE Transactions on Neural Networks, 2011, 22(12): 2226-2236
22. Mannava A, Balakrishnan S N, Tang L, Landers R G. Optimal tracking control of motion systems. IEEE Transactions on Control Systems Technology, 2012, 20(6): 1548-1558
23. Nodland D, Zargarzadeh H, Jagannathan S. Neural network-based optimal adaptive output feedback control of a helicopter UAV. IEEE Transactions on Neural Networks and Learning Systems, 2013, 24(7): 1061-1073
24. Na J, Herrmann G, Ren X M, Mahyuddin M N, Barber P. Robust adaptive finite-Time parameter estimation and control of nonlinear systems. In: Proceedings of IEEE International Symposium on Intelligent Control (ISIC). Denver, CO: IEEE, 2011. 1014-1019
25. Uang H J, Chen B S. Robust adaptive optimal tracking design for uncertain missile systems: a fuzzy approach. Fuzzy Sets and Systems, 2002, 126(1): 63-87
26. Krstic M, Kokotovic P V, Kanellakopoulos I. Nonlinear and Adaptive Control Design. New York: Wiley, 1995
27. Kosmatopoulos E B, Polycarpou M M, Christodoulou M A, Ioannou P A. High-order neural network structures for identification of dynamical systems. IEEE Transactions on Neural Networks, 1995, 6(2): 422-431
28. Abdollahi F, Talebi H A, Patel R V. A stable neural network-based observer with application to flexible-joint manipulators. IEEE Transactions on Neural Networks, 2006, 17(1): 118-129
29. Lin J S, Kanellakopoulos I. Nonlinearities enhance parameter convergence in strict feedback systems. IEEE Transactions on Automatic Control, 1999, 44(1): 89-94
30. Edwards C, Spurgeon S K. Sliding Mode Control: Theory and Applications. Boca Raton: CRC Press, 1998
31. Sira-Ramirez H. Differential geometric methods in variable-structure control. International Journal of Control, 1988, 48 (4): 1359-1390
32. Nevistic V, Primbs J A. Constrained Nonlinear Optimal Control: A Converse HJB Approach, Technical Report CIT-CDS 96-021, California Institute of Technology, Pasadena, CA, 1996