Adaptive critic design-based robust neural network control for nonlinear distributed parameter systems with unknown dynamics

Neurocomputing

Volumn 148, Issue , 2015, Pages 200-208

  Luo, Yanhong ^a,b   Sun, Qiuye ^a   Zhang, Huaguang ^a,b   Cui, Lili ^c  

^a NORTHEASTERN UNIVERSITY   (China)

^b STATE KEY LABORATORY OF SYNTHETICAL AUTOMATION FOR PROCESS INDUSTRIES   (China)

^c SHENYANG NORMAL UNIVERSITY   (China)

Author keywords

Adaptive critic designs; Adaptive dynamic programming; Learning control; Neural networks; Partial differential equation; Uniformly ultimate boundedness

Indexed keywords

PARTIAL DIFFERENTIAL EQUATIONS;

ADAPTIVE CRITIC; ADAPTIVE CRITIC DESIGNS; ADAPTIVE DYNAMIC PROGRAMMING; LEARNING CONTROL; NEURAL NETWORK CONTROL; NONLINEAR DISTRIBUTED PARAMETER SYSTEM; UNIFORMLY ULTIMATE BOUNDEDNESS;

NEURAL NETWORKS;

ACCURACY; ADAPTIVE CRITIC DESIGN; ARTICLE; ARTIFICIAL NEURAL NETWORK; INTERMETHOD COMPARISON; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NONLINEAR SYSTEM; ONLINE SYSTEM; PROCESS DEVELOPMENT; PROCESS OPTIMIZATION; PROCESS TECHNOLOGY;

EID: 84908068577     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.08.049     Document Type: Article

References (30)

1. Christofides P.D., Daoutidis P. Finite-dimensional control of parabolic PDE systems using approximate inertial manifolds. J. Math. Anal. Appl. 1997, 216(2):398-420.
2. Baker J., Christofides P.D. Finite-dimensional approximation and control of nonlinear parabolic PDE systems. Int. J. Control 2000, 73(5):439-456.
3. Deng H., Li H.-X., Chen G. Spectral-approximation-based intelligent modeling for distributed thermal processes. IEEE Trans. Control. Syst. Technol. 2005, 13(5):686-700.
4. Antoniades C., Christofides P.D. Nonlinear feedback control of parabolic partial differential difference equation systems. Int. J. Control 2000, 73(17):1572-1591.
5. Park H.M., Cho D.H. The use of the Karhunen-Loeve decomposition for the modelling of distributed parameter systems. Chem. Eng. Sci. 1996, 51:81-98.
6. Butkovskiy A.G. Distributed Control Systems 1969, American Elsevier, New York.
7. Lions J.L. Optimal Control of Systems Governed by Partial Differential Equations 1971, Springer-Verlag, New York.
8. Fattorini H.O. Infinite Dimensional Optimization Theory and Optimal Control 1999, Cambridge University Press, Cambridge, UK.
9. Li X., Yong J. Optimal Control Theory for Infinite Dimensional Systems 1995, Birkhäuser, Boston, MA.
10. Yuan K., Li H.X., Cao J. Robust stabilization of the distributed parameter system with time delay via fuzzy control. IEEE Trans. Fuzzy Syst. 2008, 16(March (3)):567-584.
11. Wu H.-N., Li H.-X. A Galerkin/neural-network-based design of guaranteed cost control for nonlinear distributed parameter systems. IEEE Trans. Neural Netw. 2008, 19(May (5)):795-807.
12. Luo B., Wu H.-N. Approximate optimal control design for nonlinear one-dimensional parabolic PDE systems using empirical eigenfunctions and neural network. IEEE Trans. Syst. Man Cybern. B: Cybern. 2012, 42(August (6)):1538-1549.
13. Widrow B., Gupta N., Maitra S. Punish/reward. learning with a critic in adaptive threshold systems. IEEE Trans. Syst. Man Cybern. 1973, 3(Sept. (5)):455-465.
14. Bertsekas D.P., Tsitsiklis J.N. Neuro-Dynamic Programming 1996, Athena, Belmont, MA.
15. Werbos P.J. Approximate dynamic programming for real-time control and neural modeling. Handbook of Intelligent Control: Neural, Fuzzy and Adaptive Approaches 1992, Van Nostrand, New York, (chapter 13). D.A. White, D.A. Sofge (Eds.).
16. Murray J.J., Cox C.J., Lendaris G.G., Saeks R. Adaptive dynamic programming. IEEE Trans. Syst. Man Cybern. C: Appl. Rev. 2002, 32(May (2)):140-153.
17. Liu D., Zhang Y., Zhang H. A self-learning call admission control scheme for CDMA cellular networks. IEEE Trans. Neural Netw. 2005, 16(Sept. (5)):1219-1228.
18. Al-Tamimi A., Lewis F.L., Abu-Khalaf M. Discrete-time nonlinear HJB solution using approximate dynamic programming. convergence proof. IEEE Trans. Syst. Man Cybern. B: Cybern. 2008, 38(Aug. (4)):943-949.
19. Yadav V., Padhi R., Balakrishnan S.N. Robust/optimal temperature profile control of a high-speed aerospace vehicle using neural networks. IEEE Trans. Neural Netw. 2007, 18(July (4)):1115-1128.
20. Zhang H., Wei Q., Luo Y. A novel infinite-time optimal tracking control for a class discrete-time nonlinear systems via the greedy iteration algorithm. IEEE Trans. Syst. Man. Cybern. B. Cybern. 2008, 38(4):937-942.
21. C. Watkins, Learning from delayed rewards (Ph.D. dissertation), Cambridge University, Cambridge, England, 1989.
22. Zhang H., Luo Y., Liu D. Neural network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints. IEEE Trans. Neural Netw. 2009, 20(9):1490-1503.
23. He P., Jagannathan S. Reinforcement learning neural-network-based controller for nonlinear discrete-time systems with input constraints. IEEE Trans. Syst. Man. Cybern. B: Cybern. 2007, 37(2):425-436.
24. Shih P., Kaul B.C., Jagannathan S. Reinforcement-learning-based output-feedback control of nonstrict nonlinear discrete-time systems with application to engine emission control. IEEE Trans. Syst. Man. Cybern. B: Cybern. 2009, 39(5):1162-1179.
25. Kuljaca O., Lewis F.L. Adaptive critic design using non-linear network structure. Int. J. Adapt. Control Signal Progress 2003, 17:431-445.
26. Kim Y.H., Lewis F.L. Reinforcement adaptive learning neural-net-based friction compensation control for high speed and precision. IEEE Trans. Control Syst. Technol. 2000, 8(1):118-126.
27. ∞ reinforcement learning control of robot manipulators using fuzzy wavelet networks. Fuzzy Sets Syst. 2009, 160:1765-1786.
28. Lin C.K. Adaptive critic autopilot design of bank-to-turn missiles using fuzzy basis function networks. IEEE Trans. Syst. Man. Cybern. B: Cybern. 2005, 35(2):197-206.
29. Shen Bo, Wang Zidong, Liu Xiaohui Sampled-data synchronization control of complex dynamical networks with stochastic sampling. IEEE Trans. Autom. Control 2012, 57(October (10)):2644-2650.
30. Wang Z., Shen B., Shu H., Wei G. Quantized H-infinity control for nonlinear stochastic time-delay systems with missing measurements. IEEE Trans. Autom. Control 2012, 57(June (6)):1431-1444.