Optimal Control-Based Adaptive NN Design for a Class of Nonlinear Discrete-Time Block-Triangular Systems

IEEE Transactions on Cybernetics

Volumn 46, Issue 11, 2016, Pages 2670-2680

  Liu, Yan Jun ^a   Tong, Shaocheng ^a  

^a LIAONING UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Adaptive control; adaptive optimal control; neural networks (NNs); uncertain nonlinear systems

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; DESIGN; DIGITAL CONTROL SYSTEMS; FEEDBACK; LYAPUNOV METHODS; MIMO SYSTEMS; NEURAL NETWORKS; OPTIMIZATION; SYSTEM STABILITY;

ADAPTIVE NEURAL NETWORKS; GRADIENT DESCENT METHOD; MULTI INPUT MULTI OUTPUT; NONLINEAR DISCRETE-TIME; NONLINEAR DISCRETE-TIME SYSTEMS; OPTIMAL CONTROL SCHEME; OPTIMAL PERFORMANCE; TRIANGULAR SYSTEM;

DISCRETE TIME CONTROL SYSTEMS;

EID: 84959422030     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2015.2494007     Document Type: Article

References (63)

1. M. Krstic and P. V. Kokotovic, "Adaptive nonlinear output-feedback schemes with Marino-Tomei controller," IEEE Trans. Autom. Control, vol. 41, no. 2, pp. 274-280, Feb. 1996.
2. W. He, S. Zhang, and S. S. Ge, "Adaptive control of a flexible crane system with the boundary output constraint," IEEE Trans. Ind. Electron., vol. 61, no. 8, pp. 4126-4133, Aug. 2014.
3. A. Boulkroune, M. Tadjine, M. M'Saad, and M. Farza, "How to design a fuzzy adaptive controller based on observers for uncertain affine nonlinear systems," Fuzzy Sets Syst., vol. 159, no. 8, pp. 926-948, 2008.
4. A. Boulkroune, M. Tadjine, M. M'Saad, and M. Farza, "Design of a unified adaptive fuzzy observer for uncertain nonlinear systems," Inf. Sci., vol. 265, pp. 139-153, May 2014.
5. T. Wang, Y. F. Zhang, J. B. Qiu, and H. Gao, "Adaptive fuzzy backstepping control for a class of nonlinear systems with sampled and delayed measurements," IEEE Trans. Fuzzy Syst., vol. 23, no. 2, pp. 302-312, Apr. 2015.
6. T. Wang, H. Gao, and J. Qiu, "A combined adaptive neural network and nonlinear model predictive control for multirate networked industrial process control," IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 2, pp. 416-425, 2016.
7. M. Chen and S. S. Ge, "Direct adaptive neural control for a class of uncertain nonaffine nonlinear systems based on disturbance observer," IEEE Trans. Cybern., vol. 43, no. 4, pp. 1213-1225, Aug. 2013.
8. Z. J. Li, X. Q. Cao, and N. Ding, "Adaptive fuzzy control for synchronization of nonlinear teleoperators with stochastic time-varying communication delays," IEEE Trans. Fuzzy Syst., vol. 19, no. 4, pp. 745-757, Aug. 2011.
9. Z. J. Li, H. Z. Xiao, C. G. Yang, and Y. W. Zhao, "Model predictive control of nonholonomic chained systems using general projection neural networks optimization," IEEE Trans. Syst., Man, Cybern. Syst., vol. 45, no. 10, pp. 1313-1321, Oct. 2015.
10. W. S. Chen and L. C. Jiao, "Adaptive tracking for periodically timevarying and nonlinearly parameterized systems using multilayer neural networks," IEEE Trans. Neural Netw., vol. 21, no. 2, pp. 345-351, Feb. 2010.
11. S. J. Yoo, J. B. Park, and Y. H. Choi, "Adaptive neural control for a class of strict-feedback nonlinear systems with state time delays," IEEE Trans. Neural Netw., vol. 20, no. 7, pp. 1209-1215, Jul. 2009.
12. Y. J. Liu and S. C. Tong, "Adaptive fuzzy control for a class of unknown nonlinear dynamical systems," Fuzzy Sets Syst., vol. 263, pp. 49-70, Mar. 2015.
13. S. S. Ge and C. Wang, "Adaptive neural control of uncertain MIMO nonlinear systems," IEEE Trans. Neural Netw., vol. 15, no. 3, pp. 674-692, May 2004.
14. S. Tong, S. Sui, and Y. Li, "Fuzzy adaptive output feedback control of MIMO nonlinear systems with partial tracking errors constrained," IEEE Trans. Fuzzy Syst., vol. 23, no. 4, pp. 729-742, Aug. 2015.
15. Y. J. Liu and S. C. Tong, "Adaptive fuzzy identification and control for a class of nonlinear pure-feedback MIMO systems with unknown dead-zones," IEEE Trans. Fuzzy Syst., vol. 23, no. 5, pp. 1387-1398, 2015.
16. Y.-J. Liu, S.-C. Tong, and T.-S. Li, "Observer-based adaptive fuzzy tracking control for a class of uncertain nonlinear MIMO systems," Fuzzy Sets Syst., vol. 164, no. 1, pp. 25-44, 2011.
17. H. Q. Wang, K. F. Liu, X. P. Liu, B. Chen, and C. Lin, "Neuralbased adaptive output-feedback control for a class of nonstrict-feedback stochastic nonlinear systems," IEEE Trans. Cybern., vol. 45, no. 9, pp. 1977-1987, Sep. 2015.
18. H. Q. Wang, B. Chen, X. P. Liu, K. F. Liu, and C. Lin, "Robust adaptive fuzzy tracking control for pure-feedback stochastic nonlinear systems with input constraints," IEEE Trans. Cybern., vol. 43, no. 6, pp. 2093-2104, Dec. 2013.
19. S. S. Ge, C. G. Yang, and T. H. Lee, "Adaptive predictive control using neural network for a class of pure-feedback systems in discrete time," IEEE Trans. Neural Netw., vol. 19, no. 9, pp. 1599-1614, Sep. 2008.
20. Y. J. Liu and S. C. Tong, "Adaptive fuzzy control for a class of nonlinear discrete-time systems with backlash," IEEE Trans. Fuzzy Syst., vol. 22, no. 5, pp. 1359-1365, 2014.
21. Y. N. Li, C. G. Yang, S. S. Ge, and T. H. Lee, "Adaptive output feedback NN control of a class of discrete-time MIMO nonlinear systems with unknown control directions," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 2, pp. 507-517, Apr. 2011.
22. Y.-J. Liu and S. Tong, "Adaptive NN tracking control of uncertain nonlinear discrete-time systems with nonaffine dead-zone input," IEEE Trans. Cybern., vol. 45, no. 3, pp. 497-505, Mar. 2015.
23. H. G. Zhang, Q. L. Wei, and D. Liu, "An iterative approximate dynamic programming method to solve for a class of nonlinear zero-sum differential games," Automatica, vol. 47, no. 1, pp. 207-214, 2011.
24. H. G. Zhang, L. L. Cui, and Y. H. Luo, "Near-optimal control for nonzero-sum differential games of continuous-time nonlinear systems using single-network ADP," IEEE Trans. Cybern., vol. 43, no. 1, pp. 206-216, Feb. 2013.
25. X. Yang, D. Liu, and Y. Huang, "Neural-network-based online optimal control for uncertain non-linear continuous-time systems with control constraints," IET Control Theory Appl., vol. 7, no. 17, pp. 2037-2047, Nov. 2013.
26. D. Liu, D. Wang, and H. Li, "Decentralized stabilization for a class of continuous-time nonlinear interconnected systems using online learning optimal control approach," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 2, pp. 418-428, Feb. 2014.
27. D. Liu, H. Li, and D. Wang, "Online synchronous approximate optimal learning algorithm for multiplayer non-zero-sum games with unknown dynamics," IEEE Trans. Syst., Man, Cybern. Syst., vol. 44, no. 8, pp. 1015-1027, Aug. 2014.
28. J. Na and G. Herrmann, "Online adaptive approximate optimal tracking control with simplified dual approximation structure for continuous-time unknown nonlinear systems," IEEE/CAA J. Autom. Sinica, vol. 1, no. 4, pp. 412-422, Oct. 2014.
29. R. Z. Song, W. D. Xiao, H. G. Zhang, and C. Y. Sun, "Adaptive dynamic programming for a class of complex-valued nonlinear systems," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 9, pp. 1733-1739, Sep. 2014.
30. R. Z. Song et al., "Multiple actor-critic structures for continuous-time optimal control using input-output data," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 4, pp. 851-865, Apr. 2015.
31. H. Zhang, Q. Wei, and Y. Luo, "A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 937-942, Aug. 2008.
32. H. Zhang, R. Song, Q. Wei, and T. Zhang, "Optimal tracking control for a class of nonlinear discrete-time systems with time delays based on heuristic dynamic programming," IEEE Trans. Neural Netw., vol. 22, no. 12, pp. 1851-1862, Dec. 2011.
33. D. Liu, D. Wang, D. Zhao, Q. Wei, and N. Jin, "Neural-network-based optimal control for a class of unknown discrete-time nonlinear systems using globalized dual heuristic programming," IEEE Trans. Autom. Sci. Eng., vol. 9, no. 3, pp. 628-634, Jul. 2012.
34. H. G. Zhang, C. B. Qin, and Y. H. Luo, "Neural-network-based constrained optimal control scheme for discrete-time switched nonlinear system using dual heuristic programming," IEEE Trans. Autom. Sci. Eng., vol. 11, no. 3, pp. 839-849, Jul. 2014.
35. Y. Gao and Y. J. Liu, "Adaptive fuzzy optimal control using direct heuristic dynamic programming for chaotic discrete-time system," Journal of Vibration and Control, vol. 22, no. 2, pp. 595-603, Feb. 2016.
36. Y. J. Liu, Y. Gao, S. C. Tong, and Y. M. Li, "Fuzzy approximation-based adaptive backstepping optimal control for a class of nonlinear discretetime systems with dead-zone," IEEE Trans. Fuzzy Syst., vol. 24, no. 1, pp. 16-28, Feb. 2016.
37. Q. M. Yang and S. Jagannathan, "Reinforcement learning controller design for affine nonlinear discrete-time systems using online approximators," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 377-390, Apr. 2012.
38. Y.-J. Liu, L. Tang, S. Tong, C. L. P. Chen, and D.-J. Li, "Reinforcement learning design-based adaptive tracking control with less learning parameters for nonlinear discrete-time MIMO systems," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 1, pp. 165-176, Jan. 2015.
39. D. Liu, D. Wang, and X. Yang, "An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs," Inf. Sci., vol. 220, pp. 331-342, Jan. 2013.
40. Q. Wei, F.-Y. Wang, D. Liu, and X. Yang, "Finite-approximation-errorbased discrete-time iterative adaptive dynamic programming," IEEE Trans. Cybern., vol. 44, no. 12, pp. 2820-2833, Dec. 2014.
41. D. Liu and Q. Wei, "Finite-approximation-error-based optimal control approach for discrete-time nonlinear systems," IEEE Trans. Cybern., vol. 43, no. 2, pp. 779-789, Apr. 2013.
42. D. Liu and Q. Wei, "Policy iteration adaptive dynamic programming algorithm for discrete-time nonlinear systems," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 3, pp. 621-634, Mar. 2014.
43. Q. Wei and D. Liu, "Data-driven neuro-optimal temperature control of water-gas shift reaction using stable iterative adaptive dynamic programming," IEEE Trans. Ind. Electron., vol. 61, no. 11, pp. 6399-6408, Nov. 2014.
44. Q. Wei and D. Liu, "Adaptive dynamic programming for optimal tracking control of unknown nonlinear systems with application to coal gasification," IEEE Trans. Autom. Sci. Eng., vol. 11, no. 4, pp. 1020-1036, Oct. 2014.
45. B. Xu, C. Yang, and Z. Shi, "Reinforcement learning output feedback NN control using deterministic learning technique," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 3, pp. 635-641, Mar. 2014.
46. P. Shih, B. C. Kaul, S. Jagannathan, and J. A. Drallmeier, "Reinforcement-learning-based output-feedback control of nonlinear discrete-time systems with application to engine emission control," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 5, pp. 1162-1179, Oct. 2009.
47. X. J. Su, L. G. Wu, P. Shi, and C. L. P. Chen, "Model approximation for fuzzy switched systems with stochastic perturbation," IEEE Trans. Fuzzy Syst., vol. 23, no. 5, pp. 1458-1473, Oct. 2015.
48. N. Kazachek, V. Lokhin, S. Manko, and M. Romanov, "Research of periodic oscillations in control systems with fuzzy controllers," Int. J. Innov. Comput. Inf. Control, vol. 11, no. 3, pp. 985-997, 2015.
49. J.-G. Wang, S.-C. Tai, and C.-J. Lin, "Face detection using TSK-type fuzzy cerebellar model articulation controller network," Int. J. Innov. Comput. Inf. Control, vol. 11, no. 2, pp. 707-717, 2015.
50. P. Shi, X. Luan, and C.-L. Liu, "H8 filtering for discrete-time systems with stochastic incomplete measurement and mixed delays," IEEE Trans. Ind. Electron., vol. 59, no. 6, pp. 2732-2739, Jun. 2012.
51. P. Shi, Y. Zhang, M. Chadli, and R. K. Agarwal, "Mixed H-infinity and passive filtering for discrete fuzzy neural networks with stochastic jumps and time delays," IEEE Trans Neural Netw. Learn. Syst., to be published.
52. X. J. Su, L. G. Wu, P. Shi, and Y.-D. Song, "A novel approach to output feedback control of fuzzy stochastic systems," Automatica, vol. 50, no. 12, pp. 3268-3275, 2014.
53. X. J. Su, P. Shi, L. G. Wu, and M. V. Basin, "Reliable filtering with strict dissipativity for T-S fuzzy time-delay systems," IEEE Trans. Cybern., vol. 44, no. 12, pp. 2470-2483, Dec. 2014.
54. P. Shi and Q. Shen, "Cooperative control of multi-agent systems with unknown state-dependent controlling effects," IEEE Trans. Autom. Sci. Eng., vol. 12, no. 3, pp. 827-834, Jul. 2015.
55. X. Xie, D. Yue, H. Zhang, and Y. Xue, "Control synthesis of discretetime T-S fuzzy systems via a multi-instant homogenous polynomial approach," IEEE Trans. Cybern., vol. 46, no. 3. pp. 630-640, 2016
56. H. Y. Li, S. Yin, Y. Pan, and H.-K. Lam, "Model reduction for interval type-2 Takagi-Sugeno fuzzy systems," Automatica, vol. 61, pp. 308-314, Nov. 2015.
57. H. Li, C. Wu, L. Wu, H.-K. Lam, and Y. Gao, "Filtering of interval type-2 fuzzy systems with intermittent measurements," IEEE Trans. Cybern., to be published.
58. H. Y. Li, Y. Pan, and Q. Zhou, "Filter design for interval type-2 fuzzy systems with D stability constraints under a unified frame," IEEE Trans. Fuzzy Syst., vol. 23, no. 3, pp. 719-725, Jun. 2015.
59. A. Boulkroune, A. Bouzeriba, S. Hamel, and T. Bouden, "A projective synchronization scheme based on fuzzy adaptive control for unknown multivariable chaotic systems," Nonlinear Dyn., vol. 78, no. 1, pp. 433-447, 2014.
60. A. Boulkroune, M. Msaad, and M. Farza, "State and output feedback fuzzy variable structure controllers for multivariable nonlinear systems subject to input nonlinearities," Int. J. Adv. Manuf. Technol., vol. 71, nos. 1-4, pp. 539-556, 2014.
61. A. Boulkroune, A. Bouzeriba, S. Hamel, and T. Bouden, "Adaptive fuzzy control-based projective synchronization of uncertain nonaffine chaotic systems," Complexity, vol. 21, no. 2, pp. 180-192, 2015.
62. C. Yang, H. Ma, and M. Fu, "Adaptive predictive control of periodic NARMA systems using nearest-neighbor compensation," IET Control Theory Appl., vol. 7, no. 7, pp. 936-951, May 2013.
63. Y. J. Liu, S. C Tong, D. J. Li and Y. Gao, "Fuzzy adaptive control with state observer for a class of nonlinear discretetime systems with input constraint," IEEE Trans. Fuzzy Syst., DOI: 10.1109/TFUZZ.2015.2505088, in press.