An optimal PID control algorithm for training feedforward neural networks

IEEE Transactions on Industrial Electronics

Volumn 60, Issue 6, 2013, Pages 2273-2283

  Jing, Xingjian ^a   Cheng, Li ^a  

^a HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Feedforward neural networks; linear matrix inequality (LMI); proportional integral and derivative (PID) controller; robust learning

Indexed keywords

FEEDFORWARD NEURAL NETWORKS; LEARNING ALGORITHMS; LINEAR MATRIX INEQUALITIES; OPTIMIZATION; ROBUST CONTROL; THREE TERM CONTROL SYSTEMS; TWO TERM CONTROL SYSTEMS;

ANALYSIS AND DESIGN; CONTROL APPROACH; CONTROL PROBLEMS; ESTIMATION ERRORS; EXCLUSIVE-OR; FUNCTION APPROXIMATION; LEARNING PARAMETERS; LINEAR DISCRETE DYNAMIC SYSTEMS; LINEAR MATRIX INEQUALITY OPTIMIZATIONS; OPTIMAL PID CONTROL; PROPORTIONAL INTEGRAL AND DERIVATIVES; ROBUST CONTROL METHODS; ROBUST LEARNING; ROBUST LEARNING ALGORITHM;

PROPORTIONAL CONTROL SYSTEMS;

EID: 84873696913     PISSN: 02780046     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIE.2012.2194973     Document Type: Article

References (30)

1. S. Haykin, Neural Networks: A Comprehensive Foundation. Englewood Cliffs, NJ: Prentice-Hall, 1999.
2. M. T. Hagan, H. B. Demuth, and M. Beale, Neural Network Design. Boston, MA: PWS-Kent, 1996.
3. D. Sarkar, "Methods to speed up error back propagation learning algorithm," ACM Comput. Surv., vol. l27, no. 4, pp. 519-544, Dec. 1995.
4. C. Charalambous, "Conjugate gradient algorithm for efficient training of artificial neural networks," Proc. Inst. Elect. Eng.-Circuits, Devices, Syst., vol. 139, no. 3, pp. 301-310, Jun. 1992.
5. S. Osowski, P. Bojarczak, and M. Stodolski, "Fast second order learning algorithm for feedforward multilayer neural network and its applications," Neural Netw., vol. 9, no. 9, pp. 1583-1596, Dec. 1996. (Pubitemid 27055276)
6. J. Bilski and L. Rutkowski, "A fast training algorithm for neural networks," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 45, no. 6, pp. 749-753, Jun. 1998. (Pubitemid 128745953)
7. G. Lera and M. Pinzolas, "Neighborhood based Levenberg-Marquardt algorithm for neural network training," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1200-1203, Sep. 2002.
8. L. Behera, S. Kumar, and A. Patnaik, "On adaptive learning rate that guarantees convergence in feedforward networks," IEEE Trans. Neural Netw., vol. 17, no. 5, pp. 1116-1125, Sep. 2006. (Pubitemid 46445171)
9. Y. Iiguni, H. Sakai, and H. Tokumaru, "A real-time learning algorithm for a multilayered neural netwok based on extended Kalman filter," IEEE Trans. Signal Process., vol. 40, no. 4, pp. 959-966, Apr. 1992.
10. K. Nishiyama and K. Suzuki, "H∞-learning of layered neural networks," IEEE Trans. Neural Netw., vol. 12, no. 6, pp. 1265-1277, Nov. 2001.
11. J. Park and I. W. Sandberg, "Universal approximation using radial basis function networks," Neural Comput., vol. 3, no. 2, pp. 246-257, Jun. 1991.
12. H. Han, C. Y. Su, and Y. Stepanenko, "Adaptive control of a class of nonlinear systems with nonlinearly parameterized fuzzy approximators," IEEE Trans. Fuzzy Syst., vol. 9, no. 2, pp. 315-323, Apr. 2001. (Pubitemid 32505587)
13. P. Sastry, "Backpropagation algorithm with momentum," IEEE Trans. Neural Netw., vol. 5, no. 3, pp. 505-506, 1994.
14. H. L. Wei and S. A. Billings, "Model structure selection using an integrated forward orthogonal search algorithm assisted by squared correlation and mutual information," Int. J. Model., Identif. Control, vol. 3, no. 4, pp. 341-356, 2008.
15. Z. Man, H. R. Wu, S. Liu, and X. Yue, "A new adaptive backpropagation algorithm based on Lyapunov stability theory for neural networks," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1580-1591, Nov. 2006. (Pubitemid 44824269)
16. J. H. Park, S. H. Kim, and C. J. Moon, "Adaptive neural control for strictfeedback nonlinear systems without backstopping," IEEE Trans. Neural Netw., vol. 20, no. 7, pp. 1204-1209, 2009.
17. S. S. Ge, C. C. Hang, T. H. Lee, and T. Zhang, Stable adaptive Neural Network Control. Boston, MA: Kluwer, 2001.
18. G. Cybenko, "Approximation by superpositions of a sigmoidal function," Math. Control Signal Syst., vol. 2, no. 4, pp. 303-314, 1989.
19. H. Shao andW.Wu, "Convergence of BP algorithm with variable learning rates for FNN training," in Proc. 5th Mexican Int. Conf. Artif. Intell., 2006, pp. 245-252.
20. S. Huang and K. Tan, "Intelligent friction modeling and compensation using neural network approximations," IEEE Trans. Ind. Electron., vol. 59, no. 8, pp. 3342-3349, Aug. 2012.
21. M. T. Hagan, H. B. Demuth, and M. H. Beale, Neural Network Design. Boston, MA: PWS-Kent, 1996.
22. F. Scarselli and A. C. Tsoi, "Universal approximation using feedforward neural networks: A survey of some existing methods and some new results," Neural Netw., vol. 11, no. 10, pp. 15-37, Jan. 1998. (Pubitemid 28123730)
23. S. Cong and Y. Liang, "PID-like neural network nonlinear adaptive control for uncertain multivariable motion control systems," IEEE Trans. Ind. Electron., vol. 56, no. 10, pp. 3872-3879, Oct. 2009.
24. H. Yu, T. Xie, S. Paszczynski, and B. M. Wilamowski, "Advantages of radial basis function networks for dynamic system design," IEEE Trans. Ind. Electron., vol. 58, no. 12, pp. 5438-5450, Dec. 2011.
25. E. Kayacan, O. Cigdem, and O. Kaynak, "Sliding mode control approach for online learning as applied to type-2 fuzzy neural networks and its experimental evaluation," IEEE Trans. Ind. Electron., vol. 59, no. 9, pp. 3510-3520, Sep. 2012.
26. R. Vitthal, P. Sunthar, and C. D. Rao, "The generalized proportionalintegral-derivative (PID) gradient descent back propagation algorithm," Neural Netw., vol. 8, no. 4, pp. 563-569, 1995.
27. M. A. Khanesar, E. Kayacan, M. Teshnehlab, and O. Kaynak, "Extended Kalman filter based learning algorithm for type-2 fuzzy logic systems and its experimental evaluation," IEEE Trans. Ind. Electron., vol. 59, no. 11, pp. 4443-4455, Nov. 2012.
28. R. H. Abiyev and O. Kaynak, "Type 2 fuzzy neural structure for identification and control of time-varying plants," IEEE Trans. Ind. Electron., vol. 57, no. 12, pp. 4147-4159, Dec. 2010.
29. A. Slowik, "Application of an adaptive differential evolution algorithm with multiple trial vectors to artificial neural network training," IEEE Trans. Ind. Electron., vol. 58, no. 8, pp. 3160-3167, Aug. 2011.
30. X. J. Jing, "An H∞ control approach to robust learning of feedforward neural networks," Neural Netw., vol. 24, no. 7, pp. 759-766, Sep. 2011.