Evolutionary diagonal recurrent neural network with improved hybrid EP-PSO algorithm and its identification application

International Journal of Innovative Computing, Information and Control

Volumn 5, Issue 6, 2009, Pages 1615-1624

  Mu, Yuqiang ^a   Sheng, Andong ^a  

^a NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Diagonal recurrent neural network; Evolutionary programming; Nonlinear system identification; Particle swarm optimization

Indexed keywords

CONVENTIONAL METHODS; DIAGONAL RECURRENT NEURAL NETWORK; DIAGONAL RECURRENT NEURAL NETWORKS; EVOLUTIONARY PROGRAMMING; NON-LINEAR DYNAMIC SYSTEMS; NONLINEAR SYSTEM IDENTIFICATION; PREMATURE CONVERGENCE; PSO ALGORITHMS; SECOND DERIVATIVES; TRAINING ALGORITHMS; TRAINING METHODS;

COMPUTER PROGRAMMING; DYNAMIC PROGRAMMING; DYNAMICAL SYSTEMS; LEARNING ALGORITHMS; NONLINEAR SYSTEMS; PARTICLE SWARM OPTIMIZATION (PSO); REINFORCEMENT LEARNING;

RECURRENT NEURAL NETWORKS;

EID: 67649359749     PISSN: 13494198     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (23)

1. C. C. Ku and K. Y. Lee, Diagonal recurrent neural networks for dynamic systems control, IEEE Transactions on Neural Networks, vol. 6, no. 1, pp. 144-156, 1995.
2. W. Kim, C. K. Mak and M. W. Mak, Exploring the effects of Lamarckian and Baldwinian learning in evolving recurrent neural networks, Proc. of the IEEE International Conference on Evolutionary Computation, Indianapolis, IN, USA, pp. 617-620, 1997.
3. A. Blanco, M. Delgado and M. C. Pegalajar, A real-coded genetic algorithm for training recurrent neural networks, Neural Networks, vol. 14, no. 1, pp. 93-105, 2001.
4. C. F. Juang, A hybrid of genetic algorithm and particle swarm optimization for recurrent network design, IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 34, no. 2, pp. 997-1006, 2004.
5. C. F. Juang and I. Chung, Recurrent fuzzy network design using hybrid evolutionary learning algorithms, Neurocomputing, vol. 70, no. 16-18, pp. 3301-3310, 2007.
6. P. J. Angeline, Using selection to improve particle swarm optimization, Proc. of the IEEE International Conference on Evolutionary Computation, Anchorage, Alas, USA, pp. 84-89, 1998.
7. T. Blackwell and P. Bentley, Don't push me! Collision-avoiding swarms, Proc. of the 2002 Congress on Evolutionary Computation, Honolulu, HI, USA, pp. 1691-1696, 2002.
8. W. J. Zhang and X. F. Xie, DEPSO: hybrid particle swarm with differential evolution operator, Proc. of the IEEE International Conference on Systems, Man, and Cybernetics, Washington D.C, USA, pp. 3816-3821, 2003.
9. R. Xu, G. K. Venayagamoorthy and D. C. Wunsch II, Modeling of gene regulatory networks with hybrid differential evolution and particle swarm optimization, Neural Networks, vol. 20, no. 8, pp. 917-927, 2007.
10. X. Yao and Y. Liu, A new evolutionary system for evolving artificial neural network, IEEE Transactions on Neural Networks, vol. 8, no. 3, pp. 694-713, 1997.
11. X. Yao, Evolving artificial neural networks, Proc. IEEE, pp. 1423-1447, 1999 (Invited paper).
12. W. Gao, New evolutionary neural networks, Proc. 1st International Conference on Neural Interface and Control, Wuhan, China, pp. 167-171, 2005.
13. X. Cai, N. Zhang, G. K. Venayagamoorthy and D. C. Wunsch II, Time series prediction with recurrent neural networks trained by a hybrid PSO-EA algorithms, Neurocomputing, vol. 70, no. 15, pp. 2342-2353, 2007.
14. J. S. Cho, Y. W. Kim and D. J. Park, Identification of nonlinear dynamic systems using higher order diagonal recurrent neural network, Electronics Letters, vol. 33, no. 25, pp. 2133-2135, 1997.
15. Y. W. Kim and D. J. Park, Fast nonlinear channel equalisation using generalized diagonal recurrent neural networks, Electronics Letters, vol. 34, no. 23, pp. 2253-2255, 1998.
16. S. C. Sivakumar, W. Robertson and W. J. Phillips, On-line stabilization of block-diagonal recurrent neural networks, IEEE Transactions on Neural Networks, vol. 10, no. 1, pp. 167-175, 1999.
17. H. R. Li, J. H. Wang, S. S. Gu, Study on a quasi-diagonal recurrent neural network and its algorithm, Journal of System Simulation, vol. 16, no. 7, pp. 1542-1544, 2004.
18. X. Yao and Y. Liu, Evolutionary programming made faster, IEEE Transactions on Evolutionary Computation, vol. 3, no. 2, pp. 82-102, 1999.
19. J. Kennedy and R. Eberhart, Particle swarm optimization, Proc. of the IEEE International Conference on Neural Networks, Perth, WA, Australia, pp. 1942-1948, 1995.
20. R. Eberhart and Y. Shi, Particle swarm optimization: Developmental, applications and resources, Proc. of the 2001 Congress on Evolutionary Computation, Seoul, Korea, pp. 81-86, 2001.
21. I. Nobuhiro, and Y. Keiichiro, Adaptive particle swarm optimization using velocity feedback, International Journal of Innovative Computing, Information and Control, vol. 1, no. 3, pp. 369-380, 2005.
22. Z. H. Cui, J. C. Zeng and G. J. Sun, A fast particle swarm optimization, International Journal of Innovative Computing, Information and Control, vol. 2, no. 6, pp. 1365-1380, 2006.
23. X. J. Cai, Z. H. Cui, J. C. Zeng and Y. Tan, Performance-dependent adaptive particle swarm optimization, International Journal of Innovative Computing, Information and Control, vol. 3, no. 6(B), pp. 1697-1706, 2007.