Elman network with embedded memory for system identification

Journal of Information Science and Engineering

Volumn 22, Issue 6, 2006, Pages 1555-1568

  Kalinli, Adem ^a   Sagiroglu, Seref ^b  

^a ERCIYES UNIVERSITY   (Turkey)

^b GAZI UNIVERSITY   (Turkey)

Author keywords

Dynamic system identification; Elman network; Embedded memory; Jordan network; Multi system identification

Indexed keywords

DATA STORAGE EQUIPMENT; EMBEDDED SYSTEMS; NONLINEAR SYSTEMS; RECURRENT NEURAL NETWORKS;

DYNAMIC SYSTEM IDENTIFICATION; ELMAN NETWORK; EMBEDDED MEMORY; JORDAN NETWORK; MULTISYSTEM IDENTIFICATION;

IDENTIFICATION (CONTROL SYSTEMS);

EID: 33751544830     PISSN: 10162364     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (27)

1. D. T. Pham and X. Liu, "Identification of linear and nonlinear dynamic systems using recurrent neural networks," Artificial Intelligence in Engineering, Vol. 8, 1993, pp. 90-97.
2. J. W. Dong, J. X. Qian, and Y. X. Sun, "Recurrent neural networks for recursive identification nonlinear dynamic process," in Proceedings of the IEEE International Conference on Industrial Technology, 1994, pp. 794-798.
3. C. C. Ku and K. Y. Lee, "Diagonal recurrent neural networks for dynamic systems control," IEEE Transactions on Neural Networks, Vol. 6, 1995, pp. 144-156.
4. L. R. Medsker and L. C. Jain, Recurrent Neural Networks: Design and Applications, CRC Press, 2001.
5. C. A. L. Bailer-Jones, D. J. C. MacKay, and P. J. Withers, "A recurrent neural network for modelling dynamical systems," Network: Computation in Neural Systems, Vol. 9, 1998, pp. 531-547.
6. D. T. Pham and X. Liu, Neural Networks for Identification, Prediction and Control, 4th ed., Springer-Verlag, London, 1999.
7. D. T. Pham and D. Karaboga, "Training Elman and Jordan networks for system identification using genetic algorithms," Artificial Intelligence in Engineering, Vol. 13, 1999, pp. 107-117.
8. X. Ren and S. Fei, "Recurrent neural networks for identification of nonlinear systems," in Proceedings of the 39th IEEE Conference on Decision and Control, Vol. 3, 2000, pp. 2861-2866.
9. J. L. Elman, "Finding structure in time," Cognitive Science, Vol. 14, 1990, pp. 179-211.
10. M. I. Jordan, "Attractor dynamics and parallelism in a connectionsist sequential machine," in Proceedings of the 8th Conference on Cognitive Science, 1986, pp. 531-546.
11. X. Liu, "Modelling and prediction using neural networks," Ph.D. Thesis, Department of System Engineering, University of Wales College of Cardiff, Cardiff, UK, 1993.
12. A. Kalinli and D. Karaboga, "Training recurrent neural networks by using parallel tabu search algorithm based on crossover operation," Engineering Applications of Artificial Intelligence, Vol. 17, 2004, pp. 529-542.
13. A. Kalinli and S. Sagiroglu, "Anew approach based on recurrent neural networks for system identification," in Proceedings of the International Symposium on Computer and Information Sciences, LNCS 2869, Springer-Verlag, 2003, pp. 568-575.
14. D. P. Kwok, P. Wang, and K. Zhou, "Process identification using a modified Elman neural net," International Symposium on Speech, Image Processing and Neural Networks, 1994, pp. 499-502.
15. X. Z. Gao, X. M. Gao, and S. J. Ovaska, "A modified Elman neural network model with application to dynamical systems identification," in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Vol. 2, 1996, pp. 1376-1381.
16. D. T. Pham and X. Liu, "Training of Elman networks and dynamic system modelling," International Journal of Systems Science, Vol. 27, 1996, pp. 221-226.
17. W. Chagra, R. B. Abdennour, F. Bouani, M. Ksouri, and G. Favier, "A comparative study on the channel modeling using feedforward and recurrent neural network structures," in Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Vol. 4, 1998, pp. 3759-3763.
18. M. B. De Martino, "A partially recurrent architecture applied to classification problems," in Proceedings of the IEEE International Conference on Neural Networks, Vol. 3, 1995, pp. 1244-1248.
19. T. B. Chen and V. W. Soo, "A comparative study of recurrent neural network architectures on learning temporal sequences," in Proceedings of the IEEE International Conference on Neural Networks, 1996, pp. 1945-1950.
20. P. Stagge and B. Sendhoff, "An extended Elman net for modeling time series," in Proceedings of the International Conference on Artificial Neural Networks, LNCS 1327, Springer-Verlag, 1997, pp. 427-432.
21. J. E. W. Holm and N. J. H. Kotze, "Training recurrent neural networks with leap-frog," in Proceedings of the IEEE International Conference on Industrial Electronics, 1998, pp. 99-104.
22. J. Hertz, A. Krogh, and R. G. Palmer, Recurrent networks. In Introduction to the Theory of Neural Computation, (Ch. 7), Addison-Wesley, Reading, 1991.
23. D. T. Pham and S. J. Oh, "A recurrent back propagation neural network for dynamic system identification," Journal of Systems Engineering, Vol. 2,1992, pp. 213-223.
24. T. Lin, B. G. Horne, P. Tino, and C. L. Giles, "Learning long-term dependencies is not as difficult with NARX recurrent neural networks," Advances in Neural Information Processing Systems 8, MIT Press, Cambridge, MA, 1996.
25. T. Lui, B. G Horne, and C. L. Giles, "How embedded memory in recurrent neural network architectures helps learning long-term temporal dependencies," Neural Networks, Vol. 11, 1998, pp. 861-868.
26. T. Lin, B. G. Horne, C. L. Giles, and S. Y. Kung, "What to remember: how memory order affects the performance of NARX neural networks," in Proceedings of the IEEE World Congress on Computational Intelligence, Vol. 2, 1998, pp. 1051-1056.
27. C. L. Giles, T. Lin, B. G. Horne, and S. Y. Kung, "The past is important: a method for determining memory structure in NARX neural networks," in Proceedings of the IEEE World Congress on Computational Intelligence, Vol. 3, 1998, pp. 1834-1839.