An application of non-linear programming to train Recurrent Neural Networks in Time Series Prediction problems

ICEIS 2005 - Proceedings of the 7th International Conference on Enterprise Information Systems

Volumn , Issue , 2005, Pages 35-42

  Cuellar M P ^a   Delgado, M ^a   Pegalajar, M C ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

Non linear programming; Recurrent Neural Networks; Time Series Prediction

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BIO-INSPIRED; COMPLEX PROBLEMS; ELMAN RECURRENT NEURAL NETWORK; EVOLUTIONARY TECHNIQUES; EXPERIMENTAL SECTION; LIFE-TIMES; LOCAL SOLUTION; SUITABLE SOLUTIONS; TIME SERIES PREDICTION; TRAINING ALGORITHMS;

COMPUTER SYSTEMS PROGRAMMING; FORECASTING; INFORMATION SYSTEMS; MATHEMATICAL MODELS; OPTIMIZATION; REINFORCEMENT LEARNING; TIME SERIES;

RECURRENT NEURAL NETWORKS;

EID: 33646672300     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Blanco, Delgado, Pegalajar. 2001. A Real-Coded genetic algorithm for training recurrent neural networks. Neural Networks, vol. 14, pp. 93-105.
2. C. Zhu, R. H. Byrd and J. Nocedal. 1997. L-BFGS-B: Algorithm 778: L-BFGS-B, FORTRAN routines for large scale bound constrained optimization, ACM Transactions on Mathematical Software, Vol 23, Num. 4, pp. 550 - 560.
3. Cuéllar M.P., Delgado M., Pegalajar M.C.. 2004. A Comparative study of Evolutionary Algorithms for Training Elman Recurrent Neural Networks to predict the Autonomous Indebtedness. in Proc. ICEIS, Porto, Portugal, pp. 457-461.
4. Danilo P. Mandic, Jonathon A. Chambers. 2001. Recurrent Neural Networks for Prediction. Wiley, John & Sons, Incorporated.
5. D. W. Marquardt. 1963. An algorithm for least-squares estimation of nonlinear parameters, Journal of the Society for Industrialand Applied Mathematics, pp. 11431-441.
6. Martin T. Hagan, Mohammed B. Menhaj. 1994. Training FeedForward networks with the Marquardt algorithm, IEEE transactions on Neural networks, vol 5, no. 6, pp. 989-993.
7. Michael Hüsken, Peter Stagge. 2003. Recurrent Neural Networks for Time Series classification, Neurocomputing, vol. 50, pp. 223-235.
8. More, J. J. 1977. The Levenberg-Marquardt algorithm: Implementation and theory. Lecture notes in mathematics, Edited by G. A. Watson, SpringerVerlag.
9. R. H. Byrd, P. Lu and J. Nocedal. 1995. A Limited Memory Algorithm for Bound Constrained Optimization, SIAM Journal on Scientific and Statistical Computing, 16, 5, pp. 1190-1208.
10. R. Martí, A. El-Fallahi. 2002. Multilayer Neural Networks: An experimental evaluation of on-line training methods. Computers and Operations Research 31, pp. 1491-1513.
11. Ryad Zemomi, Daniel Racaceanu, Nouredalime Zerhonn. 2003. Recurrent Radial Basis fuction network for Time Seties prediction, Engineering appl. Of Artificial Intelligence, vol. 16, no. 5-6, pp. 453-463.
12. Simon Haykin. 1999. Neural Networks (a Comprehensive foundation). Second Edition. Prentice Hall.
13. Williams R.J., Peng J. 1990. An efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network trajectories, " Neural Computation, vol. 2, pp. 491-501.
14. Williams R.J., Zipser D. 1989. A learning algorithm for continually running fully recurrent neural networks, Neural Computation, vol. 1, pp. 270-280.