Online symbolic-sequence prediction with discrete-time recurrent neural networks

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2130, Issue , 2001, Pages 719-724

  Pérez Ortiz, Juan Antonio ^a   Calera Rubio, Jorge ^a   Forcada, Mikel L ^a  

^a UNIVERSITY OF ALICANTE   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX NETWORKS; FORECASTING; LOGIC CIRCUITS; NEURAL NETWORKS;

DECOUPLED EXTENDED KALMAN FILTERS; DISCRETE TIME RECURRENT NEURAL NETWORK; GRAMMATICAL INFERENCES; NETWORK TRAINING; ONLINE PREDICTION; REAL-TIME RECURRENT LEARNING; RECURRENT NETWORKS; SYMBOLIC SEQUENCE;

RECURRENT NEURAL NETWORKS;

EID: 84958963592     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-44668-0_100     Document Type: Conference Paper

References (14)

1. Bengio, Y., P. Simard and P. Frasconi (1994), “Learning long-term dependencies with gradient descent is difficult”, IEEE Transactions on Neural Networks, 5(2).
2. Carrasco, R. C. et al. (2000), “Stable-encoding of finite-state machines in discretetime recurrent neural nets with sigmoid units”, Neural Computation, 12(9).
3. Cleeremans, A., D. Servan-Schreiber and J. L. McClelland (1989), “Finite state automata and simple recurrent networks”, Neural Computation, 1(3), 372–381.
4. Elman, J. L. (1990), “Finding structure in time”, Cognitive Science, 14, 179–211.
5. Haykin, S. (1999), Neural networks: a comprehensive foundation, Chapter 15, Prentice-Hall, New Jersey, 2nd edition.
6. Hochreiter, J. (1991), Untersuchungen zu dynamischen neuronalen Netzen, Diploma thesis, Institut für Informatik, Technische Universität München.
7. Nelson, M. (1991), “Arithmetic coding + statistical modeling = data compression”, Dr. Dobb’s Journal, Feb. 1991.
8. Pérez-Ortiz, J. A., J. Calera-Rubio, M. L. Forcada (2001), “Online text prediction with recurrent neural networks”, Neural Processing Letters, in press.
9. Puskorius, G. V. and L. A. Feldkamp (1991), “Decoupled extended Kalman filter training of feedforward layered networks”, in International Joint Conference on Neural Networks, volume 1, pp. 771–777.
10. Robinson, A. J. and F. Fallside (1991), “A recurrent error propagation speech recognition system”, Computer Speech and Language, 5, 259–274.
11. Schmidhuber, J. and S. Heil (1996), “Sequential neural text compression”, IEEE Transactions on Neural Networks, 7(1), pp. 142-146.
12. Smith, A. W. and D. Zipser (1989), “Learning sequential structures with the realtime recurrent learning algorithm”, International Journal of Neural Systems, 1(2).
13. Tiňo, P., M. Köteles (1999), “Extracting finite-state representations from recurrent neural networks trained on chaotic symbolic sequences”, IEEE Transactions on Neural Networks, 10(2), pp. 284–302.
14. Williams, R. J. and R. A. Zipser (1989), “A learning algorithm for continually training recurrent neural networks”, Neural Computation, 1, 270–280.