Biologically plausible speech recognition with LSTM neural nets

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3141, Issue , 2004, Pages 127-136

  Graves, Alex ^a   Eck, Douglas ^a   Beringer, Nicole ^a   Schmidhuber, Juergen ^a  

^a DALLE MOLLE INSTITUTE FOR ARTIFICIAL INTELLIGENCE IDSIA   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

HIDDEN MARKOV MODELS; MARKOV PROCESSES; RECURRENT NEURAL NETWORKS;

BIOLOGICAL MODELING; LONG SHORT TERM MEMORY; PREFRONTAL CORTEX; RECURRENT NEURAL NETWORK (RNNS); SEQUENTIAL PROCESSING; SPACE AND TIME; SPEECH CORPORA; STATE OF THE ART;

SPEECH RECOGNITION;

EID: 35048892582     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-27835-1_10     Document Type: Article

References (16)

1. Williams, R.J., Zipser, D.: Gradient-based learning algorithms for recurrent networks and their computational complexity. In Chauvin, Y., Rumelhart, D.E., eds.: Back-propagation: Theory, Architectures and Applications. Lawrence Erlbaum Publishers, Hillsdale, N.J. (1995) 433-486
2. Werbos, P.J.: Generalization of backpropagation with application to a recurrent gas market model. Neural Networks 1 (1988)
3. Robinson, A.J., Fallside, F.: The utility driven dynamic error propagation network. Technical Report CUED/F-INFENG/TR.l, Cambridge University Engineering Department (1987)
4. Hochreiter, S., Bengio, Y., Frasconi, P., Schmidhuber, J.: Gradient flow in recurrent nets: the difficulty of learning long-term dependencies. In Kremer, S.C., Kolen, J.F., eds.: A Field Guide to Dynamical Recurrent Neural Networks. IEEE Press (2001)
5. Rabiner, L.R.: A tutorial on hidden markov models and selected applications in speech recognition. In: Proc. IEEE. Volume 77., IEEE (1989) 257-286
6. Bourlard, H., Morgan, N.: Connnectionist Speech Recognition: A Hybrid Approach. Kluwer Academic Publishers (1994)
7. Robinson, A. J.: An application of recurrent nets to phone probability estimation. IEEE Transactions on Neural Networks 5 (1994) 298-305
8. Hochreiter, S., Schmidhuber, J.: Long Short-Term Memory. Neural Computation 9 (1997) 1735-1780
9. Gers, F.: Long Short-Term Memory in Recurrent Neural Networks. PhD thesis (2001)
10. O'Reilly, R.: Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia. Technical Report ICS-03-03, ICS (2003)
11. Gers, F.A., Schmidhuber, J.: LSTM recurrent networks learn simple context free and context sensitive languages. IEEE Transactions on Neural Networks 12 (2001) 1333-1340
12. Eck, D., Schmidhuber, J.: Finding temporal structure in music: Blues improvisation with LSTM recurrent networks. In Bourlard, H., ed.: Neural Networks for Signal Processing XII, Proceedings of the 2002 IEEE Workshop, New York, IEEE (2002) 747-756
13. Young, S.: The HTK Book. Cambridge University (1995/1996)
14. Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press, Inc. (1995)
15. Plaut, D.C., Nowlan, S.J., Hinton, G.E.: Experiments on learning back propagation. Technical Report CMU-CS-86-126, Carnegie-Mellon University, Pittsburgh, PA (1986)
16. Zheng, F., Picone, J.: Robust low perplexity voice interfaces. Technical report, MITRE Corporation (2001)