Framewise phoneme classification with bidirectional LSTM and other neural network architectures

Neural Networks

Volumn 18, Issue 5-6, 2005, Pages 602-610

  Graves, Alex ^a   Schmidhuber, Jürgen ^a,b  

^a DALLE MOLLE INSTITUTE FOR ARTIFICIAL INTELLIGENCE IDSIA   (Switzerland)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; MULTILAYERS; NEURAL NETWORKS; SPEECH PROCESSING;

BIDIRECTIONAL NETWORKS; LONG SHORT TERM MEMORY (LSTM); PHONEME CLASSIFICATION;

LEARNING SYSTEMS;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; CONFERENCE PAPER; DATA BASE; LEARNING; LONG TERM MEMORY; MATHEMATICAL COMPUTING; ONLINE SYSTEM; PHONEME; PRIORITY JOURNAL; SHORT TERM MEMORY; SPEECH PERCEPTION; TRAINING; ARTICLE; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; CLASSIFICATION; COMPUTER SYSTEM; MEMORY; PHYSIOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLASSIFICATION; COMPUTER SYSTEMS; MEMORY; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); SPEECH PERCEPTION;

EID: 27744588611     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2005.06.042     Document Type: Conference Paper

References (24)

1. P. Baldi, S. Brunak, P. Frasconi, G. Soda, and G. Pollastri Exploiting the past and the future in protein secondary structure prediction BIOINF: Bioinformatics 1999 15
2. P. Baldi, S. Brunak, R. Frasconi, G. Pollastri, and G. Soda Bidirectional dynamics for protein secondary structure prediction Lecture Notes in Computer Science 1828 2001 80 104
3. N. Beringer Human language acquisition in a machine learning task Proceedings of ICSLP 2004
4. N. Beringer Human language acquisition methods in a machine learning task Proceedings of the 8th international conference on spoken language processing 2004 pp. 2233-2236
5. C. Bishop Neural networks for pattern recognition 1995 Oxford University Press, Inc. Oxford
6. H. Bourlard, and N. Morgan Connnectionist speech recognition: A hybrid approach 1994 Kluwer Academic Publishers Dordecht
7. J. Chen, and N.S. Chaudhari Capturing long-term dependencies for protein secondary structure prediction F. Yin J. Wang C. Guo Advances in neural networks-ISNN 2004, international symposiumon neural networks, Part II, of lecture notes in computer science 2004 Springer Dalian, China 494 500
8. R. Chen, and L. Jamieson Experiments on the implementation of recurrent neural networks for speech phone recognition Proceedings of the thirtieth annual asilomar conference on signals, systems and computers 1996 pp. 779-782
9. Eck, D., Graves, A., & Schmidhuber, J. (2003). A new approach to continuous speech recognition using LSTM recurrent neural networks. Technical Report IDSIA-14-03, IDSIA, www.idsia.ch/techrep.html.
10. T. Fukada, M. Schuster, and Y. Sagisaka Phoneme boundary estimation using bidirectional recurrent neural networks and its applications Systems and Computers in Japan 30 4 1999 20 30
11. J.S. Garofolo, L.F. Lamel, W.M. Fisher, J.G. Fiscus, D.S. Pallett, and N.L. Dahlgren Darpa timit acoustic phonetic continuous speech corpus cdrom 1993
12. F. Gers, N. Schraudolph, and J. Schmidhuber Learning precise timing with LSTM recurrent networks Journal of Machine Learning Research 3 2002 115 143
13. A. Graves, and J. Schmidhuber Framewise phoneme classification with bidirectional lstm networks Proceedings of the international joint conference on neural networks, Montreal 2005
14. A. Graves, N. Beringer, and J. Schmidhuber A comparison between spiking and differentiable recurrent neural networks on spoken digit recognition The 23rd IASTED international conference on modelling, identification, and control, Grindelwald 2004
15. A. Graves, D. Eck, N. Beringer, and J. Schmidbuber Biologically plausible speech recognition with lstm neural nets First international workshop on biologically inspired approaches to advanced information technology, Lausanne 2004
16. Graves, A., Beringer, N., & Schmidhuber, J. (2005). Rapid retraining on speech data with lstm recurrent networks. Technical Report IDSIA-09-05, IDSIA, www.idsia.ch/-techrep.html.
17. S. Hochreiter, and J. Schmidhuber Long short-term memory Neural Computation 9 8 1997 1735 1780
18. S. Hochreiter, Y. Bengio, P. Frasconi, and J. Schmidhuber Gradient flow in recurrent nets: The difficulty of learning long-term dependencies S.C. Kremer J.F. Kolen A field guide to dynamical recurrent neural networks 2001 IEEE Press
19. Robinson, A. J. (1991). Several improvements to a recurrent error propagation network phone recognition system. Technical Report CUED/F-INFENG/TR82, University of Cambridge.
20. A.J. Robinson An application of recurrent nets to phone probability estimation IEEE Transactions on Neural Networks 5 2 1994 298 305
21. Robinson, A.J., & Fallside, F. (1987). The utility driven dynamic error propagation network. Technical Report CUED/F-INFENG/TR.1, Cambridge University Engineering Department.
22. Schuster, M. (1999). On supervised learning from sequential data with applications for speech recognition. PhD thesis, Nara Institute of Science and Technolog, Kyoto, Japan.
23. M. Schuster, and K.K. Paliwal Bidirectional recurrent neural networks IEEE Transactions on Signal Processing 45 1997 2673 2681
24. R.J. Williams, and D. Zipser Gradient-based learning algorithms for recurrent networks and their computational complexity Y. Chauvin D.E. Rumelhart Back-propagation: Theory, architectures and applications 1995 Lawrence Erlbaum Publishers Hillsdale, NJ 433 486