Towards end-to-end speech recognition with recurrent neural networks

31st International Conference on Machine Learning, ICML 2014

Volumn 5, Issue , 2014, Pages 3771-3779

  Graves, Alex ^a   Jaitly, Navdeep ^b  

^a DEEPMIND   (United Kingdom)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CHARACTER RECOGNITION; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL LINGUISTICS; LEARNING SYSTEMS; NETWORK ARCHITECTURE; RECURRENT NEURAL NETWORKS; TRANSCRIPTION;

BASELINE SYSTEMS; LINGUISTIC INFORMATION; OBJECTIVE FUNCTIONS; PHONETIC REPRESENTATION; SPEECH RECOGNITION SYSTEMS; TEMPORAL CLASSIFICATION; WALL STREET JOURNAL; WORD ERROR RATE;

SPEECH RECOGNITION;

EID: 84919832465     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Bahl, L., Brown, P., De Souza, P.V., and Mercer, R. Maximum mutual information estimation of hidden markov model parameters for speech recognition. In Acoustics, Speech, and Signal Processing, IEEE International Conference on ICASSP '86., volume 11, pp. 49-52, Apr 1986. doi: 10.1109/ICASSP.1986.1169179.
2. Bisani, Maximilian and Ney, Hermann. Open vocabulary speech recognition with flat hybrid models. In INTER-SPEECH, pp. 725-728, 2005.
3. Bourlard, Herve A. and Morgan, Nelson. Connection-ist Speech Recognition: A Hybrid Approach. Kluwer Academic Publishers, Norwell, MA, USA, 1993. ISBN 0792393961.
4. Ciresan, Dan C, Meier, Ueli, Masci, Jonathan, and Schmidhuber, Jrgen. A committee of neural networks for traffic sign classification. In IJCNN, pp. 1918-1921. IEEE, 2011.
5. Davis, S. and Mermelstein, P. Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences. IEEE Transactions on Acoustics, Speech and Signal Processing, 28(4):357-366, August 1980.
6. Eyben, F., Wllmer, M., Schuller, B., and Graves, A. From speech to letters - using a novel neural network architecture for grapheme based asr. In Proc. Automatic Speech Recognition and Understanding Workshop (ASRU 2009), Merano, Italy. IEEE, 2009. 13.-17.12.2009.
7. Galescu, Lucian. Recognition of out-of-vocabulary words with sub-lexical language models. In INTERSPEECH, 2003.
8. Gers, F., Schraudolph, N., and Schmidhuber, J. Learning Precise Timing with LSTM Recurrent Networks. Journal of Machine Learning Research, 3:115-143, 2002.
9. Graves, A. and Schmidhuber, J. Framewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures. Neural Networks, 18(5-6):602-610, June/July 2005.
10. Graves, A., Fernandez, S., Gomez, F., and Schmidhuber, J. Connectionist Temporal Classification: Labelling Un-segmented Sequence Data with Recurrent Neural Networks. In ICML, Pittsburgh, USA, 2006.
11. Graves, A., Mohamed, A., and Hinton, G. Speech recognition with deep recurrent neural networks. In Proc ICASSP 2013, Vancouver, Canada, May 2013.
12. Graves, Alex. Supervised Sequence Labelling with Recurrent Neural Networks, volume 385 of Studies in Computational Intelligence. Springer, 2012.
13. Hinton, G. E. and Salakhutdinov, R. R. Reducing the Dimensionality of Data with Neural Networks. Science, 313(5786):504-507, May 2006.
14. Hinton, Geoffrey, Deng, Li, Yu, Dong, Dahl, George, rah-man Mohamed, Abdel, Jaitly, Navdeep, Senior, Andrew, Vanhoucke, Vincent, Nguyen, Patrick, Sainath, Tara, and Kingsbury, Brian. Deep neural networks for acoustic modeling in speech recognition. Signal Processing Magazine, 2012.
15. Hochreiter, S. and Schmidhuber, J. Long Short-Term Memory. Neural Computation, 9(8): 1735-1780, 1997.
16. Jaitly, Navdeep and Hinton, Geoffrey E. Learning a better representation of speech soundwaves using restricted boltzmann machines. In ICASSP, pp. 5884-5887, 2011.
17. Jaitly, Navdeep, Nguyen, Patrick, Senior, Andrew W, and Vanhoucke, Vincent. Application of pretrained deep neural networks to large vocabulary speech recognition. In INTERSPEECH, 2012.
18. Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, 2012.
19. Lee, Li and Rose, R. A frequency warping approach to speaker normalization. Speech and Audio Processing, IEEE Transactions on, 6(1):49-60, Jan 1998.
20. Peters, J. and Schaal, S. Reinforcement learning of motor skills with policy gradients. In Neural Networks, number 4, pp. 682-97, 2008.
21. Povey, D., Ghoshal, A., Boulianne, G., Bürget, L., Glem-bek, O., Goel, N., Hannemann, M., Motlicek, P., Qian, Y, Schwarz, P., Silovsky, J., Stemmer, G., and Vesely, K. The kaldi speech recognition toolkit. In IEEE 2011 Workshop on Automatic Speech Recognition and Understanding. IEEE Signal Processing Society, December 2011.
22. Schuster, M. and Paliwal, K. K. Bidirectional Recurrent Neural Networks. IEEE Transactions on Signal Processing, 45:2673-2681, 1997.