Learning acoustic frame labeling for speech recognition with recurrent neural networks

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2015-August, Issue , 2015, Pages 4280-4284

  Sak, Hasim ^a   Senior, Andrew ^a   Rao, Kanishka ^a   Irsoy, Ozan ^a   Graves, Alex ^a   Beaufays, Francoise ^a   Schalkwyk, Johan ^a  

^a GOOGLE INC   (United States)

Author keywords

acoustic modeling; CTC; LSTM; RNN

Indexed keywords

AUDIO SIGNAL PROCESSING; SPEECH COMMUNICATION; SPEECH RECOGNITION; TELEPHONE SETS;

ACOUSTIC MODEL; CONTEXT DEPENDENT; CONVENTIONAL APPROACH; DISCRIMINATIVE TRAINING; FINITE STATE TRANSDUCERS; LARGE VOCABULARY SPEECH RECOGNITION; LSTM; TEMPORAL CLASSIFICATION;

LONG SHORT-TERM MEMORY;

EID: 84946084790     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2015.7178778     Document Type: Conference Paper

References (25)

1. H. Bourlard and N. Morgan, Connectionist speech recognition. Kluwer Academic Publishers, 1994
2. A. Graves, N. Jaitly, and A. Mohamed, Hybrid speech recognition with deep bidirectional LSTM, in Automatic Speech Recognition and Understanding (ASRU), 2013 IEEEWorkshop on. IEEE, 2013, pp. 273-278
3. H. Sak, A. Senior, and F. Beaufays, Long Short-Term Memory Recurrent Neural Network Architectures for Large Scale Acoustic Modeling, in INTERSPEECH 2014, 2014
4. H. Sak, O. Vinyals, G. Heigold, A. Senior, E. McDermott, R. Monga, and M. Mao, Sequence discriminative distributed training of long short-term memory recurrent neural networks, in Interspeech, 2014
5. H. Sak, A. Senior, and F. Beaufays, Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition, ArXiv e-prints, Feb. 2014
6. A. Graves, S. Fernández, F. Gomez, and J. Schmidhuber, Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks, in Proceedings of the 23rd international conference on Machine learning. ACM, 2006, pp. 369-376
7. A. Graves, A. Mohamed, and G. Hinton, Speech recognition with deep recurrent neural networks, in Proceedings of ICASSP, 2013
8. F. Seide, G. Li, and D. Yu, Conversational speech transcription using context-dependent deep neural networks, in INTERSPEECH, 2011, pp. 437-440
9. G. Dahl, D. Yu, and L. Deng, Context-dependent pre-trained deep neural networks for large vocabulary speech recognition, in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2011
10. G. E. Dahl, D. Yu, L. Deng, and A. Acero, Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition, IEEE Transactions on Audio, Speech &Language Processing, vol. 20, no. 1, pp. 30-42, Jan. 2012. [Online]. Available: http://dx.doi.org/10.1109/TASL.2011.2134090
11. N. Jaitly, P. Nguyen, A. Senior, and V. Vanhoucke, Application of pretrained deep neural networks to large vocabulary speech recognition, in INTERSPEECH, 2012
12. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, IEEE Signal Process. Mag., vol. 29, no. 6, pp. 82-97, 2012
13. L. R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, Proceedings of the IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989
14. Y. Normandin, Hidden Markov models, maximum mutual information, and the speech recognition problem, Ph.D. dissertation, McGill University, Montreal, Canada, 1991
15. D. Povey, Discriminative training for large vocabulary speech recognition, Ph.D. dissertation, Cambridge, England, 2004
16. B. Kingsbury, Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling, in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Taipei, Taiwan, Apr. 2009, pp. 3761-3764
17. B. Kingsbury, T. N. Sainath, and H. Soltau, Scalable minimum Bayes risk training of deep neural network acoustic models using distributed Hessian-free optimization, in INTERSPEECH, 2012
18. H. Su, G. Li, D. Yu, and F. Seide, Error back propagation for sequence training of context-dependent deep networks for conversational speech transcription, in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2013, pp. 6664-6668
19. K. Veselý, A. Ghoshal, L. Burget, and D. Povey, Sequencediscriminative training of deep neural networks, in INTERSPEECH, 2013
20. G. Heigold, A log-linear discriminative modeling framework for speech recognition, Ph.D. dissertation, RWTH Aachen University, Aachen, Germany, Jun. 2010
21. M. Schuster and K. K. Paliwal, Bidirectional recurrent neural networks, Signal Processing, IEEE Transactions on, vol. 45, no. 11, pp. 2673-2681, 1997
22. F. Eyben, M. Wollmer, B. Schuller, and A. Graves, From speech to letters using a novel neural network architecture for grapheme based ASR, in Automatic Speech Recognition &Understanding, 2009. ASRU 2009. IEEE Workshop on. IEEE, 2009, pp. 376-380
23. Q. Le, M. Ranzato, R. Monga, M. Devin, K. Chen, G. Corrado, J. Dean, and A. Ng, Building high-level features using large scale unsupervised learning, in International Conference on Machine Learning, 2012, pp. 81-88
24. J. Dean, G. Corrado, R. Monga, K. Chen, M. Devin, Q. Le, M. Mao, M. Ranzato, A. Senior, P. Tucker, K. Yang, and A. Ng, Large scale distributed deep networks, in Advances in Neural Information Processing Systems (NIPS), 2012
25. G. Heigold, V. Vanhoucke, A. Senior, P. Nguyen, M. Ranzato, M. Devin, and J. Dean, Multilingual acoustic models using distributed deep neural networks, in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), vol. 1, Vancouver, Canada, Apr. 2013