Character-level incremental speech recognition with recurrent neural networks

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 5335-5339

  Hwang, Kyuyeon ^a   Sung, Wonyong ^a  

^a Seoul National University   (South Korea)

Author keywords

beam search; character level; connectionist temporal classification; Incremental speech recognition; recurrent neural networks

Indexed keywords

EID: 84973382845     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472696     Document Type: Conference Paper

References (21)

1. Ethan O Selfridge, Iker Arizmendi, Peter A Heeman, and Jason DWilliams, "Stability and accuracy in incremental speech recognition, " in Proceedings of the SIGDIAL 2011 Conference. Association for Computational Linguistics, 2011, pp. 110-119
2. Ian McGraw and Alexander Gruenstein, "Estimating wordstability during incremental speech recognition, " Training, vol. 17, no. 27, 327, pp. 6-4, 2011
3. Gerhard Sagerer, Heike Rautenstrauch, Gernot A Fink, Bernd Hildebrandt, A Jusek, and Franz Kummert, "Incremental generation of word graphs., " in ICSLP. Citeseer, 1996
4. Mirjam Killer, Sebastian Stüker, and Tanja Schultz, "Grapheme based speech recognition., " in INTERSPEECH, 2003
5. Maximilian Bisani and Hermann Ney, "Open vocabulary speech recognition with flat hybrid models., " in INTERSPEECH, 2005, pp. 725-728
6. Alex Graves and Navdeep Jaitly, "Towards end-to-end speech recognition with recurrent neural networks, " in Proceedings of the 31st International Conference on Machine Learning (ICML-14), 2014, pp. 1764-1772
7. Awni Hannun, Carl Case, Jared Casper, Bryan Catanzaro, Greg Diamos, Erich Elsen, Ryan Prenger, Sanjeev Satheesh, Shubho Sengupta, Adam Coates, et al., "DeepSpeech: Scaling up endto-end speech recognition, " arXiv preprint arXiv: 1412. 5567, 2014
8. Awni Y Hannun, Andrew L Maas, Daniel Jurafsky, and Andrew Y Ng, "First-pass large vocabulary continuous speech recognition using bi-directional recurrent DNNs, " arXiv preprint arXiv: 1408. 2873, 2014
9. Yajie Miao, Mohammad Gowayyed, and Florian Metze, "EESEN: End-to-end speech recognition using deep RNN models and WFST-based decoding, " arXiv preprint arXiv: 1507. 08240, 2015
10. Dzmitry Bahdanau, Jan Chorowski, Dmitriy Serdyuk, Philemon Brakel, and Yoshua Bengio, "End-to-end attentionbased large vocabulary speech recognition, " arXiv preprint arXiv: 1508. 04395, 2015
11. Andrew L Maas, Ziang Xie, Dan Jurafsky, and Andrew Y Ng, "Lexicon-free conversational speech recognition with neural networks, " in NAACL HLT 2015, The 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, Colorado, USA, May 31-June 5, 2015, 2015, pp. 345-354
12. Alex Graves, Santiago Fernández, Faustino Gomez, and Jürgen Schmidhuber, "Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks, " in Proceedings of the 23rd international conference on Machine learning. ACM, 2006, pp. 369-376
13. Douglas B Paul and Janet M Baker, "The design for the Wall Street Journal-based CSR corpus, " in Proceedings of the workshop on Speech and Natural Language. Association for Computational Linguistics, 1992, pp. 357-362
14. Sepp Hochreiter and Jürgen Schmidhuber, "Long short-term memory, " Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997
15. Alex Graves, Navdeep Jaitly, and Abdel-rahman Mohamed, "Hybrid speech recognition with deep bidirectional LSTM, " in Automatic Speech Recognition and Understanding (ASRU), 2013 IEEE Workshop on. IEEE, 2013, pp. 273-278
16. Kyuyeon Hwang and Wonyong Sung, "Online sequence training of recurrent neural networks with connectionist temporal classification, " arXiv preprint arXiv: 1511. 06841, 2015
17. Kyuyeon Hwang and Wonyong Sung, "Single stream parallelization of generalized LSTM-like RNNs on a GPU, " in Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on. IEEE, 2015, pp. 1047-1051
18. Tomás Mikolov, Stefan Kombrink, Lukás Burget, Jan Honza Cernockỳ, and Sanjeev Khudanpur, "Extensions of recurrent neural network language model, " in Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on. IEEE, 2011, pp. 5528-5531
19. Matthew D Zeiler, "ADADELTA: An adaptive learning rate method, " arXiv preprint arXiv: 1212. 5701, 2012
20. Ilya Sutskever, James Martens, and Geoffrey E Hinton, "Generating text with recurrent neural networks, " in Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011, pp. 1017-1024
21. Phillip C Woodland, Julian J Odell, Valtcho Valtchev, and Steve J Young, "Large vocabulary continuous speech recognition using HTK, " in Acoustics, Speech, and Signal Processing, 1994. ICASSP-94., 1994 IEEE International Conference on. IEEE, 1994, vol. 2, pp. II-125.