Segmental recurrent neural networks for end-to-end speech recognition

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 08-12-September-2016, Issue , 2016, Pages 385-389

  Lu, Liang ^a   Kong, Lingpeng ^b   Dyer, Chris ^b   Smith, Noah A ^c   Renals, Steve ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b Carnegie Mellon University ^*  (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

End to end speech recognition; Recurrent neural networks; Segmental CRF

Indexed keywords

DECODING; FEATURE EXTRACTION; RANDOM PROCESSES; RECURRENT NEURAL NETWORKS; SPEECH; SPEECH COMMUNICATION; SPEECH PROCESSING;

ACOUSTIC MODELLING; END TO END; EXTERNAL SYSTEMS; PRACTICAL TRAINING; RECURRENT NEURAL NETWORK (RNN); SEGMENTAL CONDITIONAL RANDOM FIELDS; SEGMENTAL CRF; SEGMENTATION BOUNDARIES;

SPEECH RECOGNITION;

EID: 84994242299     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: 10.21437/Interspeech.2016-40     Document Type: Conference Paper

References (29)

1. D. Gillick, L. Gillick, and S. Wegmann, "Don't multiply lightly: Quantifying problems with the acoustic model assumptions in speech recognition," in Proc. ASRU. IEEE, 2011, pp. 71-76.
2. M. Ostendorf, V. Digalakis, and O. Kimball, "From HMM's to segment models: A unified view of stochastic modeling for speech recognition," IEEE Transactions on Speech and Audio Processing, pp. 360-378, 1996.
3. N. Smith and M. Gales, "Speech recognition using SVMs," in Advances in neural information processing systems, 2001, pp. 1197-1204.
4. A. Gunawardana, M. Mahajan, A. Acero, and J. C. Platt, "Hidden conditional random fields for phone classification." in INTERSPEECH, 2005, pp. 1117-1120.
5. Y. Hifny and S. Renals, "Speech recognition using augmented conditional random fields," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 17, no. 2, pp. 354-365, 2009.
6. A. Graves and N. Jaitly, "Towards end-to-end speech recognition with recurrent neural networks," in Proc. ICML, 2014, pp. 1764-1772.
7. A. Hannun, C. Case, J. Casper, B. Catanzaro, G. Diamos, E. Elsen, R. Prenger et al., "Deep Speech: Scaling up end-to-end speech recognition," in arXiv preprint arXiv:1412.5567, 2014.
8. H. Sak, A. Senior, K. Rao, and F. Beaufays, "Fast and accurate recurrent neural network acoustic models for speech recognition," in Proc. INTERSPEECH, 2015.
9. Y. Miao, M. Gowayyed, and F. Metze, "EESEN: Endto-end speech recognition using deep RNN models and WFST-based decoding," in Proc. ASRU, 2015.
10. D. Bahdanau, K. Cho, and Y. Bengio, "Neural machine translation by jointly learning to align and translate," in Proc. ICLR, 2015.
11. J. K. Chorowski, D. Bahdanau, D. Serdyuk, K. Cho, and Y. Bengio, "Attention-based models for speech recognition," in Advances in Neural Information Processing Systems, 2015, pp. 577-585.
12. L. Lu, X. Zhang, K. Cho, and S. Renals, "A study of the recurrent neural network encoder-decoder for large vocabulary speech recognition," in Proc. INTERSPEECH, 2015.
13. W. Chan, N. Jaitly, Q. V. Le, and O. Vinyals, "Listen, attend and spell," arXiv preprint arXiv:1508.01211, 2015.
14. L. Kong, C. Dyer, and N. A. Smith, "Segmental recurrent neural networks," arXiv preprint arXiv:1511.06018, 2015.
15. S. Sarawagi and W. W. Cohen, "Semi-markov conditional random fields for information extraction," in Advances in neural information processing systems, 2004, pp. 1185-1192.
16. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. ICML, 2001, pp. 282-289.
17. G. Zweig, P. Nguyen, D. Van Compernolle, K. Demuynck, L. Atlas, P. Clark et al., "Speech recognition with segmental conditional random fields: A summary of the JHU CLSP 2010 summer workshop," in Proc. ICASSP. IEEE, 2011, pp. 5044-5047.
18. E. Fosler-Lussier, Y. He, P. Jyothi, and R. Prabhavalkar, "Conditional random fields in speech, audio, and language processing," Proceedings of the IEEE, vol. 101, no. 5, pp. 1054-1075, 2013.
19. O. Abdel-Hamid, L. Deng, D. Yu, and H. Jiang, "Deep segmental neural networks for speech recognition." in Proc. INTERSPEECH, 2013, pp. 1849-1853.
20. Y. He and E. Fosler-Lussier, "Segmental conditional random fields with deep neural networks as acoustic models for first-pass word recognition," in Proc. INTERSPEECH, 2015.
21. A. Graves, "Hierarchical subsampling networks," in Supervised Sequence Labelling with Recurrent Neural Networks. Springer, 2012, pp. 109-131.
22. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlicek, Y. Qian, P. Schwarz, J. Silovský, G. Semmer, and K. Veselý, "The Kaldi speech recognition toolkit," in Proc. ASRU, 2011.
23. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.
24. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting," The Journal of Machine Learning Research, vol. 15, no. 1, pp. 1929-1958, 2014.
25. W. Zaremba, I. Sutskever, and O. Vinyals, "Recurrent neural network regularization," arXiv preprint arXiv:1409.2329, 2014.
26. G. Zweig, "Classification and recognition with direct segment models," in Proc. ICASSP. IEEE, 2012, pp. 4161-4164.
27. Y. He and E. Fosler-Lussier, "Efficient segmental conditional random fields for phone recognition," in Proc. INTERSPEECH, 2012, pp. 1898-1901.
28. H. Tang, W. Wang, K. Gimpel, and K. Livescu, "Discriminative segmental cascades for feature-rich phone recognition," in Proc. ASRU, 2015.
29. A. Graves, A.-R. Mohamed, and G. Hinton, "Speech recognition with deep recurrent neural networks," in Proc. ICASSP. IEEE, 2013, pp. 6645-6649