Word embeddings for speech recognition

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 1053-1057

  Bengio, Samy ^a   Heigold, Georg ^a  

^a GOOGLE INC   (United States)

Author keywords

Deep learning; Embeddings; Speech recognition

Indexed keywords

SPEECH COMMUNICATION;

ACOUSTIC MODEL; DEEP LEARNING; EMBEDDINGS; EUCLIDEAN SENSE; LATTICE RESCORING; MODEL COMBINATION; SPEECH RECOGNITION SYSTEMS; WORD ERROR RATE;

SPEECH RECOGNITION;

EID: 84910030525     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. M. Bacchiani and M. Ostendorf. Joint lexicon, acoustic unit inventory and model design. Speech Communication, 29(2-4):99-114, 1999.
2. M. Bisani and H. Ney. Joint-sequence models for grapheme-to-phoneme conversion. Speech Communication, 50(5):434-451, 2008.
3. G. Dahl, D. Yu, L. Deng, and A. Acero. Contextdependent pre-trained deep neural networks for large vocabulary speech recognition. IEEE Transactions on Audio, Speech, and Language Processing, Special Issue on Deep Learning for Speech and Language Processing, 20(1):30- 42, 2012.
4. G.E. Dahl, D. Yu, and L. Deng. Context-dependent pretrained deep neural networks for large vocabulary speech recognition. In IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP, 2011.
5. G. Heigold, P. Nguyen, M. Weintraub, and V. Vanhoucke. Investigations on exemplar-based features for speech recognition towards thousands of hours of unsupervised, noisy data. In IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP, 2012.
6. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal Process. Mag., 29(6):82- 97, 2012.
7. P.-S. Huang, X. He, J. Gao, and L. Deng. Learning deep structures semantic models for web search using clickthrough data. In Proceedings of CIKM, 2013.
8. N. Jaitly, P. Nguyen, A. Senior, and V. Vanhoucke. Application of pretrained deep neural networks to large vocabulary speech recognition. In Conference of the International Communication Association, INTERSPEECH, 2012.
9. C. Lee, Y. Zhang, and J. Glass. Joint learning of phonetic units and word pronunciations for asr. In Conference on Empirical Methods in Natual Language Processing, EMNLP, 2013.
10. L. Lu, A. Ghoshal, and S. Renals. Acoustic data-driven pronunciation lexicon for large vocabulary speech recognition. In IEEE Automatic Speech Recognition and Understanding Workshop, ASRU, 2013.
11. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. In Proceedings of the Workshop at ICLR, 2013.
12. P. Nguyen, G. Heigold, and G. Zweig. Speech recognition with flat direct models. IEEE Journal of Selected Topics in Signal Processing, 4(6):994-1006, 2010.
13. L. Rabiner and B.-H. Juang. An introduction to hidden Markov models. IEEE ASSP Magazine, 3(1):4-16, 1986.
14. F. Seide, G. Li, and D. Yu. Conversational speech transcription using context-dependent deep neural networks. In Conference of the International Communication Association, INTERSPEECH, pages 437-440, 2011.
15. O. Vinyals, L. Deng, D. Yu, and A. Acero. Discriminative pronunciation learning using phonetic decoder and minimum classification error criterion. In IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP, 2009.
16. J. Weston, S. Bengio, and N. Usunier. Wsabie: Scaling up to large vocabulary image annotation. In Proceedings of the International Joint Conference on Artificial Intelligence, IJCAI, 2011.
17. S. Young, J. Odell, and P. Woodland. Tree-based state tying for high accuracy acoustic modelling. In ARPA Spoken Language Technology Workshop, 1994.
18. G. Zweig and P. Nguyen. A segmental crf approach to large vocabulary continuous speech recognition. In IEEE Automatic Speech Recognition and Understanding Workshop, ASRU, 2009.