Recurrent neural network based language modeling in meeting recognition

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2011, Pages 2877-2880

  Kombrink, Stefan ^a   Mikolov, Tomáš ^a   Karafiát, Martin ^a   Burget, Lukáš ^a  

^a BRNO UNIVERSITY OF TECHNOLOGY   (Czech Republic)

Author keywords

Adaptation; Automatic speech recognition; Language modeling; Recurrent neural networks; Rescoring

Indexed keywords

ADAPTATION; AUTOMATIC SPEECH RECOGNITION; DATA SETS; LANGUAGE MODEL; LANGUAGE MODEL ADAPTATION; LANGUAGE MODELING; N-BEST LIST; N-GRAM LANGUAGE MODELS; RESCORING; UNSUPERVISED ADAPTATION; WORD ERROR RATE;

NATURAL LANGUAGE PROCESSING SYSTEMS; RECURRENT NEURAL NETWORKS; SPEECH RECOGNITION;

COMPUTATIONAL LINGUISTICS;

EID: 84865804529     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. A. Deoras, T. Mikolov, S. Kombrink, M. Karafiát and S. Khudanpur. Variational Approximation of Long-Span Language Models in LVCSR. In IEEE Intl. Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, CZ, May 2011.
2. M. Afify, O. Siohan, and R. Sarikaya. Gaussian mixture language models for speech recognition. In Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on, volume 4, pages IV- 29. IEEE, 2007.
3. M. Bodén. A guide to recurrent neural networks and backpropagation. In THE DALLAS PROJECT, SICS TECHNICAL REPORT T2002:03, SICS, 2002.
4. F. Grezl, M. Karafiát and L. Burget. Investigation into bottle-neck features for meeting speech recognition. In Proc. Interspeech 2009, number 9, pages 2947-2950, Brighton, GB, 2009. International Speech Communication Association.
5. H. Schwenk and J.L. Gauvain. Building continuous space language models for transcribing european languages. pages 737-740, Lisbon, Portugal, 2005.
6. M.C. Mozer. A focused backpropagation algorithm for temporal pattern recognition, pages 137-169. L. Erlbaum Associates Inc., Hillsdale, NJ, USA, 1995.
7. S. Hochreiter and J. Schmidhuber. LSTM Can Solve Hard Long Time Lag Problems. In Advances in Neural Information Processing Systems 9, pages 473-479. MIT Press, 1997.
8. T. Hain, L. Burget, J. Dines, G. Garau, M. Karafiát, D.v. Leeuwen, M. Lincoln and V. Wan. The 2007 AMI(DA) system for meeting transcription. In Proc. Rich Transcription 2007 Spring Meeting Recognition Evaluation Workshop, Baltimore, Maryland USA, May 2007.
9. T. Hain, L. Burget, J. Dines, N.P. Garner, A.H. El, M. Huijbregts, M. Karafiát, M. Lincoln and V.Wan. The AMIDA 2009 Meeting Transcription System. In Proc. of INTERSPEECH 2010, volume 2010, pages 358-361, Makuhari, Chiba, JP, 2010. International Speech Communication Association.
10. T. Mikolov, M. Karafiát, L. Burget, J. Černocký and S. Khudanpur. Recurrent neural network based language model. In Proc. of INTERSPEECH 2010, number 9, pages 1045-1048, Makuhari, Chiba, JP, 2010. International Speech Communication Association.
11. T. Mikolov, S. Kombrink, L. Burget, J. Černocký and S. Khudanpur. Extensions of Recurrent Neural Network Language Models. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, CZ, May 2011.
12. Y. Bengio, R. Ducharme, P. Vincent, C. Jauvin, T. Hofmann, T. Poggio and J. Shawe-taylor. A neural probabilistic language model. In Journal of Machine Learning Research, volume 3, pages 1137-1155, 2003.