Conversion of recurrent neural network language models to weighted finite state transducers for automatic speech recognition

13th Annual Conference of the International Speech Communication Association 2012, INTERSPEECH 2012

Volumn 2, Issue , 2012, Pages 1666-1669

  Lecorvé, Gwénolé ^a   Motlicek, Petr ^a  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

Language model; Recurrent neural network; Speech decoding; Weighted finite state transducer

Indexed keywords

AUTOMATIC SPEECH RECOGNITION; CLUSTERING TECHNIQUES; LANGUAGE MODEL; N-GRAM LANGUAGE MODELS; SPEECH DECODING; SPEECH SIGNALS; WEIGHTED FINITE-STATE TRANSDUCERS; WORD ERROR RATE;

COMPUTATIONAL LINGUISTICS; PROBABILITY DISTRIBUTIONS; RECURRENT NEURAL NETWORKS; TRANSDUCERS; TRANSLATION (LANGUAGES);

SPEECH RECOGNITION;

EID: 84878381641     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. T.Mikolov, M. Karafiat, L. Burget, J. ?Cernocky, and S. Khudanpur, "Recurrent neural network based language model, " in Proc. of Interspeech, 2010, pp. 1045-1048.
2. H. Ney and S. Ortmanns, "Dynamic programming search for continuous speech recognition, " IEEE Signal Processing Magazine, pp. 64-83, 1999.
3. M. Mohri, F. C. Pereira, and M. Riley, "Speech recognition with weighted finite-state transducers, " Springer Handbook of Speech Processing, pp. 559-584, 2008.
4. T. Mikolov, A. Deoras, S. Kombrink, L. Burget, and J. ?Cernocky, "Empirical evaluation and combination of advanced languagemodeling techniques, " in Proc. of Interspeech, 2011, pp. 605-608.
5. S. Kombrink, T. Mikolov, M. Karafit, and L. Burget, "Recurrent neural network based language modeling in meeting recognition, " in Proc. of Interspeech, 2011, pp. 2877-2880.
6. A. Deoras, T. M. Mikolov, S. Kombrink, M. Karafiat, and S. Khudanpur, "Variational approximation of long-span language models for LVCSR, " in Proc. of ICASSP, 2011, pp. 5532-5535.
7. A. Deoras, "Search and decoding strategies for complex lexical modeling in LVCSR, " Ph.D. dissertation, Johns Hopkins University, 2011.
8. S. M. Katz, "Estimation of probabilities from sparse data for the language model component of a speech recognizer, " IEEE Trans. on Acoustics, Speech, and Signal Processing, vol. 35, no. 3, pp. 400-401, 1987.
9. A. Stolcke, "Entropy-based pruning of backoff language models, " in Proc. DARPA Broadcast News Transcription and UnderstandingWorkshop, 1998, pp. 270-274.
10. M. P. Marcus, M. A. Marcinkiewicz, and B. Santorini, "Building a large annotated corpus of English: the Penn Treebank, " Computational Linguistics, vol. 19, no. 2, pp. 313-330, 1993.
11. T. Hain, L. Burget, J. Dines, P. N. Garner, A. E. Hannani, M. Huijbregts, M. Karafit, M. Lincoln, and V.Wan, "The AMIDA 2009 meeting transcription system, " in Proc. of Interspeech, 2010, pp. 358-361.