Variational approximation of long-span language models for LVCSR

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2011, Pages 5532-5535

  Deoras, Anoop ^a   Mikolov, Tomáš ^b   Kombrink, Stefan ^b   Karafiát, Martin ^b   Khudanpur, Sanjeev ^a  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b BRNO UNIVERSITY OF TECHNOLOGY   (Czech Republic)

Author keywords

Language Model; Recurrent Neural Network; Variational Inference

Indexed keywords

DATA SETS; EMPIRICAL RESULTS; LANGUAGE MODEL; LARGE VOCABULARY CONTINUOUS SPEECH RECOGNITION; LONG SPAN; N-BEST LIST; N-GRAM MODELS; VARIATIONAL APPROXIMATION; VARIATIONAL INFERENCE; WORD ERROR RATE;

CONTINUOUS SPEECH RECOGNITION; RECURRENT NEURAL NETWORKS; SEMANTICS; SIGNAL PROCESSING; SPEECH COMMUNICATION; SPEECH PROCESSING;

COMPUTATIONAL LINGUISTICS;

EID: 80051613991     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2011.5947612     Document Type: Conference Paper

References (13)

1. Tomáš Mikolov, Martin Karafiát, Lukáš Burget, Jan "Honza" Černocký, and Sanjeev Khudanpur, "Recurrent neural network based language model," in Proc. of the ICSLP-Interspeech, 2010.
2. Peng Xu, Random forests and the data sparseness problem in language modeling, Ph.D. thesis, Johns Hopkins University, 2005.
3. Ciprian Chelba and Frederick Jelinek, "Structured language modeling," Computer Speech and Language, vol. 14, no. 4, pp. 283-332, 2000.
4. Brian Roark, "Probabilistic top-down parsing and language modeling," Computational Linguistics, vol. 27, no. 2, pp. 249-276, 2001.
5. Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer, 2006.
6. P. J. Bickel and K. A. Doksum, Mathematical Statistics: Basic Ideas and Selected Topics, Holden-Day Inc, Oakland, CA, 1977.
7. Anoop Deoras, Denis Filimonov, Mary Harper, and Fred Jelinek, "Model combination for speech recognition using empirical bayes risk minimization," in Proc. of IEEE-Spoken Language Technologies, 2010, to appear.
8. Denis Filimonov and Mary Harper, "A joint language model with fine-grain syntactic tags," in Proc. of 2009 Conference on Empirical Methods in Natural Language Processing, 2009.
9. Saeedeh Momtazi, Friedrich Faubel, and Dietrich Klakow, "Within and across sentence boundary language model," in Proc. of ICSLP-Interspeech, 2010.
10. J. Glass, T. Hazen, S. Cyphers, I Malioutov, D. Huynh, and R. Barzilay, "Recent progress in MIT spoken lecture processing project," in Proc. of ICSLP-Interspeech, 2007.
11. S. F. Chen, L. Mangu, B. Ramabhadran, R. Sarikaya, and A. Sethy, "Scaling shrinkage-based language models," in Proc. ASRU, 2009, pp. 299-304.
12. H. Soltau, G. Saon, and B. Kingsbury, "The IBM Attila speech recognition toolkit," in Proc. IEEE Workshop on Spoken Language Technology, 2010, to appear.
13. T. Hain et. al., "The 2005 AMI system for the transcription of speech in meetings," in Proc. of Rich Transcription 2005 Spring Meeting Recognition Evaluation Workshop, UK, 2005.