Topic n-gram count language model adaptation for speech recognition

2012 IEEE Workshop on Spoken Language Technology, SLT 2012 - Proceedings

Volumn , Issue , 2012, Pages 165-169

  Haidar, Md Akmal ^a   O'Shaughnessy, Douglas ^a  

^a INRS EMT   (Canada)

Author keywords

language model adaptation; latent Dirichlet allocation; speech recognition; topic mixtures

Indexed keywords

BETTER PERFORMANCE; CONFIDENCE MEASURE; HARD CLUSTERING; LANGUAGE MODEL; LANGUAGE MODEL ADAPTATION; LATENT DIRICHLET ALLOCATION; LATENT DIRICHLET ALLOCATIONS; N-GRAMS; SOFT CLUSTERING; TEST SETS; TOTAL COUNTS; TRADITIONAL APPROACHES; TRAINING SETS;

SPEECH RECOGNITION; STATISTICS;

COMPUTATIONAL LINGUISTICS;

EID: 84874246549     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SLT.2012.6424216     Document Type: Conference Paper

References (21)

1. J. R. Bellegarda, "Statistical Language Model Adaptation: Review and perspective", Speech Communication, vol. 42, pp. 93-108, 2004.
2. R. Kuhn and R. D. Mori, "A Cache-Based Natural Language Model for Speech Recognition", in IEEE Trans. On Pattern Analysis and Machine Intelligence, vol. 12(6), pp. 570-583, 1990.
3. R. Rosenfeld, "A Maximum Entropy Approach to Adaptive Statistical Language Modeling", Computer, Speech and Language, vol. 10(3), pp. 187-228, 1996.
4. J. R. Bellegarda, "Exploiting Latent Semantic Information in Statistical Language Modeling", in IEEE Trans. on Speech and Audio Proc, vol. 88, No. 8, pp. 1279-1296, 2000.
5. D. Gildea and T. Hofmann, "Topic-Based Language Models Using EM", in Proc. of EUROSPEECH, pp. 2167-2170, 1999.
6. D. M. Blei, A. Y.Ng, and M. I. Jordan, "Latent Dirichlet Allocation", Journal of Machine Learning Research, vol. 3, pp. 993-1022, 2003.
7. Y.-C. Tam and T. Schultz, "Dynamic Language Model Adaptation Using Variational Bayes Inference", in Proc. of INTERSPEECH, pp. 5-8, 2005.
8. Y.-C. Tam and T. Schultz, "Unsupervised Language Model Adaptation Using Latent Semantic Marginals", in Proc. of INTERSPEECH, pp. 2206-2209, 2006.
9. F. Liu and Y. Liu, "Unsupervised Language Model Adaptation Incorporating Named Entity Information", in Proc. of ACL, pp. 672-679, 2007.
10. M. A. Haidar and D. O'Shaughnessy, "Novel Weighting Scheme for Unsupervised Language Model Adaptation Using Latent Dirichlet Allocation", in Proc. of INTERSPEECH, pp. 2438-2441, 2010.
11. M. A. Haidar and D. O'Shaughnessy, "Unsupervised Language Model Adaptation Using N-gram weighting", in Proc. of CCECE, pp. 857-860, 2011.
12. T. L. Griffiths and M. Steyvers, "Finding Scientific Topics", in Proc. National Academy of Sciences, 101 (suppl. 1), pp. 5228-5235, 2004.
13. G. Heinrich, "Parameter estimation for text analysis", Technical report, Fraunhofer IGD, 2009.
14. A. Heidel,H. Chang,and L. Lee,"Language model adaptation using latent dirichlet allocation and an efficient topic inference algorithm", in Proc. of INTERSPEECH, pp.2361-2364, 2007.
15. "CSR-II (WSJ1) Complete", Linguistic Data Consortium, Philadelphia, 1994.
16. A. Stolcke, "SRILM-An Extensible Language Modeling Toolkit", in Proc. of ICSLP, vol. 2, pp. 901-904, 2002.
17. S. Young, P.Woodland, G. Evermann and M. Gales, "The HTK toolkit 3.4.1", http://htk.eng.cam.ac.uk/, Cambridge Univ. Eng. Dept. CUED.
18. K. Vertanen, "HTK Wall Street Journal Training Recipe", http://www.inference.phy.cam.ac.uk/kv227/htk/.
19. John S. Garofolo, et al,"TIMIT Acoustic-Phonetic Continuous Speech Corpus" Linguistic Data Consortium, Philadelphia, 1993
20. "The Carnegie Mellon University (CMU) Pronounciation Dictionary",http://www.speech.cs.cmu.edu/cgi-bin/cmudict
21. P.C. Woodland, J.J. Odell, V. Valtchev and S.J. Young, "Large Vocabulary Continuous Speech Recognition Using HTK", in Proc. of ICASSP, pp. II:125-128, 1994.