Unsupervised language model adaptation using n-gram weighting

Canadian Conference on Electrical and Computer Engineering

Volumn , Issue , 2011, Pages 000857-000860

  Haidar, Md Akmal ^a   O'Shaughnessy, Douglas ^a  

^a INRS EMT   (Canada)

Author keywords

language model adaptation; latent Dirichlet allocation; Mixture models; speech recognition

Indexed keywords

LANGUAGE MODEL ADAPTATION; LATENT DIRICHLET ALLOCATION; LATENT DIRICHLET ALLOCATIONS; MIXTURE MODELS; N-GRAMS; TOPIC MODEL; WORD ERROR RATE;

COMPUTATIONAL LINGUISTICS; INFORMATION RETRIEVAL; MIXTURES; SPEECH RECOGNITION;

MODELS;

EID: 80053965842     PISSN: 08407789     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCECE.2011.6030578     Document Type: Conference Paper

References (17)

1. J. R. Bellegarda, "Statistical Language Model Adaptation: Review and perspective", Speech Communication, vol. 42, pp. 93-108, 2004.
2. R. Kneser and V. Steinbiss, "On the Dynamic Adaptation of Stochastic Language Models", in Proc. of ICASSP, vol. 2, pp. 586-589, 1993.
3. J. R. Bellegarda, "Exploiting Latent Semantic Information in Statistical Language Modeling", in IEEE Trans. On Speech and Audio Proc, vol. 88, No. 8, pp. 1279-1296, 2000.
4. D. Gildea and T. Hofmann, "Topic-Based Language Models Using EM", in Proc. of EUROSPEECH, pp. 2167-2170, 1999.
5. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet Allocation", Journal of Machine Learning Research, vol. 3, pp. 993-1022, 2003.
6. R. Iyer and M. Ostendorf, "Modeling Long Distance Dependence in Language: Topic Mixtures vs Dynamic Cache Models", in Proc. of ICSLP, vol. 1, pp. 236-239, 1996.
7. F. Liu and Y. Liu, "Unsupervised Language Model Adaptation Incorporating Named Entity Information", in Proc. of ACL, pp. 672-679, 2007.
8. M. A. Haidar and D. O'Shaughnessy, "Novel Weighting Scheme for Unsupervised Language Model Adaptation Using Latent Dirichlet Allocation", in Proc. of INTERSPEECH, pp. 2438-2441, 2010.
9. http://jmlr.csail.mit.edu/papers/volume5/lewis04a/a11-smart-stop-list/ english.stop
10. R. Kuhn and R. D. Mori, "A Cache-Based Natural Language Model for Speech Recognition", in IEEE Trans. On Pattern Analysis and Machine Intelligence, vol. 12(6), pp. 570-583, 1990.
11. R. Rosenfeld, "A Maximum Entropy Approach to Adaptive Statistical Language Modeling", Computer, Speech and Language, vol. 10(3), pp. 187-228, 1996.
12. Y.-C. Tam and T. Schultz, "Dynamic Language Model Adaptation Using Variational Bayes Inference", in Proc. of INTERSPEECH, pp. 5-8, 2005.
13. A. Sethy and B. Ramabhadran, "Bag-Of-Word Normalized N-gram Models", in Proc. of INTERSPEECH, pp. 1594-1597, 2008.
14. T. L. Griffiths and M. Steyvers, "Finding Scientific Topics", in Proc. National Academy of Sciences, 101 (suppl. 1), pp. 5228-5235, 2004.
15. A. Stolcke, "SRILM- An Extensible Language Modeling Toolkit", in Proc. of ICSLP, vol. 2, pp. 901-904, 2002.
16. S. Young, P. woodland, G. Evermann and M. Gales, "The HTK toolkit 3.4.1", http://htk.eng.cam.ac.uk/, Cambridge Univ. Eng. Dept. CUED.
17. K. Vertanen, "HTK Wall Street Journal Training Recipe", http://www.inference.phy.cam.ac.uk./kv227/htk/, 2006.