Novel weighting scheme for unsupervised language model adaptation using Latent Dirichlet Allocation

Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010

Volumn , Issue , 2010, Pages 2438-2441

  Haidar, Md Akmal ^a   O'Shaughnessy, Douglas ^a  

^a INRS EMT   (Canada)

Author keywords

Language model adaptation; Latent Dirichlet Allocation; Mixture models; Speech recognition

Indexed keywords

COMPUTATIONAL LINGUISTICS; MIXTURES; SPEECH COMMUNICATION; STATISTICS; CLUSTER ANALYSIS;

DOCUMENT-BASED; HARD CLUSTERING; LANGUAGE MODEL ADAPTATION; LATENT DIRICHLET ALLOCATION; LATENT DIRICHLET ALLOCATIONS; MIXTURE MODEL; WEIGHTING SCHEME; WORD ERROR RATE; CLUSTERING METHODS; MIXTURE MODELING; NEW APPROACHES; TOPIC MODELING; TOPIC WORDS;

SPEECH RECOGNITION;

EID: 79959836072     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. J. R. Bellegarda, "Statistical Language Model Adaptation: Review and perspective", Speech Communication, vol. 42, pp. 93-108, 2004.
2. R. Kneser and V. Steinbiss, "On the Dynamic Adaptation of Stochastic Language Models", in Proc. of ICASSP, vol. 2, pp. 586-589, 1993.
3. H. Suzuki and J. Gao, "A Comparative Study on Language Model Adaptation Techniques Using New Evaluation Metrics", in Proc. of HLT/EMNLP, pp. 265-272, 2005.
4. J. R. Bellegarda, "Exploiting Latent Semantic Information in Statistical Language Modeling", in IEEE Trans. On Speech and Audio Proc, vol. 88, No. 8, pp. 1279-1296, 2000.
5. D. Gildea and T. Hofmann, "Topic-Based Language Models Using EM", in Proc. of EUROSPEECH, pp. 2167-2170, 1999.
6. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet Allocation", Journal of Machine Learning Research, vol. 3, pp. 993-1022, 2003.
7. R. Iyer and M. Ostendorf, "Modeling Long Distance Dependence in Language: Topic Mixtures vs Dynamic Cache Models", in Proc. of ICSLP, vol. 1, pp. 236-239, 1996.
8. F. Liu and Y. Liu, "Unsupervised Language Model Adaptation Incorporating Named Entity Information", in Proc. of ACL, pp. 672-679, 2007.
9. R. Kuhn and R. D. Mori, "A Cache-Based Natural Language Model for Speech Recognition", in IEEE Trans. On Pattern Analysis and Machine Intelligence, vol. 12(6), pp. 570-583, 1990. (Pubitemid 20724489)
10. R. Rosenfeld, "A Maximum Entropy Approach to Adaptive Statistical Language Modeling", Computer, Speech and Language, vol. 10(3), pp. 187-228, 1996.
11. Y.-C. Tam and T. Schultz, "Dynamic Language Model Adaptation Using Variational Bayes Inference", in Proc. of INTERSPEECH, pp. 5-8, 2005. (Pubitemid 43907987)
12. Y.-C. Tam and T. Schultz, "Unsupervised Language Model Adaptation Using Latent Semantic Marginals", in Proc. of INTERSPEECH, pp. 2206-2209, 2006.
13. D. Mrva and P. C. Woodland, "Unsupervised Language Model Adaptation for Mandarin Broadcast Conversation Transcription", in Proc. of INTERSPEECH, 2006.
14. B.-J. Hsu and J. Glass, "Style & Topic Language Model Adaptation Using HMM-LDA", in Proc. of EMNLP, pp. 373-381, 2006.
15. B. Ramabhadran, O. Siohan, and A. Sethy, "The IBM 2007 speech transcription system for European Parliamentary Speeches", in Proc. of ASRU, pp. 472-477, 2007.
16. A. Heidel and L.-S. Lee, "Robust Topic Inference for Latent Semantic Language Model Adaptation", in Proc. of ASRU, pp. 177-182, 2007.
17. A. Sethy and B. Ramabhadran, "Bag-Of-Word Normalized N-gram Models", in Proc. of INTERSPEECH, pp. 1594-1597, 2008.
18. C.-H. Chueh and J.-T. Chien, "Nonstationary Latent Dirichlet Allocation for Speech Recognition", in Proc. of INTERSPEECH, pp. 372-375, 2009.
19. T. L. Griffiths, M. Steyvers, D. M. Blei, and J. B. Tenenbaum, "Integrating Topics and Syntax", Advances in Neural Information Processing Systems, vol. 17, pp. 537-544, 2004.
20. A. Stolcke, "SRILM- An Extensible Language Modeling Toolkit", in Proc. of ICSLP, vol. 2, pp. 901-904, 2002.
21. S. Young, P. woodland, G. Evermann and M. Gales, "The HTK toolkit 3.4.1", http://htk.eng.cam.ac.uk/, Cambridge Univ. Eng. Dept. CUED.
22. K. Vertanen, "HTK Wall Street Journal Training Recipe", http://www.inference.phy.cam.ac.uk./kv227/htk/, 2006.