LDA-based LM adaptation using latent semantic marginals and minimum discriminant information

European Signal Processing Conference

Volumn , Issue , 2012, Pages 2040-2044

  Haidar, Md Akmal ^a   O'Shaughnessy, Douglas ^a  

^a INRS EMT   (Canada)

Author keywords

Latent Dirichlet allocation; latent semantic marginals; speech recognition; unsupervised LM adaptation

Indexed keywords

LANGUAGE MODEL; LATENT DIRICHLET ALLOCATION; LATENT DIRICHLET ALLOCATIONS; LATENT SEMANTICS; MARGINALS; TEST DATA; TOPIC MODEL; UNSUPERVISED LM ADAPTATION; WORD ERROR RATE;

COMPUTATIONAL LINGUISTICS; PROBABILITY DISTRIBUTIONS; SEMANTICS; SIGNAL PROCESSING; SPEECH RECOGNITION; STATISTICS;

MODELS;

EID: 84869765819     PISSN: 22195491     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. J. R. Bellegarda, "Statistical Language Model Adaptation: Review and perspective", Speech Communication, vol. 42, pp. 93-108, 2004.
2. J. R. Bellegarda, "Exploiting Latent Semantic Information in Statistical Language Modeling", in IEEE Trans. On Speech and Audio Proc, vol. 88, No. 8, pp. 1279-1296, 2000.
3. D. Gildea and T. Hofmann, "Topic-Based Language Models Using EM", in Proc. Of EUROSPEECH, pp. 2167-2170, 1999.
4. D. M. Blei, A. Y.Ng, and M. I. Jordan, "Latent Dirichlet Allocation", Journal of Machine Learning Research, vol. 3, pp. 993-1022, 2003.
5. Y.-C. Tam and T. Schultz, "Unsupervised Language Model Adaptation Using Latent Semantic Marginals", in Proc. Of INTERSPEECH, pp. 2206-2209, 2006.
6. M. A. Haidar and D. O'Shaughnessy, "Unsupervised Language Model Adaptation Using N-gram weighting", in Proc. Of CCECE, pp. 857-860, 2011.
7. R. Kneser, J. Peters, and D. Klakow, "Language Model Adaptation Using Dynamic Marginals", in Proc. Of EUROSPEECH, pp. 1971-1974, 1997.
8. R. Kuhn and R. D. Mori, "A Cache-Based Natural Language Model for Speech Recognition", in IEEE Trans. On Pattern Analysis and Machine Intelligence, vol. 12(6), pp. 570-583, 1990.
9. R. Rosenfeld, "A Maximum Entropy Approach to Adaptive Statistical Language Modeling", Computer, Speech and Language, vol. 10(3), pp. 187-228, 1996.
10. R. Iyer and M. Ostendorf, "Modeling Long Distance Dependence in Language: Topic Mixtures vs Dynamic Cache Models", in Proc. Of ICSLP, vol. 1, pp. 236-239, 1996.
11. Y.-C. Tam and T. Schultz, "Dynamic Language Model Adaptation Using Variational Bayes Inference", in Proc. Of INTERSPEECH, pp. 5-8, 2005.
12. F. Liu and Y. Liu, "Unsupervised Language Model Adaptation Incorporating Named Entity Information", in Proc. Of ACL, pp. 672-679, 2007.
13. M. A. Haidar and D. O'Shaughnessy, "Novel Weighting Scheme for Unsupervised Language Model Adaptation Using Latent Dirichlet Allocation", in Proc. Of INTERSPEECH, pp. 2438-2441, 2010.
14. M. A. Haidar and D. O'Shaughnessy, "Unsupervised Language Model Adaptation Using Latent Dirichlet Allocation and Dynamic Marginals", in Proc .of EUSIPCO, pp. 1480-1484, 2011.
15. T. L. Griffiths and M. Steyvers, "Finding Scientific Topics", in Proc. National Academy of Sciences, 101 (suppl. 1), pp. 5228-5235, 2004.
16. "CSR-II (WSJ1) Complete", Linguistic Data Consortium, Philadelphia, 1994.
17. A. Stolcke, "SRILM-An Extensible Language Modeling Toolkit", in Proc. Of ICSLP, vol. 2, pp. 901-904, 2002.
18. S. Young, P.Woodland, G. Evermann and M. Gales, "The HTK toolkit 3.4.1", http://htk.eng.cam.ac.uk/, Cambridge Univ. Eng. Dept. CUED.
19. K. Vertanen, "HTK Wall Street Journal Training Recipe", http://www.inference.phy.cam.ac.uk/kv227/htk/.
20. John S. Garofolo, et al,"TIMIT Acoustic-Phonetic Continuous Speech Corpus" Linguistic Data Consortium, Philadelphia, 1993
21. "The Carnegie Mellon University (CMU) Pronounciation Dictionary",http://www.speech.cs.cmu.edu/cgi-bin/cmudict