Dirichlet class language models for speech recognition

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 3, 2011, Pages 482-495

  Chien, Jen Tzung ^a   Chueh, Chuang Hua ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Bayes procedure; clustering method; natural language; smoothing method; speech recognition

Indexed keywords

BAG OF WORDS; BAYES PROCEDURE; BAYESIAN; CLASS INFORMATION; CLASS-BASED; CLASS-BASED LANGUAGE MODEL; CLUSTERING METHOD; DIFFERENT SIZES; DIRICHLET; DIRICHLET PRIOR; DOCUMENT MODELING; LANGUAGE MODEL; LANGUAGE MODELING; LATENT CLASS; LATENT DIRICHLET ALLOCATIONS; MARGINAL LIKELIHOOD; NATURAL LANGUAGE; RECOGNITION ACCURACY; RELATIVE GAINS; SMOOTHING METHODS; SPEECH RECOGNITION SYSTEMS; TRAINING DATA; VARIATIONAL BAYESIAN; WALL STREET JOURNAL; WORD ERROR RATE;

BAYESIAN NETWORKS; COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; PROBABILITY;

SPEECH RECOGNITION;

EID: 78149256857     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2010.2050717     Document Type: Article

References (32)

1. S. Bai, H. Li, Z. Lin, and B. Yuan, "Building class-based language models with contextual statistics", in Proc. IEEE Int Conf. Acoust., Speech, Signal Process., 1998, pp. 173-176.
2. J. Bellegarda, "Exploiting latent semantic information in statistical language modeling", Proc. IEEE, vol. 88, no. 8, pp. 1279-1296, Aug. 2000.
3. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin, "A neural probabilistic language model", J. Mach. Learn. Res., vol. 3, pp. 1137-1155, 2003.
4. M. Bisani and H. Ney, "Bootstrap estimates for confidence intervals in ASR performance evaluation", in Proc. IEEE Int Conf. Acoust., Speech, Signal Process., 2004, vol. 1, pp. 409-412.
5. C. M. Bishop, Pattern Recognition and Machine Learning. New York: Springer Science, 2006.
6. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation", J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
7. P. Brown, V. Della Pietra, P. De Souza, J. Lai, and R. Mercer, "Classbased n-gram models of natural language", Comput. Linguist., vol. 18, no. 4, pp. 467-179, 1992.
8. J.-T. Chien, "Association pattern language modeling", IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1719-1728, Jul. 2006.
9. J.-T. Chien and M.-S. Wu, "Adaptive Bayesian latent semantic analysis", IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 1, pp. 198-207, Jan. 2008.
10. J.-T. Chien and C.-H. Chueh, "Latent Dirichlet language model for speech recognition", in Proc. IEEE Workshop Spoken Lang. Technol., 2008, pp. 201-204.
11. J.-T. Chien and C.-H. Chueh, "Joint acoustic and language modeling for speech recognition", Speech Commun., vol. 52, no. 3, pp. 223-235, 2010.
12. C.-H. Chueh and J.-T. Chien, "Continuous topic language modeling for speech recognition", in Proc. IEEE Workshop Spoken Lang. Technol., 2008, pp. 193-196.
13. C.-H. Chueh and J.-T. Chien, "Nonstationary latent Dirichlet allocation for speech recognition", in Proc. Annu. Conf. Int. Speech Commun. Assoc., 2009, pp. 372-375.
14. C.-H. Chueh and J.-T. Chien, "Topic cache language model for speech recognition", in Proc. IEEE Int Conf. Acoust., Speech, Signal Process., 2010, pp. 5194-5197.
15. P. R. Clarkson and A. J. Robinson, "Language model adaptation using mixtures and an exponentially decaying cache", in Proc. IEEE Int Conf. Acoust., Speech, Signal Process., 1997, pp. 799-802.
16. D. Gildea and T. Hofmann, "Topic-based language models using EM", in Proc. Eur. Conf. Speech Commun. Technol., 1999, pp. 2167-2170.
17. T. Hofmann, "Probabilistic latent semantic indexing", in Proc. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 1999, pp. 50-57.
18. S. Katz, "Estimation of probabilities from sparse data for the language model component of a speech recognizer", IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-35, no. 3, pp. 400-401, Mar. 1987.
19. R. Kneser and H. Ney, "Improved backing-off for m-gram language modeling", in Proc. IEEE Int Conf. Acoust., Speech, Signal Process., 1995, pp. 181-184.
20. R. Kuhn and R. De Mori, "A cache-based natural language model for speech recognition", IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 6, pp. 570-583, Jun. 1990.
21. D. J. C. MacKay and L. C. B. Peto, "A hierarchical Dirichlet language model", Nat. Lang. Eng., vol. 1, no. 3, pp. 1-19, 1995.
22. G. Moore and S. Young, "Class-based language model adaptation using mixtures of word-class weights", in Proc. Int Conf. Spoken Lang. Process., 2000, pp. 512-515.
23. D. B. Paul and J. M. Baker, "The design for the Wall street journalbased CSR corpus", in Proc. Int Conf. Spoken Lang. Process., 1992, pp. 899-902.
24. J. B. Rosen, "The gradient projection method for nonlinear programming. Part I. Linear constraints", J. Soc. Ind. Appl. Math., vol. 8, pp. 181-217, 1960.
25. H. Schwenk, "Continuous space language models", Comput. Speech Lang., vol. 21, pp. 492-518, 2007.
26. Y.-C. Tam and T. Schultz, "Dynamic language model adaptation using variational Bayes inference", in Proc. Annu. Conf. Int. Speech Commun. Assoc., 2005, pp. 5-8.
27. Y.-C. Tam and T. Schultz, "Unsupervised language model adaptation using latent semantic marginals", in Proc. Annu. Conf. Int. Speech Commun. Assoc., 2006, pp. 2206-2209.
28. E. M. Voorhees and D. K. Harman, TREC: Experiment and Evaluation in Information Retrieval. Cambridge, MA: MIT Press, 2005.
29. H. M. Wallach, "Topic modeling: Beyond bag-of-words", in Proc. Int Conf. Mach. Learn., 2006, pp. 977-984.
30. H. Yamamoto, S. Isogai, and Y. Sagisaka, "Multi-class composite N-gram language model", Speech Commun., vol. 41, pp. 369-379, 2003.
31. S. Yaman, J.-T. Chien, and C.-H. Lee, "Structural Bayesian language modeling and adaptation", in Proc. Annu. Conf. Int. Speech Commun. Assoc, 2007, pp. 2365-2368.
32. I. Zitouni, "Backoff hierarchical classn-gram language models: Effectiveness to model unseen events in speech recognition", Comput. Speech Lang., vol. 21, pp. 88-104, 2007.