Cache-based statistical language models of english and highly inflected Lithuanian

Informatica

Volumn 17, Issue 1, 2006, Pages 111-124

  Vaičiunas, Airenas ^a   Raškinis, Gailius ^a,b  

^a VYTAUTAS MAGNUS UNIVERSITY   (Lithuania)

^b Center of Computational Linguistics   (Lithuania)

Author keywords

Cache models; Dynamic interpolation; Free word order language; Inflected language; Language models; Lithuanian; n grams; Perplexity reduction

Indexed keywords

EID: 33645659797     PISSN: 08684952     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (25)

1. Clarkson, P. (1999). Adaptation of Statistical Language Models for Automatic Speech Recognition. PhD thesis, Cambridge University Engineering Department, Cambridge.
2. Clarkson, P., and R. Rosenfeld (1997). Statistical language modeling using the CMU-Cambridge Toolkit. In Proceedings of 5th European Conference on Speech Communication and Technology, pp. 2707-2710.
3. Clarkson, P., and A. Robinson (1997). Language model adaptation using mixtures and an exponentially decaying cache. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing. pp. 799-802.
4. Federico, M., and N. Bertoldi (2001). Broadcast news LM adaptation using contemporary texts. In Proceedings of 7th European Conference on Speech Communication and Technology, vol. A42. pp. 239-242.
5. Gildea, D., and T. Hofmann (1999). Topic-based language models using EM. In Proceedings of 6th European Conference on Speech Communication and Technology. pp. 2167-2170.
6. Goodman, J.T. (2001). A bit of progress in language modeling. Computer Speech and Language, 15(4), 403-434.
7. Gotoh, Y., and S. Renals (1997). Document space models using latent semantic analysis. In Proceedings of 5th European Conference on Speech Communication and Technology, pp. 1443-1446.
8. Iyer, R., and M. Ostendorf (1999). Modeling long distance dependence in language: topic mixture vs. dynamic cache models. In Proceedings of the IEEE Transactions on Speech and Audio Processing IEEE-SAP, vol. 7. pp. 30-39.
9. Jelinek, F. (2001). Statistical Methods for Speech Recognition. Massachusetts Institute of Technology, Cambridge.
10. Jelinek, F., B. Merialdo, S. Roukos and M. Strauss (1991). A dynamic LM for speech recognition. In Proceedings of the ARPA Workshop on Speech and Natural Language, pp. 293-295.
11. Kneser, R., and H. Ney (1995). Improved backing-off for m-gram language modeling. In Proceedings of International Conference on Acoustics, Speech and Signal Processing, pp. 181-184.
12. Kneser, R., and V. Steinbiss (1993). On the dynamic adaptation of stochastic language models. In Proceedings of International Conference on Acoustics, Speech and Signal Processing, pp. 586-589.
13. Kuhn, R. (1988). Speech recognition and the frequency of recently used words: a modified Markov model for natural language. In Proceedings of 12th International Conference on Computational Linguistics, pp. 348-350.
14. Kuhn, R., and R. De Mori (1990). A cache-based natural language model for speech recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(6), 570-583.
15. Marcinkevičienė, R. (2000). Corpus linguistics in theory and practice. Darbai ir Dienos, 24, 7-64 (in Lithuanian). http://donelaitis.vdu.lt/
16. Martin, S.C., J. Liermann and H. Ney (1997). Adaptive topic-dependent language modelling using word-based varigrams. In Proceedings of 5th European Conference on Speech Communication and Technology. pp. 1447-1450.
17. Rosenfeld, R. (1996). A maximum entropy approach to adaptive statistical language modeling. Computer Speech and Language, 10, 187-228.
18. Sepesy Maucec, M., and Z. Kacic (2001). Topic detection for language model adaptation of highly-inflected languages by using a fuzzy comparison function. In Proceedings of 7th European Conference on Speech Communication and Technology, vol. A42. pp. 243-247.
19. Seymore, K., S. Chen and R. Rosenfeld (1998). Nonlinear interpolation of topic models for language model adaptation. In Proceedings of ICSLP-98.
20. Siivola, V., M. Kurimo and K. Lagus (2001). Large vocabulary statistical language modeling for continuous speech recognition in Finnish. In Proceedings of 7th European Conference on Speech Communication and Technology, vol. B25. pp. 737-741.
21. The Lithuanian Language Corpus at Vytautas Magnus University. http://donelaitis.vdu.lt/
22. Tillmann, Ch., and H. Ney (1996). Statistical language modeling and word triggers. In Proceedings of the SPECOM 96. pp. 22-27.
23. Vaičiūnas, A., G. Raškinis and V. Kaminskas (2004). Statistical Language Models of Lithuanian based on word clustering and morphological decomposition. Informatica, 15(4), 565-580.
24. Vaičiūnas, A., and G. Raškinis (2003). Statistical modeling of Lithuanian language. In Proceedings of the Conference "Information Technologies 2003", KTU, Kaunas, pp. IX 35-40 (in Lithuanian).
25. Zinkevičius, V. (2000). Lemuoklis - tool for morphological analysis. Darbai ir dienos, 245-274 (in Lithuanian).