Statistical language models of Lithuanian based on word clustering and morphological decomposition

Informatica

Volumn 15, Issue 4, 2004, Pages 565-580

  Vaičiunas, Airenas ^a   Kaminskas, Vytautas ^a   Raškinis, Gailius ^a  

^a VYTAUTAS MAGNUS UNIVERSITY   (Lithuania)

Author keywords

Class based models; Inflections; Interpolation; Language models; Morphology; n grams; Out of vocabulary words; Perplexity reduction

Indexed keywords

EID: 18644384970     PISSN: 08684952     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (21)

1. Chen, S., and J.T. Goodman (1999). An empirical study of smoothing techniques for language modeling. Computer Speech and Language, 13, 359-394.
2. Clarkson, P., and R. Rosenfeld (1997). Statistical language modeling using the CMU - Cambridge Toolkit. In Proceedings of 5th European Conference on Speech Communication and Technology, Eurospeech'97.
3. Filipovič, M. (2003). Isolated word recognition using neural networks. In Proceedings of the Conference "Informacines technologies 2003", IX, KTU. pp. 10-20 (in Lithuanian).
4. Huang, X., A. Acero and H.W. Hon (2001). Spoken Language Processing. Prentice-Hall, New Jersey.
5. Ircing, P., P. Krbec, J. Hajic, J. Psutka, S. Khudanpur, F. Jelinek and W. Byme (2001). On large vocabulary continuous speech recognition of highly inflectional language - Czech. In Proceedings of 7th European Conference on Speech Communication and Technology, Eurospeech'2001, B14. pp. 487-491.
6. Jelinek, F. (2001). Statistical Methods for Speech Recognition. Massachusetts Institute of Technology, Cambridge.
7. Jurafsky, D., and J.H. Martin (2000). Speech and Language Processing. Prentice-Hall, New Jersey.
8. Klakow, D. (1998). Log-linear interpolation of language models. In Proceedings of the International Conference on Spoken Language Processing, Sydney, Australia.
9. Kobayashi, N., and T. Kobayashi (1999). Class-combined word N-gram for robust language modeling. In Proceedings of 6th European Conference on Speech Communication and Technology, Eurospeech '99. pp. 1599-1602.
10. Laurinčiukaitė, S. (2003). Isolated Lithuanian word recognition based on hidden Markov models. In Proceedings of the Conference "Informacinės technologies 2003", IX, KTU. pp. 21-24 (in Lithuanian).
11. Lipeika, A., J. Lipeikienė and L. Telksnys (2002). Development of isolated word speech recognition system. Informatica, 13(1), 37-16.
12. Maltese, G., P. Bravetti, H. Crépy, B.J. Grainger, M. Herzog and F. Palou (2001). Combining word- and class-based language models: a comparative study in several languages using automatic and manual word-clustering techniques. In Proceedings of 7th European Conference on Speech Communication and Technology, Eurospeech'2001, A32. pp. 21-24.
13. Marcinkevičienė, R. (2000). Corpus linguistics in theory and practice. Darbai ir Dienos, VDU, 24, 7-64 (in Lithuanian), http://donelaitis. vdu.lt/
14. Martins, C., J.P. Neto and L.B. Almeida (1999). Using partial morphological analysis in language modeling estimation for large vocabulary portuguese speech recognition. In Proceedings of 6th European Conference on Speech Communication and Technology, Eurospeech'99. pp. 1603-1606.
15. Raškinis, G., and D. Raškinienė (2003). Building medium-vocabulary isolated-word Lithuanian HMM speech recognition system. Informatica, 14(1), 75-84.
16. Rosenfeld, R. (2000). Two decades of statistical language modeling: where do we go from here. In Proceedings of the IEEE, 88(8).
17. Sepesy Maucec, M., and Z. Kacic (2001). Topic detection for language model adaptation of highly-inflected languages by using a fuzzy comparison function. In Proceedings of 7th European Conference on Speech Communication and Technology, Eurospeech'2001, A42. pp. 243-247.
18. Siivola, V., M. Kurimo and K. Lagus (2001). Large vocabulary statistical language modeling for continuous speech recognition in Finnish. In Proceedings of 7th European Conference on Speech Communication and Technology, Eurospeech'2001, B25. pp. 737-741.
19. Vaičiunas, A., and G. Raškinis (2003). Statistical modeling of Lithuanian language. In Proceedings of the Conference "Informacinė s technologijos 2003", KTU, IX. pp. 35-40 (in Lithuanian).
20. Whittaker, E.W.D. (2000). Statistical Language Modelling for Automatic Speech Recognition of Russian and English. PhD thesis. Cambridge University, Cambridge.
21. Zinkevičius, V. (2000). Lemuoklis - tool for morphological analysis. Darbai ir Dienos, VDU, 24, 245-274 (in Lithuanian).