Morph-based speech recognition and modeling of out-of-vocabulary words across languages

ACM Transactions on Speech and Language Processing

Volumn 5, Issue 1, 2007, Pages

  Creutz, Mathias ^a   Hirsimäki, Teemu ^a   Kurimo, Mikko ^a   Puurula, Antti ^a   Pylkkönen, Janne ^a   Siivola, Vesa ^a   Varjokallio, Matti ^a   Arisoy, Ebru ^b   Saraçlar, Murat ^b   Stolcke, Andreas ^c  

^a AALTO UNIVERSITY   (Finland)

^b BOGAZICI UNIVERSITY   (Turkey)

^c INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

Author keywords

Egyptian Colloquial Arabic; Estonian; Finnish; Highly inflecting and compounding languages; LVCSR; Morfessor; Morpheme; Morphologically rich languages; N gram models; Subword based language modeling; Turkish

Indexed keywords

EGYPTIAN COLLOQUIAL ARABIC LANGUAGES; ESTONIAN LANGUAGES; HIGHLY INFLECTING AND COMPOUNDING LANGUAGES; MORPHEME; MORPHOLOGICALLY RICH LANGUAGES; N-GRAM MODELS; SUBWORD BASED LANGUAGE MODELING;

ALGORITHMS; COMPUTER SIMULATION LANGUAGES; DATABASE SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; WORD PROCESSING;

SPEECH RECOGNITION;

EID: 37849048345     PISSN: 15504875     EISSN: 15504883     Source Type: Journal    
DOI: 10.1145/1322391.1322394     Document Type: Article

References (52)

1. ARISOY, E., DUTAǦACI, H., AND ARSLAN, L. M. 2006. A unified language model for large vocabulary continuous speech recognition of Turkish. Signal Proces. 10, 2844-2862.
2. ARISOY, E. AND SARAÇLAR, M. 2006. Lattice extension and rescoring based approaches for LVCSR of turkish. In Proceedings of Interspeech (ICSLP'06). 1025-1028.
3. BAZZI, I. AND GLASS, J. 2001. Learning units for domain-independent out-of-vocabulary word modelling. In Proceedings of the 7th European Conference on Speech Communication and Technology (Eurospeech). Aalborg, Denmark.
4. BAZZI, I. AND GLASS, J. R. 2000. Modeling out-of-vocabulary words for robust speech recognition. In Proceedings of the 6th International Conference on Spoken Language Processing (ICSLP). Beijing, China.
5. BAZZI, I. AND GLASS, J. R. 2002. A multi-class approach for modelling out-of-vocabulary words. In Proceedings of the 7th International Conference on Spoken Language Processing (ICSLP). Denver, CO.
6. BERTON, A., FETTER, P., AND REGEL-BRIETZMANN, P. 1996. Compound words in large-vocabulary German speech recognition systems. In Proceedings of ICSLP '96. Philadelphia, PA. Vol. 2, 1165-1168.
7. BILMES, J. A. AND KIRCHHOFF, K. 2003. Factored language models and generalized parallel back-off. In Proceedings of the Human Language Technology Conference (HLT/NAACL). Edmonton, Canada. 4-6.
8. BISANI, M. AND NEY, H. 2005. Open vocabulary speech recognition with flat hybrid models. In Proceedings of Interspeech'05. Lisbon, Portugal.
9. BRENT, M. R. 1999. An efficient, probabilistically sound algorithm for segmentation and word discovery. Machine Learn. 34, 71-105.
10. BYRNE, W., HAJIČ, J., IRCING, P., JELINEK, F., KHUDANPUR, S., KRBEC, P., AND PSUTKA, J. 2001. On large vocabulary continuous speech recognition of highly inflectional language - Czech. In Proceedings of the 7th European Conference on Speech Communication and Technology (Eurospeech). 487-489.
11. CHEN, S. F. AND GOODMAN, J. 1999. An empirical study of smoothing techniques for language modeling. Comput. Speech Lang. 13, 359-394.
12. CREUTZ, M. 2003. Unsupervised segmentation of words using prior distributions of morph length and frequency. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL). 280-287.
13. CREUTZ, M. 2006. Induction of the morphology of natural language: Unsupervised morpheme segmentation with application to automatic speech recognition. Ph.D. thesis, Dissertations in Computer and Information Science, Report D13, Helsinki University of Technology. http://lib.tkk.fi/Diss/ 2006/isbn9512282119/.
14. CREUTZ, M. AND LAGUS, K. 2002. Unsupervised discovery of morphemes. In Proceedings of the Workshop on Morphological and Phonological Learning of ACL'02. Philadelphia, PA. 21-30.
15. CREUTZ, M. AND LAGUS, K. 2004. Induction of a simple morphology for highly-inflecting languages. In Proceedings of the 7th Meeting of the ACL Special Interest Group in Computational Phonology (SIGPHON). Barcelona, Spain. 43-51.
16. CREUTZ, M. AND LAGUS, K. 2005a. Inducing the morphological lexicon of a natural language from unannotated text. In Proceedings of the International and Interdisciplinary Conference on Adaptive Knowledge Representation and Reasoning (AKRR'05). Espoo, Finland. 106-113.
17. CREUTZ, M. AND LAGUS, K. 2005b. Unsupervised morpheme segmentation and morphology induction from text corpora using Morfessor 1.0. Tech. rep. A81, Publications in Computer and Information Science, Helsinki University of Technology.
18. CREUTZ, M. AND LAGUS, K. 2007. Unsupervised models for morpheme segmentation and morphology learning. ACM Trans. Speech Lang. Proces. 4, 1.
19. DE MARCKEN, C. G. 1996. Unsupervised language acquisition. Ph.D. thesis, MIT, Cambridge, MA.
20. GALESCU, L. 2003. Recognition of out-of-vocabulary words with sub-lexical language models. In Proceedings of the 8th European Conference on Speech Communication and Technology (Eurospeech). Geneva, Switzerland. 249-252.
21. GALLWITZ, F., NÖTH, E., AND NIEMANN, H. 1996. A category based approach for recognition of out-of-vocabulary words. In Proceedings of the 4th International Conference on Spoken Language Processing (ICSLP). Philadelphia, PA.
22. GEUTNER, P., FINKE, M., AND SCHEYTT, P. 1998. Adaptive vocabularies for transcribing multilingual broadcast news. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Vol. 2. 925-928.
23. GOLDSMITH, J. 2001. Unsupervised learning of the morphology of a natural language. Comput. Linguis. 27, 2, 153-198.
24. GOLDWATER, S., GRIFFITHS, T. L., AND JOHNSON, M. 2006. Contextual dependencies in unsupervised word segmentation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (Coling/ACL). Sydney, Australia. 673-680.
25. HACIOGLU, K., PELLOM, B., CILOGLU, T., OZTURK, O., KURIMO, M., AND CREUTZ, M. 2003. On lexicon creation for Turkish LVCSR. In Proceedings of the 8th European Conference on Speech Communication and Technology (Eurospeech). 1165-1168.
26. HARRIS, Z. S. 1955. From phoneme to morpheme. Language 31, 2, 190-222.
27. (Reprinted 1970 in Papers in Structural and Transformational Linguistics, Reidel Publishing Company, Dordrecht, Holland.)
28. HARRIS, Z. S. 1967. Morpheme boundaries within words: Report on a computer test. Transform. Discourse Anal. Papers 73.
29. (Reprinted 1970 in Papers in Structural and Transformational Linguistics, Reidel Publishing Company, Dordrecht, Holland.)
30. HIRSIMAKI, T., CREUTZ, M., SIIVOLA, V., KURIMO, M., VIRPIOJA, S., AND PYLKKÖ NEN, J. 2006. Unlimited vocabulary speech recognition with morph language models applied to Finnish. Comput. Speech Lang. 20, 4, 515-541.
31. KIRCHHOFF, K., VERGYRI, D., BILMES, J., DUH, K., AND STOLCKE, A. 2006. Morphology-based language modeling for Arabic speech recognition. Comput. Speech Lang. 20, 4, 589-608.
32. KLAKOW, D., ROSE, G., AND AUBERT, X. 1999. OOV-detection in large vocabulary system using automatically defined word-fragments as fillers. In Proceedings of the 6th European Conference on Speech Communication and Technology (Eurospeech). Budapest, Hungary. 49-52.
33. KNEISSLER, J. AND KLAKOW, D. 2001. Speech recognition for huge vocabularies by using optimized sub-word units. In Proceedings of the 7th European Conference on Speech Communication and Technology (Eurospeech). 69-72.
34. KNESER, R. AND NEY, H. 1995. Improved backing-off for m-gram language modeling. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP'95). 181-184.
35. KURIMO, M., CREUTZ, M., VARJOKALLIO, M., ARISOY, E., AND SARA CLAR, M. 2006a. Unsupervised segmentation of words into morphemes-Challenge 2005, an introduction and evaluation report. In Proceedings of the PASCAL Challenge Workshop on Unsupervised Segmentation of Words into Morphemes. Venice, Italy.
36. KURIMO, M., CREUTZ, M., VARJOKALLIO, M., ARISOY, E., AND SARAÇLAR, M. 2006b. Unsupervised segmentation of words into morphemes-Morpho Challenge 2005, Application to automatic speech recognition. In Proceedings of Interspeech 2006. Pittsburgh, PA.
37. KURIMO, M., PUURULA, A., ARISOY, E., SIIVOLA, V., HIRSIMÄKI, T., PYLKKÖNEN, J., ALUMÄE, T., AND SARAÇLAR, M. 2006. Unlimited vocabulary speech recognition for agglutinative languages. In Proceedings of Human Language Technology, Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL'06). New York, NY
38. KWON, O.-W. AND PARK, J. 2003. Korean large vocabulary continuous speech recognition with morpheme-based recognition units. Speech Commun. 39, 3-4, 287-300.
39. LARSON, M., WILLETT, D., KOEHLER, J., AND RIGOLL, G. 2000. Compound splitting and lexical unit recombination for improved performance of a speech recognition system for German parliamentary speeches. In Proceedings of ICSLP.
40. MOHRI, M. AND RILEY, M. D. 2002. DCD library, Speech recognition decoder library. AT&T Labs Re search. http://www.research.att.com/sw/tools/dcd/.
41. MOU, X. AND ZUE, V. 2001. Sub-lexical modelling using a finite-state transducer framework. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Salt Lake City, UT.
42. ORDELMAN, R., VAN HESSEN, A., AND DE JONG, F. 2003. Compound decomposition in Dutch large vocabulary speech recognition. In Proceedings of the 8th European Conference on Speech Communication and Technology (Eurospeech). 225-228.
43. PYLKKONEN, J. 2005. An efficient one-pass decoder for Finnish large vocabulary continuous speech recognition. In Proceedings of the 2nd Baltic Conference on Human Language Technologies (HLT'05). 167-172.
44. RISSANEN, J. 1989. Stochastic Complexity in Statistical Inquiry. Vol. 15. World Scientific Series in Computer Science, Singapore.
45. SCHONE, P. AND JURAFSKY, D. 2000. Knowledge-free induction of morphology using Latent Semantic Analysis. In Proceedings of CoNLLOO and LLL00. 67-72.
46. SCHONE, P. AND JURAFSKY, D. 2001. Knowledge-free induction of inflectional morphologies. In Proceedings of NAACL-01.
47. SHAFRAN, I. AND HALL, K. 2006. Corrective models for speech recognition of inflected languages. In Proceedings of EMNLP. Sydney, Australia.
48. SIIVOLA, V. AND PELLOM, B. 2005. Growing an n-gram model. In Proceedings of Interspeech'05. Lisbon, Portugal, 1309-1312.
49. STOLCKE, A. 1998. Entropy-based pruning of backoff language models. In Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop. Lansdowne, VA. 270-274.
50. STOLCKE, A. 2002. SRILM-an extensible language modeling toolkit. In Proceedings of the 7th International Conference on Spoken Language Processing (ICSLP). 901-904. http://www.speech.sri.com/projects/srilm/.
51. WHITTAKER, E. AND WOODLAND, P. 2000. Particle-based language modelling. In Proceedings of the 6th International Conference on Spoken Language Processing (ICSLP). 170-173.
52. YOUNG, S., OLLASON, D., VALTCHEV, V., AND WOODLAND, P. 2002. The HTK Book (for version 3.2 of HTK). University of Cambridge, Cambridge, UK.