Unsupervised segmentation of words using prior distributions of morph length and frequency

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn 2003-July, Issue , 2003, Pages

  Creutz, Mathias ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

AGGLUTINATIVE MORPHOLOGY; COMPETING ALGORITHMS; FREQUENCY DISTRIBUTIONS; LANGUAGE INDEPENDENTS; LENGTH DISTRIBUTIONS; PRIOR DISTRIBUTION; PRIOR INFORMATION; PROBABILISTIC MODELS; UNSUPERVISED ALGORITHMS; UNSUPERVISED SEGMENTATION;

PROBABILITY DISTRIBUTIONS;

EID: 85149151707     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. R. H. Baayen. 2001. Word Frequency Distributions. Kluwer Academic Publishers.
2. M. Baroni, J. Matiasek, and H. Trost. 2002. Unsupervised learning of morphologically related words based on orthographic and semantic similarity. In Proc. ACL Workshop Morphol. & Phonol. Learning, pp. 48-57.
3. M. R. Brent. 1999. An efficient, probabilistically sound algorithm for segmentation and word discovery. Machine Learning, 34:71-105.
4. M. Creutz and K. Lagus. 2002. Unsupervised discovery of morphemes. In Proc. ACL Workshop on Morphol. and Phonological Learning, pp. 21-30, Philadelphia.
5. H. Déjean. 1998. Morphemes as necessary concept for structures discovery from untagged corpora. In Workshop on Paradigms and Grounding in Nat. Lang. Learning, pp. 295-299, Adelaide.
6. S. Deligne and F. Bimbot. 1995. Language modeling by variable length sequences: Theoretical formulation and evaluation of multigrams. In Proc. ICASSP.
7. S. Deligne and F. Bimbot. 1997. Inference of variable-length linguistic and acoustic units by multigrams. Speech Communication, 23:223-241.
8. J. Goldsmith. 2001. Unsupervised learning of the morphology of a natural language. Computational Linguistics, 27(2):153-198.
9. F. Karlsson. 1987. Finnish Grammar. WSOY, 2nd ed.
10. C. Kit and Y. Wilks. 1999. Unsupervised learning of word boundary with description length gain. In Proc. CoNLL99 ACL Workshop, Bergen.
11. K. Koskenniemi. 1983. Two-level morphology: A general computational model for word-form recognition and production. Ph.D. thesis, University of Helsinki.
12. W. Li. 1992. Random texts exhibit Zipf's-Law-like word frequency distribution. IEEE Transactions on Information Theory, 38(6):1842-1845.
13. S. Neuvel and S. A. Fulop. 2002. Unsupervised learning of morphology without morphemes. In Proc. ACL Workshop on Morphol. & Phonol. Learn., pp. 31-40.
14. J. Rissanen. 1989. Stochastic Complexity in Statistical Inquiry, vol. 15. World Scientific Series in Computer Science, Singapore.
15. P. Schone and D. Jurafsky. 2000. Knowledge-free induction of morphology using Latent Semantic Analysis. In Proc. CoNLL-2000 & LLL-2000, pp. 67-72.
16. M. G. Snover and M. R. Brent. 2001. A Bayesian model for morpheme and paradigm identification. In Proc. 39th Annual Meeting of the ACL, pp. 482-490.
17. M. G. Snover, G. E. Jarosz, and M. R. Brent. 2002. Unsupervised learning of morphology using a novel directed search algorithm: Taking the first step. In Proc. ACL Worksh. Morphol. & Phonol. Learn., pp. 11-20.
18. H. Yu. 2000. Unsupervised word induction using MDL criterion. In Proc. ISCSL, Beijing.