Using the levenshtein edit distance for automatic lemmatization: A case study for modern greek and english

Proceedings - International Conference on Tools with Artificial Intelligence, ICTAI

Volumn 2, Issue , 2007, Pages 428-435

  Lyras, Dimitrios P ^a   Sgarbas, Kyriakos N ^a   Fakotakis, Nikolaos D ^a  

^a UNIVERSITY OF PATRAS   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER SOFTWARE; CYBERNETICS; FOOD PROCESSING; INFORMATION SERVICES; NATURAL LANGUAGE PROCESSING SYSTEMS; QUERY LANGUAGES; SEARCH ENGINES; TEXT PROCESSING;

AUTOMATIC INDUCTION; CASE STUDIES; EDIT DISTANCES; ELECTRONIC DICTIONARIES; ENGLISH LANGUAGES; INTERNATIONAL CONFERENCES; LEMMATIZATION; LEVENSHTEIN DISTANCES; LEVENSHTEIN EDIT DISTANCE; LINGUISTIC APPLICATIONS; TEXT-MINING;

LINGUISTICS;

EID: 48649095456     PISSN: 10823409     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICTAI.2007.41     Document Type: Conference Paper

References (20)

1. C. & G. Merriam Co., Webster's Revised Unabridged Dictionary. (1913). Retrieved May 23 2007 from http://www.thefreedictionary.com/lemmatise
2. Porter M., An algorithm for suffix stripping, Program, 14(3), 1980, pp. 130-137.
3. Dalianis, H. and Jongejan B., "Hand-crafted versus machine-learned inflexional rules: The SiteSeeker stemmer and CST's lemmatiser", LREC 2006, Genoa, Italy, 2006.
4. "Tartarus", http://snowball.tartarus.org
5. Al-Sughaiyer I. and Al-Kharashi I.: "Arabic Morphological Analysis Techniques: A Comprehensive Survey", Journal of the American Society for Information Science and Technology, Vol 55, Issue 3, 2004, pp. 189-213.
6. Carlberger J., Dalianis H., Hassel M. and Knutsson O., "Improving Precision in Information Retrieval for Swedish using Stemming", In Proc. Of NODALIDA '01, Uppsala, Sweden, 2001.
7. R.J. Mooney and M.E. Califf, "Induction of first-order decision lists: Results on learning the past tense of English verbs", In Proc. of the 5th International Workshop on Inductive Logic Programming, 1995, pp. 145-146.
8. Stroppa, Nicolas and François Yvon, "An analogical learner for morphological analysis", In Proc. of the 9th Conf. on Computational Natural Language Learning (CoNLL-2005), 2005, pp. 120-127.
9. Saso Dzeroski and Tomaz Erjavec, "Learning to lemmatise Slovene words", Learning language in logic, Springer, pp. 69-88, 2001.
10. Erjavec Tomaz and Saso Dzeroski, "Machine learning of morphosyntactic structure: Lemmatizing unknown Slovene words". Applied Artificial Intelligence, 18, 2004, pp. 17-41.
11. Xu J. and Croft W. B., "Corpus-based stemming using cooccurrence of word variants". ACM Transactions on Information Systems, 16 (1), 1998, pp. 61-81.
12. V. I. Levenshtein. "Binary codes capable of correcting deletions, insertions, and reversals". Soviet Physics Dokl., 10, February 1966, pp. 707-710.
13. D. Gusfield. Algorithms on Strings, Trees, and Sequences. Cambridge University Press, 1997.
14. P. Pevzner. Computational Molecular Biology. Elsevier Science Ltd., 2003.
15. Greek source
16. Sgarbas K., "Techniques for Automatic Morphosyntactic Analysis of Modern Greek Language", PhD Dissertation No.55, University of Patras, Dept. of Electrical and Computer Engineering, June 1997 (in Greek).
17. Ralli Angela, "Morphology in Greek linguistics", Journal of Greek Linguistics, John Benjamins Publishing Company, 4 (2003), pp. 77-129.
18. Richard Wicentowski, "Modeling and Learning Multilingual Inflectional Morphology in a Minimally Supervised Framework", Johns Hopkins University Ph.D. thesis, October 2002.
19. David Yarowsky and Richard Wicentowski, "Minimally Supervised Morphological Analysis by Multimodal Alignment", In Proc.of the ACL-2000, Hong Kong, 2000, pp. 207-216.
20. Brew, C. and D. McKelvie, "Word-pair extraction for lexicography", In Proc.of the 2nd International Conference on New Methods in Language Processing, eds. K. Oflazer and H. Somers, Ankara: Bilkent University, 1996, pp. 45-55.