Automatic training of lemmatization rules that handle morphological changes in pre-, in- and suffixes alike

ACL-IJCNLP 2009 - Joint Conf. of the 47th Annual Meeting of the Association for Computational Linguistics and 4th Int. Joint Conf. on Natural Language Processing of the AFNLP, Proceedings of the Conf.

Volumn , Issue , 2009, Pages 145-153

  Jongejan, Bart ^a   Dalianis, Hercules ^b,c  

^a UNIVERSITY OF COPENHAGEN   (Denmark)

^b ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^c SiteSeeker   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS;

AUTOMATIC TRAINING; ICELANDICS; LEMMATIZATION; LEMMATIZER; MORPHOLOGICAL CHANGES; SWEDISHS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84859911010     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1687878.1687900     Document Type: Conference Paper

References (26)

1. Per Bak, Chao Tang and Kurt Wiesenfeld. 1987. Self-Organized Criticality: An Explanation of 1/f Noise, Phys. Rev. Lett., vol. 59,. pp. 381-384, 1987
2. Per Bak, Chao Tang and Kurt Wiesenfeld . 1988. Phys. Rev. A38, (1988), pp. 364-374
3. Andrzej Białecki, 2004, Stempel - Algorithmic Stemmer for Polish Language http://www.getopt.org/stempel/
4. Remco R. Bouckaert and Eibe Frank. 2000. Evaluating the Replicability of Significance Tests for Comparing Learning Algorithms. In H. Dai, R. Srikant, & C. Zhang (Eds.), Proc. 8th Pacific-Asia Conference, PAKDD 2004, Sydney, Australia, May 26-28, 2004 (pp. 3-12). Berlin: Springer.
5. Johan Carlberger, Hercules Dalianis, Martin Hassel, and Ola Knutsson. 2001. Improving Precision in Information Retrieval for Swedish using Stemming. In the Proceedings of NoDaLiDa-01 - 13th Nordic Conference on Computational Linguistics, May 21-22, Uppsala, Sweden.
6. Celex: http://celex.mpi.nl/
7. Hercules Dalianis and Bart Jongejan 2006. Handcrafted versus Machine-learned Inflectional Rules: the Euroling-SiteSeeker Stemmer and CST's Lemmatiser, in Proceedings of the International Conference on Language Resources and Evaluation, LREC 2006.
8. F. Çuna Ekmekçioglu, Mikael F. Lynch, and Peter Willett. 1996. Stemming and N-gram matching for term conflation in Turkish texts. Information Research, 7(1) pp 2-6.
9. Niklas Hedlund 2001. Automatic construction of stemming rules, Master Thesis, NADA-KTH, Stockholm, TRITA-NA-E0194.
10. IFD: Icelandic Centre for Language Technology, http://tungutaekni.is/ researchsystems/rannsoknir-12en.html
11. Bart Jongejan and Dorte Haltrup. 2005. The CST Lemmatiser. Center for Sprogteknologi, University of Copenhagen version 2.7 (August, 23 2005) http://cst.dk/online/lemmatiser/cstlemma.pdf
12. Jakub Kanis and Ludek Müller. 2005. Automatic Lemmatizer Construction with Focus on OOV Words Lemmatization in Text, Speech and Dialogue, Lecture Notes in Computer Science, Berlin /Heidelberg, pp 132-139
13. Ron Kohavi. 1995. A study of cross-validation and bootstrap for accuracy estimation and model selection. Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence 2 (12): 1137-1143, Morgan Kaufmann, San Mateo.
14. Prasenjit Majumder, Mandar Mitra, Swapan K. Parui, Gobinda Kole, Pabitra Mitra, and Kalyankumar Datta. 2007. YASS: Yet another suffix stripper. ACM Transactions on Information Systems , Volume 25 , Issue 4, October 2007.
15. Juršič Matjaž, Igor Mozetič, and Nada Lavrač. 2007. Learning ripple down rules for efficient lemmatization In proceeding of the Conference on Data Mining and Data Warehouses (SiKDD 2007), October 12, 2007, Ljubljana, Slovenia
16. Morfologik: Polish morphological analyzer http://mac.softpedia.com/get/ Word-Processing/Morfologik.shtml
17. Douglas W. Oard, Gina-Anne Levow, and Clara I. Cabezas. 2001. CLEF experiments at Maryland: Statistical stemming and backoff translation. In Cross-language information retrieval and evaluation: Proceeding of the Clef 2000 workshops Carol Peters Ed. Springer Verlag pp. 176-187-2001.
18. Georgios Petasis, Vangelis Karkaletsis , Dimitra Farmakiotou , Ion Androutsopoulos and Constantine D. Spyropoulo. 2003. A Greek Morphological Lexicon and its Exploitation by Natural Language Processing Applications. In Lecture Notes on Computer Science (LNCS), vol.2563, "Advances in Informatics - Post-proceedings of the 8th Panhellenic Conference in Informatics", Springer Verlag.
19. Joël Plisson, Nada Lavrač, and Dunja Mladenic. 2004, A rule based approach to word lemmatization, Proceedings of the 7th International Multiconference Information Society, IS-2004, Institut Jozef Stefan, Ljubljana, pp.83-6.
20. Martin F. Porter 1980. An algorithm for suffix stripping. Program, vol 14, no 3, pp 130-130.
21. John W. Ratcliff and David Metzener, 1988. Pattern Matching: The Gestalt Approach, Dr. Dobb's Journal, page 46, July 1988.
22. SCARRIE 2009. Scandinavian Proofreading Tools http://ling.uib.no/ ~desmedt/scarrie/
23. STO: http://cst.ku.dk/sto-ordbase/
24. SUC 2009. Stockholm Umeå corpus, http://www.ling.su.se/staff/sofia/ suc/suc.html
25. Pieter Theron and Ian Cloete 1997 Automatic acquisition of two-level morphological rules, Proceedings of the fifth conference on Applied natural language processing, p.103-110, March 31-April 03, 1997, Washington, DC.
26. Ellen M. Voorhees. 2000. Variations in relevance judgments and the measurement of retrieval effectiveness, J. of Information Processing and Management 36 (2000) pp 697-716