LeTs Preprocess: The multilingual LT3 linguistic preprocessing toolkit

Computational Linguistics in the Netherlands Journal

Volumn 3, Issue , 2013, Pages 103-120

  Van De Kauter, Marjan ^a   Coorman, Geert ^a   Lefever, Els ^a   Desmet, Bart ^a   Macken, Lieve ^a   Hoste, Véronique ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

CROSS VALIDATION; DIFFERENT DOMAINS; GOLD STANDARDS; LINGUISTIC PREPROCESSINGS; NAMED ENTITIES; PART-OF-SPEECH TAGGER; PRE-PROCESSING STEP; PREPROCESSING MODULES;

COMPUTATIONAL LINGUISTICS;

EID: 84907924798     PISSN: 22114009     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. Abeille, A., L. Clement, and F. Toussenel (2003), Building a treebank for French, Treebanks: Building and Using Parsed Corpora, Kluwer, Dordrecht, pp. 165-188.
2. Baayen, R. H., R. Piepenbrock, and L. Gulikers (1995), The CELEX lexical database (CD-ROM).
3. Brants, S., S. Dipper, S. Hansen, W. Lezius, and G. Smith (2002), The TIGER treebank, Proceedings of the Workshop on Treebanks and Linguistic Theories, Sozopol, Bulgaria, pp. 24-41.
4. Chrupala, G. (2006), Simple data-driven context-sensitive lemmatization, Proceedings of the Sociedad Espanola para el Procesamiento del Lenguaje Natural, volume 37, Zaragoza, Spain, pp. 121-130.
5. Crysmann, B., S. Hansen-Schirra, G. Smith, and D. Ziegler-Eisele (2005), TIGER Morphologie-Annotationsschema, Technical report, Universitat des Saarlandes - Computerlinguistik, Universität Stuttgart - Institut für Maschinelle Sprachverarbeitung, Universität Potsdam - Institut für Germanistik.
6. Daelemans, W., J. Zavrel, P. Berck, and S. Gillis (1996), MBT: A memory-based part of speech tagger-generator, Proceedings of the Fourth Workshop on Very Large Corpora, Copenhagen, Denmark, pp. 14-27.
7. Desmet, B. and V. Hoste (2010a), Dutch named entity recognition using classifier ensembles, Computational Linguistics in the Netherlands 2010: selected papers from the twentieth CLIN meeting, Netherlands Graduate School of Linguistics, pp. 29-41.
8. Desmet, B. and V. Hoste (2010b), Towards a balanced named entity corpus for Dutch, Proceedings of the seventh International Conference on Language Resources and Evaluation (LREC'10), Valletta, Malta, pp. 535-541.
9. Giménez, J. and L. Màrquez (2004), SVMTool: A general POS tagger generator based on Support Vector Machines, Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC'04), Lisbon, Portugal, pp. 43-46.
10. Hemphill, C. T., J. J. Godfrey, and G. R. Doddington (1990), The ATIS Spoken Language Systems pilot corpus, Proceedings of the DARPA Speech and Natural Language Workshop, pp. 96-101.
11. Isozaki, H. and H. Kazawa (2002), Efficient Support Vector Classifiers for named entity recognition, Proceedings of the 19th International Conference on Computational Linguistics (COLING'02), Taipei, Taiwan, pp. 1-7.
12. Koehn, P. (2005), Europarl: A parallel corpus for statistical machine translation, Proceedings of the tenth Machine Translation Summit, Phuket, Thailand, pp. 79-86.
13. Kupiec, J. (1992), Robust part-of-speech tagging using a hidden Markov model, Computer Speech and Language 6(3), pp. 225-242.
14. Lafferty, J., A. McCallum, and F. Pereira (2001), Conditional random fields: Probabilistic models for segmenting and labeling sequence data, Proceedings of the eighteenth International Conference on Machine Learning (ICML'01), Williamstown, Massachusetts, USA, pp. 282-289.
15. Macken, L. and W. Daelemans (2010), A chunk-driven bootstrapping approach to extracting translation patterns, Proceedings of the 11th International Conference on Intelligent Text Processing and Computational Linguistics (Iaşi, Romania), Vol. 6008 of Lecture Notes in Computer Science, Springer-Verlag, Berlin Heidelberg, pp. 394-405.
16. Macken, L., E. Lefever, and V. Hoste (2013), TExSIS: bilingual terminology extraction from parallel corpora using chunk-based alignment, Terminology 19(1), pp. 1-30, John Benjamins Publishing Company.
17. Marcus, M. P., B. Santorini, and M. A. Marcinkiewicz (1993), Building a large annotated corpus of English: The Penn Treebank, Computational Linguistics 19(2), pp. 313-330.
18. McCallum, A. and W. Li (2003), Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons, Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003, Morristown, New Jersey, USA, pp. 188-191.
19. Paroubek, P. (2000), Language resources as by-product of evaluation: the MULTITAG example, Proceedings of the Second International Conference on Language Resources and Evaluation (LREC'00), Athens, Greece, pp. 151-154.
20. Paulussen, H., L. Macken, W. Vandeweghe, and P. Desmet (2013), Dutch Parallel Corpus: a balanced parallel corpus for Dutch-English and Dutch-French, Essential Speech and Language Technology for Dutch pp. 185-199, Springer.
21. Romary, L., S. Salmon-Alt, and G. Francopoulo (2004), Standards going concrete: from LMF to Morphalou, Proceedings of the Workshop on Enhancing and Using Electronic Dictionaries - COLING-2004, Geneva, Switzerland, pp. 22-28.
22. Sagot, B. (2010), The Lefff, a freely available and large-coverage morphological and syntactic lexicon for French, Proceedings of the seventh International Conference on Language Resources and Evaluation (LREC'10), Valletta, Malta.
23. Santorini, B. (1990), Part-of-speech tagging guidelines for the Penn Treebank Project, Technical report, University of Pennsylvania, Department of Computer and Information Science, Philadelphia, Pennsylvania, USA.
24. Schiller, A., S. Teufel, C. Stöckert, and C. Thielen (1999), Guidelines für das Tagging deutscher Textcorpora mit STTS (kleines und großes Tagset), Technical report, Universität Stuttgart - Institut für maschinelle Sprachverarbeitung, Universität Tübingen - Seminar für Sprachwissenschaft.
25. Schmid, H. (1994), Probabilistic part-of-speech tagging using decision trees, Proceedings of the International Conference on New Methods in Language Processing, Manchester, UK, pp. 44-49.
26. Schmid, H. (1995), Improvements in part-of-speech tagging with an application to German, Proceedings of the ACL SIGDAT-Workshop, Dublin, Ireland, pp. 47-50.
27. Schuurman, I., V. Hoste, and P. Monachesi (2009), Cultivating trees: Adding several semantic layers to the Lassy treebank in SoNaR, Proceedings of the 7th International Workshop on Treebanks and Linguistic Theories, Groningen, The Netherlands, pp. 135-146.
28. Skut, W., T. Brants, B. Krenn, and H. Uszkoreit (1998), A linguistically interpreted corpus of German newspaper text, Proceedings of the Tenth European Summer School in Logic, Language and Information (ESSLLI'98). Workshop on Recent Advances in Corpus Annotation, Saarbrücken, Germany, pp. 705-711.
29. Smith, G. (2003), A brief introduction to the TIGER treebank, version 1, Technical report, Universität Potsdam.
30. Telljohann, H., E. Hinrichs, and S. Kübler (2004), The Tüba-D/Z treebank: annotating German with a context-free backbone, Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC'04), Lisbon, Portugal, pp. 2229-2235.
31. Tjong Kim Sang, E. F. (2002a), Introduction to the CoNLL-2002 shared task: Language-independent named entity recognition, Proceedings of the 6th Conference on Natural Language Learning (COLING'02), Taipei, Taiwan, pp. 155-158.
32. Tjong Kim Sang, E. F. (2002b), Memory-based named entity recognition, Proceedings of CoNLL-2002, Taipei, Taiwan, pp. 203-206.
33. Tjong Kim Sang, E. F. and F. De Meulder (2003), Introduction to the CoNLL-2003 shared task: Language-independent named entity recognition, Proceedings of CoNLL-2003, Edmonton, Canada, pp. 142-147.
34. Van Den Bosch, A. and W. Daelemans (1999), Memory-based morphological analysis, Proceedings of the 37th annual meeting of the Association for Computational Linguistics (ACL'99), University of Maryland, USA, pp. 285-292.
35. Van Den Bosch, A., B. Busser, W. Daelemans, and S. Canisius (2007), An efficient memory-based morphosyntactic tagger and parser for Dutch, Computational Linguistics in the Netherlands 2006, Selected Papers of the 17th Computational Linguistics in the Netherlands Meeting, Leuven, Belgium, pp. 99-114.
36. Van Eynde, F. (2005), Part of speech tagging en lemmatisering van het D-Coi corpus, Technical report, Centrum voor Computerlingüistiek, KU Leuven.
37. Van Gompel, M. (2012), FoLiA: Format for Linguistic Annotation. Documentation. ILK Technical Report 12-03, Technical report, Center for Language Studies, Radboud University Nijmegen. http://ilk.uvt.nl/downloads/pub/papers/ilk.1203.pdf.
38. Van Noord, G., G. Bouma, F. Van Eynde, D. De Kok, J. Van Der Linde, I. Schuurman, E. Tjong Kim Sang, and V. Vandeghinste (2009), Large scale syntactic annotation of written Dutch: Lassy, Essential Speech and Language Technology for Dutch, Springer Berlin Heidelberg, pp. 147-164.
39. Van Rijsbergen, C. J. (1975), Information Retrieval, Buttersworth, London.
40. Zhou, GD. and J. Su (2002), Named entity recognition using an HMM-based Chunk Tagger, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics (ACL'02), Philadelphia, USA, pp. 473-480.