Data, annotations and measures in EASY the evaluation campaign for parsers of French

Proceedings of the 5th International Conference on Language Resources and Evaluation, LREC 2006

Volumn , Issue , 2006, Pages 315-320

  Paroubek, Patrick ^a   Robba, Isabelle ^a   Vilnat, Anne ^a   Ayache, Christelle ^b  

^a CNRS   (France)

^b ELDA   (France)

Author keywords

[No Author keywords available]

Indexed keywords

SYNTACTICS;

ANNOTATION SCHEME; EVALUATION METHODOLOGIES; SYNTACTIC PARSERS;

COMPUTATIONAL LINGUISTICS;

EID: 84890535767     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. A. Abeillé, L. Clément, and A. Kinyon. 2000. Building a treebank for french. In Proceedings of the 2nd International Conference on Language Ressources and Evaluation (LREC), pages 1251-1254, Athen, Greece.
2. A. Abeillé. 1991. Analyseurs syntaxiques du français. Bulletin Semestriel de l'Association pour le Traitement Automatique des Langues, 32:107-120.
3. e conférence annuelle sur le Traitement Automatique des Langues Naturelles (TALN), Batz-sur-Mer, juin.
4. E. Black, S. Abney, D. Flickenger, C. Gdaniec, R. Grishman, P. Harison, D. Hindle, R. Ingria, F. Jelineck, J. Klavan, M. Liberman, M. Marcus, S. Roukos, B. Santorini, and Strzalkozskijl. 1991. A procedure for quantitatively comparing the syntactic coverage of english grammars. In Proceedings of the 4th DARPA Speech and Natural Language Workshop, pages 306-311, Pacific Grove, California. Morgan Kaufman.
5. S. Brant, S. Dipper, S. Hansen, W. Lezius, and G. Simth. 2002. The tiger treebank. In Proceedings of the 1st Workshop on Treebank and Linguistics Thories (TLT), Sozopol, Bulgaria.
6. E. Briscoe, J. Carroll, J. Grayham, and A. Copestake. 2002. Relational evaluation schemes. In Proceedings of the Workshop Beyond Parseval - Toward improved evaluation measures for parsing systems at the 3rd International Conference on Lnaguage Resources and Evaluation (LREC), Las Palmas.
7. J. Carroll, T. Briscoe, and A Sanfilipo. 1998. Parser evaluation: a survey and a new proposal. In Proceedings of the 1st International Conference on Linguistic Resources and Evaluation (LREC), pages 447-454, Granada, Spain.
8. rd International Conference on Language Resources and Evaluation (LREC), Las Palmas, Spain.
9. J. Carroll, G. Minnen, and E. Briscoe, 2003. Parser evaluation using a grammtical relation annotation scheme, pages 299-316. Treebanks: Building and Using Parsed Corpora. Kluwer, Dordrecht.
10. R. Gaizauskas, M. Hepple, and C. Huyck. 1998. Modifying existing annotated corpora for general comparative evaluation of parsing. In Proceedings fo the Workshop on Evaluation of Parsing Systems in the Proceedings of the 1st International Conference on Language Resources and Evaluation (LREC), Granada, Spain.
11. V. Gendner, G. Illouz, M. Jardino, L. Monceaux, P. Paroubek, I. Robba, and A. Vilnat. 2003. Peas the first instanciation of a comparative framework for evaluating parsers of french. In Proceedings of the 10th Conference of the European Chapter fo the Association for Computational Linguistics, pages 95-98, Budapest, Hungarie. Companion Volume.
12. D. Lin. 98. Dependency-based evaluation of minipar. In Proceedings of the Workshop on Evaluation of Parsing Systems, Granada, Spain.
13. C. D. Manning and H. Schütze. 2002. Foundation of Statistical Natural Language Processing. Massachusetts institute of Technology Press, 5 edition.
14. M. Marcus, B. Santorini, and M. Marcinkiewciz. 1993. Building a large annotated corpus of english: The penn treebank. Computational Linguistics, 19:313-330.
15. E. Miltsakaki, R. Prasad, A. Joshi, and B. Webber. 2004. Annotating discourse connectives and their arguments. In Proceedings of the Frontiers in Corpus Annotation NAACL/HLT Conference Workshop, Boston.
16. G. Musillo and K. Sima'an. 2002. Toward comparing parsers from different linguistic frameworks - an information theoretic approach. In Proceedings of the Workshop Beyon Parseval - Toward improved evaluation measures for parsing systems at the 3rd International Conference on Language Resources and Evaluation (LREC), Las Palmas, Spain.
17. S. Oepen, K. Netter, and J. Klein. 1996. Test suites for natural language processing. In CSLI Lecture Notes. Center for the Study of Language and Information.
18. M. Palmer, D. Gildea, and P. Kingsbury. 2005. The proposition bank: A corpus annotated with semantic roles. Computational Linguistics, 31(1).
19. P. Paroubek, L.-G. Pouillot, I. Robba, and A. Vilnat. 2005. Easy: Campagne d'évaluation des analyseurs syntaxiques. In Proceedings of the 12e conférence annuelle sur le Traitement Automatique des Langues Naturelles (TALN), pages 3-12, Dourdan, France.
20. B. Roark. 2002. Evaluating parser accuracy using edit distance. In Proceedings of the Workshop Beyon Parseval - Toward improved evaluation measures for parsing systems at the 3rd International Conference on Language Resources and Evaluation (LREC), Las Palmas, Spain.
21. B. Srinivas, C. Doran, B.A. Hockey, and K. Joshi. 1996. An approachto robust partial parsing and evaluation metrics. In Proceedings of the Workshop on Robust Parsing, Pragues. ESSLI.
22. th International Conference on Language Resources and Evaluation (LREC), pages 2023-2026, Lisboa, Portugal.
23. nd International Conference on Language Ressources and Evaluation (LREC), Athen.