Evaluating evaluation measures

Proceedings of the 16th Nordic Conference of Computational Linguistics, NODALIDA 2007

Volumn , Issue , 2007, Pages 372-379

  Rehbein, Ines ^a   van Genabith, Josef ^a  

^a DUBLIN CITY UNIVERSITY   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; FORESTRY;

ANNOTATION SCHEME; ERROR TYPES; EVALUATION MEASURES; PERFORMANCE; PROBABILISTICS; TREEBANKS;

QUALITY CONTROL;

EID: 84874625805     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Dipper, S., T. Brants, W. Lezius, O. Plaehn, and G. Smith. 2001. The TIGER Treebank. In Third Workshop on Linguistically Interpreted Corpora LINC-2001, Leuven, Belgium.
2. Brants, Sabine, and Silvia Hansen 2002. Developments in the TIGER Annotation Scheme and their Realization in the Corpus. In Proceedings of the Third Conference on Language Resources and Evaluation (LREC 2002), pp. 1643-1649. Las Palmas, Canary Islands.
3. Briscoe, E. J., J. A. Carroll, and A. Copestake. 2002. Relational evaluation schemes. In Proceedings Workshop'Beyond Parseval - towards improved evaluation measures for parsing systems', 3rd International Conference on Language Resources and Evaluation, pp. 4-38. Las Palmas, Canary Islands.
4. Carroll, J., E. Briscoe and A. Sanfilippo. 1998. Parser evaluation: a survey and a new proposal. In Proceedings of the 1st International Conference on Language Resources and Evaluation, Granada, Spain. 447-454.
5. Dipper, S., T. Brants, W. Lezius, O. Plaehn, and G. Smith. 2001. The TIGER Treebank. In Third Workshop on Linguistically Interpreted Corpora LINC-2001, Leuven, Belgium.
6. Drach, Erich. 1937. Grundgedanken der Deutschen Satzlehre. Frankfurt/M.
7. Kübler, Sandra, and Heike Telljohann. 2002. Towards a Dependency-Oriented Evaluation for Partial Parsing. In Proceedings of Beyond PARSEVAL - Towards Improved Evaluation Measures for Parsing Systems (LREC 2002 Workshop), Las Palmas, Gran Canaria.
8. Kübler, Sandra. 2005. How Do Treebank Annotation Schemes Influence Parsing Results? Or How Not to Compare Apples And Oranges. In Proceedings of RANLP 2005, Borovets, Bulgaria.
9. Kübler, Sandra, Erhard Hinrichs, and Wolfgang Maier. 2006. Is it Really that Difficult to Parse German? In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, EMNLP, Sydney, Australia.
10. Levenshtein, V. I. 1966. Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics - Doklady, 10.707-10 (translation of Russian original published in 1965).
11. Lin, Dekang. 1998. Dependency-based Evaluation of MINIPAR. Workshop on the Evaluation of Parsing Systems, Granada, Spain.
12. Maier, Wolfgang. 2006. Annotation Schemes and their Influence on Parsing Results. In Proceedings of the COLING/ACL 2006 Student Research Workshop), Sydney, Australia.
13. Sampson, Geoffrey, and Anna Babarczy. 2003. A test of the leaf-ancestor metric for parse accuracy. Natural Language Engineering, 9 (4):365-380.
14. Schmid, Helmut. 2004. Efficient Parsing of Highly Ambiguous Context-Free Grammars with Bit Vectors. In Proceedings of the 20th International Conference on Computational Linguistics (COLING 2004), Geneva, Switzerland.
15. Skut, Wojciech, Brigitte Krann, Thorsten Brants, and Hans Uszkoreit. 1997. An annotation scheme for free word order languages. In Proceedings of ANLP 1997, Washington, D.C.
16. Telljohann, Heike, Erhard W. Hinrichs, Sandra Kübler, and Heike Zinsmeister. 2005. Stylebook for the Tübingen Treebank of Written German (TüBa-D/Z). Seminar für Sprachwissenschaft, Universität Tübingen, Germany.
17. Schiller, Anne, Simone Teufel, and Christine Thielen. 1995. Guidelines fr das Tagging deutscher Textcorpora mit STTS. Technical Report, IMS-CL, University Stuttgart.