Tree-distance and some other variants of evalb

Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008

Volumn , Issue , 2008, Pages 1373-1379

  Emms, Martin ^a  

^a TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

MAPPING;

DISTANCE MEASURE; EVALUATION MEASURES; PENALISATION; PRESERVING MAPPINGS; TREEBANKS;

FORESTRY;

EID: 84943765257     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Srinivas Bangalore, Anoop Sarkar, Christy Doran, and Beth-Ann Hockey. 1998. Grammar and parser evaluation in the xtag project. In Proceedings of LREC Workshop on Evaluation of Parsing Systems.
2. Philip Bille. 2005. A survey on tree edit distance and related problems. Theor. Computer. Sci., 337(1-3):217-239.
3. Ezra Black, Steven P. Abney, D. Flickenger, Claudia Gdaniec, Ralph Grishman, P. Harrison, Donald Hindle, Robert Ingria, Frederick Jelinek, Judith L. Klavans, Mark Liberman, Mitchell P. Marcus, Salim Roukos, Beatrice Santorini, and Tomek Strzalkowski. 1991. A procedure for quantitatively comparing the syntactic coverage of english grammars. In Proceedings of HLT.
4. Eugene Charniak. 2000. A maximum-entropy-inspired parser. In Proceedings of NAACL 2000, pages 132-139.
5. Michael Collins. 1997. Three generative, lexicalized models for statistical parsing. In Proceedings of ACL 97.
6. Michael Collins. 2003. Head-driven statistical models for natural language parsing. Computational Linguistics, 29(4):589-637.
7. Martin Emms. 2006a. Clustering by tree distance for parse tree normalisation. In Proceedings of NLUCS 2006, pages 91-100.
8. Martin Emms. 2006b. Variants of tree similarity in a question answering task. In Proceedings of the Workshop on Linguistic Distances, pages 100-108, Sydney, Australia, July. Association for Computational Linguistics.
9. Martin Emms. 2008. Tree distance software at www.cs.tcd.ie/Martin. Emms/tdist.
10. Milen Kouylekov and Bernardo Magnini. 2005. Recognizing textual entailment with tree edit distance algorithms. In Ido Dagan, Oren Glickman, and Bernardo Magnini, editors, Pascal Challenges Workshop on Recognising Textual Entailment.
11. K. Zhang and D. Shasha. 1989. Simple fast algorithms for the editing distance between trees and related problems. SIAM Journal of Computing, 18:1245-1262.
12. Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1994. Building a large annotated corpus of english: The penn treebank. Computational Linguistics, 19(2):313-330.
13. Slav Petrov, Leon Barret, Romain Thibaux, and Dan Klein. 2006. Learning accurate, compact, and interpretable tree annotation. In Proceedings of COLING/ACL 2006, pages 433-440.
14. Vasin Punyakanok, Dan Roth, and Wen tau Yih. 2004. Natural language inference via dependency tree mapping: An application to question answering. Computational Linguistics.
15. Ines Rehbein and Josef van Genabith. 2007. Treebank annotation schemes and parser evaluation for German. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 630-639.
16. B. Roark. 2002. Evaluating parser accuracy using edit distance. In Proceedings of the LREC 2002 workshop: Beyond PARSEVAL: Towards Improved Evaluation Measures for Parsing Systems, pages 30-36.
17. Geoffrey Sampson and Anna Babarczy. 2003. A test of the leaf-ancestor metric for parse accuracy. Nat. Lang. Eng., 9(4):365-380.
18. Satoshi Sekine and Michael Collins. 1997. evalb software at nlp. cs.nyu.edu/evalb.
19. S. Siegel and N. J. Castellan. 1988. Non-Parametric Statistics for the Behavioural Sciences. McGraw-Hill.
20. C. J. van Rijsbergen. 1979. Information Retrieval, 2nd edition. Dept. of Computer Science, University of Glasgow.
21. V. I. Levenshtein. 1966. Binary codes capable of correcting insertions and reversals. Sov. Phys. Dokl, 10:707-710.