Cross-framework evaluation for statistical parsing

EACL 2012 - 13th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings

Volumn , Issue , 2012, Pages 44-54

  Tsarfaty, Reut ^a   Nivre, Joakim ^a   Andersson, Evelina ^a  

^a UPPSALA UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATION THEORY; FORESTRY; LINGUISTICS;

DEPENDENCY PARSER; EDIT DISTANCE; FORMAL FRAMEWORK; FRAMEWORK EVALUATION; FUNCTION TREES; LANGUAGE INDEPENDENCE; STATISTICAL PARSING; SWEDISHS;

COMPUTATIONAL LINGUISTICS;

EID: 84876804903     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. Philip Bille. 2005. A survey on tree edit distance and related problems. Theoretical Computer Science, 337:217-239.
2. Ezra Black, Steven P. Abney, D. Flickenger, Claudia Gdaniec, Ralph Grishman, P. Harrison, Donald Hindle, Robert Ingria, Frederick Jelinek, Judith L. Klavans, Mark Liberman, Mitchell P. Marcus, Salim Roukos, Beatrice Santorini, and Tomek Strzalkowski. 1991. A procedure for quantitatively comparing the syntactic coverage of English grammars. In Proceedings of the DARPA Workshop on Speech and Natural Language, pages 306-311.
3. Sabine Brants, Stefanie Dipper, Silvia Hansen, Wolfgang Lezius, and George Smith. 2002. The Tiger treebank. In Proceedings of TLT.
4. Joan Bresnan. 2000. Lexical-Functional Syntax. Blackwell.
5. Sabine Buchholz and Erwin Marsi. 2006. CoNLL-X shared task on multilingual dependency parsing. In Proceedings of CoNLL-X, pages 149-164.
6. Aoife Cahill, Michael Burke, Ruth O'Donovan, Stefan Riezler, Josef van Genabith, and Andy Way. 2008. Wide-coverage deep statistical parsing using automatic dependency structure annotation. Computational Linguistics, 34(1):81-124.
7. John Carroll, Edward Briscoe, and Antonio Sanfilippo. 1998. Parser evaluation: A survey and a new proposal. In Proceedings of LREC, pages 447-454.
8. Daniel Cer, Marie-Catherine de Marneffe, Daniel Jurafsky, and Christopher D. Manning. 2010. Parsing to Stanford Dependencies: Trade-offs between speed and accuracy. In Proceedings of LREC.
9. Eugene Charniak and Mark Johnson. 2005. Coarseto- fine n-best parsing and maxent discriminative reranking. In Proceedings of ACL.
10. Paul Cohen. 1995. Empirical Methods for Artificial Intelligence. The MIT Press.
11. Marie-Catherine de Marneffe, Bill MacCartney, and Christopher D. Manning. 2006. Generating typed dependency parses from phrase structure parses. In Proceedings of LREC, pages 449-454.
12. Ryan Gabbard, Mitchell Marcus, and Seth Kulick. 2006. Fully parsing the Penn treebank. In Proceeding of HLT-NAACL, pages 184-191.
13. Jeśus Giḿenez and Llúis Màrquez. 2004. SVMTool: A general POS tagger generator based on support vector machines. In Proceedings of LREC.
14. Sandra Kübler, Ryan McDonald, and Joakim Nivre. 2009. Dependency Parsing. Number 2 in Synthesis Lectures on Human Language Technologies. Morgan & Claypool Publishers.
15. Dekang Lin. 1995. A dependency-based method for evaluating broad-coverage parsers. In Proceedings of IJCAI-95, pages 1420-1425.
16. Mohamed Maamouri, Ann Bies, Tim Buckwalter, and Wigdan Mekki. 2004. The Penn Arabic treebank: Building a large-scale annotated Arabic corpus. In Proceedings of NEMLAR International Conference on Arabic Language Resources and Tools.
17. Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19:313-330.
18. Ryan McDonald, Fernando Pereira, Kiril Ribarov, and Jan Hajǐc. 2005. Non-projective dependency parsing using spanning tree algorithms. In HLT '05: Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, pages 523-530, Morristown, NJ, USA. Association for Computational Linguistics.
19. Beata Megyesi. 2009. The open source tagger Hun- PoS for Swedish. In Proceedings of the 17th Nordic Conference of Computational Linguistics (NODALIDA), pages 239-241.
20. Igor Mel'cuk. 1988. Dependency Syntax: Theory and Practice. State University of New York Press.
21. Paola Merlo and Gabriele Musillo. 2005. Accurate function parsing. In Proceedings of EMNLP, pages 620-627.
22. Joakim Nivre and Beata Megyesi. 2007. Bootstrapping a Swedish Treebank using cross-corpus harmonization and annotation projection. In Proceedings of TLT.
23. Joakim Nivre, Johan Hall, and Jens Nilsson. 2006. Maltparser: A data-driven parser-generator for dependency parsing. In Proceedings of LREC, pages 2216-2219.
24. Joakim Nivre, Laura Rimell, Ryan McDonald, and Carlos Ǵomez-Rodŕiguez. 2010. Evaluation of dependency parsers on unbounded dependencies. In Proceedings of COLING, pages 813-821.
25. Slav Petrov, Leon Barrett, Romain Thibaux, and Dan Klein. 2006. Learning accurate, compact, and interpretable tree annotation. In Proceedings of ACL.
26. Paul M. Postal and David M. Perlmutter. 1977. Toward a universal characterization of passivization. In Proceedings of the 3rd Annual Meeting of the Berkeley Linguistics Society, pages 394-417.
27. Owen Rambow. 2010. The simple truth about dependency and phrase structure representations: An opinion piece. In Proceedings of HLT-ACL, pages 337-340.
28. Roy Schwartz, Omri Abend, Roi Reichart, and Ari Rappoport. 2011. Neutralizing linguistically problematic annotations in unsupervised dependency parsing evaluation. In Proceedings of ACL, pages 663-672.
29. Khalil Sima'an, Alon Itai, Yoad Winter, Alon Altman, and Noa Nativ. 2001. Building a Tree-Bank for Modern Hebrew Text. In Traitement Automatique des Langues.
30. Reut Tsarfaty and Khalil Simaan. 2008. Relational- Realizational parsing. In Proceedings of Coling.
31. Reut Tsarfaty, Joakim Nivre, and Evelina Andersson. 2011. Evaluating dependency parsing: Robust and heuristics-free cross-framework evaluation. In Proceedings of EMNLP.
32. Kaizhong Zhang and Dennis Shasha. 1989. Simple fast algorithms for the editing distance between trees and related problems. In SIAM Journal of Computing, volume 18, pages 1245-1262.