It depends: Dependency parser comparison using a web-based evaluation tool

ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference

Volumn 1, Issue , 2015, Pages 387-396

  Choi, Jinho D ^a   Tetreault, Joel ^b   Stent, Amanda ^b  

^a EMORY UNIVERSITY   (United States)

^b YAHOO RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS; WEBSITES;

COMPARATIVE ANALYSIS; DEPENDENCY PARSER; DEPENDENCY PARSING; DESIRED SPEED; STATISTICAL DEPENDENCIES; WEB-BASED EVALUATION TOOLS; WEB-BASED TOOLS;

COMPUTATIONAL LINGUISTICS;

EID: 84943760232     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/p15-1038     Document Type: Conference Paper

References (41)

1. Emily M. Bender, Dan Flickinger, Stephan Oepen, and Yi Zhang. 2011. Parser evaluation over local and non-local deep dependencies in a large corpus. In Proceedings of EMNLP.
2. Anders Bjorkelund et al. 2014. Introducing the IMSWrocaw-Szeged-CIS entry at the SPMRL 2014 shared task: Reranking and morpho-syntax meet unlabeled data. In Proceedings of the First Joint Workshop on Statistical Parsing of Morphologically Rich Languages and Syntactic Analysis of Non-Canonical Languages.
3. Bernd Bohnet. 2010. Very high accuracy and fast dependency parsing is not a contradiction. In Proceedings of COLING.
4. Sabine Buchholz and Erwin Marsi. 2006. CoNLL-X shared task on multilingual dependency parsing. In Proceedings of CoNLL.
5. Danqi Chen and Christopher Manning. 2014. A fast and accurate dependency parser using neural networks. In Proceedings of EMNLP.
6. Jinho D. Choi and Andrew McCallum. 2013. Transition-based Dependency Parsing with Selectional Branching. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, ACL13, pages 1052-1062.
7. Jinho D. Choi and Martha Palmer. 2012a. Fast and Robust Part-of-Speech Tagging Using Dynamic Model Selection. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, ACL12, pages 363-367.
8. Jinho D. Choi and Martha Palmer. 2012b. Guidelines for the Clear Style Constituent to Dependency Conversion. Technical Report 01-12, Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO, USA.
9. Ronan Collobert et al. 2011. Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12:2493-2537.
10. Marie-Catherine de Marneffe and Christopher D. Manning. 2008. The Stanford typed dependencies representation. In Proceedings of the COLING workshop on Cross-Framework and Cross-Domain Parser Evaluation.
11. Yoav Goldberg and Joakim Nivre. 2013. Training deterministic parser with non-deterministic oracles. In Proceedings of TACL.
12. Gholamreza Haffari, Marzieh Razavi, and Anoop Sarkar. 2011. An ensemble model that combines syntactic and semantic clustering for discriminative dependency parsing. In Proceedings of ACL-HLT.
13. Jan Hajic et al. 2009. The CoNLL-2009 shared task: Syntactic and semantic dependencies in multiple languages. In Proceedings of CoNLL.
14. Matthew Honnibal, Yoav Goldberg, and Mark Johnson. 2013. A non-monotonic arc-eager transition system for dependency parsing. In Proceedings of CoNLL.
15. Liang Huang, Suphan Fayong, and Yang Guo. 2012. Structured perceptron with inexact search. In Proceedings of the NAACL.
16. Richard Johansson and Pierre Nugues. 2007. Extended constituent-To-dependency conversion for English. In Proceedings of NODALIDA.
17. Jonathan K. Kummerfeld et al. 2012. Parser showdown at the wall street corral: An empirical investigation of error types in parser output. In Proceedings of EMNLP.
18. Joseph Le Roux et al. 2012. DCU-Paris13 systems for the SANCL 2012 shared task. In Proceedings of the First Workshop on Syntactic Analysis of Non-Canonical Language (SANCL).
19. Joseph Le Roux, Antoine Rozenknop, and Jennifer Foster. 2013. Combining PCFG-LA models with dual decomposition: A case study with function labels and binarization. In Proceedings of EMNLP.
20. Tao Lei, Yu Xin, Yuan Zhang, Regina Barzilay, and Tommi Jaakkola. 2014. Low-rank tensors for scoring dependency structures. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1381-1391, Baltimore, Maryland, June. Association for Computational Linguistics.
21. Mitchell P. Marcus, Mary Ann Marcinkiewicz, and Beatrice Santorini. 1993. Building a large annotated corpus of english: The Penn treebank. Computational Linguistics, 19(2):313-330.
22. Andre F. T. Martins, Miguel B. Almeida, and Noah A. Smith. 2013. Turning on the turbo: Fast third-order non-projective turbo parsers. In Proceedings of the ACL.
23. Ryan McDonald and Joakim Nivre. 2007. Characterizing the errors of data-driven dependency parsing models. In Proceedings of EMNLP-CoNLL.
24. Ryan McDonald and Joakim Nivre. 2011. Analyzing and integrating dependency parsers. Computational Linguistics, 37(1):197-230.
25. Makoto Miwa et al. 2010. A comparative study of syntactic parsers for event extraction. In Proceedings of BioNLP.
26. Jens Nilsson and Joakim Nivre. 2008. MaltEval: An evaluation and visualization tool for dependency parsing. In Proceedings of LREC.
27. Joakim Nivre et al. 2007. The CoNLL 2007 shared task on dependency parsing. In Proceedings of CoNLL.
28. Joakim Nivre, Laura Rimell, Ryan McDonald, and Carlos Gomez Rodrguez. 2010. Evaluation of dependency parsers on unbounded dependencies. In Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), pages 833-841, Beijing, China, August. Coling 2010 Organizing Committee.
29. Stephan Oepen et al. 2014. SemEval 2014 Task 8: Broad-Coverage Semantic Dependency Parsing. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pages 63-72.
30. Slav Petrov and Ryan McDonald. 2012. Overview of the 2012 shared task on parsing the web. In Proceedings of the FirstWorkshop on Syntactic Analysis of Non-Canonical Language (SANCL) Shared Task.
31. Slav Petrov, Pi-Chuan Chang, Michael Ringgaard, and Hiyan Alshawi. 2010. Uptraining for accurate deterministic question parsing. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pages 705-713, Cambridge, MA, October. Association for Computational Linguistics.
32. Sameer Pradhan et al. 2013. Towards robust linguistic analysis using OntoNotes. In Proceedings of CoNLL.
33. Mohammad Sadegh Rasooli and Joel R. Tetreault. 2015. Yara parser: A fast and accurate dependency parser. CoRR, abs/1503.06733.
34. Kenji Sagae and Alon Lavie. 2006. Parser combination by reparsing. In Proceedings HLT-NAACL.
35. Kenji Sagae and Junichi Tsujii. 2010. Dependency parsing and domain adaptation with data-driven LR models and parser ensembles. In Trends in Parsing Technology: Dependency Parsing, Domain Adaptation, and Deep Parsing, pages 57-68. Springer.
36. Djame Seddah et al. 2013. Overview of the SPMRL 2013 shared task: A cross-framework evaluation of parsing morphologically rich languages. In Proceedings of the 4th Workshop on Statistical Parsing of Morphologically Rich Languages.
37. Pontus Stenetorp et al. 2012. BRAT: A web-based tool for NLP-Assisted text annotation. In Proceedings of the EACL.
38. Mihai Surdeanu et al. 2008. The CoNLL-2008 shared task on joint parsing of syntactic and semantic dependencies. In Proceedings of CoNLL.
39. Reut Tsarfaty, Joakim Nivre, and Evelina Andersson. 2011. Evaluating dependency parsing: Robust and heuristics-free cross-Annotation evaluation. In Proceedings of EMNLP.
40. Ralph Weischedel et al. 2011. OntoNotes: A large training corpus for enhanced processing. In Joseph Olive, Caitlin Christianson, and John McCary, editors, Handbook of Natural Language Processing and Machine Translation. Springer.
41. Deniz Yuret, Laura Rimell, and Aydin Han. 2013. Parser evaluation using textual entailments. Language Resources and Evaluation, 47(3)