DEPEVAL(summ): Dependency-based evaluation for automatic summaries

ACL-IJCNLP 2009 - Joint Conf. of the 47th Annual Meeting of the Association for Computational Linguistics and 4th Int. Joint Conf. on Natural Language Processing of the AFNLP, Proceedings of the Conf.

Volumn , Issue , 2009, Pages 190-198

  Owczarzak, Karolina ^a  

^a NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC EVALUATION; BASIC ELEMENTS; DEPENDENCY TRIPLES; EVALUATION METRICS; HUMAN JUDGMENTS; LEXICAL-FUNCTIONAL GRAMMAR; PARTIAL MATCHING; RE-RANKING; WORDNET;

COMPUTATIONAL LINGUISTICS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 77956310517     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the ACL 2005Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and/or Summarization, pages 65-73, Ann Arbor, MI, USA.
2. Joan Bresnan. 2001. Lexical-Functional Syntax. Blackwell, Oxford.
3. Aoife Cahill, Michael Burke, Ruth O'Donovan, Josef van Genabith, and Andy Way. 2004. Longdistance dependency resolution in automatically acquired wide-coverage PCFG-based LFG approximations. In Proceedings of the 42th Annual Meeting of the Association for Computational Linguistics, pages 320-327, Barcelona, Spain.
4. Aoife Cahill, Michael Burke, Ruth O'Donovan, Stefan Riezler, Josef van Genabith, and Andy Way. 2008. Wide-coverage deep statistical parsing using automatic dependency structure annotation. Comput. Linguist., 34(1):81-124.
5. Eugene Charniak and Mark Johnson. 2005. Coarseto-fine n-best parsing and MaxEnt discriminative reranking. In ACL 2005: Proceedings of the 43rd Annual Meeting of the Association for ComputationalLinguistics, pages 173-180, Morristown, NJ, USA. Association for Computational Linguistics.
6. Eugene Charniak. 2000. A maximum entropy inspired parser. In Proceedings of the 1st Annual Meeting of the North American Chapter of the Association for Computational Linguistics, pages 132-139, Seattle, WA, USA.
7. Hoa Trang Dang and Karolina Owczarzak. 2008. Overview of the tac 2008 summarization track: Update task. In to appear in: Proceedings of the 1st Text Analysis Conference (TAC).
8. Eduard Hovy, Chin-Yew Lin, and Liang Zhou. 2005. Evaluating DUC 2005 using Basic Elements. In Proceedings of the 5th Document Understanding Conference (DUC).
9. Ronald M. Kaplan and Joan Bresnan, 1982. The Mental Representation of Grammatical Relations, chapter Lexical-functional Grammar: A Formal System for Grammatical Representation. MIT Press, Cambridge, MA, USA.
10. Roger Levy and Galen Andrew. 2006. Tregex and tsurgeon: Tools for querying and manipulating tree data structures. In Proceedings of the 5th International Conference on Language Resources and Evaluation.
11. Dekang Lin. 1995. A dependency-based method for evaluating broad-coverage parsers. In Proceedings of the 14th International Joint Conference on Artificial Intelligence, pages 1420-1427.
12. Chin-Yew Lin. 2004. ROUGE: A package for automatic evaluation of summaries. In Proceedings of the ACL 2004 Workshop: Text Summarization Branches Out, pages 74-81.
13. Karolina Owczarzak, Josef van Genabith, and Andy Way. 2007. Evaluating Machine Translation with LFG dependencies. Machine Translation, 21(2):95-119.
14. Karolina Owczarzak. 2008. A novel dependencybased evaluation metric for Machine Translation. Ph.D. thesis, Dublin City University.
15. Rebecca J. Passonneau, Ani Nenkova, Kathleen McKeown, and Sergey Sigelman. 2005. Applying the Pyramid method in DUC 2005. In Proceedings of the 5th Document Understanding Conference (DUC).
16. Jason Rennie. 2000. Wordnet::querydata: a Perl module for accessing the WordNet database. http://people.csail.mit.edu/ jrennie/WordNet.
17. Stephen Tratz and Eduard Hovy. 2008. Summarization evaluation using transformed Basic Elements. In Proceedings of the 1st Text Analysis Conference (TAC).