Intrinsic vs. extrinsic evaluation measures for referring expression generation

ACL-08: HLT - 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference

Volumn , Issue , 2008, Pages 197-200

  Belz, Anja ^a   Gatt, Albert ^b  

^a UNIVERSITY OF BRIGHTON   (United Kingdom)

^b UNIVERSITY OF ABERDEEN   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EVALUATION MEASURES; EVALUATION METRICS; EVALUATION RESULTS; HUMAN TASKS; LANGUAGE GENERATION; REFERRING EXPRESSIONS;

COMPUTATIONAL LINGUISTICS;

EID: 84859906188     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1557690.1557746     Document Type: Conference Paper

References (10)

1. S. Bangalore, O. Rambow, and S. Whittaker. 2000. Evaluation metrics for generation. In Proceedings of the 1st International Conference on Natural Language Generation (INLG'00), pages 1-8.
2. A. Belz and A. Gatt. 2007. The attribute selection for GRE challenge: Overview and evaluation results. In Proceedings of the 2nd UCNLG Workshop: Language Generation and Machine Translation (UCNLG+MT), pages 75-83.
3. A. Belz and E. Reiter. 2006. Comparing automatic and human evaluation of NLG systems. In Proc. EACL'06, pages 313-320.
4. R. Dale and E. Reiter. 1995. Computational interpretations of the Gricean maxims in the generation of referring expressions. Cognitive Science, 19(2):233-263.
5. R. Dale. 1989. Cooking up referring expressions. In Proceedings of the 27th AnnualMeeting of the Association for Computational Linguistics.
6. G. Doddington. 2002. Automatic evaluation of machine translation quality using n-gram co-occurrence statistics. In Proc. ARPA Workshop on Human Language Technology.
7. A. Gatt, I. van der Sluis, and K. van Deemter. 2007. Evaluating algorithms for the generation of referring expressions using a balanced corpus. In Proceedings of the 11th European Workshop on Natural Language Generation (ENLG'07), pages 49-56.
8. I. Langkilde. 2002. An empirical verification of coverage and correctness for a general-purpose sentence generator. In Proceedings of the 2nd International Natural LanguageGeneration Conference (INLG'02).
9. C.-Y. Lin and E. Hovy. 2003. Automatic evaluation of summaries using n-gram co-occurrence statistics. In Proc. HLT-NAACL 2003, pages 71-78.
10. R. Passonneau. 2006. Measuring agreement on setvalued items (MASI) for semantic and pragmatic annotation. In Proceedings of the 5th Language Resources and Evaluation Converence (LREC'06).