GENEVAL: A proposal for shared-task evaluation in NLG

COLING/ACL 2006: INLG-06 - 4th International Natural Language Generation Conference, Proceedings of the Conference

Volumn , Issue , 2011, Pages 136-138

  Reiter, Ehud ^a   Belz, Anja ^b  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b UNIVERSITY OF BRIGHTON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84858120616     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Srinavas Bangalore, Owen Rambow, and Steve Whittaker. 2000. Evaluation metrics for generation. In Proceedings of INLG-2000, pages 1-8.
2. Anja Belz and Adam Kilgarriff. 2006. Shared-task evaluations in HLT: Lessons for NLG. In Proceedings of INLG-2006.
3. Anja Belz and Ehud Reiter. 2006. Comparing automatic and human evaluation of NLG systems. In Proceedings of EACL-2006, pages 313-320.
4. Lynette Hirschman. 1998. The evolution of evaluation: Lessons from the Message Understanding Conferences. Computer Speech and Language, 12:283-285.
5. Anna Law, Yvonne Freer, Jim Hunter, Robert Logie, Neil McIntosh, and John Quinn. 2005. Generating textual summaries of graphical time series data to support medical decision making in the neonatal intensive care unit. Journal of Clinical Monitoring and Computing, 19:183-194. (Pubitemid 41631341)
6. Kishore Papineni, Salim Roukos, ToddWard, andWei- Jing Zhu. 2002. Bleu: A method for automatic evaluation of machine translation. In Proceedings of ACL-2002, pages 311-318.
7. Ehud Reiter and Robert Dale. 2000. Building Natural Language Generation Systems. Cambridge University Press.
8. Ehud Reiter and Somayajulu Sripada. 2002. Should corpora texts be gold standards for NLG? In Proceedings of INLG-2002, pages 97-104.
9. Ehud Reiter, Roma Robertson, and Liesl Osman. 2003. Lessons from a failure: Generating tailored smoking cessation letters. Artificial Intelligence, 144:41-58.
10. Somayajulu Sripada, Ehud Reiter, Jim Hunter, and Jin Yu. 2003. Exploiting a parallel text-data corpus. In Proceedings of Corpus Linguistics 2003, pages 734- 743.