QARLA: A framework for the evaluation of text summarization systems

ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

Volumn , Issue , 2005, Pages 280-289

  Amigó, Enrique ^a   Gonzalo, Julio ^a   Peñas, Anselmo ^a   Verdejo, Felisa ^a  

^a UNIVERSIDAD NACIONAL DE EDUCACIÓN A DISTANCIA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC EVALUATION; OPTIMAL SETS; PROBABILISTIC FRAMEWORK; SIMILARITY METRICS; TEXT SUMMARIZATION;

COMPUTATIONAL LINGUISTICS; RATING; TEXT PROCESSING;

QUALITY CONTROL;

EID: 77951968286     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. E. Amigo, V. Peinado, J. Gonzalo, A. Peñas, and F. Verdejo. 2004. An empirical study of information synthesis task. In Proceedings of the 42th Annual Meeting of the Association for Computational Linguistics (ACL), Barcelona, July.
2. Deborah Coughlin. 2003. Correlating Automated and Human Assessments of Machine Translation Quality. In In Proceedings of MT Summit IX, New Orleans, LA.
3. Christopher Culy and Susanne Riehemann. 2003. The Limits of N-Gram Translation Evaluation Metrics. In Proceedings of MT Summit IX, New Orleans,LA.
4. Luke Shen Joseph P. Turian and I. Dan Melamed. 2003. Evaluation of Machine Translation and its Evaluation. In In Proceedings of MT Summit IX, New Orleans,LA.
5. C. Lin and E. H. Hovy. 2003a. Automatic Evaluation of Summaries Using N-gram Co-ocurrence Statistics. In Proceeding of 2003 Language Technology Conference (HLT-NAACL 2003).
6. Chin-Yew Lin and Eduard Hovy. 2003b. The Potential and Limitations of Automatic Sentence Extraction for Summarization. In Dragomir Radev and Simone Teufel, editors, HLT-NAACL 2003 Workshop:Text Summarization (DUC03), Edmonton, Alberta, Canada, May 31 - June 1. Association for Computational Linguistics.
7. C. Lin. 2004. Orange: a Method for Evaluating Automatic Metrics for Machine Translation. In Proceedings of the 36th Annual Conference on Computational Linguisticsion for Computational Linguistics (Coling'04), Geneva, August.
8. P. Over and J. Yen. 2004. An introduction to duc 2004 intrinsic evaluation of generic new text summarization systems. In Proceedings of DUC 2004 Document Understanding Workshop, Boston.
9. K. Papineni, S. Roukos, T. Ward, and W. Zhu. 2001. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pages 311-318, Philadelphia, jul.