Comparison of some automatic and manual methods for summary evaluation based on the Text Summarization Challenge 2

Proceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004

Volumn , Issue , 2004, Pages 1029-1032

  Nanba, Hidetsugu ^a   Okumura, Manabu ^b  

^a HIROSHIMA CITY UNIVERSITY   (Japan)

^b TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

TEXT PROCESSING;

AUTOMATIC METHOD; CONTENT-BASED; EDIT DISTANCE; ESSENTIAL POINT; EVALUATION MEASURES; MANUAL METHODS; TEXT SUMMARIZATION;

QUALITY CONTROL;

EID: 85006549590     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (6)

1. Donaway, R.L., Drummey, K.W., and Mather, L.A. (2000). A Comparison of Rankings Produced by Summarization Evaluation Measures, Proceedings of the ANLP/NAACL 2000 Workshop on Automatic Summarization, (pp.69-78).
2. Fukushima, T. and Okumura, M. (2001). Text Summarization Challenge Text Summarization Evaluation at NTCIR Workshop2. Proceedings of the Second NTCIR Workshop Meeting, (pp.45-51).
3. Fukushima, T., Okumura, M., and Nanba, H. (2002). Text Summarization Challenge 2 / Text Summarization Evaluation at NTCIR Workshop3, Working Notes of the Third NTCIR Workshop Meeting, PART V, (pp.1-7).
4. Lin, C. and Hovy, E. (2003). Automatic Evaluation of Summaries Using N-gram Co-Occurrence Statistics, Proceedings of the Human Language Technology Conference 2003.
5. Nanba, H. and Okumura, M. (2002). Some Examinations of Intrinsic Methods for Summary Evaluation Based on the Text Summarization Challenge (TSC), Proceedings of the third International Conference on Language Resources and Evaluation, (pp.739-746).
6. Papineni, K., S. Roukos, T. Ward, W.-J. Zhu. (2001). BLEU: a Method for Automatic Evaluation of Machine Translation, IBM Research Report, RC22176 (W0109-022).