Some examinations of intrinsic methods for summary evaluation based on the text summarization challenge (TSC)

Proceedings of the 3rd International Conference on Language Resources and Evaluation, LREC 2002

Volumn , Issue , 2002, Pages 739-746

  Nanba, Hidetsugu ^a   Okumura, Manabu ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

CONTENT-BASED; EVALUATION METHODS; F MEASURE; INTRINSIC METHODS; SUBJECTIVE EVALUATIONS; TEXT SUMMARIZATION;

TEXT PROCESSING;

EID: 84883572659     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. Donaway, R.L., Drummey, K.W., and Mather, L.A. 2000. A Comparison of Rankings Produced by Summarization Evaluation Measures. Proceedings of the ANLP/NAACL 2000 Workshop on Automatic Summarization, pages 69- 78.
2. Fukushima, T. and Okumura, M. 2001. Text Summarization Challenge Text Summarization Evaluation at NTCIR Workshop2. Proceedings of the Second NTCIR Workshop Meeting, pages 45-51.
3. Fukushima, T. and Okumura, M. 2001. Text Summarization Challenge Text Summarization Evaluation in Japan. Proceedings of NAACL 2001 Workshop Automatic Summarization, pages 51-59.
4. Jing, H., Barzilay, R., McKeown, K., and Elhadad, M. 1998. Summarization Evaluation Methods: Experiments and Analysis. Technical Report SS-98-06, Intelligent Text Summarization, AAAI Press, pages 51-59.
5. Mani, I. 2001. Automatic Summarization. John Benjamins Pub Co.
6. McKeown, K.R., Barzilay, R., Evans, D., Hatzivassiloglou, V., Kan, M. Y., Schiffman, B. and Teufel, S. 2001. Columbia Multi-Document Summarization: Approach and Evaluation. Proceedings of Document Understanding Conference 2001, pages 43-63.
7. Mittal, V., Kantrowitz, M., Goldstein, J., and Carbonell, J. 1999. Selecting Text Spans for Document Summaries: Heuristics and Metrics. Proceedings of the 16th National Conference on Artificial Intelligence, pages 467-473.
8. Radev, D.R., Jing, H., and Budzikowska, M. 2000. Centroid-based Summarization of Multiple Documents: Sentence Extraction, Utility-based Evaluation, and User Studies. Proceedings of the ANLP/NAACL2000 Workshop on Automatic Summarization, pages 21-29.
9. Sparck-Jones, K. and Galliers, J. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review. Lecture Notes in Artificial Intelligence 1083, Berlin: Springer.