Evaluation challenges in large-scale document summarization

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn 2003-July, Issue , 2003, Pages

  Radev, Dragomir R ^a   Lam, Wai ^b   Çelebi, Arda ^c   Teufel, Simone ^d   Blitzer, John ^e   Liu, Danyu ^f   Saggion, Horacio ^g   Qi, Hong ^a   Drabek, Elliott ^h  

^a UNIVERSITY OF MICHIGAN   (United States)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c ISI

^d UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^e UNIVERSITY OF PENNSYLVANIA   (United States)

^f U of Alabama   (United States)

^g UNIVERSITY OF SHEFFIELD   (United Kingdom)

^h JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ABSTRACTING; DEEP LEARNING;

DOCUMENT SUMMARIZATION; EVALUATION MEASURES; EVALUATION METHODS; LARGE-SCALES; MULTIDOCUMENTS; QUANTITATIVE RESULT;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84941164475     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Ron Brandow, Karl Mitze, and Lisa F. Rau. 1995. Automatic Condensation of Electronic Publications by Sentence Selection. Information Processing and Management, 31(5):675-685.
2. Jean Carletta. 1996. Assessing Agreement on Classification Tasks: The Kappa Statistic. CL, 22(2):249-254.
3. Maxime Crochemore and Wojciech Rytter. 1994. Text Algorithms. Oxford University Press.
4. William A. Gale and Kenneth W. Church. 1993. A program for aligning sentences in bilingual corpora. Computational Linguistics, 19(1):75-102.
5. Donna Harman and Daniel Marcu, editors. 2001. Proceedings of the 1st Document Understanding Conference. New Orleans, LA, September.
6. Eduard Hovy and Chin Yew Lin. 1999. Automated Text Summarization in SUMMARIST. In Inderjeet Mani and Mark T. Maybury, editors, Advances in Automatic Text Summarization, pages 81-94. The MIT Press.
7. Klaus Krippendorff. 1980. Content Analysis: An Introduction to its Methodology. Sage Publications, Beverly Hills, CA.
8. Inderjeet Mani and Eric Bloedorn. 2000. Summarizing Similarities and Differences Among Related Documents. Information Retrieval, 1(1).
9. Inderjeet Mani, Thérèse Firmin, David House, Gary Klein, Beth Sundheim, and Lynette Hirschman. 2001. The TIPSTER SUMMAC Text Summarization Evaluation. In Natural Language Engineering.
10. Dragomir R. Radev, Hongyan Jing, and Malgorzata Budzikowska. 2000. Centroid-Based Summarization of Multiple Documents: Sentence Extraction, Utility-Based Evaluation, and User Studies. In Proceedings of the Workshop on Automatic Summarization at the 6th Applied Natural Language Processing Conference and the 1st Conference of the North American Chapter of the Association for Computational Linguistics, Seattle, WA, April.
11. Horacio Saggion. 2000. Génération automatique de résumés par analyse sélective. Ph.D. thesis, Département d'informatique et de recherche opérationnelle. Faculté des arts et des sciences. Université de Montréal, August.
12. Gerard Salton. 1988. Automatic Text Processing. Addison-Wesley Publishing Company.
13. Sidney Siegel and N. John Jr. Castellan. 1988. Nonparametric Statistics for the Behavioral Sciences. McGraw-Hill, Berkeley, CA, 2nd edition.
14. Karen Sparck-Jones and Tetsuya Sakai. 2001. Generic Summaries for Indexing in IR. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 190-198, New Orleans, LA, September.
15. Simone Teufel and Marc Moens. 1997. Sentence Extraction as a Classification Task. In Proceedings of the Workshop on Intelligent Scalable Text Summarization at the 35th Meeting of the Association for Computational Linguistics, and the 8th Conference of the European Chapter of the Assocation for Computational Linguistics, Madrid, Spain.
16. Anastasios Tombros, Mark Sanderson, and Phil Gray. 1998. Advantages of Query Biased Summaries in Information Retrieval. In Eduard Hovy and Dragomir R. Radev, editors, Proceedings of the AAAI Symposium on Intelligent Text Summarization, pages 34-43, Stanford, California, USA, March 23-25,. The AAAI Press.