An information-theoretic approach to automatic evaluation of summaries

HLT-NAACL 2006 - Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, Proceedings of the Main Conference

Volumn , Issue , 2006, Pages 463-470

  Lin, Chin Yew ^a   Cao, Guihong ^b   Gao, Jianfeng ^c   Nie, Jian Yun ^b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

^c MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; TEXT PROCESSING;

AUTOMATIC EVALUATION; AUTOMATIC TEXT SUMMARIZATION; EVALUATION METHODS; INFORMATION-THEORETIC APPROACH; JENSEN-SHANNON DIVERGENCE; MULTIPLE DOCUMENTS; TURN-AROUNDS;

INFORMATION THEORY;

EID: 84863337556     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1220835.1220894     Document Type: Conference Paper

References (24)

1. Bai, Jing, Dawei Song, Peter Bruza, Jian-Yun Nie, and Guihong Cao 2005 Query Expansion Using Term Relationships in Language Models for Information Retrieval Proceedings of International Conference on Information and Knowledge Management (CIKM) 2005 October 31 - November 5, 2005, Bremen, Germany.
2. Berger, Adam and John Lafftery 1999 Information Retrieval as Statistical Translation Proceedings of ACM-SIGIR 1999 August 15-19, 1999, Berkeley, CA, USA.
3. Cao, Guihong, Jian-Yun Nie, and Jing Bai 2005 Integrating Word Relationships into Language Models Proceedings of SIGIR 2005 August 15-19, 2005, Salvador, Brazil.
4. th Annual Meeting on Association for Computational Linguistics, page 310-318, June 23-28, Santa Cruz, California, USA.
5. Dagan, Ido, Lillian Lee, and Fernado C N Pereira 1999 Similarity-Based Models of Word Cooccurrence Probability Machine Learning Vol 34, page 43-69, 1999.
6. Gao, Jianfeng, Jian-Yun Nie, Guangyuan Wu, and Guihong Cao 2004 Dependence Language Model for Information Retrieval Proceedings of SIGIR 2004 July 25-29, 2004, Sheffield, UK.
7. nd Edition Chapman & Hall/CRC.
8. Hofmann, Thomas 1999 Probabilistic Latent Semantic Indexing Proceedings of ACM-SIGIR 1999 August 15-19, 1999, Berkeley, CA, USA.
9. Hon, Chiori, Tsutomu Hirao, and Hideki Isozaki 2004 Evaluation Measures Considering Sentence Concatenation for Automatic Summarization by Sentence or Word Extraction Proceedings of Workshop on Text Summarization Branches Out July 25, 2004, Barcelona, Spain.
10. Kraay, Wessel, Martyn Spitters, and Martine van der Heijden 2001 Combining a Mixture Language Model and Naïve Bayes for Multi-Document Summarisation Proceedings of DUC 2001
11. Lafferty, John and Chiangxiang Zhai 2001 Document Language Models, Query Models, and Risk Minimization for Information Retrieval Proceedings of ACM-SIGIR 2001 September 9-13, 2001, New Orleans, LA, USA.
12. Larkey, Leah S, Fangfang Feng, Margaret Connell, and Victor Larvrenko 2004 Language-specific Models m Multilingual Topic Tracking Proceedings of ACM-SIGIR 2004 July 25-29, 2004 Sheffield, UK.
13. Lavrenko, Victor, James Allan, Edward DeGuzman, Daniel LaFlamme, Veera Pollard, and Stephen Thomas 2002 Relevance Models for Topic Detection and Tracking Proceedings of HLT 2002 March 24-27, 2002, San Diego, CA, USA.
14. Lavrenko, Victor and W Bruce Croft 2001 Relevance-Based Language Models Proceedings of ACM-SIGIR 2001 September 9-13, 2001, New Orleans, LA, USA.
15. Lin, Chin-Yew and Eduard Hovy 2003 Automatic Evaluation of Summaries Using N-gram Cooccurrence Statistics Proceedings of HLT-NAACL-2003 May 27-June 1, 2003, Edmonton, Canada.
16. Lin, Chin-Yew 2004 ROUGE: a Package for Automatic Evaluation of Summaries Proceedings of Workshop on Text Summarization 2004 July 21-26, 2004, Barcelona, Spain.
17. Lin, Jianhua 1991 Divergence Measures Based on the Shannon Entropy IEEE Transactions on Information Theory, 37(1), page 145-151, 1991.
18. Nenkova, Am and Rebecca Passonneau 2004 Evaluating Content Selection in Summarization: the Pyramid Method Proceedings of NAACL-HLT 2004 May 2-7, 2004, Boston, MA, USA.
19. th Annual Meeting of the Association for Computational Linguistics (ACL-2002), Philadelphia, USA, July 2002, page 311-318.
20. Ponte, Jay M and W Bruce Croft 1998 A language modeling approach to information retrieval Proceedings of ACM-SIGIR 1998, pages 275-281 August 24-28, 1998, Melbourne, Australia.
21. Rosenfeld, Ronald 2002 Two Decades of Statistical Language Modeling: Where do We Go from Here? Proceedings of IEEE.
22. Van Halteren, Hans and Simone Teufel 2003 Examining the Consensus between Human Summaries: Initial Experiments with Factoid Analysis Proceedings of Workshop on Text Summarization 2003 May 27-June 1, 2003, Edmonton, Canada.
23. Zaragoza, Hugo, Djoerd Hiemstra, and Michael Tipping 2003 Bayesian Extension to the Language Model for Ad Hoc Information Retrieval Proceedings of ACM-SIGIR 2003 July 28-August 1, 2003, Toronto, Canada.
24. Zhai, Chengxiang and John Lafferty 2004 A Study of Smoothing Methods for Language Models Applied to Information Retrieval ACM Transactions on Information Systems, Vol 22, No 2, April 2004, pages 179-214.