Automation of summary evaluation by the pyramid method

International Conference Recent Advances in Natural Language Processing, RANLP

Volumn 2005-January, Issue , 2005, Pages 226-232

  Harnly, Aaron ^a   Nenkova, Ani ^a   Passonneau, Rebecca ^a   Rambow, Owen ^b  

^a Department of Computer Science ^*  (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

AUTOMATED APPROACH; AUTOMATED EVALUATION; AUTOMATIC APPROACHES; CLUSTERINGS; DOCUMENT UNDERSTANDING; EXPERIMENTAL ENVIRONMENT; N-GRAMS; SHARED INFORMATION; SIMILARITY MEASURE; SUMMARIZATION SYSTEMS;

AUTOMATION;

EID: 84962641911     PISSN: 13138502     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (8)

1. (Banko & Vanderwende 04)Michele Banko and Lucy Vanderwende. Using n-grams to understand the nature of summaries. In Proceedings of HLT/NAACL'04, 2004.
2. (Halteren & Teufel 03) Hans Halteren and Simone Teufel. Examining the consensus between human summaries: initial experiments with factoid analysis. In HLTNAACL DUC Workshop, 2003.
3. (Lin & Hovy 02) Chin-Yew Lin and Eduard Hovy. Manual and automatic evaluation of summaries. In Proceedings of the Workshop on Automatic Summarization, post conference workshop of ACL 2002, 2002.
4. (Lin & Hovy 03) Chin-Yew Lin and Eduard Hovy. Automatic evaluation of summaries using n-gram cooccurance statistics. In Proceedings of HLT-NAACL 2003, 2003.
5. (Lin 04) Chin-Yew Lin. Rouge: A package for automatic evaluation of summaries. In Proceedings of the Workshop in Text Summarization, ACL'04, 2004.
6. (Nenkova & Passonneau 04) Ani Nenkova and Rebecca Passonneau. Evaluating content selection in summarization: The pyramid method. In Proceedings of HLT/NAACL 2004, 2004.
7. (Pastra & Saggion 03) Katerina Pastra and Horacio Saggion. Colouring summaries bleu. In EACL 2003, 2003.
8. (Saggion et al. 02) H. Saggion, D. Radev, S. Teufel, and W. Lam. Meta-evaluation of summaries in a cross lingual environment using content-based metrics. In International Conference on Computational Linguistics (COLING'02), 2002.