ParaEval: Using paraphrases to evaluate summaries automatically

HLT-NAACL 2006 - Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, Proceedings of the Main Conference

Volumn , Issue , 2006, Pages 447-454

  Zhou, Liang ^a   Lin, Chin Yew ^a   Munteanu, Dragos Stefan ^a   Hovy, Eduard ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATED EVALUATION; GREEDY SEARCH; HUMAN JUDGMENTS; MACHINE TRANSLATIONS; PARALLEL CORPORA;

COMPUTATIONAL LINGUISTICS;

QUALITY CONTROL;

EID: 84863353127     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Bannard, C. and C. Callison-Burch. 2005. Paraphrasing with bilingual parallel corpora. Proceedings of ACL-2005.
2. Barzilay, R. and K. McKeown. 2001. Extracting paraphrases from a parallel corpus. Proceedings of ACL/EACL-2001.
3. Brown, P. F., S. A. Della Pietra, V. J. Della Pietra, R. L. Mercer. 1993. The mathematics of machine translation: Parameter estimation. Computational Linguistics, 19(2): 263 - 311, 1993.
4. Cohen, J. 1960. A coefficient of agreement for nominal scales. Education and Psychological Measurement, 43(6):37 - 46.
5. Diab, M. and P. Resnik. 2002. An unsupervised method for word sense tagging using parallel corpora. Proceedings of ACL-2002.
6. DUC. 2001 - 2005. Document Understanding Conferences.
7. Hermjakob, U., A. Echihabi, and D. Marcu. 2002. Natural language based reformulation resource and web exploitation for question answering. Proceedings of TREC-2002.
8. Hovy, E, C.Y. Lin, and L. Zhou. 2005. Evaluating DUC 2005 using basic elements. Proceedings of DUC-2005.
9. Hovy, E., C.Y. Lin, L. Zhou, and J. Fukumoto. 2005a. Basic Elements. http://www.isi.edu/~cyl/BE.
10. Lin, C.Y. 2001. http://www.isi.edu/~cyl/SEE.
11. Lin, C.Y. and E. Hovy. 2003. Automatic evaluation of summaries using n-gram co-occurrence statistics. Proceedings of the HLT-2003.
12. Miller, G.A., R. Beckwith, C. Fellbaum, D. Gross, and K. J. Miller. 1990. Introduction to WordNet: An on-line lexical database. International Journal of Lexicography, 3(4): 235 - 245.
13. Nenkova, A. and R. Passonneau. 2004. Evaluating content selection in summarization: the pyramid method. Proceedings of the HLT-NAACL 2004.
14. Och, F. J. and H. Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1): 19-51, 2003. (Pubitemid 37049767)
15. Och, F. J. and H. Ney. 2004. The alignment template approach to statistical machine translation. Computational Linguistics, 30(4), 2004.
16. Pang, B., K. Knight and D. Marcu. 2003. Syntax-based alignment of multiple translations: extracting paraphrases and generating new sentences. Proceedings of HLT/NAACL-2003.
17. Papineni, K., S. Roukos, T. Ward, and W. J. Zhu. IBM research report Bleu: a method for automatic evaluation of machine translation IBM Research Division Technical Report, RC22176, 2001.
18. Trick, M. A. 1997. A tutorial on dynamic programming.http://mat.gsia.cmu. edu/classes/dynamic/dynamic.html.
19. Van Halteren, H. and S. Teufel. 2003. Examining the consensus between human summaries: initial experiments with factoid analysis. Proceedings of HLT-2003.