A semi-automatic evaluation scheme: Automated nuggetization for manual annotation

NAACL-HLT 2007 - Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, Companion Volume: Short Papers

Volumn , Issue , 2007, Pages 217-220

  Zhou, Liang ^a   Kwon, Namhee ^a   Hovy, Eduard ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANNOTATION SCHEME; AUTOMATIC EVALUATION; AUTOMATIC INFORMATION; EVALUATION SCHEME; GOLD STANDARDS; ITS APPLICATIONS; MANUAL ANNOTATION; SEMI-AUTOMATIC ANNOTATION; SEMI-AUTOMATICS;

EID: 85066445998     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (7)

1. Collins, M. 1999. Head-driven statistical models for natural language processing. PhD Dissertation, University of Pennsylvania.
2. Hamly, A., A. Nenkova, R. Passonneau, and O. Rambow. 2005. Automation of summary evaluation by the pyramid method. In Proceedings of RANLP.
3. Lin, C.Y. and E. Hovy. 2003. Automatic evaluation of summaries using n-gram co-occurrence statistics. In Proceedings of NAACL-HLT.
4. Lin, J. and D. Demner-Fushman. 2005. Automatically evaluating answers to definition questions. In Proceedings of HLT-EMNLP.
5. Marton, G. and A. Radul. 2006. Nuggeteer: automatic nugget-based evaluation using description and judgments. In Proceedings NAACL-HLT.
6. Nenkova, A. and R. Passonneau. 2004. Evaluating content selection in summarization: the pyramid method. In Proceedings NAACL-HLT.
7. NIST. 2001-2007. Document Understanding Conference. www-nlpir.nist.gov/projects/duc/index.html.