Automatically evaluating answers to definition questions

HLT/EMNLP 2005 - Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2005, Pages 931-938

  Lin, Jimmy ^a   Demner Fushman, Dina ^a,b  

^a UNIVERSITY OF MARYLAND   (United States)

^b NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC EVALUATION; AUTOMATIC METHOD; DEFINITION QUESTIONS; DOCUMENT SUMMARIZATION; MACHINE TRANSLATIONS; QA TRACKS; SCORING SYSTEMS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80053290782     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1220575.1220692     Document Type: Conference Paper

References (11)

1. Bogdan Babych and Anthony Hartley. 2004. Extending the BLEU MT evaluation method with frequency weightings. In Proc. of ACL 2004.
2. Siddhartha Chib and Edward Greenberg. 1995. Understanding the Metropolis-Hastings algorithm. American Statistician, 49(4):329-345.
3. Wesley Hildebrandt, Boris Katz, and Jimmy Lin. 2004. Answering definition questions with multiple knowledge sources. In Proc. of HLT/NAACL 2004.
4. Chin-Yew Lin and Eduard Hovy. 2003. Automatic evaluation of summaries using n-gram co-occurrence statistics. In Proc. of HLT/NAACL 2003.
5. Chin-Yew Lin and Franz Josef Och. 2004. ORANGE: A method for evaluating automatic evaluation metrics for machine translation. In Proc. of COLING 2004.
6. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In Proc. of ACL 2002.
7. John Prager, Jennifer Chu-Carroll, and Krzysztof Czuba. 2004. Question answering using constraint satisfaction: QA-by-Dossier-with-Constraints. In Proc. of ACL 2004.
8. Radu Soricut and Eric Brill. 2004. A unified framework for automatic evaluation using n-gram co-occurrence statistics. In Proc. of ACL 2004.
9. Ellen M. Voorhees. 2000. Variations in relevance judgments and the measurement of retrieval effectiveness. Information Processing and Management, 36(5):697- 716.
10. Ellen M. Voorhees. 2003. Overview of the TREC 2003 question answering track. In Proc. of TREC 2003.
11. Jinxi Xu, Ralph Weischedel, and Ana Licuanan. 2004. Evaluation of an extraction-based approach to answering definition questions. In Proc. of SIGIR 2004.