Nuggeteer: Automatic nugget-based evaluation using descriptions and judgements

HLT-NAACL 2006 - Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, Proceedings of the Main Conference

Volumn , Issue , 2006, Pages 375-382

  Marton, Gregory ^a   Radul, Alexey ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC EVALUATION; AUTOMATIC EVALUATION TOOL; HUMAN ASSESSORS; HUMAN EVALUATION; SYSTEM DEVELOPMENT; SYSTEM RESPONSE;

COMPUTATIONAL LINGUISTICS;

EID: 84858396960     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (7)

1. Eric J. Breck, John D. Burger, Lisa Ferro, Lynette Hirschman, David House, Marc Light, and Inderjeet Mani. 2000. How to evaluate your question answering system every day ⋯ and still get real work done. In Proceedings of the second international conference on Language Res ources and Evaluation (LREC2000).
2. Jimmy Lin and Dina Demner-Fushman. 2005. Automatically evaluating answers to definition questions. In Proceedings of HLT-EMNLP.
3. Jimmy Lin and Dina Demner-Fushman. 2006. Will pyramids built of nuggets topple over? In Proceedings of HLT-NAACL.
4. Jimmy Lin, Eileen Abels, Dina Demner-Fushman, Douglas W. Oard, Philip Wu, and Yejun Wu. 2005. A menagerie of tracks at maryland: HARD, Enterprise, QA, and Genomics, oh my! In Proceedings of TREC.
5. Ellen Voorhees. 2003. Overview of the TREC 2003 question answering track.
6. Ellen Voorhees. 2004. Overview of the TREC 2004 question answering track.
7. Ellen Voorhees. 2005. Overview of the TREC 2005 question answering track.