Will pyramids built of nuggets topple over?

HLT-NAACL 2006 - Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, Proceedings of the Main Conference

Volumn , Issue , 2006, Pages 383-390

  Lin, Jimmy ^a   Demner Fushman, Dina ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

COMPLEX QUESTIONS; EVALUATION FLOW; F-SCORE; HARMONIC MEAN; RECALL AND PRECISION; SCORING MODELS; TEST SETS;

COMPUTATIONAL LINGUISTICS;

EID: 84863367339     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1220835.1220884     Document Type: Conference Paper

References (10)

1. Enrique Amigó, Julio Gonzalo, Victor Peinado, Anselmo Peñas, and Felisa Verdejo. 2004. An empirical study of information synthesis task. In Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL 2004).
2. Hoa Dang. 2005. Overview of DUC 2005. In Proceed- ings of the 2005 Document Understanding Conference (DUC 2005) at NLT/EMNLP 2005.
3. Wesley Hildebrandt, Boris Katz, and Jimmy Lin. 2004. Answering definition questions with multiple knowledge sources. In Proceedings of the 2004 Human Language Technology Conference and the North American Chapter of the Association for Computational Linguistics Annual Meeting (HLT/NAACL 2004).
4. Jimmy Lin and Dina Demner-Fushman. 2005a. Automatically evaluating answers to definition questions. In Proceedings of the 2005 Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP 2005).
5. Jimmy Lin and Dina Demner-Fushman. 2005b. Evaluating summaries and answers: Two sides of the same coin? In Proceedings of the ACL 2005 Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and/or Summarization.
6. Chin-Yew Lin and Eduard Hovy. 2003. Automatic evaluation of summaries using n-gram co-occurrence statistics. In Proceedings of the 2003 Human Language Technology Conference and the North American Chapter of the Association for Computational Linguistics Annual Meeting (HLT/NAACL 2003).
7. Ani Nenkova and Rebecca Passonneau. 2004. Evaluating content selection in summarization: The pyramid method. In Proceedings of the 2004 Human Language Technology Conference and the North American Chapter of the Association for Computational Linguistics Annual Meeting (HLT/NAACL 2004).
8. Ellen M. Voorhees. 1998. Variations in relevance judgments and the measurement of retrieval effectiveness. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 1998).
9. Ellen M. Voorhees. 2003. Overview of the TREC 2003 question answering track. In Proceedings of the Twelfth Text REtrieval Conference (TREC 2003).
10. Ellen M. Voorhees. 2005. Using question series to evaluate question answering system effectiveness. In Proceedings of the 2005 Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP 2005).