Is question answering better than information retrieval? Towards a task-based evaluation framework for question series

NAACL HLT 2007 - Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference

Volumn , Issue , 2007, Pages 212-219

  Lin, Jimmy ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EVALUATION FRAMEWORK; INFORMATION NEED; QA SYSTEM; QUESTION ANSWERING; TASK-BASED; TEXT SEGMENTS;

COMPUTATIONAL LINGUISTICS; INFORMATION RETRIEVAL;

TECHNOLOGY;

EID: 84863337734     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Regina Barzilay, Kathleen R. McKeown, and Michael Elhadad. 1999. Information fusion in the context of multi-document summarization. In Proc. of ACL 1999.
2. Charles Clarke, Gordon Cormack, and Thomas Lynam. 2001. Exploiting redundancy in question answering. In Proc. of SIGIR 2001.
3. Hoa Trang Dang, Jimmy Lin, and Diane Kelly. 2006. Overview of the TREC 2006 question answering track. In Proc. of TREC 2006.
4. Hoa Dang. 2005. Overview of DUC 2005. In Proc. of DUC 2005.
5. Jade Goldstein, Mark Kantrowitz, Vibhu Mittal, and Jaime Carbonell. 1999. Summarizing text documents: Sentence selection and evaluation metrics. In Proc. of SIGIR 1999.
6. Tsuneaki Kato, Jun'ichi Fukumoto, Fumito Masui, and Noriko Kando. 2004. Handling information access dialogue through QA technologies - a novel challenge for open-domain question answering. In Proc. of the HLT-NAACL 2004 Workshop on Pragmatics of Question Answering.
7. Jimmy Lin and Dina Demner-Fushman. 2005. Automatically evaluating answers to definition questions. In Proc. of HLT/EMNLP 2005.
8. Jimmy Lin and Dina Demner-Fushman. 2006. Will pyramids built of nuggets topple over? In Proc. of HLT/NAACL 2006.
9. Jimmy Lin, Dennis Quan, Vineet Sinha, Karun Bakshi, David Huynh, Boris Katz, and David R. Karger. 2003. What makes a good answer? The role of context in question answering. In Proc. of INTERACT 2003.
10. Ani Nenkova and Rebecca Passonneau. 2004. Evaluating content selection in summarization: The pyramid method. In Proc. of HLT/NAACL 2004.
11. Sharon Small, Tomek Strzalkowski, Ting Liu, Sean Ryan, Robert Salkin, Nobuyuki Shimizu, Paul Kantor, Diane Kelly, Robert Rittman, and Nina Wacholder. 2004. HITIQA: towards analytical question answering. In Proc. of COLING 2004.
12. Stefanie Tellex, Boris Katz, Jimmy Lin, Gregory Marton, and Aaron Fernandes. 2003. Quantitative evaluation of passage retrieval algorithms for question answering. In Proc. of SIGIR 2003.
13. Ellen M. Voorhees and Dawn M. Tice. 1999. The TREC-8 question answering track evaluation. In Proc. of TREC-8.
14. Ellen M. Voorhees. 2003. Overview of the TREC 2003 question answering track. In Proc. of TREC 2003.
15. Ellen M. Voorhees. 2004. Overview of the TREC 2004 question answering track. In Proc. of TREC 2004.
16. Ellen M. Voorhees. 2005. Using question series to evaluate question answering system effectiveness. In Proc. of HLT/EMNLP 2005.
17. Justin Zobel, Alistair Moffat, and Ross Wilkinson Ron Sacks-Davis. 1995. Efficient retrieval of partial documents. IPM, 31(3):361-377.