Combining evidence with a probabilistic framework for answer ranking and answer merging in question answering

Information Processing and Management

Volumn 46, Issue 5, 2010, Pages 541-554

  Ko, Jeongwoo ^a   Si, Luo ^b   Nyberg, Eric ^c  

^a GOOGLE INC   (United States)

^b PURDUE UNIVERSITY   (United States)

^c Carnegie Mellon University   (United States)

Author keywords

Answer merging; Answer ranking; Question answering

Indexed keywords

ANSWER RANKING; COLLECTION OF DOCUMENTS; EXTRACTION TECHNIQUES; FACTOID QUESTIONS; PROBABILISTIC FRAMEWORK; QA SYSTEM; QUESTION ANSWERING; RANKING PROCESS; RANKING STRATEGY;

COMBINES; INFORMATION RETRIEVAL SYSTEMS; MERGING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 77955418505     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2009.11.004     Document Type: Article

References (37)

1. Allan, J., Wade, C., & Bolivar, A. (2003). Retrieval and novelty detection at the sentence level. In: Proceedings of SIGIR.
2. Bilotti, M., Ogilvie, P., Callan, J., & Nyberg, E. (2007). Structured retrieval for question answering. In: Proceedings of SIGIR.
3. Chu-Carroll, J., Czuba, K., Prager, J., & Ittycheriah, A. (2003). In question answering, two heads are better than one. In: Proceedings of HLT/NAACL.
4. Chu-Carroll, J., Czuba, K., Prager, J., Ittycheriah, A., & Blair-Goldensohn, S. (2005). IBM's PIQUANT II in TREC2004. In: Proceedings of the text retrieval conference.
5. Clarke, C., Cormack, G., & Lynam, T. (2001). Exploiting redundancy in question answering. In: Proceedings of SIGIR.
6. Cohen, W., Ravikumar, P., & Fienberg, S. (2003). A comparison of string distance metrics for name-matching tasks. In: Proceedings of the IJCAI-2003 workshop on information integration on the Web.
7. Echihabi, A., Hermjakob, U., Hovy, E., Marcu, D., Melz, E., & Ravichandran, D. (2004). How to select an answer string? In: Strzalkowski, T., & Harabagiu, S. (Eds.), Advances in textual question answering. Kluwer.
8. C. Fellbaum WordNet: an electronic lexical database 1998 MIT Press
9. Fox, E., & Shaw, J. (1994). Combination of multiple searches. In: Proceedings of the text retrieval conference.
10. Harabagiu, S., Moldovan, D., Pasca, M., Mihalcea, R., Surdeanu, M., Bunsecu, R., et al. (2000). Falcon: boosting knowledge for answer engines. In: Proceedings of TREC.
11. Jijkoun, V., Kamps, J., Mishne, G., Monz, C., de Rijke, M., Schlobach, S., et al. (2004). The University of Amsterdam at TREC 2003. In: Proceedings of the text retrieval conference.
12. Jijkoun, V., van Rantwijk, J., Ahn, D., Tjong Kim Sang, E., & de Rijke, M. (2006). The University of Amsterdam at CLEF@QA 2006. Working Notes CLEF.
13. Ko, J., Si, L., & Nyberg, E. (2007a). A probabilistic framework for answer selection in question answering. In: Proceedings of NAACL/HLT.
14. Ko, J., Si, L., & Nyberg, E. (2007b). A probabilistic graphical model for joint answer ranking in question answering. In: Proceedings of SIGIR.
15. Kupiec, J. (1993). MURAX: a robust linguistic approach for question-answering using an on-line encyclopedia. In: Proceedings of ACM SIGIR conference on research and development on information retrieval.
16. Kwok, C., Etzioni, O., & Weld, D. (2001). Scaling question answering to the Web. In: Proceedings of the text retrieval conference.
17. Lin, J., & Katz, B. (2003). Question answering from the Web using knowledge annotation and knowledge mining techniques. In: Proceedings of the text retrieval conference.
18. Magnini, B., Negri, M., Pervete, R., & Tanev, H. (2002). Comparing statistical and content-based techniques for answer validation on the Web. In: Proceedings of the VIII Convegno AI*IA.
19. Manmatha, R., & Sever, H. (2002). A formal approach to score normalization for metasearch. In: Proceedings of HLT.
20. Minka, T. (2003). A comparison of Numerical Optimizers for Logistic Regression. Unpublished draft.
21. Moldovan, D., Clark, D., Harabagiu, S., & Maiorano, S. (2003). Cogex: a logic prover for question answering. In: Proceedings of HLT-NAACL.
22. Nyberg, E., Mitamura, T., Carbonell, J., Callan, J., Collins-Thompson, K., Czuba, K., et al. (2003). The JAVELIN question-answering system at TREC 2002. In: Proceedings of the text retrieval conference.
23. Nyberg, E., Mitamura, T., Callan, J., Carbonell, J., Frederking, R., Collins-Thompson, K., et al. (2004). A multi-strategy approach with dynamic planning. In: Proceedings of the text retrieval conference.
24. Nyberg, E., Mitamura, T., Frederking, R., Pedro, V., Bilotti, M., Schlaikjer, A., et al. (2005). Extending the javelin qa system with domain semantics. In: Proceedings of the 20th national conference on artificial intelligence.
25. Nyberg, E., Mitamura, T., Frederking, R., Bilotti, M., Hannan, K., Hiyakumoto, et al. (2006). JAVELIN I and II systems at TREC 2005. In: Proceedings of Text REtrieval Conference.
26. Prager, J., Brown, E., Coden, A., & Radev, D. (2000). Question answering by predictive annotation. In: Proceedings of SIGIR.
27. Prager, J., Chu-Carroll, J., Czuba, K., Welty, C., Ittycheriah, A., & Mahindru, R. (2004). IBM's PIQUANT in TREC2003. In: Proceedings of text retrieval conference.
28. Prager, J., Luger, S., & Chu-Carroll, J. (2007). Type nanotheories: a framework for term comparison. In: Proceedings of CIKM.
29. Ravichandran, D., Hovy, E., & Och, F.J. (2003). Statistical QA - classifier vs. re-ranker: what's the difference? In: Proceedings of the ACL workshop on multilingual summarization and question answering.
30. Savoy, J., & Berger, P.-Y. (2004). Selection and merging strategies for multilingual information retrieval. In: Proceedings of cross-language evaluation forum.
31. Schlaefer, N., Gieselman, P., & Sautter, G. (2007). The Ephyra QA system at TREC 2006. In: Proceedings of the text retrieval conference.
32. Schlaefer, N., Ko, J., Betteridge, J., Pathak, M., Nyberg, E., & Sautter, G. (2008). Semantic extensions of the Ephyra QA system for TREC 2007. In: Proceedings of the text retrieval conference.
33. Schlobach, S., Olsthoorn, M., & de Rijke, M. (2004). Type checking in open-domain question answering. In: Proceedings of European conference on artificial intelligence.
34. L. Si, J. Callan, S. Cetintas, and H. Yuan An effective and efficient results merging strategy for multilingual information retrieval in federated search environments Information Retrieval 11 1 2008 1 24
35. Voorhees, E. (2003). Overview of the TREC 2002 question answering track. In: Proceedings of text retrieval conference.
36. Voorhees, E. (2004). Overview of the TREC 2003 question answering track. In: Proceedings of text retrieval conference.
37. Xu, J., Licuanan, A., May, J., Miller, S., & Weischedel, R. (2003). TREC 2002 QA at BBN: answer selection and confidence estimation. In: Proceedings of text retrieval conference.