Probabilistic models for answer-ranking in multilingual question-answering

ACM Transactions on Information Systems

Volumn 28, Issue 3, 2010, Pages

  Ko, Jeongwoo ^a   Si, Luo ^b   Nyberg, Eric ^c   Mitamura, Teruko ^c  

^a GOOGLE INC   (United States)

^b PURDUE UNIVERSITY   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Answer selection; Answer merging; Answer ranking; Probabilistic graphical model; Question answering

Indexed keywords

ANSWER SELECTION; ANSWER-MERGING; ANSWER-RANKING; PROBABILISTIC GRAPHICAL MODELS; QUESTION ANSWERING;

FORMAL METHODS;

EID: 78649767995     PISSN: 10468188     EISSN: 15582868     Source Type: Journal    
DOI: 10.1145/1777432.1777439     Document Type: Article

References (54)

1. AHN, D., JIJKOUN, V., MISHA, G., MLLER, K., DE RIJKE, M., AND SCHLOBACH, S. 2004. Using Wikipedia at the TREC QA Track. In Proceedings of the Text Retrieval Conference.
2. ALLAN, J., WADE, C., AND BOLIVAR, A. 2003. Retrieval and novelty detection at the sentence level. In Proceedings of the ACM SIGIR Conference on Research and Development on Information Retrieval. ACM, New York.
3. ASLAM, J. AND MONTAGUE, M. 2001. Models for meta-search. In Proceedings of the ACM SIGIR Conference on Research and Development on Information Retrieval. ACM, New York.
4. BOS, J. AND NISSIM, M. 2006. Cross-lingual question answering by answer translation. In Working Notes of the Cross Language Evaluation Forum.
5. BRILL, E., DUMAIS, S., AND BANKO, M. 2002. An analysis of the AskMSR question answering system. In Proceedings of the Conference on Empirical Methods in Natural Language Processing.
6. BUSCALDI, D. AND ROSSO, P. 2006. Mining knowledge from Wikipedia for the question answering task. In Proceedings of the International Conference on Language Resources and Evaluation.
7. CARDIE, C., PIERCE, D., NG, V., AND BUCKLEY, C. 2000. Examining the role of statistical and linguistic knowledge sources in a general-knowledge question-answering system. In Proceedings of the 6th Applied Natural Language Processing Conference and the 1st Meeting of the North American Chapter of the Association for Computational Linguistics.
8. CHEN, H. H., LIN, C. C., AND LIN, W. C. 2000. Construction of a Chinese-English WordNet and its application to CLIR. In Proceedings of the 5th International Workshop on Information Retrieval with Asian Languages.
9. CHU-CARROLL, J., CZUBA, K., PRAGER, J., AND ITTYCHERIAH, A. 2003. In question answering, two heads are better than one. In Proceedings of the Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics.
10. CHU-CARROLL, J., CZUBA, K., PRAGER, J., ITTYCHERIAH, A., AND BLAIR-GOLDENSOHN, S. 2005. IBM's PIQUANT II in TREC2004. In Proceedings of the Text Retrieval Conference.
11. CLARKE, C., CORMACK, G., AND LYNAM, T. 2001. Exploiting redundancy in question answering. In Proceedings of the ACM SIGIR Conference on Research and Development on Information Retrieval.
12. DONG, Z. 2000. Hownet. http://www.keenage.com.
13. ECHIHABI, A., HERMJAKOB, U., HOVY, E., MARCU, D., MELZ, E., AND RAVICHANDRAN, D. 2004. How to select an answer string? In Advances in Textual Question Answering, Kluwer, Amsterdam.
14. FELLBAUM, C. 1998. WordNet: An Electronic Lexical Database. MIT Press, Cambridge, MA.
15. HARABAGIU, S., MOLDOVAN, D., CLARK, C., BOWDEN, M., WILLIAMS, J., AND BENSLEY, J. 2003. Answer mining by combining extraction techniques with abductive reasoning. In Proceedings of the Text Retrieval Conference.
16. HARABAGIU, S., MOLDOVAN, D., PASCA, M., MIHALCEA, R., SURDEANU, M., BUNSECU, R., GIRJU, R., RUS, V., AND MORARESCU, P. 2001. Falcon: Boosting knowledge for answer engines. In Proceedings of the Text Retrieval Conference.
17. HICKL, A., WILLIAMS, J., BENSLEY, J., ROBERTS, K., SHI, Y., AND RINK, B. 2007. Question answering with LCC's CHAUCER at TREC 2006. In Proceedings of the Text Retrieval Conference.
18. HINTON, G. AND SEJNOWSKI, T. J. 1986. Learning and relearning in Boltzmann machines. In Parallel Distributed Processing, 282-317.
19. HINTON, G. 2000. Training products of experts by minimizing contrastive divergence. Japanese on WordNet. http://nlpwww.nict.go.jp/wn-ja/index.en. html.
20. JARO, M. A. 1995. Probabilistic linkage of large public health data files. Stat. Medicine 14, 5-7, 491-498.
21. JIJKOUN, V., VAN RANTWIJK, J., AHN, D., SANG, E. T. K., AND DE RIJKE, M. 2006. The University of Amsterdam at CLEF@QA 2006. In Working Notes of the Cross Language Evaluation Forum.
22. JIJKOUN, V., KAMPS, J., MISHNE, G., MONZ, C., DE RIJKE, M., SCHLOBACH, S., AND TSUR, O. 2003. The University of Amsterdam at TREC 2003. In Proceedings of the Text Retrieval Conference.
23. KATZ, B., LIN, J. J., LORETO, D., HILDEBRANDT, W., BILOTTI, M., FELSHIN, S., FERNANDES, A., MARTON, G., AND MORA, F. 2003. Integrating web-based and corpus-based techniques for question answering. In Proceedings of the Text Retrieval Conference.
24. KO, J., SI, L., AND NYBERG, E. 2010. Combining evidence with a probabilistic framework for answer ranking and answer merging in question answering. Inform. Process, Manage. To appear.
25. KO, J., MITAMURA, T., AND NYBERG, E. 2007a. Language-independent probabilistic answer ranking for question. In Proceedings of the Association for Computational Linguistics.
26. KO, J., SI, L., AND NYBERG, E. 2007b. A probabilistic graphical model for joint answer ranking in question answering. In Proceedings of the ACM SIGIR Conference on Research and Development on Information Retrieval.
27. KWOK, C., ETZIONI, O., AND WELD, D. 2001. Scaling question answering to the Web. In Proceedings of the Text Retrieval Conference.
28. LIN, F., SHIMA, H., WANG, M., AND MITAMURA, T. 2005. CMU JAVELIN system for NTCIR5 CLQA1. In Proceedings of the 5th NTCIR Workshop (NII Test Collection for IR Systems).
29. LITA L. V., HUNT W., AND NYBERG E. 2004. Resource analysis for question answering. In Proceedings of the Annual Meeting of the Association for Computational Linguistics.
30. *IA.
31. MEI, J., ZHU, Y., GAO, Y., AND YIN, H. 1982. Tongyici Cilin. Shanghai Dictionary Press.
32. MINKA, T. 2003. A comparison of numerical optimizers for logistic regression. Unpublished draft.
33. MITAMURA, T., LIN, F., SHIMA, H., WANG, M., KO, J., BETTERIDGE, J., BILOTTI, M., SCHLAIKJER, A., AND NYBERG, E. 2007. JAVELIN III: Cross-lingual question answering from Japanese and Chinese documents. In Proceedings of the 6th NII Test Collection for IR Systems Workshop.
34. MOLDOVAN, D., CLARK, D., HARABAGIU, S., AND MAIORANO, S. 2003. Cogex: A logic prover for question answering. In Proceedings of Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics.
35. NYBERG, E., MITAMURA, T., FREDERKING, R., BILOTTI, M., HANNAN, K., HIYAKUMOTO, L., KO, J., LIN, F., PEDRO, V., AND SCHLAIKJER, A. 2006. JAVELIN I and II systems at TREC 2005. In Proceedings of Text Retrieval Conference.
36. NYBERG, E., MITAMURA, T., FREDERKING, R., PEDRO, V., BILOTTI, M., SCHLAIKJER, A., AND HANNAN, K. 2005. Extending the JAVELIN QA system with domain semantics. In Proceedings of the 20th National Conference on Artificial Intelligence.
37. NYBERG, E., MITAMURA, T., CARBONELL, J., CALLAN, J., FREDERKING, R., COLLINS-THOMPSON, K., HIYAKUMOTO, L., HUANG, Y., HUTTENHOWER, C., JUDY, S., KO, J., KUPSE, A., LITA, L., PEDRO, V., SVOBODA, D., AND VAN DURME, B. 2004. The JAVELIN question-answering system at TREC 2003: A multi-strategy approach with dynamic planning. In Proceedings of the Text Retrieval Conference.
38. NYBERG, E., MITAMURA, T., CARBONELL, J., CALLAN, J., COLLINS-THOMPSON, K., CZUBA, K., DUGGAN, M., HIYAKUMOTO, L., HU, N., HUANG, Y., KO, J., LITA, L., MURTAGH, S., PEDRO, V., AND SVOBODA, D. 2003. The JAVELIN question-answering system at TREC 2002. In Proceedings of the Text Retrieval Conference.
39. PEDRO, V. 2006. Federated ontology search. Thesis proposal.
40. PRAGER, J., BROWN, E., CODEN, A., AND RADEV, D. 2000. Question answering by predictive annotation. In Proceedings of the ACM SIGIR Conference on Research and Development on Information Retrieval. ACM, New York.
41. PRAGER, J., CHU-CARROLL, J., CZUBA, K., WELTY, C., ITTYCHERIAH, A., AND MAHINDRU, R. 2004. IBM's PIQUANT in TREC2003. In Proceedings of the Text Retrieval Conference.
42. RAVICHANDRAN, D., HOVY, E., AND OCH, F. J. 2003. Statistical QA-Classifier vs. Re-ranker: What's the difference? In Proceedings of the ACL Workshop on Multilingual Summarization and Question Answering.
43. SCHLOBACH, S., OLSTHOORN, M., AND DE RIJKE, M. 2004. Type checking in open-domain question answering. In Proceedings of the European Conference on Artificial Intelligence.
44. SI, L. 2006. Federated search of text search engines in uncooperative environments. Thesis.
45. SOBOROFF, I. 2005. Overview of the TREC 2004 novelty track. In Proceedings of the Text Retrieval Conference.
46. VOORHEES, E. 2003. Overview of the TREC 2003 question answering track. In Proceedings of the Text Retrieval Conference.
47. VOORHEES, E. 2002. Overview of the TREC 2002 question answering track. In Proceedings of the Text Retrieval Conference.
48. WANG, M., SAGAE, K., AND MITAMURA, T. 2006. A fast, accurate deterministic parser for Chinese. In Proceedings of the Joint Conference of the International Committee on Computational Linguistics and the Association for Computational Linguistics.
49. WINKLER, W. E. 1999. The state of record linkage and current research problems. Tech. rep., Statistical Research Division, U. S. Census Bureau, Washington, D. C.
50. XU, J., LICUANAN, A., MAY, J., MILLER, S., AND WEISCHEDEL, R. 2003. TREC 2002 QA at BBN: Answer selection and confidence estimation. In Proceedings of the Text Retrieval Conference.
51. YANG, H., CUI, H., MASLENNIKOV, M., QIU, L., KAN, M.-Y., AND CHUA, T.-S. 2003. QUALIFIER In TREC-12 QA main task. In Proceedings of the Text Retrieval Conference.
52. YANG, Y. AND LIU, X. 1999. A re-examination of text categorization methods. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, New York.
53. ZHOU, Z. AND LIU, X. 2006. Training cost-sensitive neural networks with methods addressing the class imbalance problem. IEEE Trans. Knowl. Data Engin. 18, 1, 63-77. (Pubitemid 43145089)
54. ZHU, H. AND HOVY, E. 2007. Active learning for word sense disambiguation with methods for addressing the class imbalance problem. In Proceedings of the Association for Computational Linguistics.