Finding needles in the haystack: Search and candidate generation

IBM Journal of Research and Development

Volumn 56, Issue 3-4, 2012, Pages

  Chu Carroll, J ^a   Fan, J ^a   Boguraev, B K ^a   Carmel, D ^b   Sheinwald, D ^b   Welty, C ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b IBM HAIFA RESEARCH LAB   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

BLIND TEST; CANDIDATE GENERATION; HYPOTHESIS GENERATION; KNOWLEDGE RESOURCE; KNOWLEDGE SOURCES; QUESTION ANSWERING; SEARCH QUERIES; SYSTEM RESPONSE; TWO-COMPONENT;

COMPUTER SCIENCE; RESEARCH;

METADATA;

EID: 84859820580     PISSN: 00188646     EISSN: 21518556     Source Type: Journal    
DOI: 10.1147/JRD.2012.2186682     Document Type: Review

References (39)

1. J. W. Murdock, J. Fan, A. Lally, H. Shima, and B. K. Boguraev, "Textual evidence gathering and analysis," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 8, pp. 8:1-8:14, May/Jul. 2012.
2. J. W. Murdock, A. Kalyanpur, C. Welty, J. Fan, D. A. Ferrucci, D. C. Gondek, L. Zhang, and H. Kanayama, "Typing candidate answers using type coercion," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 7, pp. 7:1-7:13, May/Jul. 2012.
3. A. Kalyanpur,B. K. Boguraev, S. Patwardhan, J. W. Murdock, A. Lally, C. Welty, J. M. Prager,B. Coppola, A. Fokoue-Nkoutche, L. Zhang, Y. Pan, and Z. M. Qiu, "Structured data and inference in DeepQA," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 10, pp. 10:1-10:14, May/Jul. 2012.
4. C. Wang, A. Kalyanpur, J. Fan,B. K. Boguraev, and D. C. Gondek, "Relation extraction and scoring in DeepQA," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 9, pp. 9:1-9:12, May/Jul. 2012.
5. D. C. Gondek, A. Lally, A. Kalyanpur, J. W. Murdock, P. Duboue, L. Zhang, Y. Pan, Z. M. Qiu, and C. Welty, "A framework for merging and ranking of answers in DeepQA," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 14, pp. 14:1-14:12, May/Jul. 2012.
6. A. Lally, J. M. Prager, M. C. McCord,B. K. Boguraev, S. Patwardhan, J. Fan, P. Fodor, and J. Chu-Carroll, "Question analysis: How Watson reads a clue," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 2, pp. 2:1-2:14, May/Jul. 2012.
7. J. M. Prager, E. W. Brown, and J. Chu-Carroll, "Special questions and techniques," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 11, pp. 11:1-11:13, May/Jul. 2012.
8. M. C. McCord, J. W. Murdock, and B. K. Boguraev, "Deep parsing in Watson," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 3, pp. 3:1-3:15, May/Jul. 2012.
9. D. A. Ferrucci, "Introduction to FThis is Watson," ' IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 1, pp. 1:1-1:15, May/Jul. 2012.
10. J. Chu-Carroll, J. Fan, N. Schlaefer, and W. Zadrozny, "Textual resource acquisition and engineering," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 4, pp. 4:1-4:11, May/Jul. 2012.
11. S. Tellex,B. Katz, J. Lin, A. Fernandes, and G. Marton, "Quantitative evaluation of passage retrieval algorithms for question answering," in Proc. 26th ACM SIGIR Conf. Res. Develop. Inform. Retrieval, 2003, pp. 41-47.
12. J. Chu-Carroll and J. Fan, "Leveraging Wikipedia characteristics for search and candidate generation in question answering," in Proc. 25th Conf. AAAI, 2011, pp. 872-877.
13. Indri Search Engine. [Online]. Available: http://www.lemurproject. org/indri.php.
14. Apache Lucene. [Online]. Available: http://lucene.apache.org.
15. D. Metzler and W. B. Croft, "Combining the language model and inference network approaches to retrieval," Inform. Process. Manage. Special Issue Bayesian Netw. Inform. Retrieval, vol. 40, no. 5, pp. 735-750, Sep. 2004.
16. E. Hatcher and O. Gospodnetic, Lucene in Action. Greenwich, CT: Manning Publ. Co., 2004.
17. D. Cohen, E. Amitay, and D. Carmel, "Lucene and Juru at TREC 2007: 1-Million queries track," presented at the Text REtrieval Conf., Gaithersburg, MD, 2007, Special Publ. 500-274.
18. D. Carmel, E. Farchi, Y. Petruschka, and A. Soffer, "Automatic query refinement using lexical affinities with maximal information gain," in Proc. 25th ACM SIGIR Conf. Res. Develop. Inform. Retrieval, 2002, pp. 283-290.
19. DBPedia. [Online]. Available: http://www.dbpedia.org.
20. J. Fan, A. Kalyanpur, D. C. Gondek, and D. A. Ferrucci, "Automatic knowledge extraction from documents," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 5, pp. 5:1-5:10, May/Jul. 2012.
21. Internet Movie Database. [Online]. Available: http://www.imdb. com.
22. FreeBase. [Online]. Available: http://www.freebase.com/.
23. J. Prager, J. Chu-Carroll, E. Brown, and K. Czuba, "Question answering using predictive annotation," in Advances in Open-Domain Question Answering, T. Strzalkowski and S. Harabagiu, Eds. Norwell, MA: Kluwer, 2006, pt. 4, pp. 307-347.
24. J. Prager, E. Brown, A. Coden, and D. Radev, "Question answering by predictive annotation," in Proc. ACM SIGIR Conf. Res. Develop. Inform. Retrieval, 2000, pp. 184-191.
25. D. Moldovan, S. Harabagiu, M. Pasca, R. Mihalcea, R. Girju, R. Goodrum, and V. Rus, "The structure and performance of an open-domain question answering system," in Proc. 38th Annu. Meeting Assoc. Comput. Linguistics, 2000, pp. 563-570.
26. J. Chu-Carroll, E. W. Brown, A. Lally, and J. W. Murdock, "Identifying implicit relationships," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 12, pp. 12:1-12:10, May/Jul. 2012.
27. E. Rich, Artificial Intelligence. New York: McGraw-Hill, 1991.
28. R. V. Guha and D. B. Lenat, "CYC: A mid-term report," AI Mag., vol. 11, no. 3, pp. 32-59, 1990.
29. B. Katz, G. Marton, G. Borchardt, A. Brownell, S. Felshin, D. Loreto, J. Louis-Rosenberg,B. Lu, F. Mora, S. Stiller, O. Uzuner, and A. Wilcox, "External knowledge sources for question answering," presented at the 14th Annual Text REtrieval Conf. (TREC), Gaithersburg, MD, 2005. [Online]. Available: http://www.mendeley.com/research/external-knowledge-sourcesquestion- answering/.
30. B. Katz and J. Lin, "REXTOR: A system for generating relations from natural language," in Proc. ACL 2000 Workshop NLP&IR, 2000, pp. 67-77.
31. D. Gunning, V. Chaudhri, P. Clark, K. Barker, S. Chaw, M. Greaves,B. Grosof, A. Leung, D. McDonald, S. Mishra, J. Pacheco,B. Porter, A. Spaulding, D. Tecuci, and J. Tien. (2010). Project Halo updateVProgress toward digital Aristotle. AI Mag. [Online]. 31(3). Available: http://www.cs.utexas.edu/users/ pclark/papers/AURA-AIMag.pdf.
32. C. Clark, G. Cormack, T. Lynam, C. Li, and G. McLearn, "Web reinforced question answering (MultiText Experiments for TREC 2001)," in Proc. Text REtrieval Conf., 2001, pp. 673-679. [Online]. Available: http://trec.nist.gov/pubs/trec10/papers/mtA.pdf.
33. S. Dumais, M. Banko, E. Brill, J. Lin, and A. Ng, "Web question answering: Is more always better?[ in Proc. 25th ACM SIGIR Conf. Res. Develop. Inform. Retrieval, 2002, pp. 291-298.
34. B. Katz, J. Lin, D. Loreto, W. Hildebrandt, M. Bilotti, S. Felshin, A. Fernandes, G. Marton, and F. Mora, "Integrating web-based and corpus-based techniques for question answering," in Proc. 12th Text REtrieval Conf., 2003, pp. 426-435.
35. B. Magnini, M. Negri, R. Prevete, and H. Tanev, "Is it the right answer?: Exploiting web redundancy for answer validation," in Proc. 40th Annu. Meeting Assoc. Comput. Linguistics, 2002, pp. 425-432.
36. J. Ko, L. Si, and E. Nyberg, "A probabilistic framework for answer selection in question answering," in Proc. NAACL-HLT, 2007, pp. 524-531.
37. J. Kupiec, "MURAX: A robust linguistic approach for question answering using an online encyclopedia," in Proc. ACM SIGIR Conf. Res. Develop. Inform. Retrieval, 1993, pp. 181-190.
38. D. Ahn, V. Jijkoun, G. Mishne, K. Muller, M. de Rijke, and S. Schlobach, "Using Wikipedia at the TREC QA track," in Proc. Text REtrieval Conf., 2004. [Online]. Available: http://www. mendeley.com/research/using-wikipedia- in-the-trec-qa-track/.
39. D. Giampiccolo, P. Froner, A. Penas, C. Ayaache, D. Cristea, V. Jijkoun, P. Osenova, P. Rocha,B. Sacaleanu, and R. Suteliffe, "Overview of the CLEF 2007 multilingual QA track," in Advances in Multilingual and Multimodal Information Retrieval, C. Peters, V. Jijkoun, T. Mandl, M. Henning, D. W. Oard, P. Anselmo, V. Petras, and D. Santos, Eds. Berlin, Germany: Springer-Verlag, 2007, pp. 200-236.