Question analysis: How Watson reads a clue

IBM Journal of Research and Development

Volumn 56, Issue 3-4, 2012, Pages

  Lally, A ^a   Prager, J M ^a   McCord, M C ^a   Boguraev, B K ^a   Patwardhan, S ^a   Fan, J ^a   Fodor, P ^b   Chu Carroll, J ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b Stony Brook University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CRITICAL ELEMENTS; DETECTION RULES; NAMED ENTITIES; QUESTION ANALYSIS; QUESTION ANSWERING SYSTEMS; RELATION EXTRACTION; SEMANTIC ANALYSIS;

ARTIFICIAL INTELLIGENCE; SEMANTICS;

FORMAL LANGUAGES;

EID: 84859843760     PISSN: 00188646     EISSN: 21518556     Source Type: Journal    
DOI: 10.1147/JRD.2012.2184637     Document Type: Review

References (30)

1. J. W. Murdock, J. Fan, A. Lally, H. Shima, and B. K. Boguraev, "Textual evidence gathering and analysis," IBM J. Res. Develop., vol. 56, no. 3/4, Paper 8, pp. 8:1-8:14, May/Jul. 2012.
2. J. W. Murdock, A. Kalyanpur, C. Welty, J. Fan, D. Ferrucci, D. C. Gondek, L. Zhang, and H. Kanayama, "Typing candidate answers using type coercion," IBM J. Res. Develop., vol. 56, no. 3/4, Paper 7, pp. 7:1-7:13, May/Jul. 2012.
3. J. M. Prager, E. W. Brown, and J. Chu-Carroll, "Special questions and techniques," IBM J. Res. Develop., vol. 56, no. 3/4, Paper 11, pp. 11:1-11:13, May/Jul. 2012.
4. D. C. Gondek, A. Lally, A. Kalyanpur, J. W. Murdock, P. Duboue, L. Zhang, Y. Pan, Z. M. Qiu, and C. Welty, "A framework for merging and ranking of answers in DeepQA," IBM J. Res. Develop., vol. 56, no. 3/4, Paper 14, pp. 14:1-14:12, May/Jul. 2012.
5. A. Kalyanpur, S. Patwardhan,B. K. Boguraev, A. Lally, and J. Chu-Carroll, "Fact-based question decomposition in DeepQA," IBM J. Res. Develop., vol. 56, no. 3/4, Paper 13, pp. 13:1-13:11, May/Jul. 2012.
6. L. Sterling and E. Shapiro, The Art of PrologVAdvanced Programming Techniques, 2nd ed. Cambridge, MA: MIT Press, 1994.
7. M. Covington, Natural Language Processing for Prolog Programmers. Englewood Cliffs, NJ: Prentice-Hall, 1994.
8. E. Voorhees, "Overview of the TREC 2002 question answering track," in Proc. 11th Text REtrieval Conf., 2002, pp. 115-123.
9. D. Giampiccolo, P. Froner, A. Penãs, C. Ayache, D. Cristea, V. Jijkoun, P. Osenova, P. Rocha,B. Sacaleanu, and R. Suteliffe, "Overview of the CLEF 2007 multilingual question answering track," in Proc. Cross Language Eval. ForumVAdvances in Multilingual and Multimodal Information Retrieval, vol. 5152, Lecture Notes In Computer Science, C. Peters, V. Jijkoun, T. Mandl, M. Henning, D. W. Oard, P. Anselmo, V. Petras, and D. Santos, Eds. Berlin, Germany: Sringer-Verlag, 2007, pp. 200-236.
10. D. Ferrucci, E. Brown, J. Chu-Carroll, J. Fan, D. Gondek, A. Kalyanpur, A. Lally, J. W. Murdock, E. Nyberg, J. Prager, N. Schlaefer, and C. Welty, "Building Watson: An overview of the DeepQA project," AI Mag., vol. 31, no. 3, pp. 59-79, 2010.
11. M. C. McCord, J. W. Murdock, and B. K. Boguraev, "Deep parsing in Watson," IBM J. Res. Develop., vol. 56, no. 3/4, Paper 3, pp. 3:1-3:15, May/Jul. 2012.
12. C. Wang, A. Kalyanpur, J. Fan,B. K. Boguraev, and D. C. Gondek, "Relation extraction and scoring in DeepQA," IBM J. Res. Develop., vol. 56, no. 3/4, Paper 9, pp. 9:1-9:12, May/Jul. 2012.
13. L. Vita, A. Ittycheriah, S. Roukos, and N. Kambhatla, "tRuEcasing," in Proc. ACL, Sapporo, Japan, 2003, pp. 152-159.
14. A. Kalyanpur,B. K. Boguraev, S. Patwardhan, J. W. Murdock, A. Lally, C. Welty, J. M. Prager,B. Coppola, A. Fokoue-Nkoutche, L. Zhang, Y. Pan, and Z. M. Qiu, "Structured data and inference in DeepQA," IBM J. Res. Develop., vol. 56, no. 3/4, Paper 10, pp. 10:1-10:14, May/Jul. 2012.
15. D. Ferrucci and A. Lally, "Building an example application with the unstructured information management architecture," IBM Syst. J., vol. 43, no. 3, pp. 455-475, 2004.
16. C. Fellbaum, WordNet: An Electronic Lexical Database. Cambridge, MA: MIT Press, 1998.
17. Q. McNemar, "Note on the sampling error of the difference between correlated proportions or percentages," Psychometrika, vol. 12, no. 2, pp. 153-157, Jun. 1947.
18. U. Hermjakob, E. H. Hovy, and C. Lin, "Knowledge-based question answering," in Proc. 6th World Multiconf. Syst., Cybern. Inform., 2002. [Online]. Available: http://research.microsoft.com/en-us/people/cyl/sci2002.pdf.
19. J. Chu-Carroll, J. Prager, C. Welty, K. Czuba, and D. Ferrucci, "A multi-strategy and multi-source approach to question answering," in Proc. Text REtreival Conf., 2003. [Online]. Available: http://trec.nist.gov/pubs/ trec11/papers/ibm.prager.pdf.
20. D. Moldovan, C. Clark, S. Harabagiu, and S. Maioran, "COGEX: A logic prover for question answering," in Proc. HLT-NAACL, 2003, pp. 87-93.
21. W. Lehnert, "Human and computational question answering," Cognit. Sci., vol. 1, no. 1, pp. 47-73, Jan. 1977.
22. D. B. Lenat, "CyC: A large-scale investment in knowledge infrastructure," Commun. ACM, vol. 38, no. 11, pp. 33-38, Nov. 1995.
23. K. Forbus and P. Paritosh, "Analysis of strategic knowledge in back of the envelope reasoning," in Proc. 20th Nat. Conf. AAAI, vol. 2, A. Cohn, Ed., 2005, vol. 2, pp. 651-656. (Pubitemid 43006683)
24. J. M. Prager, "Open-domain question answering," Found. Trends Inform. Retrieval, vol. 1, no. 2, pp. 91-231, 2006.
25. R. Bunescu and Y. Huang, "Towards a general model of answer typing: Question focus identification," in Proc. 11th Int. Conf. Intell. Text Process. Comput. Linguist., Iasi, Romania, 2010. [Online]. Available: http://ace.cs.ohiou.edu/̃razvan/papers/cicling10.pdf.
26. X. Li and D. Roth, "Learning question classifiers," in Proc. 19th Int. Conf. Comput. Linguist., 2002, vol. 1, pp. 1-7.
27. D. Zhang and W. S. Lee, "Question classification using support vector machines," in Proc. 26th Annu. Int. ACM SIGIR Conf. Res. Dev. Inform. Retrieval, 2003, pp. 26-32.
28. N. Schlaefer, J. Ko, J. Betteridge, G. Sautter, M. Pathak, and E. Nyberg, "Semantic extensions of the Ephyra QA system for TREC," in Proc. TREC, 2007. [Online]. Available: http://www.cs.cmu.edu/̃nico/pubs/trec2007- schlaefer.pdf.
29. A. Mikhailian, T. Dalmas, and R. Pinchuk, "Learning foci for question answering over topic maps," in Proc. ACL-IJCNLP Conf., Suntec, Singapore, 2008, pp. 325-328.
30. C. Pinchak and D. Lin, "A probabilistic answer type model," in Proc. 11th Conf. Eur. Chapter Assoc. Comput. Linguist., Trento, Italy, 2006, pp. 393-400.