Introduction to "This is Watson"

IBM Journal of Research and Development

Volumn 56, Issue 3-4, 2012, Pages

  Ferrucci, D A ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMIC TECHNIQUES; GRAND CHALLENGE; QUESTION ANSWERING SYSTEMS; RESEARCH PLANS;

COMPUTER SCIENCE;

RESEARCH;

EID: 84859838710     PISSN: 00188646     EISSN: 21518556     Source Type: Journal    
DOI: 10.1147/JRD.2012.2184356     Document Type: Review

References (45)

1. R. F. Simmons, "Natural language question-answering systems: 1969," Commun. ACM, vol. 13, no. 1, pp. 15-30, Jan. 1970.
2. M. Maybury, New Directions in Question-Answering. Menlo Park, CA: AAAI Press, 2004.
3. T. Strzalkowski and S. Harabagiu, Advances in Open-Domain Question-Answering. Berlin, Germany: Springer-Verlag, 2006.
4. D. Ferrucci, E. Brown, J. Chu-Carroll, J. Fan, D. Gondek, A. Kalyanpur, A. Lally, J. W. Murdock, E. Nyberg, J. Prager, N. Schlaefer, and C. Welty, "Building Watson: An Overview of the DeepQA Project," AI Mag., vol. 31, no. 3, pp. 59-79, Fall 2010.
5. D. Jurafsky and J. H. Martin, Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, 2nd ed. Upper Saddle River, NJ: Prentice-Hall, 2008.
6. C. Manning and H. Schütze, Foundations of Statistical Natural Language Processing. Cambridge, MA: MIT Press, 1999.
7. S. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman, "Indexing by latent semantic analysis," J. Amer. Soc. Inf. Sci., vol. 41, no. 6, pp. 391-407, Sep. 1990.
8. PASCAL, Recognizing Textual Entailment Challenge, first RTE challenge 2006 collection. It is now incorporated as part of Text Analytics Conference (TAC). [Online]. Available: http://pascallin.ecs.soton.ac.uk/Challenges/RTE/; http://www.nist. gov/tac/2011/RTE/.
9. N. Ge, J. Hale, and E. Charniak, "A statistical approach to anaphora resolution," in Proc. 6th Workshop Very Large Corp., 1998, pp. 417-434.
10. D. Ferrucci and A. Lally, "Building an example application with the unstructured information management architecture," IBM Syst. J., vol. 43, no. 3, pp. 455-475, Jul. 2004.
11. Apache UIMA. [Online]. Available: http://uima.apache.org/.
12. M. Minsky, The Society of Mind. New York: Simon and Schuster, Mar.1988.
13. J. M. Prager, J. Chu-Carroll, and K. Czuba, "A multi-strategy, multi-question approach to question answering," in New Directions in Question-Answering, M. Maybury, Ed. Menlo Park, CA: AAAI Press, 2004.
14. J. M. Prager, J. Chu-Carroll, E. W. Brown, and K. Czuba, "Question answering by predictive annotation," in Advances in Open-Domain Question-Answering, T. Strzalkowski and S. Harabagiu, Eds. Berlin, Germany: Springer-Verlag, 2006.
15. J. Chu-Carroll, K. Czuba, P. Duboue, and J. Prager, "IBM's PIQUANT II in TREC 2005," in Proc. 14th TREC, 2006, pp. 1-8.
16. D. Ferrucci, E. Nyberg, J. Allan, K. Barker, E. Brown, J. Chu-Carroll, A. Ciccolo, P. Duboue, J. Fan, D. Gondek, E. Hovy,B. Katz, A. Lally, M. McCord, P. Morarescu,B. Murdock,B. Porter, J. Prager, T. Strzalkowski, C. Welty, and W. Zadrozny, "Towards the open advancement of question answering systems," IBM, Armonk, NY, IBM Res. Rep., RC24789. [Online]. Available: http://domino.watson.ibm.com/library/CyberDig.nsf/papers/ D12791EAA13BB952852575A1004A055C/$File/rc24789.pdf
17. D. Ferrucci and E. Brown, "AdaptWatson: A methodology for developing and adapting Watson technology," IBM, Armonk, NY, IBM Res. Rep., RC25244, 2011.
18. A. Lally, J. M. Prager, M. C. McCord,B. K. Boguraev, S. Patwardhan, J. Fan, P. Fodor, and J. Chu-Carroll, "Question analysis: How Watson reads a clue," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 2, pp. 2:1-2:14, May/Jul. 2012.
19. M. C. McCord, J. W. Murdock, and B. K. Boguraev, "Deep parsing in Watson," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 3, pp. 3:1-3:15, May/Jul. 2012.
20. J. Chu-Carroll, J. Fan, N. Schlaefer, and W. Zadrozny, "Textual resource acquisition and engineering," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 4, pp. 4:1-4:11, May/Jul. 2012.
21. J. Fan, A. Kalyanpur, D. C. Gondek, and D. A. Ferrucci, "Automatic knowledge extraction from documents," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 5, pp. 5:1-5:10, May/Jul. 2012.
22. C. Bizer, J. Lehmann, G. Kobilarov, S. Auer, C. Becker, R. Cyganiak, and S. Hellmann, "DBpedia-A crystallization point for the web of data," J. Web Semantics, vol. 7, no. 3, pp. 154-165, Sep. 2009.
23. J. Chu-Carroll, J. Fan,B. K. Boguraev, D. Carmel, D. Sheinwald, and C. Welty, "Finding needles in the haystack: Search and candidate generation," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 6, pp. 6:1-6:12, May/Jul. 2012.
24. A. Kalyanpur, J. W. Murdock, J. Fan, and C. Welty, "Leveraging community-built knowledge for type coercion in question answering," in Proc. 10th ISWC, vol. Part II, L. Aroyo, C. Welty, H. Alani, J. Taylor, and A. Bernstein, Eds., vol. Part II. Berlin, Germany: Sringer-Verlag, pp. 144-156, 2011.
25. F. M. Suchanek, G. Kasneci, and G. Weikum, "YAGOVA core of semantic knowledge," in Proc. 16th Int. World Wide Web Conf., 2007, pp. 697-706.
26. C. Fellbaum, WordNet: An Electronic Lexical Database. Cambridge, MA: MIT Press, 1998.
27. J. W. Murdock, A. Kalyanpur, C. Welty, J. Fan, D. A. Ferrucci, D. C. Gondek, L. Zhang, and H. Kanayama, "Typing candidate answers using type coercion," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 7, pp. 7:1-7:13, May/Jul. 2012.
28. J. W. Murdock, J. Fan, A. Lally, H. Shima, and B. K. Boguraev, "Textual evidence gathering and analysis," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 8, pp. 8:1-8:14, May/Jul. 2012.
29. C. Wang, A. Kalyanpur, J. Fan,B. K. Boguraev, and D. C. Gondek, "Relation extraction and scoring in DeepQA," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 9, pp. 9:1-9:12, May/Jul. 2012.
30. K. Bollacker, C. Evans, P. Paritosh, T. Sturge, and J. Taylor, "Freebase: A collaboratively created graph database for structuring human knowledge," in Proc. SIGMOD ACM SIGMOD Int. Conf. Manage. Data, 2008, pp. 1247-1250.
31. IMDB: The Internet Movie Database. [Online]. Available: http://www.imdb.com/.
32. A. Kalyanpur,B. K. Boguraev, S. Patwardhan, J. W. Murdock, A. Lally, C. Welty, J. M. Prager,B. Coppola, A. Fokoue-Nkoutche, L. Zhang, Y. Pan, and Z. M. Qiu, "Structured data and inference in DeepQA," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 10, pp. 10:1-10:14, May/Jul. 2012.
33. J. M. Prager, E. W. Brown, and J. Chu-Carroll, "Special questions and techniques," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 11, pp. 11:1-11:13, May/Jul. 2012.
34. D. R. Swanson, "Fish oil, Raynaud's syndrome, and undiscovered public knowledge," Perspectives Biol. Med., vol. 30, no. 1, pp. 7-18, Autumn 1986.
35. J. Chu-Carroll, E. W. Brown, A. Lally, and J. W. Murdock, "Identifying implicit relationships," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 12, pp. 12:1-12:10, May/Jul. 2012.
36. A. Kalyanpur, S. Patwardhan,B. K. Boguraev, A. Lally, and J. Chu-Carroll, "Fact-based question decomposition in DeepQA," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 13, pp. 13:1-13:11, May/Jul. 2012.
37. D. C. Gondek, A. Lally, A. Kalyanpur, J. W. Murdock, P. Duboue, L. Zhang, Y. Pan, Z. M. Qiu, and C. Welty, "A framework for merging and ranking of answers in DeepQA," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 14, pp. 14:1-14:12, May/Jul. 2012.
38. UIMA Asynchronous Scaleout, The Apache Software Foundation, Apache UIMA Development Community, ver. 2.3.1, 2011. [Online]. Available: http://uima.apache.org/d/uima-as-2.3.1/uima-async-scaleout.html.
39. E. A. Epstein, M. I. Schor,B. S. Iyer, A. Lally, E. W. Brown, and J. Cwiklik, "Making Watson fast," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 15, pp. 15:1-15:12, May/Jul. 2012.
40. G. Tesauro, D. C. Gondek, J. Lenchner, J. Fan, and J. M. Prager, "Simulation, learning, and optimization techniques in Watson's game strategies," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 16, pp. 16:1-16:11, May/Jul. 2012.
41. B. L. Lewis, "In the game: The interface between Watson and Jeopardy!," IBM J. Res. & Dev., vol. 56, no. 3/4, Paper 17, pp. 17:1-17:6, May/Jul. 2012.
42. J. Hoffart, M. A. Yosef, I. Bordino, H. Fürstenau, M. Pinkal, M. Spaniol,B. Taneva, S. Thater, and G. Weikum, "Robust disambiguation of named entities in text," in Proc. EMNLP, 2011, pp. 782-792.
43. M. Zhang, J. Zhang, J. Su, and G. Zhou, "A composite kernel to extract relations between entities with both flat and structured features," in Proc. 21st Int. Conf. Comput. Linguistics, 44th Annu. Meeting ACL-44, Stroudsburg, PA, 2006, pp. 825-832.
44. H. Jia, X. Huang, T. Ma, X. Wan, and J. Xiao, "PKUTM participation TAC 2010 RTE and summarization track," in Proc. TAC, 2010, pp. 1-12. [Online]. Available: http://www.nist.gov/tac/publications/2010/participant. papers/PKUTM.proceedings.pdf.
45. D. Ferrucci, A. Levas, S. Bagchi, D. Gondek, and E. T. Mueller, "Watson: Beyond Jeopardy!," J. Artif. Intell., 2012.