Textual evidence gathering and analysis

IBM Journal of Research and Development

Volumn 56, Issue 3-4, 2012, Pages

  Murdock, J W ^a   Fan, J ^a   Lally, A ^a   Shima, H ^b   Boguraev, B K ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NOVEL TECHNIQUES; QUESTION ANSWERING SYSTEMS; SEARCH QUERIES;

ARTIFICIAL INTELLIGENCE;

QUERY PROCESSING;

EID: 84859851342     PISSN: 00188646     EISSN: 21518556     Source Type: Journal    
DOI: 10.1147/JRD.2012.2187249     Document Type: Review

References (38)

1. A. Lally, J. M. Prager, M. C. McCord,B. K. Boguraev, S. Patwardhan, J. Fan, P. Fodor, and J. Chu-Carroll, "Question analysis: How Watson reads a clue," IBM J. Res. Dev., vol. 56, no. 3/4, Paper 2, pp. 2:1-2:14, May/Jul. 2012.
2. J. Chu-Carroll, J. Fan,B. K. Boguraev, D. Carmel, D. Sheinwald, and C. Welty, "Finding needles in the haystack: Search and candidate generation," IBM J. Res. Dev., vol. 56, no. 3/4, Paper 6, pp. 6:1-6:12, May/Jul. 2012.
3. D. C. Gondek, A. Lally, A. Kalyanpur, J. W. Murdock, P. Duboue, L. Zhang, Y. Pan, Z. M. Qiu, and C. Welty, "A framework for merging and ranking of answers in DeepQA," IBM J. Res. Dev., vol. 56, no. 3/4, Paper 14, pp. 14:1-14:12, May/Jul. 2012.
4. M. C. McCord, J. W. Murdock, and B. K. Boguraev, "Deep parsing in Watson," IBM J. Res. Dev., vol. 56, no. 3/4, Paper 3, pp. 3:1-3:15, May/Jul. 2012.
5. C. Wang, A. Kalyanpur, J. Fan,B. K. Boguraev, and D. C. Gondek, "Relation extraction and scoring in DeepQA," IBM J. Res. Dev., vol. 56, no. 3/4, Paper 9, pp. 9:1-9:12, May/Jul. 2012.
6. D. Moldovan, C. Clark, S. Harabagiu, S. Maiorano, and Assoc. Comput. Linguistics, "COGEX: A logic prover for question answering," in Proc. NAACL Human Lang. Technol. Conf., Stroudsburg, PA, 2003, vol. 1, pp. 87-93, DOI:10.3115/1073445.1073467.
7. B. Levin, English Verb Classes and Alternations: A Preliminary Investigation. Chicago, IL: Univ. Chicago Press, 1993.
8. K. Kipper, A. Korhonen, N. Ryant, and M. Palmer, "A large-scale classification of English verbs," Lang. Resour. Eval. J., vol. 42, no. 1, pp. 21-40, Mar. 2008.
9. C.-Y. Lin, F. J. Och, and Assoc. Comput. Linguistics, "Automatic evaluation of machine translation quality using longest common subsequence and skip-bigram statistics," in Proc. 42nd Annu. Meet. ACL, Stroudsburg, PA, 2004, Article 605, DOI:10.3115/1218955.1219032.
10. T. F. Smith and M. S. Waterman, "Identification of common molecular subsequences," J. Mol. Biol., vol. 147, no. 1, pp. 195-197, Mar. 1981.
11. S. B. Needleman and C. D. Wunsch, "A general method applicable to the search for similarities in the amino acid sequence of two proteins," J. Mol. Biol., vol. 48, no. 3, pp. 443-453, Mar. 1970.
12. J. W. Murdock, "Structure mapping for Jeopardy! Clues," in Proc. 19th ICCBR, 2011, pp. 6-10.
13. D. A. Ferrucci, "Introduction to FThis Is Watson," IBM J. Res. Dev., vol. 56, no. 3/4, Paper 1, pp. 1:1-1:15, May/Jul. 2012.
14. J. W. Murdock, A. Kalyanpur, C. Welty, J. Fan, D. A. Ferrucci, D. C. Gondek, L. Zhang, and H. Kanayama, "Typing candidate answers using type coercion," IBM J. Res. Dev., vol. 56, no. 3/4, Paper 7, pp. 7:1-7:13, May/Jul. 2012.
15. B. Magnini, M. Negri, R. Prevete, and H. Tanev, "Is it the right answer? Exploiting web redundancy for answer validation," in Proc. 40th Ann. Meet. Assoc. Comput. Linguistics, 2002, pp. 425-432.
16. B. Magnini, M. Negri, R. Prevete, and H. Tanev, "Comparing statistical and content-based techniques for answer validation on the web," in Proc. VIII Con-vegno AI-IA, Sienna, Italy, 2002.
17. C. Clarke, G. Cormack, and T. Lynam, "Exploiting redundancy in question answering," in Proc. 24th SIGIR Conf., 2001, pp. 358-365. (Pubitemid 32951090)
18. E. Brill, J. Lin, M. Banko, S. Dumais, and A. Ng, "Data-intensive question answering," in Proc. 10th TREC, 2001, pp. 393-400.
19. J. Prager, D. Radev, E. Brown, A. Coden, and V. Samn, "The use of predictive annotation for question answering in TREC8," in Proc. 8th TREC, 1999, pp. 399-410.
20. J. Chu-Carroll, K. Czuba, J. Prager, and A. Ittycheriah, "Two heads are better than one," in Proc. HLT-NAACL, 2003, pp. 24-31.
21. R. Sun, J. Jiang, Y. Fan, T. Hang, C. Tatseng, and C. M.-Y. Kan, "Using syntactic and semantic relation analysis in question answering," in Proc. 14th TREC, 2005, pp. 1-9. [Online]. Available: https://mailserver.di.unipi.it/ricerca/proceedings/TREC2005/papers/nus.qa.pdf.
22. J. P. Callan, "Passage-level evidence in document retrieval," in Proc. 17th Annu. Int. ACM SIGIR Conf. Res. Dev. Inf. Retrieval, W. B. Croft and C. J. van Rijsbergen, Eds., New York, NY, 1994, pp. 302-310.
23. A. Corrada-Emmanuel, W. B. Croft, and V. Murdock. (2003). BAnswer passage retrieval for question answering," Center Intell. Inf. Retrieval, Univ. Massachusetts, Amherst, MA, Tech. Rep. [Online]. Available: http://ciir.cs. umass.edu/pubfiles/ir-283.pdf.
24. M. W. Bilotti, E. Nyberg, and Assoc. Comput. Linguistics, "Improving text retrieval precision and answer accuracy in question answering systems," in Proc. 2nd IRQA Coling Workshop, Stroudsburg, PA, 2008, pp. 1-8.
25. S. Tellex,B. Katz, J. Lin, A. Fernandes, G. Marton, and Assoc. Comput. Mach., "Quantitative evaluation of passage retrieval algorithms for question answering," in Proc. 26th Annu. Int. ACM SIGIR Conf. Res. Dev. Inf. Retrieval, New York, 2003, pp. 41-47.
26. A. Moschitti, S. Quarteroni, R. Basili, and S. Manandhar, "Exploiting syntactic and shallow semantic kernels for question/answer classification," in Proc. 45th ACL Conf., Prague, Czech Republic, 2007. [Online]. Available: http://www.ist-luna.eu/pdf/ACL07.pdf.
27. A. Moschitti, "Kernel methods, syntax and semantics for relational text categorization," in Proc. ACM 17th CIKM, 2008, pp. 253-262.
28. D. Melamed, R. Green, J. P. Turian, and Assoc. Comput. Linguistics, "Precision and recall of machine translation," in Proc. NAACL-ShortVCompanion Volume of the Proceedings of HLT-NAACL 2003VShort Papers, Volume 2, Stroudsburg, PA, 2003, vol. 2, pp. 61-63.
29. A. Agarwal, A. Lavie, and Assoc. Comput. Linguistics, "Meteor, M-BLEU and M-TER: Evaluation metrics for high-correlation with human rankings of machine translation output," in Proc. 3rd Workshop Statist. Mach. Trans., 2008, pp. 115-118.
30. C.-Y. Lin, "ROUGE: A package for automatic evaluation of summaries," in Proc. ACL Workshop Text Summarization, 2004, pp. 25-26.
31. J. Fukumoto, "Question answering system for non-factoid type questions and automatic evaluation based on BE method," in Proc. 6th NTCIR Workshop, 2007, pp. 441-447.
32. R. Durbin, S. R. Eddy, A. Krogh, and G. Mitchison, "iological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids. Cambridge, U.K.: Cambridge Univ. Press, 1999.
33. W. Lehnert, "Human and computational question answering," Cogn. Sci., vol. 1, no. 1, pp. 47-73, Jan. 1977.
34. D. B. Lenat, "CyC: A large-scale investment in knowledge infrastructure," Commun. ACM, vol. 38, no. 11, pp. 33-38, Nov. 1995.
35. P. K. Paritosh and K. D. Forbus, "Analysis of strategic knowledge in back of the envelope reasoning," in Proc. 20th AAAI Nat. Conf. Artif. Intell., vol. 2, A. Cohn, Ed., 2005, vol. 2, pp. 651-656. (Pubitemid 43006683)
36. U. Hermjakob, E. H. Hovy, and C. Lin, "Knowledge-based question answering," in Proc. 6th World Multiconf. SCI, Orlando, FL, 2002. [Online]. Available: http://research.microsoft.com/en-us/people/cyl/sci2002.pdf.
37. B. Falkenhainer, K. Forbus, and D. Gentner, "The structure mapping engine: Algorithm and examples," Artif. Intell., vol. 41, no. 1, pp. 1-63, Nov. 1989. (Pubitemid 20633338)
38. E. A. Epstein, M. I. Schor,B. S. Iyer, A. Lally, E. W. Brown, and J. Cwiklik, "Making Watson fast," IBM J. Res. Dev., vol. 56, no. 3/4, Paper 15, pp. 15:1-15:12, May/Jul. 2012.