Open-domain question-answering

Foundations and Trends in Information Retrieval

Volumn 1, Issue 2, 2006, Pages 91-233

  Prager, John ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION RETRIEVAL SYSTEMS; INNOVATION; REQUIREMENTS ENGINEERING; SOFTWARE ENGINEERING;

COMPONENT MODULES; MULTI-FACETED SYSTEMS; QUESTION ANSWERING (QA) SYSTEMS;

QUERY PROCESSING;

EID: 34548776397     PISSN: 15540669     EISSN: 15540677     Source Type: Journal    
DOI: 10.1561/1500000001     Document Type: Article

References (84)

1. A. T. Arampatzis, T. Tsoris, C. H. A. Koster, and T. P. van der Weide, "Phrase-based information retrieval," Information Processing and Management, vol. 34, no. 6, pp. 693-707, 1998.
2. A. L. Berger, V. D. Pietra, and S. D. Pietra, "A maximum entropy approach to natural language processing," Computational Linguistics, vol. 22, no. 1, 1996.
3. D. Bikel, R. Schwartz, and R. Weischedel, "An algorithm that learns what's in a name," Machine Learning, vol. 34, no. 1-3, pp. 211-231, 1999.
4. S. Blair-Goldensohn, K. R. McKeown, and A. H. Schlaikjer, "Answering definitional questions: A hybrid approach," in New Directions in Question Answering, (M. Maybury, ed.), pp. 47-57, AAAI press, 2004.
5. E. Brill, J. Lin, M. Banko, S. Dumais, and A. Ng, "Data-intensive questionanswering," in Proceedings of the 10th Text Retrieval Conference (TREC2001), NIST, Gaithersburg, MD, 2002.
6. C. Buckley, M. Mitra, J. A. Walz, and C. Cardie, "SMART high precision: TREC 7," in Proceedings of the 7th Text Retrieval Conference (TR.EC7), pp. 230-243, Gaithersburg, MD, 1998.
7. J. Burger, C. Cardie, V. Chaudhri, R. Gaizauskas, S. Harabagiu, D. Israel, C. Jacquemin, C.-Y. Lin, S. Maiorano, G. Miller, D. Moldovan, B. Ogden, J. Prager, E. Riloff, A. Singhal, R. Srihari, T. Strzalkowski, E. Voorhees, and R. Weishedel, "Issues, Tasks and Program Structures to Roadmap Research in Question & Answering (Q&A.) ARDA QA Roadmap (http://www-nlpir.nist.gov/ projects/duc/paipers/qa, Roadmap-paper.v2.doc)," 2001.
8. R. Byrd and Y. Ravin, "Identifying and extracting relations in text," in Proceedings of 4th International Conference on Applications of Natural Language and Information Systems (NLDB 99), Klagenfurt, Austria, 1999.
9. J. G. Carbonell and J. Goldstein, "The use of MMR, diversity-based reranking for reordering documents and producing summaries," in Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR98), Melbourne, Australia, August 1998.
10. D. Carmel, Y. S. Maarek, M. Mandelbrod, Y. Mass, and A. Soffer, "Searching XML documents via XML fragments," in Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2003.
11. J. Chu-Carroll, J. Prager, C. Welty, K. Czuba, and D. Ferrucci, "A multistrategy and multi-source approach to question answering," in Proceedings of the 11th Text Retrieval Conference (TREC2002), Gaithersburg, MD, 2003.
12. J. Chu-Carroll, J. M. Prager, K. Czuba, D. Ferrucci, and P. Duboue, "Semantic search via XML fragments: A high precision approach to IR," in Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR06), Seattle, WA, 2006.
13. C. L. A. Clarke, G. V. Cormack, and T. R. Lynam, "Exploiting redundancy in question answering," in Proceedings of the 24th Annual International ACM SIGIR. Conference on Research and Development in Information Retrieval (SIGIR01), New Orleans, September 2001.
14. T. Clifton, A. Colquhoun, and W. Teahan, "Bangor at TR-EC 2003: Q&A and genomics tracks," in Proceedings of the 12th Text Retrieval Conference (TREC2003), Gaithersburg, MD, 2004.
15. H. Cui, M.-Y. Kan, and T.-S. Chua-, "Unsupervised learning of soft patterns for generating definitions from online news," in Proceedings of the Thirteenth World Wide Web conference (WWW 2004), pp. 90-99, New York, May 17-22 2004.
16. H. Cui, K. Li, R. Sun, T.-S. Chua, and M.-Y. Kan, "National University of Singapore at the TREC-13 question answering main task," in Proceedings of the 13th Text Retrieval Conference (TREC2004), Gaithersburg, MD, 2005.
17. I. Dagan, O. Glickman, and B. Magnini, "The PASCAL recognising textual entailment challenge," in Proceedings of the PASCAL Challenges Workshop on Recognising Textual Entailment, 2005.
18. A. Echihabi and D. Marcu, "A noisy-channel approach to question answering," in Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL2003), pp. 16-23, 2003.
19. J. Gao, J.-Y. Nie, G. Wu, and G. Cao, "Dependence language model for information retrieval," in Proceedings of the 27th Annual International ACM SIGIR, Conference on Research and Development in Information Retrieval (SIGIR04), Sheffield, UK, July 25-29, 2004.
20. S. Harabagiu, D. Moldovan, C. Clark, M. Bowden, J. Williams, and J. Bensley, "Answer mining by combining extraction techniques with abductive reasoning," in Proceedings of the 12th Text Retrieval Conference (TREC2003), Gaithersburg, MD, 2004.
21. S. Harabagiu, D. Moldovan, M. Pasca, R. Mihalcea, M. Surdeanu, R. Bunescu, R. Girju, V. Rus, and P. Morarescu, "FALCON: Boosting knowledge for answer engines," in Proceedings of the 9th Text Retrieval Conference (TREC9), pp. 479-488, NIST, Gaithersburg MD, 2001.
22. S. Harabagiu, D. Moldovan, M. Pasca, R. Mihalcea, M. Surdeanu, R. Bunescu, R. Girju, V. Rus, and P. Morarescu, "The role of lexico-semantic feedback in open-domain textual question-answering," in Proceedings of the Association for Computational Linguistics, pp. 274-281, July 2001.
23. G. G. Hendrix, E. D. Sacerdoti, D. Sagalowicz, and J. Slocum, "Developing a natural language interface to complex data," Very Large Data Bases (VLDB), p. 292, 1977.
24. U. Hermjakob, A. Echihabi, and D. Marcu, "Natural language based reformulation resource and web exploitation for question answering," in Proceedings of the 11th Text Retrieval Conference (TREC2002), Gaithersburg, MD, 2003.
25. L. Hirschman and R. Gaizauskas, "Natural language question answering: The view from here," Natural Language Engineering, vol. 7, no. 4, pp. 275-300, 2001.
26. I. Ittycheriah, M. Franz, and S. Roukos, "IBM's statistical question-answering system -TR-EC-10," in Proceedings of the 10th Text Retrieval Conference (TREC10), pp. 258-264, NIST, Gaithersburg, MD, 2001.
27. B. Katz, "Annotating the world wide web using natural language," in Proceedings of the 5th RIAO Conference on Computer Assisted Information Searching on the Internet, 1997.
28. B. Katz, S. Felshin, D. Yuret, A. Ibrahim, J. Lin, G. Marton, A. J. McFarland, and B. Temelkuran, "Omnibase: Uniform access to heterogeneous data, for question answering," in Proceedings of the 7th International Workshop on Applications of Natural Language to Information Systems (NLDB), 2002.
29. B. Katz and J. Lin, "Selectively using relations to improve precision in question answering," in Proceedings of the EACL-2003 Workshop on Natural Language Processing for Question Answering, April 2003.
30. J. Kupiec, "Murax: A robust linguistic approach for question answering using an on-line encyclopedia," in Proceedings of the 16th Annual International ACM SIGIR, Conference on Research and Development in Information Retrieval (SIGIR93), pp. 181-190, 1993.
31. C. Kwok, O. Etzioni, and D. S. Weld, "Scaling question answering to the web," in Proceedings of the 10th World Wide Web Conference (WWW 2001), Hong Kong, pp. 150-161, 2001.
32. D. B. Lenat, "Cyc: A large-scale investment in knowledge infrastructure," Communications of the ACM, vol. 38, no. 11, 1995.
33. X. Li and D. Roth, "Learning question classifiers: The role of semantic information," Journal of Natural Language Engineering, vol. 12, no. 3, pp. 229-249, 2006.
34. C.-Y. Lin and E. Hovy, "Automatic evaluation of summaries using n-gram co-occurrence statistics," in Proceedings of the Human Language Technology Conference (HLT/NAACL), 2003.
35. J. Lin, "An exploration of the principles underlying redundancy-based factoid question answering," ACM Transactions on Information Systems, in press, 2007.
36. J. Lin and D. Demner-Fushman, "Automatically evaluating answers to definition questions," in Proceedings of the Human Language Technology Conference (HLT/EMNLP2005), Vancouver, Canada, October 2005.
37. J. Lin and D. Demner-Fushman, "Will pyramids built of nuggets topple over?," in Proceedings the Human Language Technology Conference (HLTN-AACL2006), New York, NY, June 2006.
38. J. Lin, D. Quan, V. Sinha, K. Bakshi, D. Huynh, B. Katz, and D. R. Karger, "What makes a good answer? The role of context in question-answering," in Proceedings of the Ninth IFIP TC13 International Conference on Human-Computer Interaction (INTERACT 2003), Zurich, Switzerland, 2003.
39. Linguistic Data Consortium (LDC), "ACE Phase 2: Information for LDC Annotators," http://www.ldc.upenn.edu/Projects/ACE2, 2002.
40. B. Magnini, M. Negri, R. Prevete, and H. Tanev, "Is it the right answer? exploiting web redundancy for answer validation," Association for Computational Linguistics 40th Anniversary Meeting (ACL-02), University of Pennsylvania, Philadelphia, pp. 425-432, July 7-12, 2002.
41. D. Marr, "Early processing of visual information, philosophic," Transactions of the Royal Soc IJT B, vol. 275, pp. 1377-1388, 1976.
42. M. Maybury, ed., New Directions in Question Answering, AAAI press, 2004.
43. D. Metzler and W. B. Croft, "A Markov Random field model for term dependencies," in Proceedings of the 28th Annual International ACM SIGIR, Conference on Research and Development in Information Retrieval (SIGIR 2005), pp. 472-479, 2005.
44. R. Mihalcea, and D. Moldovan, "A method for word sense disambiguation of unrestricted text," in Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (ACL-99), pp. 152-158, College Park, MD, 1999.
45. G. Miller, "WordNet: A lexical database for english," Communications of the ACM, vol. 38, no. 11, pp. 39-41, 1995.
46. D. Moldovan, C. Clark, S. Harabagiu, and S. Maiorano, "COGEX: A logic prover for question-answering," in Proceedings of the Human Language Technology Conference (HLT-NAACL03), pp. 87-93, 2003.
47. D. Moldovan, S. Harabagiu, M. Pasca, R. Mihalcea, R. Girju, R. Goodrum, and V. Rus, "The structure and performance of an open-domain question answering system," in Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (ACL00), pp. 563-570, 2000.
48. D. Moldovan, S. Harabagiu, M. Pasca, R. Mihalcea, R. Goodrum, R. Girju, and V. Rus, "LASSO: A tool for surfing the answer net," in Proceedings of the 8th Text Retrieval Conference (TR.EC8), pp. 175-183, Gaithersburg, MD, 1999.
49. D. I. Moldovan and V. Rus, "Logic form transformation of wordnet and its applicability to question answering," in Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics (ACL01), Toulouse, France, July 2001.
50. A. Nenkova and R. Passonneau, "Evaluating content selection in summarization: The pyramid method," in Proceedings of the Human Language Technology Conference (NAACL-HLT), 2004.
51. K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu, "BLEU: A method for automatic evaluation of machine translation," in Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL02), 2002.
52. M. Pasca, and S. Harabagiu, "High performance question/answering, " in Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR-2001), pp. 366-374, New Orleans LA, September 2001.
53. J. M. Prager, "A curriculum-based approach to a QA roadmap," in LREC 2002 Workshop on Question Answering: Strategy and Resources, Las Palmas, May 2002.
54. J. M. Prager, E. W. Brown, A. Coden, and R. Radev, "Question answering by predictive annotation," in Proceedings of the 23rd Annual International ACM SIGIR, Conference on Research and Development in Information Retrieval (SIGIR00), pp. 184-191, Athens, Greece, 2000.
55. J. M. Prager, J. Chu-Carroll, E. W. Brown, and K. Czuba, "Question answering by predictive annotation," in Advances in Open-Domain Question-Answering, (T. Strzalkowski and S. Harabagiu, eds.), pp. 307-347, Springer, 2006.
56. J. M. Prager, J. Chu-Carroll, and K. Czuba, "Statistical answer-type identification in open-domain question-answering," in Proceedings of the Human Language Technology Conference (HLT 2002), San Diego, CA, March 2002.
57. J. M. Prager, J. Chu-Carroll, and K. Czuba, "A multi-agent approach to using redundancy and reinforcement in question-answering," in New Directions in Question Answering, (M. Maybury, ed.), pp. 237-252, AAAI press, 2004.
58. J. M. Prager, J. Chu-Carroll, and K. Czuba, "Question-answering using constraint satisfaction: QA-by-dossier-with-constraints," in Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL04), pp. 575-582, Barcelona, Spain, 2004.
59. J. M. Prager, J. Chu-Carroll, K. Czuba, C. Welty, A. Ittycheriah, and R. Mahindru, "IBM's PIQUANT in TREC2003," in Proceedings of the 12h Text Retrieval Conference (TREC2003), Gaithersburg, MD, 2004.
60. J. M. Prager, P. Duboue, and J. Chu-Carroll, "Improving QA accuracy by question inversion," in COLING-ACL 2006, pp. 1073-1080, Sydney, Australia, 2006.
61. J. M. Prager, S. K. K. Luger, and J. Chu-Carroll, "Type nanotheories: A framework for type comparison," ACM Sixteenth Conference on Information and Knowledge Management (CIKM 2007), to appear.
62. J. M. Prager, D. R. Radev, and K. Czuba, "Answering what-is questions by virtual annotation," in Proceedings of Human Language Technologies Conference (HLT), San Diego, CA, March 2001.
63. V. Punyakanok, D. Roth, and W. Yih, "Natural language inference via dependency tree mapping: An application to question answering," AI & Math, January 2004.
64. D. R. Radev, W. Fan, H. Qi, H. Wu, and A. Grewal, "Probabilistic question answering on the web," in Proc. of the Int. WWW Conf., pp. 408-419, 2002.
65. D. R. Radev, J. M. Prager, and V. Samn, "Ranking suspected answers to natural language questions using predictive annotation," in Proceedings 6th Applied Natural Language Processing Conference (ANLP2000), pp. 150-157, Seattle, WA, 2000.
66. D. R. Radev, H. Qi, Z. Zheng, S. Blair-Goldensohn, Z. Zhang, W. Fan, and J. M. Prager, "Mining the web for answers to natural language questions," in Proceedings of the 2001 ACM CIKM International Conference on Information and Knowledge Management, Altlanta, GA, 2001.
67. D. Ravichandran and E. Hovy, "Learning surface text patterns for a question answering system," in Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL02), pp. 41-47, Philadelphia, July 2002.
68. E. Rosch et al., "Basic objects in natural categories," Cognitive Psychology, vol. 8, pp. 382-439, 1976.
69. A. Singhal, J. Choi, D. Hindle, J. Hirschberg, F. Pereira, and W. Whittaker, "AT&T at TREC-7 SDR track," in Proceedings of the Broadcast News Transcription and Understanding Workshop (BNTUW'099), 1999.
70. M. Soubbotin, "Patterns of potential answer expressions as clues to the right answers," in Proceedings of the 10th Text Retrieval Conference (TREC2001), pp. 293-302, NIST, Gaithersburg, MD, 2002.
71. M. Soubbotin and S. Soubbotin, "Use of patterns for detection of answer strings: A systematic approach," in Proceedings of the 11th Text Retrieval Conference (TREC2002), pp. 325-331, NIST, Gaithersburg, MD, 2003.
72. T. Strzalkowski and S. Harabagiu, eds., Advances in Open-Domain Question-Answering, Springer, 2006.
73. S. Tellex, B. Katz, J. Lin, G. Marton, and A. Fernandes, "Quantitative evaluation of passage retrieval algorithms for question answering," in Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR, 2003), pp. 41-47, Toronto, Canada, July 2003.
74. E. Voorhees, "Query expansion using lexical-semantic relations," in Proceedings of the Seventeenth International ACM-SIGIR, Conference on Research and Development in Information Retrieval, (W. Croft and C. van Rijsbergen, eds.), pp. 61-69, 1994.
75. E. M. Voorhees and H. T. Dang, "Overview of the TREC 2005 question answering track," in Proceedings of the 14th Text Retrieval Conference, NIST, Gaithersburg, MD, 2006.
76. E. M. Voorhees and D. K. Harman, eds., TREC: Experiment and Evaluation in Information Retrieval, MIT Press, 2005.
77. E. M. Voorhees and D. Tice, "Building a question answering test collection," in 23rd Annual International ACM SIGIR, Conference on Research and Development in Information Retrieval, pp. 200-207, Athens, August 2000.
78. N. Wacholder, Y. Ravin, and M. Choi, "Disambiguation of proper names in text," in Proceedings of the Fifth Conference on Applied Natural Language Processing (ANLP'97), Washington, DC, April 1997.
79. D. H. D. Warren and F. C. N. Pereira, "An efficient easily adaptable system for interpreting natural language queries," Computational Linguistics, vol. 8, no. 3-4, pp. 110-122, 1982.
80. T. Winograd, "Procedures as a representation for data in a computer program for under-standing natural language," Cognitive Psychology, vol. 3, no. 1, 1972.
81. W. A. Wood, "Progress in natural language understanding -An application to Lunar Geology," AFIPS Conference Proceedings, vol. 42, pp. 441-450, 1973.
82. J. Xu and W. B. Croft, "Query expansion using local and global document analysis," in Proceedings of the 19th Annual International ACM SIGIR, Conference on Research and Development in Information Retrieval, pp. 4-11, Zurich, Switzerland, August 18-22 1996.
83. J. Xu, A. Licuanan, and R. Weischedel, "TREC 2003QA at BBN: Answering definitional questions," in Proceedings of the 12th Text Retrieval Conference (TREC2003), Gaithersburg, MD, 2004.
84. H. Yang, T. Chua, S. Wang, and C. Koh, "Structured use of external knowledge for event-based open domain question answering," in Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 33-40, 2003.