User simulations for evaluating answers to question series

Information Processing and Management

Volumn 43, Issue 3, 2007, Pages 717-729

  Lin, Jimmy ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

Evaluation; Question answering; User simulations

Indexed keywords

MATHEMATICAL MODELS; USER INTERFACES;

QUESTION ANSWERING; USER SIMULATIONS;

COMPUTER SIMULATION;

EID: 33846442808     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2006.06.006     Document Type: Article

References (20)

1. Allan, J., Carterette, B., & Lewis, J. (2005). When will information retrieval be "good enough"? User effectiveness as a function of retrieval accuracy. In Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR 2005).
2. Chi, H., Pirolli, P., Chen, K., & Pitkow, J. (Eds.). (2001). Using information scent to model user information needs and actions and the Web. In Proceedings of 2001 SIGCHI conference on human factors in computing systems (CHI 2001).
3. Granka, L.A., Joachims, T., & Gay, G. (2004). Eye-tracking analysis of user behavior in WWW-search. In Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR 2004).
4. Harman, D. (1988). Towards interactive query expansion. In Proceedings of the 11th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR 1988).
5. Hersh, W., Turpin, A., Price, S., Chan, B., Kramer, D., Sacherek, L., & Olson, D. (2000). Do batch and user evaluations give the same results? In Proceedings of the 23rd annual international ACM SIGIR conference on research and development in information retrieval (SIGIR 2000).
6. Kato, T., Fukumoto, J., Masui, F., & Kando, N. (2004). Handling information access dialogue through QA technologies-a novel challenge for open-domain question answering. In Proceedings of the HLT-NAACL 2004 workshop on pragmatics of question answering.
7. Lin, J. (2005). Evaluation of resources for question answering evaluation. In Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR 2005).
8. Lin, J., & Demner-Fushman, D. (2005). Automatically evaluating answers to definition questions. In Proceedings of the 2005 human language technology conference and conference on empirical methods in natural language processing (HLT/EMNLP 2005).
9. Lin, J., & Demner-Fushman, D. (2006). Will pyramids built of nuggets topple over? In Proceedings of the 2006 human language technology conference and the north American chapter of the association for computational linguistics annual meeting (HLT/NAACL 2006).
10. Lin, J., Quan, D., Sinha, V., Bakshi, K., Huynh, D., Katz, B., et al. (2003). What makes a good answer? The role of context in question answering. In Proceedings of the ninth IFIP TC13 international conference on human-computer interaction (INTERACT 2003).
11. Magennis, M., & van Rijsbergen, C. J. (1998). The potential and actual effectiveness of interactive query expansion. In Proceedings of the 20th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR 1998).
12. Metzler D., and Bruce Croft W. Combining the language model and inference network approaches to retrieval. Information Processing and Management 40 5 (2004) 735-750
13. Monz, C. (2003). From Document Retrieval to Question Answering. Ph.D. thesis, Institute for Logic, Language, and Computation, University of Amsterdam.
14. Mostafa J., Mukhopadhyay S., and Palakal M. Simulation studies of different dimensions of users' interests and their impact on user modeling and information filtering. Information Retrieval 6 2 (2003) 199-223
15. Spärck Jones, K. (2003). Is question answering a rational task? In Proceedings of the 2nd CoLogNET-ElsNET symposium on questions and answers: Theoretical and applied perspectives.
16. Tellex, S., Katz, B., Lin, J., Marton, G., & Fernandes, A. (2003). Quantitative evaluation of passage retrieval algorithms for question answering. In Proceedings of the 26th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR 2003).
17. Voorhees, E. M. (2003). Overview of the TREC 2003 question answering track. In Proceedings of the twelfth text retrieval conference (TREC 2003).
18. Voorhees, E. M. (2004). Overview of the TREC 2004 question answering track. In Proceedings of the thirteenth text retrieval conference (TREC 2004).
19. Voorhees, E. M. (2005). Using question series to evaluate question answering system effectiveness. In Proceedings of the 2005 human language technology conference and conference on empirical methods in natural language processing (HLT/EMNLP 2005).
20. White R.W., Ruthven I., Jose J.M., and van Rijsbergen C.J. Evaluating implicit feedback models using searcher simulations. ACM Transactions on Information Systems 23 3 (2005) 325-361