Using statistical decision theory and relevance models for query-performance prediction

SIGIR 2010 Proceedings - 33rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2010, Pages 259-266

  Shtok, Anna ^a   Kurland, Oren ^a   Carmel, David ^b  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b IBM HAIFA RESEARCH LAB   (Israel)

Author keywords

Query performance prediction; Rank correlation; Relevance models; Statistical decision theory

Indexed keywords

DOCUMENT RANKING; INFORMATION NEED; PERFORMANCE PREDICTION; PERFORMANCE PREDICTOR; RANK CORRELATION; RELEVANCE JUDGMENT; RELEVANCE MODELS; STATISTICAL DECISION THEORY;

DECISION MAKING; FORECASTING; INFORMATION RETRIEVAL; INFORMATION SCIENCE; OPERATIONS RESEARCH; STATISTICS; UNCERTAINTY ANALYSIS;

DECISION THEORY;

EID: 77956023707     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1835449.1835494     Document Type: Conference Paper

References (34)

1. N. Abdul-Jaleel, J. Allan, W. B. Croft, F. Diaz, L. Larkey, X. Li, M. D. Smucker, and C. Wade. UMASS at TREC 2004 - novelty and hard. In Proceedings of TREC-13, pages 715-725, 2004.
2. G. Amati, C. Carpineto, and G. Romano. Query difficulty, robustness and selective application of query expansion. In Proceedings of ECIR, pages 127-137, 2004.
3. J. A. Aslam and V. Pavlu. Query hardness estimation using Jensen-Shannon divergence among multiple scoring functions. In Proceeding of ECIR, pages 198-209, 2007.
4. D. Carmel, E. Yom-Tov, A. Darlow, and D. Pelleg. What makes a query difficult? In Proceedings of SIGIR, pages 390-397, 2006.
5. K. Collins-Thompson and J. Callan. Estimation and use of uncertainty in pseudo-relevance feedback. In Proceedings of SIGIR, pages 303-310, 2007.
6. S. Cronen-Townsend, Y. Zhou, and W. B. Croft. Predicting query performance. In Proceedings of SIGIR, pages 299-306, 2002.
7. S. Cronen-Townsend, Y. Zhou, and W. B. Croft. A language modeling framework for selective query expansion. Technical Report IR-338, Center for Intelligent Information Retrieval, University of Massachusetts, 2004.
8. F. Diaz. Performance prediction using spatial autocorrelation. In Proceedings of SIGIR, pages 583-590, 2007.
9. D. Harman and C. Buckley. The NRRC reliable information access (RIA) workshop. In Proceedings of SIGIR, pages 528-529, 2004.
10. C. Hauff, L. Azzopardi, and D. Hiemstra. The combination and evaluation of query performance prediction methods. In Proceedings of ECIR, pages 301-312, 2009.
11. C. Hauff, D. Hiemstra, and F. de Jong. A survey of pre-retrieval query performance predictors. In Proceedings of CIKM, pages 1419-1420, 2008.
12. C. Hauff, V. Murdock, and R. Baeza-Yates. Improved query difficulty prediction for the web. In Proceedings of CIKM, pages 439-448, 2008.
13. B. He and I. Ounis. Inferring query performance using pre-retrieval predictors. In Proceedings of SPIRE, pages 43-54, 2004.
14. O. Kurland. The opposite of smoothing: A language model approach to ranking query-specific document clusters. In Proceedings of SIGIR, pages 171-178, 2008.
15. J. D. Lafferty and C. Zhai. Document language models, query models, and risk minimization for information retrieval. In Proceedings of SIGIR, pages 111-119, 2001.
16. V. Lavrenko and W. B. Croft. Relevance-based language models. In Proceedings of SIGIR, pages 120-127, 2001.
17. K.-S. Lee, W. B. Croft, and J. Allan. A cluster-based resampling method for pseudo-relevance feedback. In Proceedings of SIGIR, pages 235-242, 2008.
18. M. Mitra, A. Singhal, and C. Buckley. Improving automatic query expansion. In Proceedings of SIGIR, pages 206-214, 1998.
19. J. Mothe and L. Tanguy. Linguistic features to predict query difficulty. In ACM SIGIR 2005 Workshop on Predicting Query Difficulty - Methods and Applications, 2005.
20. S. E. Robertson. The probability ranking principle in IR. Journal of Documentation, pages 294-304, 1977.
21. F. Scholer, H. E. Williams, and A. Turpin. Query association surrogates for web search. Journal of the American Society for Information Science and Technology (JASIST), 55(7):637-650, 2004.
22. A. Shtok, O. Kurland, and D. Carmel. Predicting query performance by query-drift estimation. In Proceedings of ICTIR, pages 305-312, 2009.
23. F. Song and W. B. Croft. A general language model for information retrieval (poster abstract). In Proceedings of SIGIR, pages 279-280, 1999.
24. N. Soskin, O. Kurland, and C. Domshlak. Navigating in the dark: Modeling uncertainty in ad hoc retrieval using multiple relevance models. In Proceedings of ICTIR, pages 79-91, 2009.
25. S. Tomlinson. Robust, Web and Terabyte Retrieval with Hummingbird Search Server at TREC 2004. In Proceedings of TREC-13, 2004.
26. V. Vinay, I. J. Cox, N. Milic-Frayling, and K. R. Wood. On ranking the effectiveness of searches. In Proceedings of SIGIR, pages 398-404, 2006.
27. E. M. Voorhees. Overview of the TREC 2004 Robust Retrieval Track. In Proceedings of TREC-13, 2004.
28. M. Winaver, O. Kurland, and C. Domshlak. Towards robust query expansion: Model selection in the language model framework to retrieval. In Proceedings of SIGIR, pages 729-730, 2007.
29. E. Yom-Tov, S. Fine, D. Carmel, and A. Darlow. Learning to estimate query difficulty: including applications to missing content detection and distributed information retrieval. In Proceedings of SIGIR, pages 512-519, 2005.
30. C. Zhai and J. D. Lafferty. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of SIGIR, pages 334-342, 2001.
31. Y. Zhao, F. Scholer, and Y. Tsegay. Effective pre-retrieval query performance prediction using similarity and variability evidence. In ECIR, pages 52-64, 2008.
32. Y. Zhou. Retrieval Performance Prediction and Document Quality. PhD thesis, University of Massachusetts, September 2007.
33. Y. Zhou and W. B. Croft. Ranking robustness: a novel framework to predict query performance. In Proceedgins of CIKM, pages 567-574, 2006.
34. Y. Zhou and W. B. Croft. Query performance prediction in web search environments. In Proceedings of SIGIR, pages 543-550, 2007.