A comparison of user and system query performance predictions

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2010, Pages 979-988

  Hauff, Claudia ^a   Kelly, Diane ^b   Azzopardi, Leif ^c  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b UNIVERSITY OF NORTH CAROLINA   (United States)

^c UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Query performance prediction; Query suggestions; User ratings

Indexed keywords

IN-LINE; INFORMATION NEED; PERFORMANCE RATINGS; QUERY PERFORMANCE; QUERY PERFORMANCE PREDICTION; QUERY SUGGESTION; QUERY SUGGESTIONS; RETRIEVAL EFFECTIVENESS; RETRIEVAL QUERY; SYSTEM PREDICTION; USER RATING;

KNOWLEDGE MANAGEMENT;

FORECASTING;

EID: 78651318810     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1871437.1871562     Document Type: Conference Paper

References (40)

1. J. Allan, B. Carterette, and J. Lewis. When will information retrieval be good enough? In SIGIR '05, pages 433-440, 2005.
2. J. Aslam, V. Pavlu, and E. Yilmaz. A statistical method for system evaluation using incomplete judgments. In SIGIR '06, pages 541-548, 2006.
3. R. Baeza-Yates, V. Murdock, and C. Hauff. Efficiency trade-offs in two-tier web search systems. In SIGIR '09, pages 163-170, 2009.
4. R. Baraglia, F. Cacheda, V. Carneiro, D. Fernandez, V. Formoso, R. Perego, and F. Silvestri. Search shortcuts: a new approach to the recommendation of queries. In RecSys '09, pages 77-84, 2009.
5. D. Beeferman and A. Berger. Agglomerative clustering of a search engine query log. In KDD '00, pages 407-416, 2000.
6. N. J. Belkin, C. Cool, D. Kelly, S.-J. Lin, S. Y. Park, J. Perez-Carballo, and C. Sikora. Iterative exploration, design and evaluation of support for query reformulation in interactive information retrieval. Inf. Process. Manage., 37(3):403-434, 2001.
7. C. L. Clarke, N. Craswell, and I. Soboroff. Preliminary report on the TREC 2009 Web Track. In TREC 2009 Notebook Papers, 2009.
8. S. Cronen-Townsend, Y. Zhou, and W. B. Croft. Predicting query performance. In SIGIR '02, pages 299-306, 2002.
9. F. Diaz. Performance prediction using spatial autocorrelation. In SIGIR '07, pages 583-590, 2007.
10. A. Diriye, A. Blandford, and A. Tombros. A polyrepresentational approach to interactive query expansion. In JCDL '09, pages 217-220, 2009.
11. M. Hancock-Beaulieu and S. Jones. Interactive searching and interface issues in the okapi best match probabilistic retrieval system. Interacting with Computers, 10(3):237-248, 1998.
12. C. Hauff, D. Hiemstra, and F. de Jong. A survey of pre-retrieval query performance predictors. In CIKM '08, pages 1419-1420, 2008.
13. C. Hauff, V. Murdock, and R. Baeza-Yates. Improved query difficulty prediction for the web. In CIKM '08, pages 439-448, 2008.
14. B. He and I. Ounis. Inferring query performance using pre-retrieval predictors. In SPIRE'04, pages 43-54, 2004.
15. J. He, M. Larson, and M. de Rijke. Using coherence-based measures to predict query difficulty. In ECIR'08, pages 689-694, 2008.
16. W. Hersh, A. Turpin, S. Price, B. Chan, D. Kramer, L. Sacherek, and D. Olson. Do batch and user evaluations give the same results? In SIGIR '00, pages 17-24, 2000.
17. D. Kelly, A. Cushing, M. Dostert, X. Niu, and K. Gyllstrom. Effects of popularity and quality on the usage of query suggestions during information search. In CHI '10, pages 45-54, 2010.
18. D. Kelly, K. Gyllstrom, and E. W. Bailey. A comparison of query and term suggestion features for interactive searching. In SIGIR '09, pages 371-378, 2009.
19. J. Koenemann and N. J. Belkin. A case for interaction: a study of interactive information retrieval behavior and effectiveness. In CHI '96, pages 205-212, 1996.
20. J. Mothe and L. Tanguy. Linguistic features to predict query difficulty - a case study on previous trec campaigns. In SIGIR'05 Query Prediction Workshop, 2005.
21. Y. Nemeth, B. Shapira, and M. Taeib-Maimon. Evaluation of the real and perceived value of automatic and interactive query expansion. In SIGIR '04, pages 526-527, 2004.
22. I. Ruthven. Re-examining the potential effectiveness of interactive query expansion. In SIGIR '03, pages 213-220, 2003.
23. F. Scholer, H. Williams, and A. Turpin. Query association surrogates for web search. J. Am. Soc. Inf. Sci. Technol., 55(7):637-650, 2004.
24. A. Shtok, O. Kurland, and D. Carmel. Predicting Query Performance by Query-Drift Estimation. In ICTIR '09, pages 305-312, 2009.
25. C. L. Smith and P. B. Kantor. User adaptation: good results from poor systems. In SIGIR '08, pages 147-154, 2008.
26. B. Smyth, E. Balfe, J. Freyne, P. Briggs, M. Coyle, and O. Boydell. Exploiting query repetition and regularity in an adaptive community-based web search engine. User Modeling and User-Adapted Interaction, 14(5):383-423, 2005.
27. M. Strohmaier, M. Kröll, and C. Körner. Intentional query suggestion: making user goals more explicit during search. In WSCD '09, pages 68-74, 2009.
28. A. Turpin and W. Hersh. Why batch and user evaluations do not give the same results. In SIGIR '01, pages 225-231, 2001.
29. A. Turpin and W. Hersh. Do clarity scores for queries correlate with user performance? In ADC '04, pages 85-91, 2004.
30. A. Turpin and F. Scholer. User performance versus precision measures for simple search tasks. In SIGIR '06, pages 11-18, 2006.
31. V. Vinay, I. J. Cox, N. Milic-Frayling, and K. Wood. On ranking the effectiveness of searches. In SIGIR '06, pages 398-404, 2006.
32. E. Voorhees and D. Harman. Overview of the sixth text retrieval conference (trec-6). In Proceedings of the Sixth Text REtrieval Conference, 1997.
33. E. M. Voorhees. Overview of the TREC 2005 Robust Retrieval Track. In TREC 2005, 2005.
34. R. W. White, M. Bilenko, and S. Cucerzan. Studying the use of popular destinations to enhance web search interaction. In SIGIR '07, pages 159-166, 2007.
35. R. W. White and G. Marchionini. Examining the effectiveness of real-time query expansion. Inf. Process. Manage., 43(3):685-704, 2007.
36. E. Yom-Tov, S. Fine, D. Carmel, and A. Darlow. Learning to estimate query difficulty: including applications to missing content detection and distributed information retrieval. In SIGIR '05, pages 512-519, 2005.
37. Y. Zhao and F. Scholer. Predicting query performance for user-based search tasks. In ADC '07, pages 112-115, 2007.
38. Y. Zhao, F. Scholer, and Y. Tsegay. Effective pre-retrieval query performance prediction using similarity and variability evidence. In ECIR '08, pages 52-64, 2008.
39. Y. Zhou and W. B. Croft. Ranking robustness: a novel framework to predict query performance. In CIKM '06, pages 567-574, 2006.
40. Y. Zhou and W. B. Croft. Query performance prediction in web search environments. In SIGIR '07, pages 543-550, 2007.