User model-based metrics for offline query suggestion evaluation

SIGIR 2013 - Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2013, Pages 633-642

  Kharitonov, Eugene ^a,b   Macdonald, Craig ^b   Serdyukov, Pavel ^a   Ounis, Iadh ^b  

^a YANDEX   (Russian Federation)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Evaluation measures; Query suggestions; User models

Indexed keywords

EVALUATION APPROACH; EVALUATION MEASURES; EVALUATION METHODOLOGIES; EVALUATION METRICS; QUERY SUGGESTION; RESEARCH COMMUNITIES; USER MODELS; USERS' EXPERIENCES;

MATHEMATICAL MODELS; RESEARCH; SEARCH ENGINES;

INFORMATION RETRIEVAL;

EID: 84883081321     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2484028.2484041     Document Type: Conference Paper

References (23)

1. R. Baeza-Yates, C. Hurtado, and M. Mendoza. Query recommendation using query logs in search engines. In Current Trends in Database Technology, Volume 3268 of LNCS, pages 588-596. 2005.
2. Z. Bar-Yossef and N. Kraus. Context-sensitive query auto-completion. In WWW '11.
3. P. N. Bennett, F. Radlinski, R. W. White, and E. Yilmaz. Inferring and using location metadata to personalize web search. In SIGIR '11.
4. B. Carterette, E. Kanoulas, and E. Yilmaz. Incorporating variability in user behavior into systems based evaluation. In CIKM '12.
5. O. Chapelle, S. Ji, C. Liao, E. Velipasaoglu, L. Lai, and S.-L. Wu. Intent-based diversification of web search results: metrics and algorithms. Inf. Retr., 2011.
6. O. Chapelle, D. Metlzer, Y. Zhang, and P. Grinspan. Expected reciprocal rank for graded relevance. In CIKM '09.
7. O. Chapelle and Y. Zhang. A dynamic bayesian network click model for web search ranking. In WWW '09.
8. C. L. Clarke, M. Kolla, G. V. Cormack, O. Vechtomova, A. Ashkan, S. Büttcher, and I. MacKinnon. Novelty and diversity in information retrieval evaluation. In SIGIR '08.
9. C. Cleverdon. The Cranfield tests on index language devices. Aslib Proceedings, 19(6):173-194, 1967.
10. K. Collins-Thompson, P. N. Bennett, R. W. White, S. de la Chica, and D. Sontag. Personalizing web search results by reading level. In CIKM '11.
11. N. Craswell, O. Zoeter, M. Taylor, and B. Ramsey. An experimental comparison of click position-bias models. In WSDM '08.
12. H. Duan and B.-J. P. Hsu. Online spelling correction for query completion. In WWW '11.
13. G. E. Dupret and B. Piwowarski. A user browsing model to predict search engine click data from past observations. In SIGIR '08.
14. K. Järvelin and J. Kekäläinen. Cumulated gain-based evaluation of ir techniques. ACM Trans. Inf. Syst., 20(4):422-446, 2002.
15. F. Radlinski and N. Craswell. Comparing the sensitivity of information retrieval metrics. In SIGIR '10.
16. F. Radlinski, M. Kurup, and T. Joachims. How does clickthrough data reflect retrieval quality? In CIKM '08.
17. M. Sanderson, M. L. Paramita, P. Clough, and E. Kanoulas. Do user preferences and evaluation measures line up? In SIGIR '10.
18. M. Shokouhi and K. Radinsky. Time-sensitive query auto-completion. In SIGIR '12.
19. A. Strizhevskaya, A. Baytin, I. Galinskaya, and P. Serdyukov. Actualization of query suggestions using query logs. In WWW '12 Companion.
20. E. Voorhees. The philosophy of information retrieval evaluation. In Evaluation of Cross-Language Information Retrieval Systems, LNCS, pages 355-370. 2002.
21. E. Yilmaz, M. Shokouhi, N. Craswell, and S. Robertson. Expected browsing utility for web search evaluation. In CIKM '10.
22. Y. Zhang, W. Chen, D. Wang, and Q. Yang. User-click modeling for understanding and predicting search-behavior. In KDD '11.
23. X. Zhu, J. Guo, X. Cheng, and Y. Lan. More than relevance: high utility query recommendation by mining users' search behaviors. In CIKM '12.