Absence time and user engagement: Evaluating ranking functions

WSDM 2013 - Proceedings of the 6th ACM International Conference on Web Search and Data Mining

Volumn , Issue , 2013, Pages 173-182

  Dupret, Georges ^a   Lalmas, Mounia ^a  

^a YAHOO RESEARCH   (United States)

Author keywords

clickthrough data; metrics; ranking evaluation; search engine; time between visits; user engagement; usinterleaving

Indexed keywords

CLICKTHROUGH DATA; METRICS; RANKING EVALUATION; TIME BETWEEN VISITS; USER ENGAGEMENT; USINTERLEAVING;

DATA MINING; INFORMATION RETRIEVAL; SEARCH ENGINES;

WEBSITES;

EID: 84874250799     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2433396.2433418     Document Type: Conference Paper

References (20)

1. AALEN, O., BORGAN, O., AND GJESSING, H. Survival and Event History Analysis: A Process Point of View. Statistics for Biology and Health. Springer, 2008.
2. AGICHTEIN, E., BRILL, E., AND DUMAIS, S. Improving web search ranking by incorporating user behavior information. In 29th annual international ACM SIGIR conference on Research and development in information retrieval (2006), pp. 19-26.
3. BILENKO, M., AND WHITE, R. W. Mining the search trails of surfing crowds: identifying relevant websites from user activity. In 17th international conference on World Wide Web (2008), pp. 51-60.
4. BOLDI, P., BONCHI, F., CASTILLO, C., DONATO, D., GIONIS, A., AND VIGNA, S. The query-flow graph: model and applications. In Proceedings of the 17th ACM Conference on Information and Knowledge Management (2008), pp. 609-618.
5. CARTERETTE, B., AND JONES, R. Evaluating search engines by modeling the relationship between relevance and clicks. In Advances in Neural Information Processing Systems 20, Proceedings of the Twenty-First Annual Conference on Neural Information Processing Systems (2007).
6. CHAPELLE, O., JOACHIMS, T., RADLINSKI, F., AND YUE, Y. Large-scale validation and analysis of interleaved search evaluation. ACM Trans. Inf. Syst. 30, 1 (2012), 6.
7. CHAPELLE, O., AND ZHANG, Y. A dynamic bayesian network click model for web search ranking. In Proceedings of the 18th International Conference on World Wide Web, WWW 2009, Madrid, Spain (2009).
8. DUPRET, G., AND PIWOWARSKI, B. A user behavior model for average precision and its generalization to graded judgments. In Proceedings of the 33st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR (2010), pp. 531-538.
9. EKLUND, A. survplot: Plot survival curves with number-at-risk, 2011. R package version 0.0.5.
10. HASSAN, A., JONES, R., AND KLINKNER, K. L. Beyond DCG: user behavior as a predictor of a successful search. In Proceedings of the third ACM international conference on Web search and data mining (2010), WSDM '10, pp. 221-230.
11. HUANG, J., WHITE, R. W., BUSCHER, G., AND WANG, K. Improving searcher models using mouse cursor activity. In 35th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) (2012).
12. HUANG, J., WHITE, R. W., AND DUMAIS, S. T. No clicks, no problem: using cursor movements to understand and improve search. In CHI Conference on Human Factors in Computing Systems (2011), pp. 1225-1234.
13. JÄRVELIN, K., AND KEKÄLÄINEN, J. Cumulated gain-based evaluation of ir techniques. ACM Trans. Inf. Syst. 20, 4 (2002), 422-446.
14. JONES, R., AND KLINKNER, K. L. Beyond the session timeout: automatic hierarchical segmentation of search topics in query logs. In 17th ACM conference on Information and knowledge management (2008), pp. 699-708.
15. LEHMANN, J., LALMAS, M., YOM-TOV, E., AND DUPRET, G. Models of user engagement. In 20th conference on User Modeling, Adaptation, and Personalization (2012).
16. LI, L., CHU, W., LANGFORD, J., AND WANG, X. Unbiased offline evaluation of contextual-bandit-based news article recommendation algorithms. In Proceedings of the Forth International Conference on Web Search and Web Data Mining, WSDM (2011), pp. 297-306.
17. LIU, Y., GAO, B., LIU, T.-Y., ZHANG, Y., MA, Z., HE, S., AND LI, H. BROWSERANK: letting web users vote for page importance. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (2008), pp. 451-458.
18. R DEVELOPMENT CORE TEAM. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2011. ISBN 3-900051-07-0.
19. RADLINSKI, F., KURUP, M., AND JOACHIMS, T. How does clickthrough data reflect retrieval quality? In Proceeding of the 17th ACM conference on Information and knowledge management (2008), pp. 43-52.
20. THERNEAU, T., AND ORIGINAL SPLUS->R PORT BY THOMAS LUMLEY. survival: Survival analysis, including penalised likelihood., 2011. R package version 2.36-9.