A probabilistic method for inferring preferences from clicks

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2011, Pages 249-258

  Hofmann, Katja ^a   Whiteson, Shimon ^a   De Rijke, Maarten ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

evaluation; implicit feedback; interleaved comparison

Indexed keywords

COMPARISON METHODS; DATA SETS; EVALUATION; EVALUATION METHOD; IMPLICIT FEEDBACK; INTERLEAVED COMPARISON; LEARNING TO RANK; PROBABILISTIC METHODS; RANKING FUNCTIONS; RELEVANCE JUDGMENT; SIMULATION FRAMEWORK; UNBIASED ESTIMATOR;

COMPUTER SIMULATION;

KNOWLEDGE MANAGEMENT;

EID: 83055168219     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2063576.2063618     Document Type: Conference Paper

References (27)

1. E. Agichtein, E. Brill, and S. Dumais. Improving web search ranking by incorporating user behavior information. In SIGIR '06, pages 19-26, 2006.
2. P. Bailey, N. Craswell, I. Soboroff, P. Thomas, A. P. de Vries, and E. Yilmaz. Relevance assessment: are judges exchangeable and does it matter. In SIGIR '08, pages 667-674, 2008.
3. L. D. Brown, T. T. Cai, and A. DasGupta. Interval estimation for a binomial proportion. Statistical Science, 16(2):pp. 101-117, 2001.
4. O. Chapelle and Y. Zhang. A dynamic bayesian network click model for web search ranking. In SIGIR '09, pages 1-10, 2009.
5. M. Claypool, P. Le, M. Wased, and D. Brown. Implicit interest indicators. In IUI'01, IUI '01, pages 33-40, 2001.
6. N. Craswell, O. Zoeter, M. Taylor, and B. Ramsey. An experimental comparison of click position-bias models. In WSDM '08, pages 87-94, 2008.
7. S. Fox, K. Karnawat, M. Mydland, S. Dumais, and T. White. Evaluating implicit measures to improve web search. ACM TOIS, 23(2):147-168, 2005. (Pubitemid 40786322)
8. F. Guo, L. Li, and C. Faloutsos. Tailoring click models to user goals. In WSCD '09, pages 88-92, 2009.
9. F. Guo, C. Liu, and Y. M. Wang. Efficient multiple-click models in web search. In WSDM '09, pages 124-131, 2009.
10. J. He, C. Zhai, and X. Li. Evaluation of methods for relative comparison of retrieval systems based on clickthroughs. In CIKM '09, pages 2029-2032, 2009.
11. K. Hofmann, B. Huurnink, M. Bron, and M. de Rijke. Comparing click-through data to purchase decisions for retrieval evaluation. In SIGIR '10, pages 761-762, 2010.
12. K. Hofmann, S. Whiteson, and M. de Rijke. Balancing exploration and exploitation in learning to rank online. In ECIR'11, pages 251-263, 2011.
13. K. Järvelin and J. Kekäläinen. Cumulated gain-based evaluation of IR techniques. ACM Trans. Inf. Syst., 20(4): 422-446, 2002.
14. T. Joachims. Optimizing search engines using clickthrough data. In KDD '02, pages 133-142, 2002.
15. T. Joachims. Evaluating retrieval performance using clickthrough data. In J. Franke, G. Nakhaeizadeh, and I. Renz, editors, Text Mining, pages 79-96. Springer Verlag, 2003.
16. S. Jung, J. L. Herlocker, and J. Webster. Click data as implicit relevance feedback in web search. IPM, 43(3): 791-807, 2007. Special Issue on Heterogeneous and Distributed IR. (Pubitemid 46149966)
17. D. Kelly. Implicit feedback: Using behavior to infer relevance. In New directions in cognitive information retrieval, pages 169-186. Springer, 2005.
18. D. Kelly and N. Belkin. Display time as implicit feedback: understanding task effects. In SIGIR '04, pages 377-384, 2004.
19. J. Langford, A. Strehl, and J. Wortman. Exploration scavenging. In ICML '08, pages 528-535, 2008.
20. R. Lippmann. Pattern classification using neural networks. Communications Magazine, IEEE, 27(11): 47-50, 2002.
21. F. Radlinski and N. Craswell. Comparing the sensitivity of information retrieval metrics. In SIGIR '10, pages 667-674, 2010.
22. F. Radlinski, R. Kleinberg, and T. Joachims. Learning diverse rankings with multi-armed bandits. In ICML '08, pages 784-791, 2008.
23. F. Radlinski, M. Kurup, and T. Joachims. How does clickthrough data reflect retrieval quality? In CIKM '08, pages 43-52, 2008.
24. F. Scholer, M. Shokouhi, B. Billerbeck, and A. Turpin. Using clicks as implicit judgments: expectations versus observations. In ECIR'08, pages 28-39, 2008.
25. X. Shen, B. Tan, and C. Zhai. Context-sensitive information retrieval using implicit feedback. In SIGIR '05, pages 43-50, 2005.
26. R. S. Sutton and A. G. Barto. Introduction to Reinforcement Learning. MIT Press, Cambridge, MA, USA, 1998.
27. R. White, I. Ruthven, J. Jose, and C. Rijsbergen. Evaluating implicit feedback models using searcher simulations. ACM TOIS, 23(3):325-361, 2005. (Pubitemid 43906379)