A model to estimate intrinsic document relevance from the clickthrough logs of a web search engine

WSDM 2010 - Proceedings of the 3rd ACM International Conference on Web Search and Data Mining

Volumn , Issue , 2010, Pages 181-190

  Dupret, Georges ^a   Liao, Ciya ^a  

^a YAHOO RESEARCH   (United States)

Author keywords

Clickthrough data; Search engines; User behavior model

Indexed keywords

AVERAGE NUMBERS; CLICKTHROUGH DATA; LEARNING TO RANK; MACHINE LEARNING ALGORITHMS; MODEL-BASED; NEW MODEL; RANKING FUNCTIONS; USER BEHAVIORS; WEB SEARCH ENGINES;

BEHAVIORAL RESEARCH; ENGINES; INFORMATION RETRIEVAL; LEARNING ALGORITHMS; SEARCH ENGINES;

WORLD WIDE WEB;

EID: 77950921696     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1718487.1718510     Document Type: Conference Paper

References (24)

1. E. Agichtein, E. Brill, and S. Dumais. Improving web search ranking by incorporating user behavior information. In Proceedings of ACM SIGIR 2006, pages 19-26, New York, NY, USA, 2006. ACM Press.
2. E. Agichtein, E. Brill, S. Dumais, and R. Ragno. Learning user interaction models for predicting web search result preferences. In Proceedings of ACM SIGIR 2006, pages 3-10, New York, NY, USA, 2006. ACM Press.
3. P. Boldi, F. Bonchi, C. Castillo, D. Donato, A. Gionis, and S. Vigna. The query-flow graph: model and applications. In CIKM '08: Proceeding of the 17th ACM conference on Information and knowledge mining, pages 609-618, New York, NY, USA, 2008. ACM.
4. A. Broder. A taxonomy of web search. SIGIR Forum, 36(2):3-10, 2002.
5. B. Carterette and R. Jones. Evaluating search engines by modeling the relationship between relevance and clicks. Advances in Neural Information Processing Systems, 20:217-224, 2008.
6. O. Chapelle and Y. Zhang. A dynamic bayesian network click model for web search ranking. In WWW '09: Proceedings of the 18th international conference on World wide web, pages 1-10, New York, NY, USA, 2009. ACM.
7. N. Craswell, O. Zoeter, M. Taylor, and B. Ramsey. An experimental comparison of click position-bias models. In First ACM International Conference on Web Search and Data Mining WSDM 2008, 2008.
8. D. Downey, S. T. Dumais, and E. Horvitz. Models of searching and browsing: Languages, studies, and application. In IJCAI, pages 2740-2747, 2007.
9. G. Dupret, V. Murdock, and B. Piwowarski. Web search engine evaluation using clickthrough data and a user model. In WWW2007 workshop Query Log Analysis: Social and Technological Challenges, 2007.
10. G. Dupret and B. Piwowarski. A user browsing model to predict search engine click data from past observations. In A. Press, editor, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, 2008.
11. L. Granka, T. Joachims, and G. Gay. Eye-tracking analysis of user behavior in www search. In Proceedings of ACM SIGIR 2004, New York, NY, USA, 2004. ACM Press.
12. F. Guo, C. Liu, and Y. M. Wang. Efficient multiple-click models in web search. In WSDM '09: Proceedings of the Second ACM International Conference on Web Search and Data Mining, pages 124-131, New York, NY, USA, 2009. ACM.
13. F. Guo, C. Liu, and Y. M. Wang. Efficient multiple-click models in web search. In R. A. Baeza-Yates, P. Boldi, B. A. Ribeiro-Neto, and B. B. Cambazoglu, editors, WSDM, pages 124-131. ACM, 2009.
14. A. Hassan, R. Jones, and K. Klinkner. Beyond dcg: User behavior as a predictor of a successful search. 2009.
15. S. Ji, K. Zhao, C. Liao, Z. Zheng, G. Xue, O. Chapelle, G. Sun, and H. Zha. Global ranking by exploiting user clicks. In Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pages 35-42, 2009.
16. T. Joachims. Evaluating search engines using clickthrough data. Department of Computer Science, Cornell University, 2002.
17. T. Joachims. Optimizing search engines using clickthrough data. In KDD '02: Proceedings of the eighth ACM SIGKDD, pages 133-142, New York, NY, USA, 2002. ACM Press.
18. T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay. Accurately interpreting clickthrough data as implicit feedback. In Proceedings of ACM SIGIR 2005, pages 154-161, New York, NY, USA, 2005. ACM Press.
19. T. Joachims, L. Granka, B. Pan, H. Hembrooke, F. Radlinski, and G. Gay. Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search. ACM Transactions on Information Systems (TOIS), 25(2), 2007.
20. K. Järvelin and J. Kekäläinen. Cumulated gain-based evaluation of ir techniques. ACM Trans. Inf. Syst., 20(4):422-446, 2002.
21. D. Kelly. Implicit feedback: Using behavior to infer relevance. In A. Spink and C. Cole, editors, New Directions in Cognitive Information Retrieval, pages 169 - 186. Springer Publishing, Netherlands, 2005.
22. B. Piwowarski, G. Dupret, and R. Jones. Mining user web search activity with layered bayesian networks or how to capture a click in its context. In WSDM '09: Proceedings of the Second ACM International Conference on Web Search and Data Mining, pages 162-171, New York, NY, USA, 2009. ACM.
23. R. W. White and S. M. Drucker. Investigating behavioral variability in web search. In WWW '07, pages 21-30, New York, NY, USA, 2007. ACM.
24. Z. Zheng, H. Zha, K. Chen, and G. Sun. A regression framework for learning ranking functions using relative relevance judgments. In Proceedings of the 30th ACM SIGIR conference, 2007.