Beyond position bias: Examining result attractiveness as a source of presentation bias in clickthrough data

Proceedings of the 19th International Conference on World Wide Web, WWW '10

Volumn , Issue , 2010, Pages 1011-1015

  Yue, Yisong ^a   Patel, Rajan ^b   Roehrig, Hein ^b  

^a Department of Computer Science and School of Operations Research and Information Engineering   (United States)

^b GOOGLE INC   (United States)

Author keywords

click logs; implicit feedback; presentation bias

Indexed keywords

BIAS EFFECTS; CLICKTHROUGH DATA; IMPLICIT FEEDBACK; POTENTIAL SOURCES; SYSTEMATIC BIAS; USER BEHAVIORS; WEB SEARCH ENGINES;

BEHAVIORAL RESEARCH; INFORMATION RETRIEVAL; INFORMATION RETRIEVAL SYSTEMS; SEARCH ENGINES;

WORLD WIDE WEB;

EID: 77954572679     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1772690.1772793     Document Type: Conference Paper

References (26)

1. E. Agichtein, E. Brill, and S. Dumais. Improving web search ranking by incroporating user behavior. In ACM Conference on Information Retrieval (SIGIR), 2006.
2. E. Agichtein, E. Brill, S. Dumais, and R. Ragno. Learning user interaction models for predicting web search result preferences. In ACM Conference on Information Retrieval (SIGIR), 2006.
3. L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996.
4. O. Chapelle and S. S. Keerthi. Efficient algorithms for ranking with svms. Information Retrieval Journal, 2009.
5. O. Chapelle and Y. Zhang. A dynamic bayesian network click model for web search ranking. In World Wide Web Conference (WWW), 2009.
6. C. Clarke, E. Agichtein, S. Dumais, and R. White. The influence of caption features on clickthrough patterns in web search. In ACM Conference on Information Retrieval (SIGIR), 2007.
7. C. Clarke, M. Kolla, G. Cormack, O. Vechtomova, A. Ashkan, S. Büttcher, and I. Mackinnon. Novelty and diversity in information retrieval evaluation. In ACM Conference on Information Retrieval (SIGIR), 2008.
8. N. Craswell, O. Zoeter, M. Taylor, and B. Ramsey. An experimental comparison of click position-bias models. In ACM Conference on Web Search and Data Mining (WSDM), 2008.
9. P. Donmez, K. Svore, and C. Burges. On the local optimality of lambdarank. In ACM Conference on Information Retrieval (SIGIR), 2009.
10. G. Dupret and B. Piwowarski. A user browsing model to predict search engine click data from past observations. In ACM Conference on Information Retrieval (SIGIR), 2008.
11. Y. Freund, R. Iyer, R. Schapire, and Y. Singer. An efficient boosting algorithm for combining preferences. Journal of Machine Learning Research (JMLR), 4:933-969, 2003.
12. D. Hosmer and S. Lemeshow. Applied Logistic Regression. Wiley, 2000.
13. T. Joachims. Optimizing search engines using clickthrough data. In ACM Conference on Knowledge Discovery and Data Mining (KDD), 2002.
14. T. Joachims, L. Granka, B. Pan, H. Hembrooke, F. Radlinski, and G. Gay. Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search. ACM Transactions on Information Systems (TOIS), 25(2), April 2007.
15. D. Kelly and J. Teevan. Implicit feedback for inferring user preference: A bibliography. ACM SIGIR Forum, 37(2):18-28, 2003.
16. R. Khan, D. Mease, and R. Patel. The impact of result abstracts on task completion time. In WWW Workshop on Web Search Result Summarization and Presentation, 2009.
17. M. Murata, H. Toda, Y. Matsuura, and R. Kataoka. Query-page intention matching using clicked titles and snippets to boost search rankings. In ACM Joint Conference on Digital Libraries (JCDL), 2009.
18. L. Page, S. Brin, R. Motwani, and T. Winograd. The pagerank citation ranking: Bringing order to the web. Technical Report 1999-66, Stanford InfoLab, November 1999.
19. F. Radlinski and T. Joachims. Minimally invasive randomization for collecting unbiased preferences from clickthrough logs. In Conference of the Association for the Advancement of Artificial Intelligence (AAAI), 2006.
20. F. Radlinski and T. Joachims. Active exploration for learning rankings from clickthrough data. In ACM International Conference On Knowledge Discovery and Data Mining (KDD), 2007.
21. F. Radlinski, M. Kurup, and T. Joachims. How does clickthrough data reflect retrieval quality? In Conference on Information and Knowledge Management (CIKM), 2008.
22. A. Turpin and F. Scholer. User performance versus precision measures for simple search tasts. In ACM Conference on Information Retrieval (SIGIR), 2006.
23. E. M. Vorhees and D. K. Harman, editors. TREC: Experiment and Evaluation in Information Retrieval. MIT Press, 2005.
24. K. Wang, T. Walker, and Z. Zheng. Pskip: Estimating relevance ranking quality from web search clickthrough data. In ACM Conference on Knowledge Discovery and Data Mining (KDD), 2009.
25. Y. Yue, T. Finley, F. Radlinski, and T. Joachims. A support vector method for optimizing average precision. In ACM Conference on Information Retrieval (SIGIR), 2007.
26. C. Zhai, W. W. Cohen, and J. Lafferty. Beyond independent relevance: Methods and evaluation metric for subtopic retrieval. In ACM Conference on Information Retrieval (SIGIR), 2003.