Accurately interpreting clickthrough data as implicit feedback

SIGIR 2005 - Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2005, Pages 154-161

  Joachims, Thorsten ^a   Granka, Laura ^b   Pan, Bing ^c   Hembrooke, Helene ^c   Gay, Geri ^c  

^a Department of Computer Science and School of Operations Research and Information Engineering   (United States)

^b STANFORD UNIVERSITY   (United States)

^c Social Dynamics Laboratory   (United States)

Author keywords

clickthrough; eyetracking; implicit feedback; WWW search

Indexed keywords

CLICKTHROUGH; CLICKTHROUGH DATA; DECISION PROCESS; EYE-TRACKING; IMPLICIT FEEDBACK; RELEVANCE JUDGMENT;

INFORMATION RETRIEVAL;

EID: 84885665252     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1076034.1076063     Document Type: Conference Paper

References (26)

1. R. Almeida and V. Almeida. A community-aware search engine. In Proceedings of the World Wide Web Conference (WWW), 2004.
2. B. Bartell, G. Cottrell, and R. Belew. Automatic combination of multiple ranked retrieval systems. In Annual ACM SIGIR Conf. on Research and Development in Information Retrieval (SIGIR), pages 173-181, 1994.
3. R. Belew. Finding Out About. Cambridge, 2000.
4. J. Boyan, D. Freitag, and T. Joachims. A machine learning architecture for optimizing web search engines. In AAAI Workshop on Internet Based Information Systems, pages 1-8, August 1996.
5. A. Broder. A taxonomy of web search. SIGIR Forum, 36(2):3-10, 2002.
6. M. Claypool, P. Le, M. Waseda, and D. Brown. Implicit interest indicators. In International Conference on Intelligent User Interfaces (IUI), pages 33-40, 2001.
7. W. Cohen, R. Shapire, and Y. Singer. Learning to order things. Journal of Artificial Intelligence Research, 10:243-270, 1999. (Pubitemid 30573909)
8. S. Fox, K. Karnawat, M. Mydland, S. Dumais, and T. White. Evaluating implicit measures to improve the search experiences. In Talk presented at SIGIR03 Workshop on Implicit Measures of User Interests and Preferences, 2003.
9. N. Fuhr. Optimum polynomial retrieval functions based on the probability ranking principle. ACM Transactions on Information Systems, 7(3):183-204, 1989. (Pubitemid 21660000)
10. J. Goldberg, M. Stimson, M. Lewenstein, M. Scott, and A. Wichansky. Eye-tracking in web search tasks: design implications. In Proceedings of the Eye tracking Research and Applications Symposium (ETRA), pages 51-58, 2002.
11. L. Granka, T. Joachims, and G. Gay. Eye-tracking analysis of user behavior in www search. In ACM Conference on Research and Development in Information Retrieval (SIGIR), 2004.
12. T. Halverson and A. Hornof. Link colors guide a search. In ACM Conference on Computer-Human Interaction (CHI), 2004.
13. S. Holland, M. Ester, and W. Kieling. Preference mining: A novel approach on mining user preferences for personalized applications. In Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD), pages 204-216, 2003.
14. T. Joachims. Optimizing search engines using clickthrough data. In Proceedings of the ACM Conference on Knowledge Discovery and Data Mining (KDD), 2002.
15. M. Just and P. Carpenter. A theory of reading: From eye fixations to comprehension. Psychological Review, 87:329-354, 1980.
16. D. Kelly and N. Belkin. Display time as implicit feedback: Understanding task effects. In ACM International Conference on Research and Development in Information Retrieval (SIGIR), pages 377-384, 2004.
17. D. Kemp and K. Ramamohanarao. Long-term learning for web search engines. In European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD), pages 263-274, 2002.
18. K. Kloeckner, N. Wirschum, and A. Jameson. Depth- and breadth-first processing of search result lists. In ACM Conference on Computer-Human Interaction, 2004.
19. C. Lankford. Gazetracker: software designed to facilitate eye movement analysis. In Proceedings of Eye Tracking Research & Applications, pages 51-55, 2000.
20. M. Morita and Y. Shinoda. Information filtering based on user behavior analysis and best match text retrieval. In ACM Conference on Research and Development in Information Retrieval (SIGIR), pages 272-281, 1994.
21. B. Pan, H. Hembrooke, G. Gay, L. Granka, M. Feusner, and J. Newman. The determinants of web page viewing behavior: An eye tracking study. In S. Spencer, editor, Proceedings of Eye Tracking Research & Applications. ACM, New York, 2004.
22. F. Radlinski and T. Joachims. Query chains: Learning to rank from implicit feedback. In ACM SIGKDD International Conference On Knowledge Discovery and Data Mining (KDD), 2005.
23. K. Rayner. Eye movements in reading and information processing. Psychological Bulletin, 124:372-252, 1998.
24. E. Russo and F. LeClerc. An eye-fixation analysis of choice processes for consumer nondurables. Journal of Consumer Research, 21(2):274-290, 1994.
25. J. Salogarvi, I. Kojo, S. Jaana, and S. Kaski. Can relevance be inferred from eye movements in information retrieval? In Proceedings of the Workshop on Self-Organizing Maps, pages 261-266, 2003.
26. R. White, J. Jose, and I. Ruthven. Comparing explicit and implicit feedback techniques for web retrieval: Trec-10 interactive track report. In Text Retrieval Conference (TREC), 2001.