Find it if you can: A game for modeling different types of web search success using interaction data

SIGIR'11 - Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2011, Pages 345-354

  Ageev, Mikhail ^a   Guo, Qi ^b   Lagun, Dmitry ^b   Agichtein, Eugene ^b  

^a MOSCOW STATE UNIVERSITY   (Russian Federation)

^b EMORY UNIVERSITY   (United States)

Author keywords

Query log analysis; User studies; Web search success

Indexed keywords

BEHAVIORAL RESEARCH; INFORMATION RETRIEVAL; WEBSITES;

BEHAVIOR ANALYSIS; DATA COLLECTION; QUERY LOG ANALYSIS; SEARCH BEHAVIOR; STATE-OF-THE-ART METHODS; SUCCESSFUL SEARCH; USER STUDY; WEB SEARCHES;

SEARCH ENGINES;

EID: 80052112523     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2009916.2009965     Document Type: Conference Paper

References (31)

1. Azzah Al-Maskari, Mark Sanderson, and Paul Clough. 2007. The relationship between IR effectiveness measures and user satisfaction. In Proc. of SIGIR 2007
2. Anne Aula, Rehan M. Khan, and Zhiwei Guan. How does search behavior change as search becomes more difficult? In Proc. of CHI 2010
3. Steven M. Beitzel, Eric C. Jensen, Abdur Chowdhury, David Grossman, and Ophir Frieder. 2004. Hourly analysis of a very large topically categorized web query log. In Proc. of SIGIR 2004
4. Charles L.A. Clarke, Maheedhar Kolla, Gordon V. Cormack, Olga Vechtomova, Azin Ashkan, Stefan Büttcher, and Ian MacKinnon. Novelty and diversity in information retrieval evaluation. In Proc. SIGIR'08, 659-666, 2008.
5. Honghua (Kathy) Dai, Lingzhi Zhao, Zaiqing Nie, Ji-Rong Wen, Lee Wang, and Ying Li. 2006. Detecting online commercial intention (OCI). In Proc. of WWW 2006
6. Ali Dasdan, Kostas Tsioutsiouliklis, and Emre Velipasaoglu. 2010. Web search engine metrics: (direct metrics to measure user satisfaction). In Proc. of WWW 2010
7. Dobrov B., Loukachevitch N., Dobrov G., Reznikov Y., Shternov S. Study of Query Transformations in the First Round of Yandex's Cup. In Proc. of "Internet-Mathematics-2005", (in Russian)
8. D. Downey, S. Dumais, and E. Horvitz. Models of searching and browsing: Languages, studies, and applications. Journal of the American Society for Information Science and Technology (JASIST), 58(6):862-871, 2007
9. Dupret, G. and Liao, C. A model to estimate intrinsic document relevance from the clickthrough logs of a web search engine. In Proc. of WSDM 2010, 181-190
10. Henry A. Feild, James Allan, and Rosie Jones. Predicting searcher frustration. In Proc. of SIGIR 2010
11. Ahmed Hassan, Rosie Jones, and Kristina Lisa Klinkner. Beyond DCG: user behavior as a predictor of a successful search. In Proc. of WSDM 2010
12. Jeff Huang and Efthimis N. Efthimiadis. 2009. Analyzing and evaluating query reformulation strategies in web search logs. In Proc. of SIGIR 2009
13. Scott B. Huffman, Michael Hochster, How well does result relevance predict session satisfaction? In Proc. of SIGIR 2007
14. Bernard J. Jansen, Web Analytics. In Synthesis Lectures on Information Concepts, (Retrieval, and Services), Morgan & Claypool, 2009
15. Bernard J. Jansen, Danielle Booth, and Amanda Spink. 2009. Predicting query reformulation during web searching. In Proc. of CHI 2009 Extended Abstracts
16. Bernard J. Jansen, Amanda Spink, and Tefko Saracevic. 2000. Real life, real users, and real needs: a study and analysis of user queries on the web. Inf. Process. Manage. 36, 2 (January 2000), 207-227 (Pubitemid 30550546)
17. Bernard J. Jansen and Amanda Spink. 2006. How are we searching the world wide web?: a comparison of nine search engine transaction logs. Inf. Process. Manage. 42, 1 (January 2006), 248-263. (Pubitemid 41119088)
18. Kalervo Järvelin. 2009. Explaining User Performance in Information Retrieval: Challenges to IR Evaluation. In Proc. of ICTIR '09
19. Diane Kelly, Methods for Evaluating Interactive Information Retrieval Systems with Users, Foundations and Trends in Information Retrieval, v.3 n.1-2, p.1-224, January 2009
20. J. Lafferty, A. McCallum, and F. Pereira. Conditional random Fields: Probabilistic models for segmenting and labeling sequence data. In Proc. ICML-01, pages 282-289, 2001.
21. Chang Liu, Jacek Gwizdka, and Jingjing Liu. 2010. Helping identify when users find useful documents: examination of query reformulation intervals. In Proceeding of the third symposium on Information interaction in context (IIiX 2010).
22. Ma, H. and Chandrasekar, R. and Quirk, C. and Gupta, A. Page hunt: improving search engines using human computation games. In Proc. of SIGIR 2009, 746-747
23. Benjamin Piwowarski, Georges Dupret, and Rosie Jones. 2009. Mining user web search activity with layered bayesian networks or how to capture a click in its context. In Proc. of WSDM 2009
24. Mark Sanderson, Monica Lestari Paramita, Paul Clough, and Evangelos Kanoulas. 2010. Do user preferences and evaluation measures line up?. In Proc. of SIGIR 2010
25. Catherine L. Smith and Paul B. Kantor. 2008. User adaptation: good results from poor systems. In Proc. of SIGIR 2008.
26. Andrew Turpin and Falk Scholer. 2006. User performance versus precision measures for simple search tasks. In Proc. of SIGIR 2006
27. E.M. Voorhees, H.T. Dang. Overview of the TREC 2005 Question Answering Track, NIST.
28. Ryen W. White, Paul N. Bennett, and Susan T. Dumais. 2010. Predicting short-term interests using activity-based search context. In Proceedings of the 19th ACM international conference on Information and knowledge management (CIKM 2010)
29. Ryen W. White and Dan Morris. Investigating the querying and browsing behavior of advanced search engine users. In Proc. of SIGIR 2007.
30. Ya Xu and David Mease. 2009. Evaluating web search using task completion time. In Proc. of SIGIR 2009.
31. Yandex Internet Search Competitions http://kubok.yandex.ru/organize-eng. html