How well does result relevance predict session satisfaction?

Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR'07

Volumn , Issue , 2007, Pages 567-574

  Huffman, Scott B ^a   Hochster, Michael ^a  

^a GOOGLE INC   (United States)

Author keywords

Precision; Relevance metrics; Search evaluation; User satisfaction

Indexed keywords

MATHEMATICAL MODELS; PRECISION ENGINEERING; QUERY PROCESSING; USER INTERFACES;

RELEVANCE METRICS; SEARCH EVALUATION; USER SATISFACTION;

SEARCH ENGINES;

EID: 36448951157     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1277741.1277839     Document Type: Conference Paper

References (19)

1. J. Allan, B. Carterette, and J. Lewis. When will information retrieval be "good enough"? In SIGIR, '05: Proceedings of the 28th annual international ACM SIGIR, conference on Research and development in information retrieval, pages 433-440, New York, NY, USA, 2005. ACM Press.
2. D. Bilal. Children's use of the Yahooligans! Web search engine: Cognitive, physical, and affective behaviors on fact-based search tasks. J. Am. Soc. Inf. Sci., 51(7):646-665, 2000.
3. P. Borlund. The IIR, evaluation model: a framework for evaluation of interactive information retrieval systems. Information Research, 8(3), April 2003.
4. A. Broder. A taxonomy of web search. SIGIR. Forum, 36(2):3-10, 2002.
5. C. Buckley and E. M. Voorhees. Evaluating evaluation measure stability. In SIGIR. '00: Proceedings of the 23rd annual international A CM SIGIR. conference on Research and development in information retrieval, pages 33-40, New York, NY, USA, 2000. ACM Press.
6. C. Buckley and E. M. Voorhees. Retrieval evaluation with incomplete information. In SIGIR. '04: Proceedings of the 27th annual international A CM SIGIR. conference on Research and development in information retrieval, pages 25-32, New York, NY, USA, 2004. ACM Press.
7. C. W. Cleverdon. The significance of the Cranfield tests on index languages. In SIGIR, '91: Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, pages 3-12, New York, NY, USA, 1991. ACM Press.
8. B. J. Jansen and U. Pooch. A review of web searching studies and a framework for future research. J. Am. Soc. Inf. Sci. Technol., 52(3):235-246, 2001.
9. K. Jarvelin and J. Kekalainen. Cumulated gain-based evaluation of IR, techniques. A CM Trans. Inf. Syst., 20(4):422-446, 2002.
10. D. Kahneman, P. P. Wakker, and R. Sarin. Back to Bentham? Explorations of experienced utility. The Quarterly Journal of Economics, 112(2):375-405, May 1997.
11. J. Reid. A task-oriented non-interactive evaluation methodology for information retrieval systems. Information Retrieval, 2(1):115-129, 2000.
12. D. E. Rose and D. Levinson. Understanding user goals in web search. In WWW '04: Proceedings of the 13th international conference on World Wide Web, pages 13-19, New York, NY, USA, 2004. ACM Press.
13. D. M. Russell and C. Grimes. Assigned and self-chosen tasks are not the same in web search. In HICSS '07: Proceedings of the 40th Annual International Conference on Systems and Software, 2007.
14. M. Sanderson and J. Zobel. Information retrieval system evaluation: effort, sensitivity, and reliability. In SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pages 162-169, New York, NY, USA, 2005. ACM Press.
15. A. Spink. A user-centered approach to evaluating human interaction with web search engines: an exploratory study. Inf. Process. Manage., 38(3):401-426, 2002.
16. J. Teevan, C. Alvarado, M. S. Ackerman, and D. R. Karger. The perfect search engine is not enough: A study of orienteering behavior in directed search. In CHI '04: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 415-422, New York, NY, USA, 2004. "ACM Press.
17. A. Turpin and F. Scholer. User performance versus precision measures for simple search tasks. In SIGIR. '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, pages 11-18, New York, NY, USA, 2006. ACM Press.
18. A. H. Turpin and W. Hersh. Why batch and user evaluations do not give the same results. In SIGIR, '01: Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, pages 225-231, New York, NY, USA, 2001. ACM Press.
19. E. M. Voorhees. Evaluation by highly relevant documents. In SIGIR, '01: Proceedings of the 24th annual international A CM SIGIR, conference on Research and development in information retrieval, pages 74-82, New York, NY, USA, 2001. ACM Press.