Time drives interaction: Simulating sessions in diverse searching environments

SIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2012, Pages 105-114

  Baskaya, Feza ^a   Keskustalo, Heikki ^a   Järvelin, Kalervo ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

session based evaluation; simulation; time based evaluation

Indexed keywords

EVALUATION APPROACH; INTERACTIVE INTERFACES; INTERFACE CHARACTERISTIC; OVERALL COSTS; REAL-LIFE INFORMATION; SEARCHING STRATEGY; SESSION-BASED EVALUATION; SIMULATION; SUBTASKS; TIME-BASED EVALUATION;

INFORMATION RETRIEVAL;

COSTS;

EID: 84866615871     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2348283.2348301     Document Type: Conference Paper

References (33)

1. Azzopardi, L. 2007. Position Paper: Towards Evaluating the User Experience of Interactive Information Access Systems. In SIGIR'07 Web Information-Seeking and Interaction Workshop, 5 p.
2. Azzopardi, L. 2011. The economics of interactive information retrieval. In Proceedings of the 34th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 15-24.
3. Bates, M. J. 1979. Information search tactics. Journal of the American Society for Information Science, 30(4), 205-214.
4. Bates, M. J. 1989. The Design of Browsing and Berrypicking Techniques for the Online Search Interface. Online Review, 13(5), 407-424.
5. Beaulieu, M. 2000. Interaction in Information Searching and Retrieval. Journal of Documentation, 56(4), 431-439.
6. Belkin, N. L. 1980. Anomalous States of Knowledge as a Basis for Information Retrieval. Canadian Journal of Information and Library Science, 5, 133-143.
7. Card, S. K., Moran, T. P., and Newell, A. 1983. The Psychology of Human-Computer Interaction. L. Erlbaum Assoc. Inc., Hillsdale, NJ, USA.
8. Cleverdon, C.W., Mills, L., and Keen, M. 1966. Factors determining the performance of indexing systems, vol. 1-design. In Aslib Cranfield Research Project, Cranfield.
9. Dunlop, M. D. 1997. "Time Relevance and Interaction Modeling for Information Retrieval". In Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Philadelphia,206-213.
10. Fidel, R. 1985. Moves in online searching. Online Review, 9 (1), 62-74.
11. Hearst, M. A. 2011. "Natural" Search User Interfaces. Communications of the ACM, vol. 54, 60-67.
12. Hersh, W., Turpin, A., Price, S., Chan, B., Kraemer, D., Sacherek, L., and Olson, D. 2000. Do Batch and user Evaluations Give the Same Results? In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 17-24.
13. Ingwersen, P. and Järvelin, K. 2005. The Turn: Integration of Information Seeking and Retrieval in Context. Heidelberg, Springer.
14. Jansen, M. B. M., Spink, A., and Saracevic, T. 2000. Real Life, Real Users, and Real Needs: A Study and Analysis of User Queries on the Web. Information Processing & Management, 36(2), 207-227.
15. Järvelin, K. and Kekäläinen, J. 2002. Cumulated Gain-Based Evaluation of IR Techniques. ACM Transactions on Information Systems, 20(4), 422-446.
16. Järvelin, K. and Kekäläinen, J. 2000. IR evaluation methods for retrieving highly relevant documents. In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Athens, Greece, 41-48.
17. Kamvar, M. and Baluja, S. 2007. Deciphering Trends in Mobile Search. Computer, 40(8), 58-62.
18. Karat, C-M., Halverson, C., Horn, D., and Karat, J. 1999. Patterns of entry and correction in large vocabulary continuous speech recognition systems. In ACM Conference on Human Factors in Computing Systems, 568-575.
19. Karlgren, J., Järvelin, A., Eriksson, G, and Hansen, P. 2011. Use cases as a component of information access evaluation. In DESIRE'11 workshop, October 28, 2011, Glasgow, Scotland, UK.
20. Keskustalo, H., Järvelin, K., Pirkola, A., Sharma, T. and Lykke, M. 2009. Test Collection-Based IR Evaluation Needs Extension Toward Sessions - A Case of Extremely Short Queries. In Proceedings of the 5th Asia Information Retrieval Symposium (AIRS'09), 63-74.
21. Kuhlthau, C. C. 1991. Inside the Search Process. Journal of the American Society for Information Science, 42(5), 361-371.
22. Price, S.L., Nielsen, M.L., Delcambre, L.M.L., and Vedsted, P. 2007. Semantic Components Enhance Retrieval of Domainspecific Documents. In Proceedings of the 16th ACM CIKM, 429-438.
23. Ruthven, I. 2008. Interactive Information Retrieval. In Annual Review of Information Science and Technology, vol. 42, 2008. 43-91.
24. Salton, G. 1970. Evaluation Problems in Interactive Information Retrieval. Information Storage and Retrieval, 6, 29-44.
25. Smith, C. L. and Kantor, P. B. 2008. User Adaptation: Good Results from Poor Systems. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 147-154.
26. Smucker, M. D. 2009. Towards Timed Predictions of Human Performance for Interactive Information Retrieval Evaluation. In Third Workshop on Human-Computer Interaction and Information Retrieval (HCIR'09), October 23, 2009, Washington DC, USA.
27. Sormunen, E. 2002. Liberal Relevance Criteria of TREC - Counting on Negligible Documents? In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Tampere, 324-330.
28. Spink, A. 1997. Study of Interactive Feedback during Mediated Information Retrieval. Journal of the American Society for Information Science, 48(5), 382-394.
29. Stenmark, D. 2008. Identifying Clusters of User Behavior in Intranet Search Engine Log Files. Journal of the American Society for Information Science, 59(14), 2232-2243.
30. Su, L.T. 1992. Evaluations Measures for Interactive Information Retrieval. Information Processing & Management 28(4), 503-516.
31. Turpin, A. and Hersh, W. 2001. Why Batch and User Evaluations Do Not Give the Same Results. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 225-231.
32. Turpin, A. and Scholer, F. 2006. User Performance versus Precision Measures for Simple Search Tasks. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 11-18.
33. Vakkari, P. 2000. Cognition and changes of search terms and tactics during task performance. In Proceedings of RIAO 2000 Conference, Paris: C.I.D., 894-907.