A survey on session detection methods in query logs and a proposal for future evaluation

Information Sciences

Volumn 179, Issue 12, 2009, Pages 1822-1843

  Gayo Avello, Daniel ^a  

^a UNIVERSITY OF OVIEDO   (Spain)

Author keywords

Query log; Search engine; Session detection; Topical session; Web searching

Indexed keywords

INFORMATION RETRIEVAL; INTERNET; SURVEYS; WEB SERVICES;

DATA-SETS; DETECTION METHODS; ENGINE COMPANIES; EVALUATION FRAMEWORKS; GEOMETRIC INTERPRETATIONS; PRIVACY CONCERNS; QUERY LOG; SESSION DETECTION; TIME GAPS; TOPICAL SESSION; WEB SEARCHING;

SEARCH ENGINES;

EID: 63149152074     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2009.01.026     Document Type: Article

References (85)

1. E. Adar, User 4XXXXX9: Anonymizing Query Logs, Query Log Analysis: Social and Technological Challenges, Workshop in WWW, vol. 7, 2007. , 2008 (accessed 24.11.08).
2. E. Agichtein, E. Brill, S. Dumais, Improving Web search ranking by incorporating user behavior information, in: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2006, pp. 19-26.
3. N. Anderson, The ethics of using AOL search data, Ars Technica, 2006. , 2008 (accessed 16.07.08).
4. Baeza-Yates R. Web usage mining in search engines. In: Scime A. (Ed). Web Mining: Applications and Techniques (2005), Idea Group 307-321
5. M. Barbaro, T. Zeller, A Face Is Exposed for AOL Searcher No. 4417749, New York Times, vol. 9, 2006. , 2008 (accessed 24.11.08).
6. D. Beeferman, A. Berger, Agglomerative clustering of a search engine query log, in: Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2000, pp. 407-416.
7. N. Buzikashvili, An exploratory Web log study of multitasking, in: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2006, pp. 623-624.
8. Buzikashvili N. Automatic task detection in the Web logs and analysis of multitasking. Lecture Notes in Computer Science 4312 (2006) 131-140
9. N. Buzikashvili, Sliding window technique for the Web log analysis, in: Proceedings of the 16th International Conference on World Wide Web, 2007, pp. 1213-1214.
10. N. Buzikashvili, B.J. Jansen, Limits of the Web log analysis artifacts, in: Workshop on Logging Traces of Web Activity, WWW 2006. , 2008 (accessed 24.11.08).
11. W.B. Cavnar, J.M. Trenkle, N-gram-based text categorization, in: Proceedings of the SDAIR-94, Third Annual Symposium on Document Analysis and Information Retrieval, 1994, pp. 161-175.
12. S. Chien, N. Immorlica, Semantic similarity between search engine queries using temporal correlation, in: Proceedings of the 14th International Conference on World Wide Web, 2005, pp. 2-11.
13. N. Chinchor, G. Dungca, Four scorers and seven years ago: the scoring method for MUC-6, in: Proceedings of the Sixth Conference on Message Understanding, 1995, pp. 33-38.
14. Chuang S.L., and Chien L.F. Enriching Web taxonomies through subject categorization of query terms from search engine logs. Decision Support Systems 35 (2003) 113-127
15. S.L. Chuang, L.F. Chien, A practical Web-based approach to generating topic hierarchy for text segments, in: Proceedings of the 13th ACM Conference on Inf. and Knowledge Management, 2004, pp. 127-136.
16. S. Cucerzan, E. Brill, Spelling correction as an iterative process that exploits the collective knowledge of Web users, in: Proceedings of the EMNLP, vol. 4, 2004, pp. 293-300.
17. H. Cui et al., Probabilistic query expansion using query logs, in: Proceedings of the 11th International Conference on World Wide Web, 2002, pp. 325-332.
18. Cui H., et al. Query expansion by mining user logs. IEEE Transactions on Knowledge and Data Engineering 15 (2003) 829-839
19. D. Downey, S. Dumais, E. Horvitz, Models of searching and browsing: languages, studies, and applications, in: Proceedings of the IJCAI, 2007, pp. 1465-1472.
20. Girill T.R. Online access AIDS for documentation: a bibliographic outline. ACM SIGIR Forum 18 (1985) 24-27
21. A. Göker, D. He, Analysing Web search logs to determine session boundaries for user-oriented learning, in: Proceedings of the International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, 2000, pp. 319-322.
22. K. Hafner, Researchers yearn to use AOL logs, but they hesitate, New York Times, vol. 23, 2006. , 2008 (accessed 24.11.08).
23. M.H. Hansen, E. Shriver, Using navigation data to improve IR functions in the context of Web search, in: Proceedings of the 10th International Conference on Information and Knowledge Management, 2001, pp. 135-142.
24. D. He, A. Göker, Detecting session boundaries from Web user logs, in: Proceedings of the 22nd Annual Colloquium on Information Retrieval Research, Cambridge, April, 2000, pp. 57-66.
25. He D., Göker A., and Harper D.J. Combining evidence for automatic Web session identification. Information Processing and Management 38 (2002) 727-742
26. Huang C.K., Chien L.F., and Oyang Y.J. Relevant term suggestion in interactive Web search based on contextual information in query session logs. Journal of the American Society for Information Science and Technology 54 (2003) 638-649
27. Jansen B.J., and Spink A. Methodological approach in discovering user search patterns through Web log analysis. ACM SIGIR Forum 32 (2000) 5-17
28. B.J. Jansen, A. Spink, An analysis of Web documents retrieved and viewed, in: Proceedings of the Fourth International Conference on Internet Computing, 2003, pp. 65-69.
29. Jansen B.J., and Spink A. An analysis of Web searching by European AlltheWeb. com users. Information Processing and Management 41 (2005) 361-381
30. Jansen B.J., and Spink A. How are we searching the World Wide Web? A comparison of nine search engine transaction logs. Information Processing and Management 42 (2006) 248-263
31. Jansen B.J., Spink A., and Pedersen J. A temporal comparison of AltaVista Web searching. Journal of the American Society for Information Science and Technology 56 (2005) 559-570
32. Jansen B.J., Spink A., and Saracevic T. Real life, real users and real needs: a study and analysis of user queries on the Web. Information Processing and Management 36 (2000) 207-227
33. Jansen B.J., et al. Real life information retrieval: a study of user queries on the Web. ACM SIGIR Forum 32 (1998) 5-17
34. Jansen B.J., et al. Automated gathering of Web information: an in-depth examination of agents interacting with search engines. ACM Transactions on Internet Technology (TOIT) 6 (2006) 442-464
35. Jansen B.J., et al. Defining a session on Web search engines. Journal of the American Society for Information Science and Technology 58 (2007) 862-871
36. T. Joachims, Optimizing search engines using clickthrough data, in: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2002, pp. 133-142.
37. T. Joachims et al., Accurately interpreting clickthrough data as implicit feedback, in: Proceedings of the 28th ACM SIGIR Conference on Research and Development in Information Retrieval, 2005, pp. 154-161.
38. R. Jones et al., Generating query substitutions, in: Proceedings of the 15th International Conference on World Wide Web, 2006, pp. 387-396.
39. D. Kristol, L. Montulli, HTTP State Management Mechanism, RFC 2109, February 1997. , 2008 (accessed 24.11.08).
40. T. Lau, E. Horvitz, Patterns of search: analyzing and modeling Web query refinement, in: Proceedings of the Seventh International Conference on User Modeling, 1999, pp. 119-128.
41. D.D. Lewis, Evaluating text categorization, in: Proceedings of the Speech and Natural Language Workshop, 1991, pp. 312-318.
42. J. Makhoul et al., Performance measures for information extraction, in: Proceedings of the DARPA Broadcast News Workshop, 1999, pp. 249-252.
43. Markatos E.P. On caching search engine query results. Computer Communications 24 (2001) 137-143
44. Maron M.E., and Kuhns J.L. On relevance, probabilistic indexing and information retrieval. Journal of the ACM 7 (1960) 216-244
45. Metzler D., Dumais S., and Meek C. Similarity measures for short segments of text. Lecture Notes in Computer Science 4425 (2007) 16-27
46. Microsoft, Microsoft Research Microsoft Live Labs: Accelerating Search in Academic Research 2006, Request for Proposals, 2006. , 2008 (accessed 16.07.08).
47. Murray G.C., Lin J., and Chowdhury A. Identification of user sessions with hierarchical agglomerative clustering. ASIS& T 6 (2006) 3-8
48. Özmutlu S. Automatic new topic identification using multiple linear regression. Information Processing and Management 42 (2006) 934-950
49. S. Özmutlu, B. Buyuk, Using Monte-Carlo simulation for automatic new topic identification of search engine transaction logs, in: Proceedings of the 39th Conference on Winter Simulation, 2007, pp. 2306-2314.
50. Özmutlu H.C., and Çavdur F. Application of automatic topic identification on excite Web search engine data logs. Information Processing and Management 41 (2005) 1243-1262
51. Özmutlu S., and Çavdur F. Neural network applications for automatic new topic identification. Online Information Review 29 (2005) 34-53
52. Özmutlu H.C., Çavdur F., and Özmutlu S. Cross-validation of neural network applications for automatic new topic identification. Journal of the American Society for Information Science and Technology 59 (2008) 339-362
53. Özmutlu H.C., Çavdur F., and Özmutlu S. Automatic new topic identification in search engine transaction logs. Internet Research 16 (2006) 323-338
54. Özmutlu S., Özmutlu H.C., and Buyuk B. Using conditional probabilities for automatic new topic identification. Online Information Review 31 (2007) 491-515
55. S. Özmutlu, H.C. Özmutlu, A. Spink, Automatic new topic identification in search engine transaction logs using multiple linear regression, in: Proceedings of the 41st Annual Hawaii International Conference on System Sciences, 2008, p. 140.
56. G. Pass, A. Chowdhury, C. Torgeson, A picture of search, in: Proceedings of the First International Conference on Scalable Information Systems, 2006. , 2008 (accessed 24.11.08).
57. F. Radlinski, T. Joachims, Query chains: learning to rank from implicit feedback, in: Conference on Knowledge Discovery in Data, 2005, pp. 239-248.
58. Van Rijsbergen C.J. Evaluation. Information Retrieval (1979), Butterworth-Heinemann, Newton, MA, USA 112-140
59. D.E. Rose, D. Levinson, Understanding user goals in Web search, in: Proceedings of the 13th International Conference on World Wide Web, 2004, pp. 13-19.
60. M. Sahami, T.D. Heilman, A Web-based kernel function for measuring the similarity of short text snippets, in: Proceedings of the 15th International Conference on World Wide Web, 2006, pp. 377-386.
61. N. Seco, N. Cardoso, Detecting user sessions in the Tumba! query log, Unpublished manuscript, Department of Informatics Engineering, University of Coimbra, Portugal, 2006. , 2008 (accessed 24.11.08).
62. X. Shen, B. Tan, C. Zhai, Implicit user modeling for personalized search, in: Proceedings of the CIKM, 2005, pp. 824-831.
63. X. Shi, C.C. Yang, Mining related queries from search engine query logs, in: Proceedings of the 15th International Conference on World Wide Web, 2006, pp. 943-944.
64. Silverstein C., et al. Analysis of a very large Web search engine query log. ACM SIGIR Forum 33 (1999) 6-12
65. Spink A., Jansen B.J., and Özmutlu H.C. Use of query reformulation and relevance feedback by excite users. Internet Research: Electronic Networking Applications and Policy 10 (2000) 317-328
66. Spink A., Özmutlu H.C., and Özmutlu S. Multitasking information seeking and searching processes. Journal of the American Society for Information Science and Technology 53 (2002) 639-652
67. A. Spink et al., Modeling users' successive searches in digital environments, D-Lib Magazine, 1998. , 2008 (accessed 24.11.08).
68. Spink A., et al. Searching the Web: The public and their queries. Journal of the American Society for Information Science and Technology 52 (2001) 226-234
69. Spink A., et al. From E-sex to E-commerce: Web search changes. Computer 35 (2002) 107-109
70. Spink A., et al. US versus European Web searching trends. ACM SIGIR Forum 36 (2002) 32-38
71. Spink A., et al. Multitasking during Web search sessions. Information Processing and Management 42 (2006) 264-275
72. R. Sproat, T. Emerson, The First International Chinese Word Segmentation Bakeoff, in: Proceedings of the Second SIGHAN Workshop on Chinese Language Processing, 2003, pp. 133-143.
73. J.T. Sun et al., Web-page summarization using clickthrough data, in: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2005, pp. 194-201.
74. Swanson D.R. Information retrieval as a trial-and-error process. Library Quarterly 47 (1977) 128-148
75. Wen J.R., Nie J.Y., and Zhang H.J. Query clustering using user logs. ACM Transactions on Information Systems 20 (2002) 59-81
76. Wen J.R., and Zhang H.J. Query clustering in the Web context. In: Wu, Xiong, and Shekhar (Eds). Information Retrieval and Clustering (2003), Kluwer Academic Publishers 195-226
77. J.R. Wen et al., Clustering user queries of a search engine, in: Proceedings of the 10th International Conference on World Wide Web, 2001, pp. 162-168.
78. D. Wolfram, A query-level examination of end user searching behaviour on the excite search engine, in: Proceedings of the ACSI 2000. , 2008 (accessed 24.11.08).
79. Wolfram D., et al. Vox Populi: The public searching of the Web. Journal of the American Society for Information Science and Technology 52 (2001) 1073-1074
80. Y. Xie, D. O'Hallaron, Locality in search engine queries and its implications for caching, in: IEEE INFOCOM, 2002. , 2008 (accessed 24.11.08).
81. L. Xiong, E. Agichtein, Towards privacy-preserving query log publishing, in: Aimtay, Murray, Teevan (Eds.), Query Log Analysis: Social and Technological Challenges. A workshop at the 16th International World Wide Web Conference (WWW 2007), 2007. , 2008 (accessed 24.11.08).
82. G.R. Xue et al., Optimizing Web search using Web click-through data, in: Proceedings of the 13th ACM Conference on Information and Knowledge Management, 2004, pp. 118-126.
83. Zhang D., and Dong Y. A novel Web usage mining approach for search engines. Computer Networks 39 (2002) 303-310
84. Y. Zhang, A. Moffat, Some observations on user search behavior, in: Proceedings of the 11th Australasian Document Computing Symposium, 2006, pp. 1-8.
85. Y. Zhang, A. Moffat, Separating human and non-human Web queries, in: Proceedings of the Web Information Seeking and Interaction Workshop, Amsterdam, 2007, pp. 13-16.