Using conditional probabilities for automatic new topic identification

Online Information Review

Volumn 31, Issue 4, 2007, Pages 491-515

  Ozmutlu, Seda ^a   Ozmutlu, Huseyin C ^a   Buyuk, Buket ^a  

^a ULUDAG UNIVERSITY   (Turkey)

Author keywords

Behaviour; Information retrieval; Search engines; Statistical analysis

Indexed keywords

INFORMATION SERVICES; ONLINE SEARCHING; PROBABILITY DISTRIBUTIONS; PROBLEM SOLVING; STATISTICAL METHODS; USER INTERFACES;

QUERY CATEGORIES; TOPIC IDENTIFICATION;

SEARCH ENGINES;

EID: 39649110569     PISSN: 14684527     EISSN: None     Source Type: Journal    
DOI: 10.1108/14684520710780449     Document Type: Article

References (62)

1. Agichtein, E., Brill, E. and Dumais, S. (2006a), "Improving web search ranking by incorporating user behavior information", Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, WA, pp. 19-26.
2. Agichtein, E., Brill, E., Dumais, S. and Ragno, R. (2006b), "Learning user interaction models for predicting web search result preferences", Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, WA, pp. 3-10.
3. Allan, J. (2003), "Modeling topics for detection and tracking", in Chou, W. and Juang, B. (Eds), Pattern Recognition Speech and Language Processing, CRC Press, New York, NY, pp. 353-76.
4. Beeferman, D. and Berger, A. (2000), "Agglomerative clustering of a search engine query log", Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Boston, MA, pp. 407-16.
5. Beitzel, S., Jensen, E., Chowdhury, A., Grossman, D. and Frieder, O. (2004), "Efficiency and scaling: hourly analysis of a very large topically categorized web query log", Proceedings of the 27th Annual International Conference on Research and Development in Information Retrieval, Sheffield, pp. 321-8.
6. Chai, K., Ng, H. and Chieu, H. (2002), "Bayesian online classifiers for text classification and filtering", Proceedings of 25th ACM International Conference on Research and Development in Information Retrieval (SIGIR'02), Tampere, Finland, pp. 97-104.
7. Cooley, R., Mobasher, B. and Srivastava, J. (1999), "Data preparation for mining world wide web browsing patterns", Knowledge and Information Systems, Vol. 1, pp. 5-32.
8. Feng, A. and Allan, J. (2005), "Hierarchical topic detection in TDT", CIIR technical report, University of Massachusetts, Boston, MA.
9. Goker, A. and He, D. (2000), "Analysing Intranet logs to determine session boundaries for user-oriented learning", Proceedings of AH2000: the International Conference on Adaptive Hypermedia and Adaptive Web-based Systems, Trento, Italy, pp. 319-22.
10. Gremett, P. (2006), "Utilizing a user's context to improve search results", Journal of the American Society for Information Science and Technology, Vol. 57 No. 6, pp. 808-12.
11. He, D. and Goker, A. (2000), "Detecting session boundaries from web user logs", Proceedings of the BCS-IRSG 22nd Annual Colloquium on Information Retrieval Research, Cambridge, UK, pp. 57-66.
12. He, D., Goker, A. and Harper, D. (2002), "Combining evidence for automatic web session identification", Information Processing and Management, Vol. 38, pp. 727-42.
13. Hu, X., Bandhakavi, S. and Zhai, C. (2003), "Error analysis of difficult TREC topics", Proceedings of 26th ACM International Conference on Research and Development in Information Retrieval (SIGIR'03), Toronto, Canada, pp. 407-8.
14. Jansen, B., Spink, A. and Saracevic, T. (2000), "Real life, real users, and real needs: a study and analysis of user queries on the web", Information Processing and Management, Vol. 36, pp. 207-27.
15. Jin, R., Si, L. and Zhai, C. (2003), "Preference-based graphic models for collaborative filtering", Proceedings of the 19th Conference in Uncertainty in Artificial Intelligence, Acapulco, Mexico, pp. 329-36.
16. Joachims, T. (1998), "Text categorization with support vector machines", Proceedings of the 10th European Conference on Machine Learning (ECML'98), Chemnitz, Germany, pp. 137-42.
17. Kelly, D., Diaz, F., Belkin, N. and Allan, J. (2004), "A user-centered approach to evaluating topic models", Lecture Notes in Computer Science, Vol. 2997, pp. 27-41.
18. Kumaran, G. and Allan, J. (2004), "Text classification and named entities for new event detection", Proceedings of the 27th Annual International ACM SIGIR Conference, New York, NY, ACM Press, New York, NY, pp. 297-304.
19. Larkey, L., Feng, F., Connell, M. and Lavrenko, V. (2004), "Language-specific models in multilingual topic tracking", Proceedings of 27th ACM International Conference on Research and Development in Information Retrieval (SIGIR '04), Sheffield, pp. 402-9.
20. Lawrie, D., Croft, W. and Rosenberg, A. (2001), "Finding topic words for hierarchical summarization", Proceedings of 24th ACM International Conference on Research and Development in Information Retrieval (SIGIR '01), pp. 349-57.
21. Li, W. and McCallum, A. (2005), "Semi-supervised sequence modeling with syntactic topic models", Proceedings of 20th National Conference on Artificial Intelligence, pp. 813-18.
22. Liaw, S.-S. and Huang, H.-M. (2006), "Information retrieval from the world wide web: a user-focused approach based on individual experience with search engines", Computers in Human Behavior, Vol. 22 No. 3, pp. 501-17.
23. Liu, X., Croft, W., Oh, P. and Hart, D. (2004), "Automatic recognition of reading levels from user queries", Proceedings of the 27th ACM ACM International Conference on Research and Development in Information Retrieval (SIGIR '04), pp. 548-9.
24. Mei, Q. and Zhai, C. (2005), "Discovering evolutionary theme patterns from text: an exploration of temporal text mining", The 11th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, IL, pp. 198-207.
25. Metzler, D. and Croft, W. (2005), "Analysis of statistical question classification for fact-based questions", Information Retrieval, Vol. 8, pp. 481-504.
26. Metzler, D. and Croft, W. (2005a), "A Markov random field model for term dependencies", Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '05), pp. 472-9.
27. Miwa, M. (2001), "User situations and multiple levels of users' goals in information problem solving processes of AskERIC users", Vol. 38, Proceedings of ASIST 2001: Annual Meeting of the American Society for Information Sciences and Technology, pp. 355-71.
28. Muresan, G. and Harper, D. (2004), "Topic modeling for mediated access to very large document collections", Journal of the American Society for Information Science and Technology, Vol. 55, pp. 892-910.
29. Ozmutlu, H. and Cavdur, F. (2005), "Application of automatic topic identification on excite web search engine data logs", Information Processing and Management, Vol. 41, pp. 1243-62.
30. Ozmutlu, H., Cavdur, F. and Ozmutlu, S. (2006a), "Automatic new topic identification in search engine datalogs", Internet Research, Vol. 26 No. 3, pp. 323-38.
31. Ozmutlu, H., Cavdur, F., Ozmutlu, S. and Spink, A. (2004), "Neural network applications for automatic new topic identification on Excite web search engine datalogs", Proceedings of ASIST 2004, Annual Meeting of the American Society for Information Science and Technology, Providence, RI, pp. 310-16.
32. Ozmutlu, H., Cavdur, F., Spink, A. and Ozmutlu, S. (2006b), "Investigating the performance of automatic new topic identification across multiple datasets", Proceedings of ASIST 2006, Annual Meeting of the American Society for Information Science and Technology, Providence, RI.
33. Ozmutlu, S., Ozmutlu, H. and Spink, A. (2003a), "Multitasking web searching and implications for design", ASIST 2003, Annual Meeting of the American Society for Information Science and Technology, Long Beach, CA, pp. 416-21.
34. Ozmutlu, S., Ozmutlu, H. and Spink, A. (2003b), "Are people asking questions of general web search engines", Online Information Review, Vol. 27 No. 6, pp. 396-406.
35. Ozmutlu, S., Ozmutlu, H. and Spink, A. (2004), "A day in the life of web searching: an exploratory study", Information Processing and Management, Vol. 40, pp. 319-45.
36. Ozmutlu, S., Ozmutlu, H. and Spink, A. (2006), "Topic estimation of web search transaction log queries using Monte-Carlo simulation", paper presented at The 12th Australasian World Wide Web Conference, July 1-5, Australis Noosa Lakes, Australia.
37. Ozmutlu, S., Spink, A. and Ozmutlu, H. (2002), "Analysis of large data logs: an application of Poisson sampling on excite web queries", Information Processing and Management, Vol. 38 No. 4, pp. 473-90.
38. Ozmutlu, S., Spink, A. and Ozmutlu, H. (2003c), "Trends in multimedia web searching: 1997-2001", Information Processing and Management, Vol. 39 No. 4, pp. 611-21.
39. Pu, H.T., Chuang, S.-L. and Yang, C. (2002), "Subject categorization of query terms for exploring web users' search interests", Journal of the American Society for Information Science and Technology, Vol. 53, pp. 617-30.
40. Radlinski, F. and Dumais, S. (2006), "Improving personalized web search using result diversification", Proceedings of SIGIR'06, Seattle, Washington, USA, August 6-11.
41. Rose, D. (2006), "Reconciling information-seeking behavior with search user interfaces for the web", Journal of the American Society for Information Science and Technology, Vol. 57 No. 6, pp. 797-9.
42. Sayyadian, M., Shakery, A., Doan, A. and Zhai, C. (2004), "Toward entity retrieval over structured and text data", 1st Workshop on the Integration of Information Retrieval and Databases (WIRD'04), Sheffield, pp. 47-54.
43. Sebastiani, F. (2002), "Machine learning in automated text categorization", ACM Computing Surveys, Vol. 34 No. 1, pp. 1-47.
44. Shafer, G. (1976), A Mathematical Theory of Evidence, Princeton University Press, Princeton, NJ.
45. Shakery, A. and Zhai, C. (2003), "Relevance propagation for topic distillation", pp. 673-7, UIUC TREC-2003 web track experiments, Proceedings of the TREC Conference.
46. Shen, X., Tan, B. and Zhai, C. (2005), "Context sensitive information retrieval using implicit feedback", Proceedings of the 28th ACM International Conference on Research and Development in Information Retrieval (SIGIR '05), Salvador, Brazil, pp. 43-50.
47. Silverstein, C., Henzinger, M., Marais, H. and Moricz, M. (1999), "Analysis of a very large web search engine query log", ACM SIGIR Forum, Vol. 33, pp. 6-12.
48. Spink, A., Bateman, J. and Jansen, B. (1999), "Searching heterogeneous collections on the web: a survey of Excite users", Internet Research: Electronic Networking Applications and Policy, Vol. 9, pp. 117-28.
49. Spink, A., Ozmutlu, H. and Ozmutlu, S. (2002a), "Multitasking information seeking and searching processes", Journal of the American Society for Information Science and Technology, Vol. 53 No. 8, pp. 639-52.
50. Spink, A., Jansen, B., Wolfram, D. and Saracevic, T. (2002b), "From e-sex to e-commerce: web search changes", IEEE Computer, Vol. 35 No. 3, pp. 133-5.
51. Spink, A., Ozmutlu, S., Ozmutlu, H. and Jansen, B. (2002c), "US versus European web searching trends", ACM SIGIR Forum, Vol. 36 No. 2.
52. Spink, A., Wolfram, D., Jansen, B. and Saracevic, T. (2001), "Searching the web: the public and their queries", Journal of the American Society for Information Science and Technology, Vol. 53 No. 3, pp. 226-34.
53. Swan, R. and Jensen, D. (2000), "TimeMines: constructing timelines with statistical models of word usage", Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Boston, MA, pp. 73-80.
54. Tax, D. and Duin, R. (2001), "Uniform object generation for optimizing one-class classifiers", Journal of MachineLearning Research, Vol. 2, pp. 155-73.
55. Teevan, J., Dumais, S. and Horvitz, E. (2005), "Personalizing search via automated analysis of interests and activities", Proceedings of SIGIR '05, August 15-19, 2005, Salvador, Brazil.
56. Wang, X., Mohanty, N. and McCallum, A. (2005), "Group and topic discovery from relations and text", 11th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining Workshop on Link Discovery: Issues, Approaches and Applications (LinkKDD-05), Chicago, Illinois, USA, pp. 28-35.
57. Wen, J., Nie, J. and Zhang, H. (2002), "Query clustering using user logs", ACM Transactions on Information Systems, Vol. 20 No. 1, pp. 59-81.
58. Yang, Y. (1999), "A re-examination of text categorization methods", Proceedings of the 22th ACM International Conference on Research and Development in Information Retrieval (SIGIR '99), Berkeley, CA, pp. 42-9.
59. Yu, H., Zhai, C. and Ha, J. (2003), "Text classification from positive and unlabeled documents", Proceedings of the 2003 ACM CIKM International Conference on Information and Knowledge Management, New Orleans, Louisiana, pp. 232-9.
60. Zhai, C., Coehn, W. and Lafferty, J. (2003), "Beyond independent relevance: methods and evaluation metrics for subtopic retrieval", paper presented at SIGIR'03, Toronto, July 28-August 1, 2003.
61. Zhai, C., Velivelli, A. and Yu, B. (2004), "A cross-collection mixture model for comparative text mining", the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, WA, pp. 743-8.
62. Zhu, T., Greiner, R. and Haubl, G. (2003), "Learning a model of a web user's interests", Proceedings of the Ninth International Conference on User Modeling, Johnstown, USA.