Automatic classification of Web queries using very large unlabeled query logs

ACM Transactions on Information Systems

Volumn 25, Issue 2, 2007, Pages

  Beitzel, Steven M ^a,c   Jensen, Eric C ^a,d   Lewis, David D ^b   Chowdhury, Abdur ^a,d   Frieder, Ophir ^a,d  

^a ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

^b David D Lewis Consulting   (United States)

^c TELCORDIA TECHNOLOGIES   (United States)

^d Illinois Institute of Technology   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FEATURE SPARSENESS; PARTIAL MATCHING; QUERY CLASSIFICATION; USER QUERIES;

CLASSIFICATION (OF INFORMATION); DATABASE SYSTEMS; SEARCH ENGINES; USER INTERFACES; VOCABULARY CONTROL; WORLD WIDE WEB;

QUERY PROCESSING;

EID: 34247869672     PISSN: 10468188     EISSN: 15582868     Source Type: Journal    
DOI: 10.1145/1229179.1229183     Document Type: Article

References (51)

1. ADAMO, J.-M. 2000. Data Mining for Association Rules and Sequential Patterns: Sequential and Parallel Algorithms. Springer, Berlin, Germany.
2. BEEFERMAN, D. AND BERGER, A. 2000. Agglomerative clustering of a search engine query log. In Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM Press, New York, NY, 407-416.
3. BEITZEL, S. M., JENSEN, E. C., CHOWDHURY, A., GROSSMAN, D., AND FRIEDER, O. 2004. Hourly analysis of a very large topically categorized Web query log. In Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 321-328.
4. BEITZEL, S. M., JENSEN, E. C., LEWIS, D. D., CHOWDHURY, A., KOLCZ, A., AND FRIEDER, O. 2005a. Improving automatic query classification via semi-supervised learning. In Proceedings of the Fifth IEEE International Conference on Data Mining. IEEE Computer Society Press, Los Alamitos, CA, 42-49.
5. BEITZEL, S. M., JENSEN, E. C., LEWIS, D. D., CHOWDHURY, A., KOLCZ, A., FRIEDER, 0., AND GROSSMAN, D. 2005b. Automatic Web query classification using labeled and unlabeled training data. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 581-582.
6. BEITZEL, S. M., JENSEN, E. C., CHOWDHURY, A., FRIEDER, O., AND GROSSMAN, D. 2006. Temporal analysis of a very large topically categorized web query log. J. Amer. Soc. Inform Sci. Tech. To appear.
7. BOT, R. S., WU, Y.-F. B., CHEN, X., AND LI, Q. 2005. Generating better concept hierarchies using automatic document classification. In Proceedings of the 14th ACM International Conference on Information and Knowledge Management (CIKM). ACM Press, New York, NY, 281-282.
8. BRODER, A. 2002. A taxonomy of Web search. SIGIR For. 36, 2 (Fall), 3-10.
9. CHO, J., GARCIA-MOLINA, H., AND PAGE, L. 1998. Efficient crawling through URL ordering. In Proceedings of the 7th International World Wide Web Conference. Elsevier Science Publishers B. V., Amsterdam, The Netherlands, 161-172.
10. CHOWDHURY, A. AND PASS, G. 2003. Operational requirements for scalable search systems. In Proceedings of the 12th ACM International Conference on Information and Knowledge Management (CIKM). ACM Press, New York, NY, 435-442.
11. COVER, T. M. AND THOMAS, J. A. 1991. Elements of Information Theory. Wiley-Interscience, New York, NY.
12. CRASWELL, N. AND HAWKING, D. 2004. Overview of the trec 2004 Web track. In Proceedings of the Thirteenth Text Retrieval Conference (TREC 2004). NIST, Gaithersburg, MD. 89-97.
13. CRASWELL, N., HAWKING, D., WILKINSON, R., AND WU, M. 2003. Overview of the TREC 2003 Web track. In Proceedings of the Twelfth Text Retrieval Conference (TREC 2003). NIST, Gaithersburg, MD, 78-92.
14. DAS-NEVES, F., FOX, E. A., AND YU, X. 2005. Connecting topics in document collections with stepping stones and pathways. In Proceedings of the 14th ACM International Conference on Information and Knowledge Management (CIKM). ACM Press, New York, NY, 91-98.
15. EASTMAN, C. M. AND JANSEN, B. J. 2003. Coverage, relevance, and ranking: The impact of query operators on Web search engine results. ACM Trans. Inform. Syst. 21, 4 (Oct.), 383-411.
16. GLOVER, E. J., LAWRENCE, S., BIRMINGHAM, W. P., AND GILES, C. L. 1999. Architecture of a metasearch engine that supports user information needs. In Proceedings of the 8th ACM International Conference on Information and Knowledge Management (CIKM). ACM Press, New York, NY, 210-216.
17. GRAVANO, L., HATZIVASSILOGLOU, V., AND LICHTENSTEIN, R. 2003. Categorizing web queries according to geographical locality. In Proceedings of the 12th ACM International Conference on Information and Knowledge Management (CIKM). ACM Press, New York, NY, 325-333.
18. GROSSMAN, D. A. AND FRIEDER, O. 2004. Information retrieval: Algorithms and Heuristics. Springer, Berlin, Germany.
19. JANSEN, B. J., SPINK, A., AND PEDERSON, J. 2005. A temporal comparison of altavista Web searching. J. Amer. Soc. Inform. Sci. Techno. 56, 6, 559-570.
20. JANSEN, B. J., SPINK, A., AND SARACEVIC, T. 2000. Real life, real users, and real needs: A study and analysis of user queries on the web. Inform. Process. Manage. 36, 2 (Mar.), 207-227.
21. JOACHIMS, T. 1999. Making large-scale SVM learning practical. In Advances in Kernel Methods-Support Vector Learning, B. Scholkopf, C. Burges, and A. Smola, Eds. MIT Press, Cambridge, MA.
22. KANG, I.-H. AND KIM, G. 2003. Query type classification for web document retrieval. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 64-71.
23. KARDKOVACS, Z. T., TIKK, D., AND BANSAGHI, Z. 2005. The ferrety algorithm for the KDD Cup 2005 problem. SIGKDD Explor. 7, 2 (Dec.), 111-116.
24. KOWALCZYK, P., ZUKERMAN, I., AND NIEMANN, M. 2004. Analyzing the effect of query class on document retrieval performance. In 17th Australian Joint Conference on Artificial Intelligence (AI-04). Springer-Verlag, Berlin, Germany, 550-561.
25. KRAUTH, W. AND MEZARD, M. 1987. Learning algorithms with optimal stability in neural networks. J. Phys. A 20, 745-752.
26. LAWRENCE, S. AND GILES, C. L. 1998. Searching the World Wide Web Science, 98-100.
27. LEWIS, D. D. 1995. Evaluating and optimizing autonomous text classification systems. In Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 246-254.
28. LI, Y., ZARAGOZA, H., HERBRICH, R., SHAWE-TAYLOR, J., AND KANDOLA, J. S. 2002. The perceptron algorithm with uneven margins. In Proceedings of the 19th International Conference on Moching Learning. Morgan Kaufmann San Francisco, CA, 379-386.
29. LIGHT, M. AND GREIFF, W. 2002. Statistical models for the induction and use of selectional preferences. Cog. Sci. 26, 3 269-281.
30. MANMATHA, R., FENG, A., AND ALLAN, J. 2002. A critical examination of TDT's cost function. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 403-404.
31. MANNING, C. D. AND SCHUTZE, H. 1999. Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA.
32. MARTIN, A., DODDINGTON, G., KAMM, T., ORDOWSKI, M., AND PRZYBOCKI, M. 1997. The DET curve in assessment of detection task performance. In Proceedings of the 5th ESCA Conference on Speech Communication and Technology (Eurospeech '97), (Sept.). 1895-1898.
33. MCCARTHY, D. AND CARROLL, J. 2003. Disambiguating nouns, verbs, and adjectives using automatically acquired selectional preferences. Computat. Ling. 29, 4 (Dec.), 639-654.
34. MITCHELL, T. M. 1997. Machine Learning. McGraw-Hill, New York, NY.
35. NTOULAS, A., CHO, J., AND OLSTON, C. 2004. What's new on the Web? The evolution of the web from a search engine perspective. In Proceedings of the 13th International Conference on the World Wide Web (WWW). ACM Press, New York, NY, 1-12.
36. RESNIK, P. 1993. Selection and information: A class-based approach to lexical relationships. Unpublished manuscript. University of Pennsylvania, Philadelphia, PA.
37. SALTON, G., YANG, C. S., AND WONG, A. 1975. A vector-space model for automatic indexing. Commun. ACM 18, 11 (Nov.), 613-620.
38. SEBASTIANI, F. 2002. Machine learning in automated text categorization. ACM Comput. Surv. 34, 1 (Mar.), 1-47.
39. SHEN, D., PAN, R., SUN, J.-T., PAN, J. J., WU, K., YIN, J., AND YANG, Q. 2005. Q∧2c@ust: Our winning solution to query classification in KDD Cup 2005. SIGKDD Explor. 7, 2 (Dec.), 100-110.
40. SPINK, A. AND JANSEN, B. J. 2004. Web Search: Public Searching of the Web. Springer, Berlin, Germany.
41. SPINK, A., JANSEN, B. J., WOLFRAM, D., AND SARACEVIC, T. 2002a. From e-sex to e-commerce: Web search changes. IEEE Comput. 35, 3 (Mar.), 107-109.
42. SPINK, A., OZMUTLU, S., OZMUTLU, H. C., AND JANSEN, B. J. 2002b. U.S. versus European Web searching trends. SIGIR For. 36, 2 (Fall), 32-38.
43. SPINK, A., WOLFRAM, D., JANSEN, B. J., AND SARACEVIC, T. 2001. Searching the Web: The public and their queries. J. Amer. Soc. Inform. Sci. Tech. 52, 3, 226-234.
44. SULLIVAN, D. 2006. Searches per day. Search Engine Watch. Go online to http://searchenginewatch.com/reports/article.php/2156461.
45. TAGUE, J. M. 1981. The pragmatics of information retrieval experimentation. In Information Retrieval Experiment, K. S. Jones, Ed. Butterworth-Heinemann, London, U.K. 59-102.
46. VAN RIJSBERGEN, C. J. 1979. Information Retrieval. Butterworth-Heinemann, London, U.K.
47. VOGEL, D., BICKEL, S., HAIDER, P., SCHIMPFKY, R., SIEMEN, P., BRIDGES, S., AND SCHEFFER, T. 2005. Classifying search engine queries using the Web as background knowledge. SIGKDD Explor. 7, 2 (Dec.), 117-122.
48. VOORHEES, E. M. 2004. Overview of the TREC 2004 question answering track. In Proceedings of the Thirteenth Text Retrieval Conference (TREC 2004, Nov.). NIST, Gaitheraburg, MD.
49. WEN, J.-R., NIE, J.-Y., AND ZHANG, H.-J. 2001a. Clustering user queries of a search engine. In Proceedings of the 10th International Conference on the World Wide Web (WWW). ACM Press, New York, NY, 162-168.
50. WEN, J.-R., NIE, J.-Y., AND ZHANG, H.-J. 2001b. Query clustering using content words and user feedback. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 442-443.
51. WEN, J.-R., NIE, J.-Y., AND ZHANG, H.-J. 2002. Query clustering using user logs. ACM Trans. Inform. Sys. 20, 1 (Jan.), 59-81.