A comprehensive study of features and algorithms for URL-based topic classification

ACM Transactions on the Web

Volumn 5, Issue 3, 2011, Pages

  Baykan, Eda ^a   Henzinger, Monika ^b   Marian, Ludmila ^c   Weber, Ingmar ^d  

^a IZMIR UNIVERSITY   (Turkey)

^b UNIVERSITY OF VIENNA   (Austria)

^c CERN   (Switzerland)

^d YAHOO RESEARCH   (Spain)

Author keywords

ODP; Topic classification; URL

Indexed keywords

BINARY CLASSIFIERS; CLASSIFICATION ALGORITHM; COMPREHENSIVE STUDIES; DATA SETS; F-MEASURE; FEATURE GENERATION; FEATURE SETS; ODP; TOPIC CLASSIFICATION; URL; WEB PAGE; WEB PAGE CLASSIFICATION;

USER INTERFACES; WORLD WIDE WEB;

ALGORITHMS;

EID: 80051944589     PISSN: 15591131     EISSN: 1559114X     Source Type: Journal    
DOI: 10.1145/1993053.1993057     Document Type: Article

References (44)

1. ALEX, P.,CHIRITA, R.,COSTACHE, S.,NEJDL, W., AND HANDSCHUH, S. 2007. P-tag: Large scale automatic generation of personalized annotation tags for the Web. In Proceedings of the International Conference on World Wide Web (WWW). 8-12.
2. AVESANI, P., GIUNCHIGLIA, F., AND YATSKEVICH, M. 2005. A large scale taxonomy mapping evaluation. In Proceedings of the International Semantic Web Conference (ISWC). 67-81.
3. BAYKAN, E., HENZINGER, M., AND WEBER, I. 2008. Web page language identification based on URLs. In Proceedings of the International Conference on Very Large Data Bases (VLDB). 176-187.
4. BAYKAN, E., HENZINGER, M.,MARIAN, L., AND WEBER, I. 2009. Purely URL-based topic classification. In Proceedings of the International Conference on World Wide Web (WWW). 1109-1110.
5. CHAKER, J. AND HABIB, O. 2007. Genre categorization of Web pages. In Proceedings of the International Conference on Data Mining Workshops (ICDMW). 455-464.
6. CHAKRABARTI, S., DOM, B., AND INDYK, P. 1998. Enhanced hypertext categorization using hyperlinks. In Proceedings of the International Conference on Management of Data (SIGMOD). 307-318. (Pubitemid 128655978)
7. CHAKRABARTI, S., VAN DEN BERG, M., AND DOM, B. 1999. Focused crawling: A new approach to topicspecific Web resource discovery. Comput. Netw. 31, 11-16, 1623-1640.
8. CHEN, H. AND DUMAIS, S. 2000. Bringing order to the Web: Automatically categorizing search results. In Proceedings of the Conference on Human Factors in Computing Systems (CHI). 145-152.
9. COVER, T. AND THOMAS, J. 1991. Elements of Information Theory. Wiley & Sons.
10. DASGUPTA, A., KUMAR, R., AND SASTURKAR, A. 2008. De-Duping URLs via rewrite rules. In Proceedings of the International Conference on Knowledge Discovery and Data Mining (KDD). 186-194.
11. DEVI, M. I., RAJARAM, R., AND SELVAKUBERAN, K. 2007. Machine learning techniques for automatedWeb page classification using URL features. In Proceedings of the International Conference on Computational Intelligence and Multimedia Applications (ICCIMA). 116-120.
12. DOMINGOS, P. AND PAZZANI, M. 1997. On the optimality of the simple bayesian classifier under zero-one loss. Mach. Learn. 29, 103-130. (Pubitemid 127510035)
13. FREUD, Y. AND SCHAPIRE, R. 1996. Experiments with a new boosting algorithm. In Proceedings of the International Conference on Machine Learning (ICML). 148-156.
14. FREUDIGER, J., VRATONJIC, N., AND HUBAUX, J.-P. 2009. Towards privacy-friendly online advertising. In Proceedings of the IEEE Web 2.0 Security and Privacy Conference (W2SP).
15. FRIEDMAN, J., HASTIE, T., AND TIBSHIRANI, R. 2000. Additive logistic regression: A statistical view of boosting. Ann. Statist. 38, 2, 337-374.
16. HASTIE, T., TIBSHIRANI, R., AND FRIEDMAN, J. H. 2001. The Elements of Statistical Learning. Springer.
17. HEYMANN, P., RAMAGE, D., AND GARCIA-MOLINA, H. 2008. Social tag prediction. In Proceedings of the International Conference on Research and Development in Information Retrieval (SIGIR). 531-538.
18. J ÄSCHKE, R.,MARINHO, L., HOTHO, A., SCHMIDT-THIEME, L., AND STUMME, G. 2007. Tag recommendations in folksonomies. In Proceedings of the European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD). 506-514.
19. JOACHIMS, T. 1999. Making Large-Scale Support Vector Machine Learning Practical. MIT Press, 169-184.http://svmlight.joachims.org/.
20. KAN, M.-Y. 2004. Web page classification without the Web page. In Proceedings of the International World Wide Web Conference on Alternate Track Papers and Posters. 262-263.
21. KAN, M.-Y. AND NGUYEN, H. O. T. 2005. Fast Webpage classification using URL features. In Proceedings of the International Conference on Information and Knowledge Management (CIKM). 325-326. (Pubitemid 44022186)
22. KOPPULA, H. S., LEELA, K., AGARWAL, A., CHITRAPURA, K. P., GARG, S., AND SASTURKAR, A. 2010. Learning URL patterns for Webpage de-duplication. In Proceedings of the International Conference on Web Search and Data Mining. 381-390.
23. MANNING, C.D., RAGHAVAN, P., AND SCHÜTZE, H. 2008. Introduction to Information Retrieval. Cambridge University Press.
24. MCCALLUM, A. AND NIGAM, K. 1998. A comparison of event models for naive Bayes text classification. In Proceedings of the AAAI Workshop on Learning for Text Categorization. 41-48.
25. MCCALLUM, A. K. 1996. Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering. http://www.cs.cmu.edu/mccallum/ bow.
26. MCGUINNESS, D., FIKES, R., RICE, J., AND WILDER, S. 2000. An environment for merging and testing large ontologies. In Proceedings of the International Conference on Principles of Knowledge Representation and Reasoning (KR). 483-493.
27. NIGAM, K., LAFFERTY, J., AND MCCALLUM, A. 1999. Using maximum entropy for text classification. In Proceedings of the Workshop on Machine Learning for Information Filtering. 61-67.
28. NOY, N. 2004. Tools for mapping and merging ontologies. In Handbook on Ontologies, S. Staab and R. Studer Eds., Springer, 365-384.
29. KHEMANI, D. 2006. Unsupervised learning from URL corpora. In Proceedings of the International Conference on Management of Data (COMAD'06).
30. POOLA, K. L. AND RAMANUJAPURAM, A. 2007. Techniques for keyword extraction from URLs using statistical analysis. http://www.faqs.org/patents/ app/20090089278. US Patent application.
31. POWER, R., CHEN, J., KARTHIK, T., AND SUBRAMANIAN, L. 2009. Document classification for focused topics. In Proceedings of the AAAI Spring Symposium on AI for Development.
32. QI, X. AND DAVISON, B. D. 2006. Knowing a web page by the company it keeps. In Proceedings of the International Conference on Information and Knowledge Management (CIKM). 228-237. (Pubitemid 47203570)
33. QI, X. AND DAVISON, B. D. 2008. Classifiers without borders: Incorporating fielded text from neighboring Web pages. In Proceedings of the Conference on Research and Development in Information Retrieval (SIGIR). 643-650.
34. QI, X. AND DAVISON, B. D. 2009. Web page classification: Features and algorithms. ACM Comput. Surv. 41, 2, 1-31.
35. SHEN, D., CHEN, Z., YANG, Q., ZENG, H., ZHANG, B., LU, Y., AND MA, W. 2004. Web-Page classification through summarization. In Proceedings of the Conference on Research and Development in Information Retrieval (SIGIR). 242-249.
36. SHIH, L. K. AND KARGER, D. R. 2004. Using URLs and table layout for Web classification tasks. In Proceedings of the International Conference on World Wide Web (WWW). 193-202. (Pubitemid 40752754)
37. SILVESTRI, F. 2007. Sorting out the document identifier assignment problem. In Proceedings of the European Conference on IR Research (ECIR). 101-112. (Pubitemid 350259543)
38. STUMME, G. AND MAEDCHE, A. 2001. FCA-MERGE: Bottom-Up merging of ontologies. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). 225-230.
39. UMBRICH, J., KARNSTEDT, M., AND HARTH, A. 2009. Fast and scalable pattern mining for media-type focused crawling. In Proceedings of the Knowledge Discovery, Data Mining, and Machine Learning Workshop.
40. VEZHNEVETS, A. AND VEZHNEVETS, V. 2005. Modest AdaBoost - Teaching AdaBoost to generalize better. In Proceedings of the Computer Graphics and Applications Conference (GraphiCon). 322-325.
41. WITTEN, I. H. AND FRANK, E. 2005. Data Mining: Practical Machine Learning Tools and Techniques 2nd Ed. Morgan Kaufmann.
42. ZESCH, T. AND GUREVYCH, I. 2007. Analysis of the Wikipedia category graph for NLP applications. In Proceedings of the Workshop on TextGraphs: Graph-Based Algorithms for Natural Language Processing (NAACL). 1-8.
43. ZHANG, D. AND LEE, W. S. 2004. Web taxonomy integration using support vector machines. In Proceedings of the International Conference on World Wide Web (WWW). 472-481. (Pubitemid 40752781)
44. ZHANG, J., QIN, J., AND YAN, Q. 2006. The role of URLs in objectionable Web content categorization. In Proceedings of the International Conference on Web Intelligence (WI). 277-283.