xCrawl: A high-recall crawling method for web mining

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2008, Pages 550-559

  Shchekotykhin, Kostyantyn ^a   Jannach, Dietmar ^b   Friedrich, Gerhard ^a  

^a UNIVERSITY OF KLAGENFURT   (Austria)

^b TU DORTMUND UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION SCENARIO; FACT EXTRACTION; FOCUSED CRAWLING; INFORMATION EXTRACTION; NAVIGATIONAL STRUCTURES; PRODUCT AND SERVICES; QUERY GENERATION; REDUNDANT DATA; TECHNIQUES USED; WEB DOCUMENT; WEB MINING; WEB PAGE; WEB SOURCES;

INFORMATION MANAGEMENT; MINING; MINING MACHINERY; WEBSITES;

DATA MINING;

EID: 67049169361     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2008.121     Document Type: Conference Paper

References (19)

1. C. C. Aggarwal, F. Al-Garawi, and P. S. Yu. Intelligent crawling on the world wide web with arbitrary predicates. In Proceedings of the 10th International World Wide Web Conference, pages 96-105, New York, NY, USA, 2001.
2. E. Agichtein and L. Gravano. Querying text databases for efficient information extraction. In Proceedings of the 19th IEEE International Conference on Data Engineering, pages 113-124, Bangalore, India, 2003.
3. A. Bergholz and B. Chidlovskii. Crawling for domainspecific hidden web resources. In Proceedings of the Fourth International Conference on Web Information Systems Engineering, pages 125-133, Washington, DC, USA, 2003.
4. S. Brin and L. Page. The anatomy of a large-scale hypertextual web search engine. Computer Networks and ISDN Systems, 30(1-7):107-117, 1998.
5. S. Chakrabarti, K. Punera, and M. Subramanyam. Accelerated focused crawling through online relevance feedback. In Proceedings of the 11th International World Wide Web Conference, pages 148-159, Honolulu, Hawaii, USA, 2002.
6. S. Chakrabarti, M. van den Berg, and B. Dom. Focused crawling: a new approach to topic-specific web resource discovery. Computer Networks, 31(11-16):1623-1640, 1999.
7. M. Craven, D. DiPasquo, D. Freitag, A. McCallum, T. Mitchell, K. Nigam, and S. Slattery. Learning to construct knowledge bases from theWorldWideWeb. Artificial Intelligence, 118(1):69-113, 2000.
8. A. Dasgupta, A. Ghosh, R. Kumar, C. Olston, S. Pandey, and A. Tomkins. The discoverability of the web. In Proceedings of the 16th international conference on World Wide Web, pages 421-430, Banff, Alberta, Canada, 2007. (Pubitemid 47582271)
9. M. Diligenti, F. Coetzee, S. Lawrence, C. L. Giles, and M. Gori. Focused crawling using context graphs. In Proceedings of 26th International Conference on Very Large Data Bases, pages 527-534, Cairo, Egypt, 2000.
10. M. Ester, M. Grob, and H. Kriegel. Focused Web crawling: A generic framework for specifying the user interest and for adaptive crawling strategies. In Proceedings of 27th International Conference on Very Large Data Bases, pages 321-329, Roma, Italy, 2001.
11. W. Gatterbauer, P. Bohunsky, M. Herzog, B. Krüpl, and B. Pollak. Towards domain-independent information extraction from web tables. In Proceedings of the 16th International World Wide Web conference, pages 71-80, Banff, Alberta, Canada, 2007. (Pubitemid 47582240)
12. P. G. Ipeirotis, E. Agichtein, P. Jain, and L. Gravano. To search or to crawl? Towards a query optimizer for textcentric tasks. In Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data, pages 265-276, New York, NY, USA, 2006. (Pubitemid 46946519)
13. J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of the ACM (JACM), 46(5):604-632, 1999.
14. R. Kumar, P. Raghavan, S. Rajagopalan, and A. Tomkins. Trawling the Web for emerging cyber-communities. Computer Networks, 31(11-16):1481-1493, 1999.
15. J. Rennie and A. McCallum. Using reinforcement learning to spider the web efficiently. In Proceedings of the Sixteenth International Conference on Machine Learning, pages 335- 343, San Francisco, CA, USA, 1999.
16. U. Schonfeld, Z. Bar-Yossef, and I. Keidar. Do not crawl in the DUST: different URLs with similar text. In Proceedings of the 15th International World Wide Web Conference, pages 1015-1016, New York, NY, USA, 2006. (Pubitemid 46946760)
17. K. Shchekotykhin, D. Jannach, G. Friedrich, and O. Kozeruk. AllRight: Automatic ontology instantiation from tabular web documents. In Proceedings of 6th International Semantic Web Conference, pages 466-479, Busan, Korea, 2007.
18. I. Witten and E. Frank. Data mining: Practical machine learning tools and techniques with Java implementations. Morgan Kaufmann, 2000.
19. H. Yu, J. Han, and K. C.-C. Chang. PEBL: positive example based learning for web page classification using SVM. In KDD 02: Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 239-248, New York, NY, USA, 2002.