Geographically focused collaborative crawling

Proceedings of the 15th International Conference on World Wide Web

Volumn , Issue , 2006, Pages 287-296

  Gao, Weizheng ^a   Lee, Hyun Chul ^b   Miao, Yingbo ^a  

^a GenieKnowscom   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Collaborative crawling; Geographic entities; Geographically focused crawling

Indexed keywords

DATA ACQUISITION; INFORMATION RETRIEVAL; WEB BROWSERS; WEB SERVICES; INTERNET;

COLLABORATIVE CRAWLING; GEOGRAPHIC ENTITIES; GEOGRAPHICALLY FOCUSED CRAWLING; UNIFORM RESOURCE LOCATOR (URL);

DATA MINING; WORLD WIDE WEB;

COLLABORATIVE CRAWLING; CRAWLING STRATEGY; FOCUSED CRAWLING; GEOGRAPHIC ENTITIES; GEOGRAPHIC LOCATION; GEOGRAPHICALLY FOCUSED CRAWLING; WEB DATA;

EID: 34250648131     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1135777.1135822     Document Type: Conference Paper

References (25)

1. C. C. Aggarwal, F. Al-Garawi, and P. S. Yu. Intelligent crawling on the world wide web with arbitrary predicates. In WWW, pages 96-105, 2001.
2. E. Amitay, N. Har'El, R. Sivan, and A. Soffer. Web-a-where: geotagging web content. In SIGIR, pages 273-280, 2004.
3. S. Borgatti. Centrality and network flow. Social Networks, 27(1):55-71, 2005.
4. P. D. Bra, Y. K. Geert-Jan Houben, and R. Post. Information retrieval in distributed hypertexts. In RIAO, pages 481-491, 1994.
5. O. Buyukkokten, J. Cho, H. Garcia-Molina, L. Gravano, and N. Shivakumar. Exploiting eographical location information of web pages. In WebDB (Informal Proceedings), pages 91-96, 1999.
6. S. Chakrabarti. Mining the Web. Morgan Kaufmann Publishers, 2003.
7. S. Chakrabarti, K. Punera, and M. Subramanyam. Accelerated focused crawling through online relevance feedback. In WWW, pages 148-159, 2002.
8. S. Chakrabarti, M. van den Berg, and B. Dom. Focused crawling: A new approach to topic-specific web resource discovery. Computer Networks, 31(11-16):1623-1640, 1999.
9. J. Cho. Crawling the Web: Discovery and Maintenance of Large-Scale Web Data. PhD thesis, Stanford, 2001.
10. J. Cho and H. Garcia-Molina. Parallel crawlers. In WWW, pages 124-135, 2002.
11. J. Cho, H. Garcia-Molina, and L. Page. Efficient crawling through url ordering. Computer Networks, 30(1-7):161-172, 1998.
12. C. Chung and C. L. A. Clarke. Topic-oriented collaborative crawling. In CIKM, pages 34-42, 2002.
13. B. D. Davison. Topical locality in the web. In SIGIR, pages 272-279, 2000.
14. M. Diligenti, F. Coetzee, S. Lawrence, C. L. Giles, and M. Gori. Focused crawling using context graphs. In VLDB, pages 527-534, 2000.
15. J. Ding, L. Gravano, and N. Shivakumar. Computing geographical scopes of web resources. In VLDB, pages 545-556, 2000.
16. J. Edwards, K. S. McCurley, and J. A. Tomlin. An adaptive model for optimizing performance of an incremental web crawler. In WWW, pages 106-113, 2001.
17. J. Exposto, J. Macedo, A. Pina, A. Alves, and J. Rufino. Geographical partition for distributed web crawling. In GIR, pages 55-60, 2005.
18. L. Gravano, V. Hatzivassiloglou, and R. Lichtenstein. Categorizing web queries according to geographical locality. In CIKM, pages 325-333, 2003.
19. A. Heydon and M. Najork. Mercator: A scalable, extensible web crawler. World Wide Web, 2(4):219-229, 1999.
20. J. M. Kleinberg. Authoritative sources in a hypelinked environment. J. ACM, 46(5):604-632, 1999.
21. H. C. Lee and R. Miller. Bringing geographical order to the web. private communication, 2005.
22. A. Markowetz, Y.-Y. Chen, T. Suel, X. Long, and B. Seeger. Design and implementation of a geographic search engine. In WebDB, pages 19-24, 2005.
23. A. McCallum, K. Nigam, J. Rennie, and K. Seymore. A machine learning approach to building domain-specific search engines. In IJCAI, pages 662-667, 1999.
24. F. Menczer, G. Pant, P. Srinivasan, and M. E. Ruiz. Evaluating topic-driven web crawlers. In SIGIR, pages 241-249, 2001.
25. T. Mitchell. Machine Learning. McGraw Hill, 1997.