Adaptive geospatially focused crawling

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2009, Pages 445-454

  Ahlers, Dirk ^a   Boll, Susanne ^b  

^a OFFIS INSTITUTE FOR INFORMATION TECHNOLOGY   (Germany)

^b UNIVERSITY OF OLDENBURG   (Germany)

Author keywords

Adaptive focused crawling; Geographic web information retrieval; Location aware web search; Resource discovery

Indexed keywords

FOCUSED CRAWLING; LOCATION-AWARE; RESOURCE DISCOVERY; WEB INFORMATION RETRIEVAL; WEB SEARCHES;

INFORMATION SERVICES; KNOWLEDGE MANAGEMENT; ONLINE SEARCHING;

WORLD WIDE WEB;

EID: 74549154553     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1645953.1646011     Document Type: Conference Paper

References (38)

1. C. C. Aggarwal, F. Al-Garawi, and P. S. Yu. Intelligent crawling on the World Wide Web with arbitrary predicates. In WWW '01. ACM, 2001.
2. D. Ahlers and S. Boll. Location-based Web search. In A. Scharl and K. Tochterman, editors, The Geospatial Web. Springer, London, 2007.
3. D. Ahlers and S. Boll. Retrieving Address-based Locations from the Web. In GIR '08: 5th Workshop on Geographic Information Retrieval, 2008.
4. D. Ahlers and S. Boll. Urban Web Crawling. In S. Boll and E. Wilde, editors, First International Workshop on Location and the Web (LocWeb2008). ACM, 2008.
5. E. Amitay, N. Har'El, R. Sivan, and A. Soffer. Web-a-Where: Geotagging Web Content. In SIGIR '04, pages 273-280, New York, NY, USA, 2004. ACM.
6. R. Baeza-Yates, C. Castillo, M. Marin, and A. Rodriguez. Crawling a Country: Better Strategies than Breadth-First for Web Page Ordering. In WWW '05, pages 864-872. ACM Press, 2005.
7. L. Barbosa and J. Freire. An Adaptive Crawler for Locating Hidden-Web Entry Points. In WWW '07. ACM, 2007.
8. D. Bergmark, C. Lagoze, and A. Sbityakov. Focused Crawls, Tunneling, and Digital Libraries. In ECDL '02, pages 91-106, London, UK, 2002. Springer.
9. S. Boll and D. Ahlers. A Web more Geospatial: Insights into the Location Inside. In D. De Roure and W. Hall, editors, Workshop on Understanding Web Evolution: A Prerequisite for Web Science (WebEvolve2008), 2008.
10. S. Brin and L. Page. The anatomy of a large-scale hypertextual Web search engine. Computer Networks and ISDN Systems, 30(1-7):107-117, 1998.
11. A. Broder, R. Kumar, F. Maghoul, P. Raghavan, S. Rajagopalan, R. Stata, A. Tomkins, and J. Wiener. Graph structure in the Web. Computer Networks, 33(1):309-320, June 2000.
12. S. Chakrabarti, K. Punera, and M. Subramanyam. Accelerated Focused Crawling through Online Relevance Feedback. In WWW '02. ACM, 2002.
13. S. Chakrabarti, M. van den Berg, and B. Dom. Distributed Hypertext Resource Discovery Through Examples. In VLDB Journal, pages 375-386, 1999.
14. S. Chakrabarti, M. van den Berg, and B. Dom. Focused Crawling: A New Approach to Topic-Specific Web Resource Discovery. Computer Networks, 31(11-16):1623-1640, 1999.
15. J. Cho, H. Garcia-Molina, and L. Page. Efficient crawling through URL ordering. In WWW7, 1998.
16. B. D. Davison. Topical locality in the Web. In SIGIR 2000, pages 272-279. ACM Press, 2000.
17. M. Diligenti, F. Coetzee, S. Lawrence, C. L. Giles, and M. Gori. Focused Crawling using Context Graphs. In 26th Intl. Conf. on Very Large Databases (VLDB 2000), pages 527-534, Cairo, Egypt, 2000.
18. W. Gao, H. C. Lee, and Y. Miao. Geographically focused collaborative crawling. In WWW '06, 2006.
19. A. M. Grigoriadis and G. Paliouras. Focused crawling using temporal difference-learning. In SETN, pages 142-153. Springer, 2004.
20. M. Hersovici, M. Jacovi, Y. S. Maarek, D. Pelleg, M. Shtalhaim, and S. Ur. The shark-search algorithm. An application: tailored Web site mapping. In WWW7, 1998.
21. M. Himmelstein. Local Search: The Internet Is the Yellow Pages. IEEE Computer, 38(2):26-34, 2005.
22. M. Jakob, M. Großmann, D. Nicklas, and B. Mitschang. DCbot: Finding Spatial Information on the Web. In L. Zhou, B. C. Ooi, and X. Meng, editors, DASFAA 2005, volume 3453 of LNCS. Springer, 2005.
23. M. Kamvar and S. Baluja. A large scale study of wireless search behavior: Google mobile search. In CHI '06, pages 701-709. ACM, 2006.
24. A. Markowetz, Y.-Y. Chen, T. Suel, X. Long, and B. Seeger. Design and Implementation of a Geographic Search Engine. In WebDB 2005, 2005.
25. K. S. McCurley. Geospatial Mapping and Navigation of the Web. In WWW '01. ACM, 2001.
26. F. Menczer, G. Pant, and P. Srinivasan. Topical web crawlers: Evaluating adaptive algorithms. ACM Trans. Inter. Tech., 4(4):378-419, 2004.
27. A. Micarelli and F. Gasparetti. Adaptive Focused Crawling. In The Adaptive Web, volume 4321 of LNCS, pages 231-262. Springer, 2007.
28. Y. Morimoto, M. Aono, M. E. Houle, and K. S. McCurley. Extracting Spatial Knowledge from the Web. In SAINT '03. IEEE, 2003.
29. M. Najork and J. L. Wiener. Breadth-First Crawling Yields High-Quality Pages. In WWW10, pages 114-118, Hong Kong, May 2001. Elsevier Science.
30. G. Pant. Deriving link-context from HTML tag tree. In DMKD '03. ACM, 2003.
31. G. Pant and P. Srinivasan. Learning to Crawl: Comparing Classification Schemes. ACM Trans. Inf. Syst., 23(4):430-462, 2005.
32. T. Rattenbury, N. Good, and M. Naaman. Towards Automatic Extraction of Event and Place Semantics from Flickr Tags. In SIGIR '07. ACM, 2007.
33. J. Rennie and A. McCallum. Using Reinforcement Learning to Spider the Web Efficiently. In ICML '99, 1999.
34. M. Sanderson and J. Kohler. Analyzing geographic queries. In ACM SIGIR Workshop on Geographic Information Retrieval, Sheffield, UK, 2004.
35. S. Schockaert and M. D. Cock. Neighborhood Restrictions in Geographic IR. In SIGIR '07, 2007.
36. P. Srinivasan, F. Menczer, and G. Pant. A General Evaluation Framework for Topical Crawlers. Information Retrieval, 8:417-447, 2004.
37. T. T. Tang, D. Hawking, N. Craswell, and K. Griffiths. Focused Crawling for both Topical Relevance and Wuality of Medical Information. In CIKM '05, pages 147-154, New York, NY, USA, 2005. ACM.
38. T. T. Tang, D. Hawking, N. Craswell, and R. S. Sankaranarayana. Focused Crawling in Depression Portal Search: A Feasibility Study. In ADCS 2004, pages 2-9, Melbourne, Australia, 2004.