Crawling the hidden web

VLDB 2001 - Proceedings of 27th International Conference on Very Large Data Bases

Volumn , Issue , 2001, Pages 129-138

  Raghavan, Sriram ^a   Garcia Molina, Hector ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HYPERTEXT SYSTEMS; SEMANTICS; WEBSITES;

ELECTRONIC DATABASE; HIGH QUALITY; HYPERTEXT LINKS; INFORMATION EXTRACTION TECHNIQUES; OPERATIONAL MODEL; PUBLICLY INDEXABLE WEBS; SEARCH FORMS; SEMANTIC INFORMATION;

WORLD WIDE WEB;

EID: 84944325093     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. BrightPlanet.com. http://www.brightplanet.com.
2. The Deep Web: Surfacing Hidden Value. http://www.completeplanet.com/Tutorials/DeepWeb/.
3. S. Chakrabarti, M. van den Berg, and B. Dom. Focused crawling: A new approach to topic-specific web resource discovery. In Proc. of the 8th Intl. WWW Conf., 1999.
4. J. Cho and H. Garcia-Molina. The evolution of the web and implications for an incremental crawler. In Proc. of the 26th Intl. Conf. on Very Large Databases, 2000.
5. J. Cho and H. Garcia-Molina. Synchronizing a database to improve freshness. In Proc. of the ACM SIGMOD Conf. on Management of Data, 2000.
6. J. Cho, H. Garcia-Molina, and L. Page. Efficient crawling through url ordering. In Proc. of the 7th Intl. WWW Conf., 1998.
7. M. Diligenti, F. Coetzee, S. Lawrence, C. L. Giles, and M. Gori. Focused crawling using context graphs. In Proc. of the 26th Intl. Conf. on Very Large Databases, pages 527-534, Sept. 2000.
8. D. Florescu, A. Y. Levy, and A. O. Mendelzon. Database techniques for the world-wide web: A survey. SIGMOD Record, 27(3):59-74, 1998.
9. W. B. Frakes and R. Baeza-Yates. Information Retrieval Data Structures & Algorithms. Prentice Hall, Englewood Cliffs, N.J., 1992.
10. A. Heydon and M. Najork. Mercator: A scalable, extensible Web crawler. World Wide Web, 2(4):219-229, Dec. 1999.
11. InvisibleWeb.com. http://www.invisibleweb.com.
12. O. Kaljuvee, O. Buyukkokten, H. Garcia-Molina, and A. Paepcke. Efficient web form entry on pdas. Proc. of the 10th Intl. WWW Conf., May 2001.
13. S. Lawrence and C. L. Giles. Searching the World Wide Web. Science, 280(5360):98, 1998.
14. S. Lawrence and C. L. Giles. Accessibility of information on the web. Nature, 400:107-109, 1999.
15. D. Lopresti and A. Tomkins. Block edit models for approximate string matching. Theoretical Computer Science, 181(1):159-179, July 1997.
16. A. McCallum, K. Nigam, J. Rennie, and K. Seymore. Building domain-specific search engines with machine learning techniques. In Proc. of the AAAI Spring Symposium on Intelligent Agents in Cyberspace, 1999.
17. R. C. Miller and K. Bharat. Sphinx: a framework for creating personal, site-specific web crawlers. In Proc. of the 7th Intl. WWW Conf., 1998.
18. Open directory. http://www.dmoz.org.
19. Y. Papakonstantinou, H. Garcia-Molina, A. Gupta, and J. Ullman. A query translation scheme for rapid implementation of wrappers. In Proc. of the 4th Intl. Conf. on Deductive and Object-Oriented Databases, pages 161-186, National University of Singapore(NUS), Singapore, 1995.
20. S. Raghavan and H. Garcia-Molina. Crawling the hidden web. Technical Report 2000-36, Computer Science Dept., Stanford University, Dec. 2000. Available at http://dbpubs.stanford.edu/pub/2000-36.
21. Whizbang! labs. http://www.whizbanglabs.com.
22. Yahoo incorporated. http://www.yahoo.com.
23. H.-J.Zimmermann. Fuzzy Set Theory. Kluwer Academic Publishers, 1996.