Google's deep-web crawl

Proceedings of the VLDB Endowment

Volumn 1, Issue 2, 2008, Pages 1241-1252

  Madhavan, Jayant ^a   Ko, David ^a   Kot, Łucja ^b   Ganapathy, Vignesh ^a   Rasmussen, Alex ^c   Halevy, Alon ^a  

^a GOOGLE INC   (United States)

^b Department of Obstetrics Gynecology   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIGITAL STORAGE; HTML; SEARCH ENGINES; WEBSITES;

CARTESIAN PRODUCTS; DATABASE COMMUNITY; EXPERIMENTAL EVALUATION; GOOGLE SEARCH ENGINE; SEARCH ENGINE INDICES; SEARCH SPACES; STRUCTURED DATA; WEB SEARCHES;

WEB CRAWLER;

EID: 84867132157     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/1454159.1454163     Document Type: Article

References (19)

1. L. Barbosa and J. Freire. Siphoning hidden-web data through keyword-based interfaces. In SBBD, 2004.
2. M. K. Bergman. The Deep Web: Surfacing Hidden Value. Journal of Electronic Publishing, 2001.
3. S. Byers, J. Freire, and C. T. Silva. Efficient acquisition of web data through restricted query interfaces. In WWW Posters, 2001.
4. J. P. Callan and M. E. Connell. Query-based sampling of text databases. ACM Transactions on Information Systems, 19(2):97-130, 2001.
5. Cars.com FAQ. http://siy.cars.com/siy/qsg/faqGeneralInfo.jsp#howmanyads.
6. A. Doan, P. Domingos, and A. Y. Halevy. Reconciling Schemas of Disparate Data Sources: A Machine-Learning Approach. In SIGMOD, 2001.
7. L. Gravano, P. G. Ipeirotis, and M. Sahami. QProber: A system for automatic classification of hidden-web databases. ACM Transactions on Information Systems, 21(1):1-41, 2003.
8. B. He and K. Chang. Automatic Complex Schema Matching across Web Query Interfaces: A Correlation Mining Approach. TODS, 31(1), 2006.
9. B. He, M. Patel, Z. Zhang, and K. C.-C. Chang. Accessing the Deep Web: A survey. Communications of the ACM, 50(5):95-101, 2007.
10. P. G. Ipeirotis and L. Gravano. Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection. In VLDB, pages 394-405, 2002.
11. J. Madhavan, P. A. Bernstein, A. Doan, and A. Y. Halevy. Corpus-based Schema Matching. In ICDE, 2005.
12. J. Madhavan, S. Jeffery, S. Cohen, X. Dong, D. Ko, C. Yu, and A. Halevy. Web-scale Data Integration: You can only afford to Pay As You Go. In CIDR, 2007.
13. A. Ntoulas, P. Zerfos, and J. Cho. Downloading Textual Hidden Web Content through Keyword Queries. In JCDL, pages 100-109, 2005.
14. S. Raghavan and H. Garcia-Molina. Crawling the Hidden Web. In VLDB, pages 129-138, 2001.
15. A. Rajaraman, Y. Sagiv, and J. D. Ullman. Answering Queries Using Templates with Binding Patterns. In PODS, 1995.
16. G. Salton and M. J. McGill. Introduction to Modern Information Retrieval. 1983.
17. J. Wang, J.-R. Wen, F. Lochovsky, and W.-Y. Ma. Instance-based Schema Matching for Web Databases by Domain-specific Query Probing. In VLDB, 2004.
18. P. Wu, J.-R. Wen, H. Liu, and W.-Y. Ma. Query Selection Techniques for Efficient Crawling of Structured Web Sources. In ICDE, 2006.
19. W. Wu, C. Yu, A. Doan, and W. Meng. An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web. In SIGMOD, 2004.