Query selection techniques for efficient crawling of structured Web sources

Proceedings - International Conference on Data Engineering

Volumn 2006, Issue , 2006, Pages 48-57

  Wu, Ping ^a   Wen, Ji Rong ^b   Liu, Huan ^c   Wei Ying, Ma ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b MICROSOFT RESEARCH ASIA   (China)

^c ARIZONA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATABASE SYSTEMS; GRAPH THEORY; INTERFACES (COMPUTER); MATHEMATICAL MODELS; QUERY LANGUAGES; WORLD WIDE WEB;

HIDDEN WEB DATABASES; QUERY SELECTION; STRUCTURED INFORMATION; WEB SERVICE INTERFACES;

DATA STRUCTURES;

EID: 33749617417     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2006.124     Document Type: Conference Paper

References (25)

1. MSN Shopping, http://shopping.msn.com/.
2. Google Shopping. http://froogle.google.com/
3. UIUC Repository. http://metaquerier.cs.uiuc.edu/repository 2003.
4. E.Agichtein, P.Ipeirotis, and L.Gravano. Modelling query-based access to text databases. In WebDB, 2003.
5. A. Arasu, and H. Garcia-Molina. Extracting structured data from Web pages. In SIGMOD, 2003.
6. L.Barbosa and J.Freire. Siphoning hidden-Web data through keyword-based interfaces. In SBBD, 2004.
7. M.K.Bergman. The deep Web: Surfacing hidden value, http://www.press. umich.edu/jep/07-01/bergman.html.
8. A.Broder,R.Kumar,F.Maghoul,P.Raghavan,S.Rajagopalan, R.Stata, A. Tomkins, J.Wiener. Graph structure in the Web. In WWW 1999.
9. S.Chakrabarti, M. Berg and B. Dom. Focused Crawling: A New Approach to Topic-Specific Web Resource Discovery. In WWW,1998.
10. K. C.-C. Chang, B. He, and Z. Zhang. Toward Large Scale Integration: Building a MetaQuerier over Databases on the Web. In CIDR 2005.
11. W.B. Croft and J.Laffery, Language Modelling and Information Retrieval. Kluwer Academic Publisher, 2003.
12. J. Cho, H. Garcia-Molina, and L. Page. Efficient crawling through URL ordering. In WWW, 1998.
13. L. Gravano, P. Ipeirotis, and M. Sahami. Query- vs. Crawling-based Classification of Searchable Web Databases. In IEEE Data Engineering Bulletin, 2002.
14. F. Greets, H. Mannila, and E. Terzi. Relational link-based ranking. In VLDB, 2004.
15. B. He, and K. C. Chang. Statistical Schema Matching across Web Query Interfaces. In SIGMOD, 2003.
16. H. He, W. Meng, C, Yu and Z. Wu. WISE-Integrator: an automatic integrator of Web search interfaces for E-commerce. In VLDB, 2003.
17. P. Ipeirotis, L. Gravano, and M. Sahami. Probe, Count, and Classify: Categorizing Hidden-Web Databases. In SIGMOD, 2001.
18. S. Lawrence and C. L. Giles, Searching the World Wide Web. In Science.1998.
19. K. Lerman, L.Getoor, S. Minton and C. Knoblock. Using the structure of Web sites for automatic segmentation of tables. In SIGMOD, 2004.
20. A. Maedche and S.Stabb: Ontology learning for the semantic Web. In. IEEE Intelligent System, 2001.
21. A. Ntoulas, P.Zerfos and J. Cho. Downloading textual hidden Web content through keyword queries. In JCDL, 2005.
22. S. Raghavan, and H. Garcia-Molina. Crawling the hidden Web. In VLDB, 2001
23. S. Sizov, M.Biwer, J.Graupmann, S.Siersdorfer, M.Theobald, G.Weikum and P.Zimmer. The BINGO! System for information portal generation and expert Web search. In CIDR, 2003.
24. J. Wang, J. Wen, F. H. Lochovsky, and Wei-ying Ma. Instancebased Schema Matching for Web Databases by Domain-specific Query Probing. In VLDB, 2004.
25. Z. Zhang, B. He, and K. C. Chang. Understanding Web Query Interfaces: Best-Effort Parsing with Hidden Syntax. In SIGMOD, 2004.