Sampling, information extraction and summarisation of Hidden Web databases

Data and Knowledge Engineering

Volumn 59, Issue 2, 2006, Pages 213-230

  Hedley, Yih Ling ^a   Younas, Muhammad ^b   James, Anne ^a   Sanderson, Mark ^c  

^a Institute for Clean Growth and Future Mobility   (United Kingdom)

^b OXFORD BROOKES UNIVERSITY   (United Kingdom)

^c UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Document sampling; Hidden Web databases; Information extraction

Indexed keywords

INFORMATION RETRIEVAL; QUERY LANGUAGES; SAMPLING; STORAGE ALLOCATION (COMPUTER); WORLD WIDE WEB;

DOCUMENT SAMPLING; HIDDEN WEB DATABASES; PAGE TEMPLATES; SUMMARISATION;

DATABASE SYSTEMS;

EID: 33748195920     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2006.01.009     Document Type: Article

References (25)

1. A. Arasu, H. Garcia-Molina, Extracting structured data from Web Pages, in: Proceedings of the ACM International Conference on Management (SIGMOD'03), pp. 337-348.
2. Z. Bar-Yossef, S. Rajagopalan, Template detection via data mining and its applications, in: Proceedings of the WWW'02, pp. 580-591.
3. M.K. Bergman, The Deep Web: Surfacing hidden value, Appeared in The Journal of Electronic Publishing from the University of Michigan. , 2001 (accessed 10.01.05).
4. D. Cai, S. Yu, J.R. Wen, W.Y. Ma, Block-based Web Search, in: Proceedings of the 27th Annual International Conference on Research and Development in Information Retrieval (SIGIR'04), pp. 456-463.
5. Callan J., and Connell M. Query-based sampling of text databases. ACM Transactions on Information Systems (TOIS) 19 2 (2001) 97-130
6. V. Crescenzi, G. Mecca, P. Merialdo, ROADRUNNER: Towards automatic data extraction from large Web sites, in: Proceedings of the 27th International Conference on Very Large Data Bases (VLDB'01), pp. 109-118.
7. S. Debnath, P. Mitra, C.L. Giles, Automatic extraction of informative blocks from Webpages, in: Proceedings of the Special Track on Web Technologies and Applications in the ACM Symposium of Applied Computing, 2005, pp. 1722-1726.
8. Gravano L., Ipeirotis P.G., and Sahami M. QProber: A system for automatic classification of Hidden-Web databases. ACM Transactions on Information Systems (TOIS) 21 1 (2003) 1-41
9. M. Heß, O. Drobnik, Clustering specialised Web-databases by exploiting hyperlinks, in: Proceedings of the Second Asian Digital Library Conference, 1999.
10. Y.L. Hedley, M. Younas, A. James, A TNATS approach to Hidden Web documents, in: Proceedings of the First International Conference on Distributed Computing & Internet Technology (ICDCIT'04), pp. 158-167.
11. Y.L. Hedley, M. Younas, A. James, M. Sanderson, A two-phase sampling technique for information extraction from Hidden Web databases, in: Proceedings of the 6th ACM CIKM Workshop on Web Information and Data Management (WIDM'04), pp. 1-8.
12. Lage J.P., da Silva A.S., Golgher P.B., and Laender A.H.F. Automatic generation of agents for collecting Hidden Web pages for data extraction. Data and Knowledge Engineering 49 2 (2004) 177-196
13. S.W. Liddle, S.H. Yau, D.W. Embley, On the automatic extraction of data from the Hidden Web, in: Proceedings of the 20th International Conference on Conceptual Modeling Workshops (ER'01), pp. 212-226.
14. K.I. Lin, H. Chen, Automatic information discovery from the Invisible Web, in: Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC'02), pp. 332-337.
15. Meng W., Wang W., Sun H., and Yu C. Concept hierarchy based text database categorization. International Journal on Knowledge and Information Systems 4 2 (2002) 132-150
16. Open Directory Project (ODP), .
17. S. Raghavan, H. Garcia-Molina, Crawling the Hidden Web, in: Proceedings of the 27th International Conference on Very Large Databases (VLDB'01), pp. 129-138.
18. B. Rahardjo, R. Yap, Automatic information extraction from Web pages, in: Proceedings of the 24th Annual International ACM Conference (SIGIR'01), pp. 430-431.
19. L. Ramaswamy, A. Iyengar, L. Liu, F. Douglis, Automatic detection of fragments in dynamically generated Web pages, in: Proceedings of the 13th World Wide Web Conference, 2004, pp. 443-454.
20. Ramaswamy L., Iyengar A., Liu L., and Douglis F. Automatic fragment detection in dynamic Web pages and its impact on caching. IEEE Transactions on Knowledge and Data Engineering 17 5 (2005) 1-16
21. van Rijsbergen C.J. Information Retrieval (1979), Butterworths, London
22. Salton G., and McGill M. Introduction to Modern Information Retrieval (1983), McGraw-Hill, New York
23. C. Sherman, The Invisible Web. , 2001 (accessed 01.03.05).
24. R. Song, H. Liu, J.R. Wen, W.Y. Ma, Learning block importance models for Web pages, in: Proceedings of the 13th World Wide Web Conference, 2004, pp. 203-211.
25. A. Sugiura, O. Etzioni, Query routing for Web search engines: architecture and experiments, in: Proceedings of the 9th International World Wide Web Conference: The Web: The Next Generation (WWW9), 2000, pp. 417-430.