An approach to deep web crawling by sampling

Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008

Volumn , Issue , 2008, Pages 718-724

  Lu, Jianguo ^a   Wang, Yan ^a   Liang, Jie ^a   Chen, Jessica ^a   Liu, Jiming ^b  

^a UNIVERSITY OF WINDSOR   (Canada)

^b HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSICAL ALGORITHMS; DATA SOURCES; DEEP WEBS; GENERAL METHODS; LOW COSTS; OPTIMAL SETS; REUTERS; SAMPLING-BASED METHODS; SEARCH INTERFACES; SET-COVERING PROBLEMS; WIKIPEDIA;

WIRELESS TELECOMMUNICATION SYSTEMS;

EID: 62949239222     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WIIAT.2008.392     Document Type: Conference Paper

References (18)

1. Alvarez, M., et al., Extracting lists of data records from semi-structured web pages. 2007, Elsevier.
2. L. Barbosa and J. Freire, Siphoning hidden-web data through keyword-based interfaces, In SBBD, 2004.
3. Michael K. Bergman, The Deep Web: Surfacing Hidden Value, The Journal of Electronic Publishing 7 (1). 2001.
4. Callan, J. and M. Connell, Query-Based Sampling of Text Databases. ACM Transactions on Information Systems, 2001. 97-130.
5. Chia-Hui Chang, Mohammed Kayed, Moheb Ramzy Girgis, Khaled F. Shaalan, A Survey of Web Information Extraction Systems, IEEE Transactions on Knowledge and Data Engineering, vol. 18, no. 10, pp. 1411-1428, October, 2006.
6. Che, et al., Query Rewriting for Extracting Data Behind HTML Forms. 2004, Springer.
7. V. Crescenzi, G. Mecca, P. Merialdo, RoadRunner: towards automatic data extraction from large web sites, VLDB J. 2001. pp. 109-118.
8. Ferris, C. and Farrell, J., What are Web services?, Commun. ACM 46, 6 2003. pp. 31.
9. Hatcher, E. and O. Gospodnetic, Lucene in Action, Manning Publications, 2004.
10. He, B., et al., Accessing the Deep Web: A Survey. CACM, May 2007. p. 94-101.
11. C.A. Knoblock, K. Lerman, S. Minton, I. Muslea, Accurately and reliably extracting data from the web: a machine learning approach, IEEE Data Eng. Bull. 23 (4) (2000), pp. 33-41.
12. Palmieri Lage, J., et al., Automatic generation of agents for collecting hidden Web pages for data extraction. 2004, Elsevier. p. 177-196.
13. Stephen W. Liddle, David W. Embley, Del T. Scott, Sai Ho Yau, Extracting Data behind Web Forms, Advanced Conceptual Modeling Techniques, 2002. pp. 402-413.
14. Alexandros Ntoulas, Petros Zerfos, and Junghoo Cho, Downloading Textual Hidden Web Content through Keyword Queries. In Proceedings of the Joint Conference on Digital Libraries (JCDL), 2005. pp. 100-109.
15. S. Raghavan, H. Garcia-Molina. Crawling the Hidden Web, VLDB 2001.
16. Denis Shestakov, Sourav S. Bhowmick and Ee-Peng Lim, DEQUE: querying the deep web, Journal of Data Knowl. Eng., 52(3), 2005. pp. 273-311.
17. Ping Wu, Ji-Rong Wen, Huan Liu, Wei-Ying Ma, Query Selection Techniques for Efficient Crawling of Structured Web Sources, ICDE, 2006. pp 47-56.
18. Zipf, G. K. Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology. Addison-Wesley, Reading, MA. 1949.