Extracting lists of data records from semi-structured web pages

Data and Knowledge Engineering

Volumn 64, Issue 2, 2008, Pages 491-509

  Álvarez, Manuel ^a   Pan, Alberto ^a   Raposo, Juan ^a   Bellas, Fernando ^a   Cacheda, Fidel ^a  

^a UNIVERSITY OF A CORUÑA   (Spain)

Author keywords

Data extraction; Data mining web based information; Web web based information systems

Indexed keywords

COMPUTER SOFTWARE; DATA MINING; DATABASE SYSTEMS; DIGITAL STORAGE; HTML; PROBLEM SOLVING;

DATA EXTRACTION; WEB-BASED INFORMATION;

WEBSITES;

EID: 37349086786     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2007.10.002     Document Type: Article

References (34)

1. Abiteboul S., Hull R., and Vianu V. Foundations of Databases (1995), Addison Wesley, Reading, Massachussetts
2. M. Álvarez, A. Pan, J. Raposo, F. Cacheda, F. Bellas, V. Carneiro, Crawling the content hidden behind web forms, in: Proceedings of the 2007 International Conference on Computational Science and Its Applications (ICCSA). Lecture Notes in Computer Science, vol. 4706, Part 2, Springer, Berlin/Heidelberg, 2007, pp. 322-333, ISSN: 0302-9743, ISBN-10: 3-540-74475-4, ISBN-13: 978-3-540-74475-7.
3. A. Arasu, H. Garcia-Molina, Extracting structured data from web pages, in: Proceedings of the ACM SIGMOD International Conference on Management of Data, 2003.
4. L. Arlota, V. Crescenzi, G. Mecca, P. Merialdo, Automatic annotation of data extracted from large websites, in: Proceedings of the WebDB Workshop, 2003, pp. 7-12.
5. R. Baumgartner, S. Flesca, G. Gottlob, Visual web information extraction with Lixto, in: Proceedings of the 21st International Conference on Very Large DataBases (VLDB), 2001.
6. J. Caverlee, L. Liu, D. Buttler, Probe, cluster, and discover: focused extraction of QA-Pagelets from the Deep Web, in: Proceedings of the 20th International Conference ICDE, 2004, pp. 103-115.
7. Chakrabarti S. Mining the Web: Discovering Knowledge from Hypertext Data (2003), Morgan Kaufmann Publishers. 1-55860-754-4
8. S. Chakrabarti, Van den M. Berg, B. Dom, Focused crawling: a new approach to topic-specific web resource discovery, in: Proceedings of the Eighth International World Wide Web Conference, 1999.
9. C. Chang, S. Lui, IEPAD: information extraction based on pattern discovery, in: Proceedings of 2001 International World Wide Web Conference, 2001, pp. 681-688.
10. K. Chang, B. He, Z. Zhang, MetaQuerier over the Deep Web: Shallow Integration Across Holistic Sources, in: Proceedings of the VLDB Workshop on Information Integration on the Web (VLDB-IIWeb), 2004.
11. V. Crescenzi, G. Mecca, P. Merialdo, ROADRUNNER: towards automatic data extraction from large web sites, in: Proceedings of the 2001 International VLDB Conference, 2001, pp. 109-118.
12. Crescenzi V., Merialdo P., and Missier P. Clustering web pages based on their structure. Data and Knowledge Engineering Journal 54 3 (2005) 279-299
13. Gonnet G.H., Baeza-Yates R.A., and Snider T. New Indices for Text: Pat trees and Pat Arrays. Information Retrieval: Data Structures and Algorithms (1992), Prentice Hall
14. J. Hammer, J. McHugh, H. Garcia-Molina, Semistructured data: the Tsimmis experience, in: Proceedings of the First East-European Symposium on Advances in Databases and Information Systems (ADBIS), 1997, pp. 1-8.
15. A. Hogue, D. Karger, Thresher: automating the unwrapping of semantic content from the wold wide web, in: Proceedings of the 14th International World Wide Web Conference, 2005.
16. Hsu C.N., and Dung M.T. Generating finite-state transducers for semi-structured data extraction from the web. Information Systems 23 8 (1998) 521-538
17. Kovalev V., Bhowmick S., and Madria S. HW-STALKER: a machine learning-based system for transforming QURE-Pagelets to XML. Data and Knowledge Engineering Journal 54 2 (2005) 241-276
18. Y. Jung, J. Geller, Y. Wu, Ae S. Chun, Semantic deep web: automatic attribute extraction from the deep web data sources, in: Proceedings of the International SAC Conference, 2007, pp. 1667-1672.
19. T. Kistlera, H. Marais, WebL: A programming language for the web, in: Proceedings of the Seventh International World Wide Web Conference (WWW7), 1998, pp. 259-270.
20. N. Kushmerick, D.S. Weld, R.B. Doorenbos, Wrapper induction for information extraction, in: Proceedings of the 15th International Joint Conference on Artificial Intelligence (IJCAI), 1997, pp. 729-737.
21. Laender A.H.F., Ribeiro-Neto B.A., Soares da Silva A., and Teixeira J.S. A brief survey of web data extraction tools. ACM SIGMOD Record 31 2 (2002) 84-93
22. K. Lerman, L. Getoor, S. Minton, C. Knoblock, Using the structure of web sites for automatic segmentation of tables, in: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, 2004, pp. 119-130.
23. Levenshtein V.I. Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady 10 (1966) 707-710
24. S. Liddle, S. Yau, D. Embley, On the Automatic Extraction of Data from the Hidden Web. ER (Workshops), 2001, pp. 212-226.
25. Muslea I., Minton S., and Knoblock C.A. Hierarchical wrapper induction for semistructured information sources. Autonomous Agents and Multi-Agent Systems (2001) 93-114
26. C. Notredame, Recent progresses in multiple sequence alignment: a survey, Technical report, Information Genetique et, 2002.
27. A. Pan et al., Semi-automatic wrapper generation for commercial web sources, in: Proceedings of IFIP WG8.1 Conference on Engineering Inform, Systems in the Internet Context (EISIC), 2002.
28. S. Raghavan, H. Garci{dotless}́a-Molina, Crawling the hidden web, in: Proceedings of the 27th International Conference on Very Large Databases (VLDB), 2001.
29. Raposo J., Pan A., Álvarez M., and Hidalgo J. Automatically maintaining wrappers for web sources. Data and Knowledge Engineering Journal 61 2 (2007) 331-358
30. Sahuguet A., and Azavant F. Building intelligent web applications using lightweight wrappers. Data and Knowledge Engineering Journal 36 3 (2001) 283-316
31. The W3 Consortium. The Document Object Model. http://www.w3.org/DOM/.
32. J. Wang, F. Lochovsky, Data extraction and label assignment for web databases, in: Proceedings of the 12th International World Wide Web Conference (WWW12), 2003.
33. Y. Zhai, B. Liu, Extracting web data using instance-based learning, in: Proceedings of Web Information Systems Engineering Conference (WISE), 2005, pp. 318-331.
34. Zhai Y., and Liu B. Structured data extraction from the web based on partial tree alignment. IEEE Transactions on Knowledge and Data Engineering 18 12 (2006) 1614-1628