Joint optimization of wrapper generation and template detection

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2007, Pages 894-902

  Zheng, Shuyi ^a   Song, Ruihua ^c   Wen, Ji Rong ^c   Wu, Di ^b  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c MICROSOFT RESEARCH ASIA   (China)

Author keywords

Information extraction; Template detection; Wrapper

Indexed keywords

INFORMATION EXTRACTION; TEMPLATE DETECTION;

COMPUTER PROGRAMMING LANGUAGES; DATABASE SYSTEMS; ENCODING (SYMBOLS); OPTIMIZATION;

WEBSITES;

EID: 36849062139     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1281192.1281287     Document Type: Conference Paper

References (21)

1. http://www.w3.org/dom/.
2. A. Arasu and H. Garcia-Molina. Extracting structured data from web pages. In Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, pages 337-348, 2003.
3. C.-H. Chang and S.-C. Lui. lepad: information extraction based on pattern discovery. In Proceedings of the 10th International Conference on World Wide Web, pages 681-688, 2001.
4. S.-L. Chuang and J. Y.-j. Hsu. Tree-structured template generation for web pages. In Proceedings of IEEE/WIC/ACM International Conference on Web Intelligence, pages 327-333, 2004.
5. W. W. Cohen, M. Hurst, and L. S. Jensen. A flexible learning system for wrapping tables and lists in html documents. In Proceedings of the 11th International Conference on World Wide Web, pages 232-241, 2002.
6. V. Crescenzi, G. Mecca, and P. Merialdo. Roadrunner: Towards automatic data extraction from large web sites. In Proceedings of the 27th International Conference on Very Large Data Bases, pages 109-118, 2001.
7. V. Crescenzi, G. Mecca, and P. Merialdo. Wrapping-oriented classification of web pages. In Proceedings of the 2002 ACM symposium on Applied computing, pages 1108-1112, 2002.
8. S. Flesca, G. Manco, E. Masciari, E. Rende, and A. Tagarelli. Web wrapper induction: a brief survey. AI Communications, 17:57-61, 2004.
9. J. Hammer, H. Garcia-Molina, J. Cho, A. Crespo, and R., Aranha. Extracting semistructured information from the web. In Proceedings of the Workshop on Management fo Semistructured Data, 1997.
10. A. Hogue and D. Karger. Thresher: automating the unwrapping of semantic content from the world wide web. In Proceedings of 14th International Conference on World Wide Web, pages 86-95, 2005.
11. C.-N. Hsu and M.-T. Dung. Generating finite-state transducers for semi-structured data extraction from the web. Information Systems, Special Issue on Semistructured Data, 23(8):521-538, 1998.
12. N. Kushmerick, D. S. Weld, and R. B. Doorenbos. Wrapper induction for information extraction. In Proceedings of the International Joint Conference on Artificial Intelligence, pages 729-737, 1997.
13. A. H. F. Laender, B. A. Ribeiro-Neto, A. S. da Silva, and J. S. Teixeira. A brief survey of web data extraction tools. SIGMOD Record, 31(2):84-93, 2002.
14. B. Liu. Web content mining (tutorial). In Proceedings of the 14th International Conference on World Wide Web, 2005.
15. B. Liu, R. Grossman, and Y. Zhai. Mining data records in web pages. In Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 601-606, 2003.
16. L. Liu, C Pu, and W. Han. Xwrap: an xml-enabled wrapper construction system for web information sources. In Proceedings of the 16th International Conference on Data Engineering, pages 611-621, 2000.
17. I. Muslea, S. Minton, and C Knoblock. A hierarchical approach to wrapper induction. In Proceedings of the 3rd Annual Conference on Autonomous Agents, pages 190-197, 1999.
18. D. C. Reis, P. B. Golgher, A. S. Silva, and A. F. Laender. Automatic web news extraction using tree edit distance. In Proceedings of the 13th International Conference on World Wide Web, pages 502-511, 2004.
19. S. Sarawagi. Automation in information extraction and data integration (tutorial). In Proceedings of the 28th International Conference on Very Large Data Bases, 2002.
20. P. Willett. Recent trends in hierarchic document clustering: a critical review. Information Processing and Management, 24(5):577-597, 1988.
21. H. Zhao, W. Meng, Z. Wu, V. Raghavan, and C. Yu. Fully automatic wrapper generation for search engines. In Proceedings of the 14th International Conference on World Wide Web, pages 66-75, 2005.