Can we learn a template-independent wrapper for news article extraction from a single training site?

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2009, Pages 1345-1353

  Wang, Junfeng ^a   Chen, Chun ^a   Wang, Can ^a   Pei, Jian ^b   Bu, Jiajun ^a   Guan, Ziyu ^a   Zhang, Wei Vivian ^c  

^a ZHEJIANG UNIVERSITY   (China)

^b SIMON FRASER UNIVERSITY   (Canada)

^c MICROSOFT RESEARCH   (United States)

Author keywords

Classification; Data extraction; Web mining

Indexed keywords

CLASSIFICATION; DATA EXTRACTION; EXISTING METHOD; EXTRACTION METHOD; MACHINE LEARNING PROBLEM; NEWS AGGREGATION; NEWS ARTICLES; PLAIN TEXT; SINGLE SITES; USER FRIENDLY; WEB APPLICATION; WEB MINING; WRAPPER INDUCTION;

IMAGE PROCESSING; WORLD WIDE WEB;

CLASSIFICATION (OF INFORMATION);

EID: 71049182378     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1557019.1557163     Document Type: Conference Paper

References (25)

1. H. Arasu, A. Garcia-Molina. Extracting structured data from web pages. In SIGMOD'03, pages 337-348, 2003.
2. J. Y. Chuang, S. L. Hsu. Tree-structured template generation for web pages. In Web Intelligence'04, pages 327-333, 2004.
3. G. M. P. Crescenzi, V. Mecca. Roadrunner: Towards automatic data extraction from large web sites. In VLDB'01, 2001.
4. S. Flesca. Web wrapper induction: a brief survey. AI Communications, 17(2):57-61, 2004.
5. G. N. D. G. P. Gupta, S. Kaiser. Dom-based content extraction of html documents. In WWW'03, pages 207-214, 2003.
6. M. T. Hsu, C. N. Dung. Generating finite-state transducers for semi-structured data extraction from the web. Information Systems, 23(8):521-538, 1998.
7. Y. Hu, G. Xin, R. Song, G. Hu, S. Shi, Y. Cao, and H. Li. Title extraction from bodies of html documents and its application to web page retrieval. In SIGIR'05, pages 250-257, 2005.
8. T. Irmak, U. Suel. Interactive wrapper generation with minimal user effort. In WWW'06, pages 553-563, 2006.
9. N. Jindal and B. Liu. Review spam detection. In WWW'07, pages 1189-1190, 2007.
10. K. A. M. C. Kamba, T. Bharat. An interactive, personalized, newspaper on the www. In WWW'95, 1995.
11. N. Kushmerick. Wrapper induction: Efficiency and expressiveness. Artificial Intelligence, 118(1-2):15-68, 2000.
12. B. A. d. S. A. S. T. J. S. Laender, A. H. F. Ribeiro-Neto. A brief survey of web data extraction tools. ACM SIGMOD Record, 31(2):84-93, 2002.
13. B. Liu. Web content mining (tutorial). In WWW'05, 2005.
14. S. K.-C. Muslea, I. Minton. A hierarchical approach to wrapper induction. In Int. Conf. Autonomous Agents, 1999.
15. J. C. Platt. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in Large Margin Classifiers, 1999.
16. D. C. Reis, P. B. Golgher, A. S. Silva, and A. F. Laender. Automatic web news extraction using tree edit distance. In WWW'04, pages 502-511, 2004.
17. S. Sarawagi. Automation in information extraction and data integration (tutorial). In VLDB'02, 2002.
18. S. M. Selkow. The tree-to-tree editing problem. Information Processing Letters, 6(6):184-186, 1977.
19. B. C. T. K. L. Shen, H. T. Ooi. Giving meanings to www images. In ACM MULTIMEDIA'00, pages 39-47, 2000.
20. R. Song, H. Liu, J. R. Wen, andW. Y. Ma. Learning block importance models for web pages. In WWW'04, 2004.
21. V. Vapnik. Principles of risk minimization for learning theory. In NIPS'91, pages 831-838, 1991.
22. B. Zhai, Y. Liu. Web data extraction based on partial tree alignment. In WWW'05, pages 76-85, 2005.
23. W. W. Z. R. V. Y. C. Zhao, H. Meng. Fully automatic wrapper generation for search engines. In WWW'05, pages 66-75, 2005.
24. W. Y. C. Zhao, H. Meng. Mining templates from search result records of search engines. In SIGKDD'07, pages 884-893, 2007.
25. S. Zheng, R. Song, and J. Wen. Template-independent news extraction based on visual consistency. In SAAAI'07, volume 22, pages 1507-1513, 2007.