Robust web extraction: An approach based on a probabilistic tree-edit model

SIGMOD-PODS'09 - Proceedings of the International Conference on Management of Data and 28th Symposium on Principles of Database Systems

Volumn , Issue , 2009, Pages 335-347

  Dalvi, Nilesh ^a   Bohannon, Philip ^a   Sha, Fei ^b  

^a YAHOO RESEARCH   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Probabilistic tree edit model; Wrappers; Xpath

Indexed keywords

EVOLUTION PROBLEM; HIGH COSTS; HTML DOCUMENTS; PROBABILISTIC MODELS; PROBABILISTIC TREE-EDIT MODEL; PROBABILISTIC TREES; QUADRATIC TIME; SOURCE TREE; TRAINING EXAMPLE; TREE STRUCTURES; WEB EXTRACTION; WEB-PAGE;

HTML; LEARNING ALGORITHMS; MARKUP LANGUAGES; WEBSITES;

DATABASE SYSTEMS;

EID: 70849104261     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1559845.1559882     Document Type: Conference Paper

References (32)

1. Mari Abe and Masahiro Hori. Robust pointing by xpath language: Authoring support and empirical evaluation. Applications and the Internet, IEEE/IPSJ International Symposium on, 0:156, 2003.
2. Tobias Anton. Xpath-wrapper induction by generating tree traversal patterns. In LWA, pages 126-133, 2005.
3. Internet archive: http://www.archive.org/.
4. Robert Baumgartner, Sergio Flesca, and Georg Gottlob. Visual web information extraction with lixto. In VLDB, pages 119-128, 2001.
5. Marc Bernard, Amaury Habrard, and Marc Sebban. Learning stochastic tree edit distance. In ECML, pages 42-53, 2006.
6. Philip Bille. A survey on tree edit distance and related problems. Theor. Comput. Sci., 337(1-3):217-239, 2005.
7. Laurent Boyer, Amaury Habrard, and Marc Sebban. Learning metrics between tree structured data: Application to image recognition. In ECML, pages 54-66, 2007.
8. Boris Chidlovskii, Bruno Roustant, and Marc Brette. Documentum eci self-repairing wrappers: performance analysis. In SIGMOD, pages 708-717, 2006.
9. William W. Cohen, Matthew Hurst, and Lee S. Jensen. A flexible learning system for wrapping tables and lists in html documents. In WWW, pages 232-241, New York, NY, USA, 2002. ACM.
10. Valter Crescenzi, Giansalvatore Mecca, and Paolo Merialdo. Roadrunner: Towards automatic data extraction from large web sites. In VLDB, pages 109-118, 2001.
11. J. Graehl and K. Knight. Training tree transducers. In HLT-NAACL, pages 105-112, 2004.
12. Wei Han, David Buttler, and Calton Pu. Wrapping web data into XML. SIGMOD Record, 30(3):33-38, 2001.
13. Chun-Nan Hsu and Ming-Tzung Dung. Generating finite-state transducers for semi-structured data extraction from the web. Information Systems, 23(8):521-538, 1998.
14. Internet movie database: http://www.imdb.com/.
15. Kevin Knight and JonathaGraehl. An overview of probabilistic tree transducers for natural language processing. In Proceedings of the CICLing, 2005.
16. Marek Kowalkiewicz, Tomasz Kaczmarek, and Witold Abramowicz. Myportal: Robust extraction and aggregation of web content. In VLDB, pages 1219-1222. VLDB Endowment, 2006.
17. Marek Kowalkiewicz, Maria E. Orlowska, Tomasz Kaczmarek, and Witold Abramowicz. Robust web content extraction. In WWW, pages 887-888, 2006.
18. Nickolas Kushmerick, Daniel S. Weld, and Robert B. Doorenbos. Wrapper induction for information extraction. In IJCAI, pages 729-737, 1997.
19. Kristina Lerman, Steven N. Minton, and Craig A. Knoblock. Wrapper maintenance: A machine learning approach. Journal of Artificial Intelligence Research, 18:2003, 2003.
20. A. McCallum, K. Bellare, and P. Pereira. A conditional random field for discriminatively-trained finite-state string edit distance. In UAI, 2005.
21. Robert McCann, Bedoor AlShebli, Quoc Le, Hoa Nguyen, Long Vu, and AnHai Doan. Mapping maintenance for data integration systems. In VLDB, pages 1018-1029, 2005.
22. I. Muslea, S. Minton, and C. Knoblock. Stalker: Learning extraction rules for semistructured, 1998.
23. Jussi Myllymaki and Jared Jackson. Robust web data extraction with xml path expressions. Technical report, IBM Research Report RJ 10245, May 2002.
24. Andrew Ng and Michael Jordan. On discriminative vs. generative classifiers: A comparison of logistic regression and naive bayes. In NIPS, 2002.
25. Jorge Nocedal and Stephen J. Wright. Numerical Optimization. Springer, 1999.
26. Jose Oncina and Marc Sebban. Learning stochastic edit distance: Application in handwritten character recognition. Pattern Recogn., 39(9):1575-1587, 2006.
27. J. S. Provan and M. O. Ball. The complexity of counting cuts and of computing the probability that a graph is connected. SIAM J. Comput., 12(4):777-788, 1983.
28. Eric Sven Ristad and Peter N. Yianilos. Learning string edit distance. In ICML, pages 287-295, 1997.
29. Arnaud Sahuguet and Fabien Azavant. Building light-weight wrappers for legacy web data-sources using w4f. In VLDB, pages 738-741, 1999.
30. http://sourceforge.net/projects/jtidy.
31. L. Valiant. The complexity of enumeration and reliability problems. SIAM J. Comput., 8:410-421, 1979.
32. K. Zhang and D. Shasha. Simple fast algorithms for the editing distance between trees and related problems. SIAM J. Comput., 18(6):1245-1262, 1989.