A flexible learning system for wrapping tables and lists in HTML documents

Proceedings of the 11th International Conference on World Wide Web, WWW '02

Volumn , Issue , 2002, Pages 232-241

  Cohen, William W ^a   Hurst, Matthew ^a   Jensen, Lee S ^b,c  

^a WhizBang Labs   (United States)

^b WhizBang Labs   (United States)

^c NextPage Corporation   (United States)

Author keywords

Canopy; Learning; Record linkage; Reference matching

Indexed keywords

CONTROLLED EXPERIMENT; HTML DOCUMENTS; LEARNING RATES; LEARNING RECORD; MANAGEMENT SYSTEMS; REFERENCE MATCHING; TABULAR DATA; VISUAL APPEARANCE;

LEARNING ALGORITHMS; VISUALIZATION; WORLD WIDE WEB;

LEARNING SYSTEMS;

EID: 77953046656     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/511446.511477     Document Type: Conference Paper

References (30)

1. H. Adé, L. de Raedt, and M. Bruynooghe. Declarative bias for general-to-specific ILP systems. Machine Learning, 20(1/2):119-154, 1995.
2. A. Blum. Empirical support for WINNOW and weighted majority algorithms: results on a calendar scheduling domain. In Machine Learning: Proceedings of the Twelfth International Conference, Lake Tahoe, California, 1995. Morgan Kaufmann.
3. B. Chidlovskii. Wrapper generation by k-reversible grammar induction. In Proceedings of the Workshop on Machine Learning and Information Extraction, Berlin, Germany, 2000.
4. XML path language (XPath) version 1.0. Available from http://www.w3.org/TR/1999/REC-xpath-19991116, 1999.
5. W. W. Cohen. Grammatically biased learning: learning logic programs using an explicit antecedent description language. Artificial Intelligence, 68:303-366, 1994.
6. W. W. Cohen. Recognizing structure in web pages using similarity queries. In Proceedings of the Sixteenth National Conference on Artificial Intelligence (AAAI-99), Orlando, FL, 1999.
7. W. W. Cohen and W. Fan. Learning page-independent heuristics for extracting data from web pages. In Proceedings of the Eighth International World Wide Web Conference (WWW-99), Toronto, 1999.
8. L. De Raedt, editor. Advances in Inductive Logic Programming. IOS Press, 1995.
9. D. Freitag. Multistrategy learning for information extraction. In Proceedings of the Fifteenth International Conference on Machine Learning. Morgan Kaufmann, 1998.
10. D. Freitag and N. Kushmeric. Boosted wrapper induction. In Proceedings of the Seventeenth National Conference on Artificial Intelligence (AAAI-2000), Austin, TX, 2000.
11. C.-N. Hsu. Initial results on wrapping semistructured web pages with finite-state transducers and contextual rules. In Papers from the 1998 Workshop on AI and Information Integration, Madison, WI, 1998. AAAI Press.
12. HTML 4.01 specification. http://www.w3.org/TR/html4/, 1999.
13. M. Hurst. The Interpretation of Tables in Texts. PhD thesis, University of Edinburgh, School of Cognitive Science, Informatics, University of Edinburgh, 2000.
14. L. S. Jensen and W. W. Cohen. A structured wrapper induction system for extracting information from semi-structured documents. In Proceedings of the IJCAI-2001 Workshop on Adaptive Text Extraction and Mining, Seattle, WA, 2001.
15. N. Kushmeric. Regression testing for wrapper maintenance. In Proceedings of the Sixteenth National Conference on Artificial Intelligence (AAAI-99), Orlando, FL, 1999.
16. N. Kushmeric. Wrapper induction: efficiency and expressiveness. Artificial Intelligence, 118:15-68, 2000.
17. D. Lewis. Naive (bayes) at forty: The independence assumption in information retrieval. In Proceedings of ECML-98, 10th European Conference on Machine Learning, 1998.
18. N. Littlestone. Learning quickly when irrelevant attributes abound: A new linear-threshold algorithm. Machine Learning, 2(4), 1988.
19. A. McCallum and K. Nigam. A comparison of event models for naive bayes text classification. In AAAI-98 Workshop on Learning for Text Categorization, 1998.
20. S. Muggleton and L. De Raedt. Inductive logic programming: Theory and methods. Journal of Logic Programming, 19/20(7):629-679, 1994.
21. I. Muslea, S. Minton, and C. Knoblock. A hierarchical approach to wrapper induction. In Proceedings of the Third International Conference on Autonomous Agents (Agents'99), Seattle, WA, 1999.
22. I. Muslea, S. Minton, and C. Knoblock. Wrapper induction for semistructured information sources. Journal of Autonomous Agents and Multi-Agent Systems, 16(12), 1999.
23. K. Nigam, J. Lafferty, and A. McCallum. Using maximum entropy for text classification. In Proceedings of Machine Learning for Information Filtering Workshop, IJCAI '99, Stockholm, Sweden, 1999.
24. J. R. Quinlan. Learning logical definitions from relations. Machine Learning, 5(3):239-266, 1990.
25. J. R. Quinlan. C4.5: programs for machine learning. Morgan Kaufmann, 1994.
26. J. R. Quinlan and R. M. Cameron-Jones. FOIL: A midterm report. In P. B. Brazdil, editor, Machine Learning: ECML-93, Vienna, Austria, 1993. Springer-Verlag. Lecture notes in Computer Science # 667.
27. A. Sahuget and F. Azavant. Building light-weight wrappers for legacy web datasources using W4F. In Proceedings of VLDB '99, pages pages 738-741, 1999.
28. Clean up your web pages with HTML TIDY. http://www.w3.org/People/Raggett/ tidy/, 1999.
29. X. Wang. Tabular Abstraction, Editing, and Formatting. PhD thesis, University of Waterloo, Waterloo, Ontario, Canada, 1996.
30. J. M. Zelle and R. J. Mooney. Inducing deterministic Prolog parsers from treebanks: a machine learning approach. In Proceedings of the Twelfth National Conference on Artificial Intelligence, Seattle, Washington, 1994. MIT Press.