Detecting data records in semi-structured web sites based on text token clustering

Integrated Computer-Aided Engineering

Volumn 15, Issue 4, 2008, Pages 297-311

  Gao, Xiaoying ^a   Vuong, Le Phong Bao ^a   Zhang, Mengjie ^a  

^a VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

Author keywords

Automatic data detection; HTML tags; Semi structured web sites; Text token clustering; Web information extraction

Indexed keywords

CLUSTER ANALYSIS; CLUSTERING ALGORITHMS; HTML; INFORMATION RETRIEVAL; WEBSITES;

DATA DETECTION; HTML TAGS; SEMI-STRUCTURED; TEXT TOKEN CLUSTERING; WEB INFORMATION EXTRACTION;

ARTIFICIAL INTELLIGENCE;

EID: 50249132381     PISSN: 10692509     EISSN: None     Source Type: Journal    
DOI: 10.3233/ica-2008-15403     Document Type: Conference Paper

References (31)

1. Manuel Álvarez, Alberto Pan, Juan Raposo, Fernando Bellas and Fidel Cacheda, Extracting lists of data records from semi-structured web pages, Data Knowl Eng 64(2) (2008), 491-509.
2. Julien Carme, Michal Ceresna, Oliver Frlich, Georg Gottlob, Tamir Hassan, Marcus Herzog, Wolfgang Holzinger and Bernhard Krpl, The lixto project: Exploring new frontiers of web data extraction, in: BNCOD 2006, Springer-Verlag Berlin Heidelberg, 2006, pp. 1-15.
3. James Caverlee, Ling Liu and David Buttler. Probe, cluster, and discover: Focused extraction of qa-pagelets from the deep web, in: ICDE, 2004, pp. 103-115.
4. Chia-hui Chang, Mohammed Kayed, Moheb Ramzy Girgis, and khaled Shaalan. A survy of web information extraction systems, IEEE transactions on Knowledge and Data Engineering 18(10) (2006), 1411-1428.
5. Peter Cheeseman and John Stutz. Bayesian classification (au-toclass): Theory and results, in: Advances in Knowledge Discovery and Data Mining, American Association for Artificial Intelligence USA, 1996, pp. 153-180.
6. Valter Crescenzi, Giansalvatore Mecca and Paolo Merialdo. Roadrunner: Towards automatic data extraction from large web sites, in: Proceedings of 27th International Conference on Very Large Data Bases, 2001, pp. 109-118.
7. Davi de Castro Reis, Paulo Braz Golgher, Altigran Soares da Silva and Alberto H.F. Laender, Automatic web news extraction using tree edit distance, in: WWW, 2004, pp. 502-511.
8. Xiaoying Gao, Peter Andreae and Richard Collins, Approximately repetitive structure detection for wrapper induction, in: Proceeding of the Eighth Pacific Rim International Conference on Artificial Intelligence (PRICAI'04), 2004, pp. 585-594.
9. Xiaoying Gao, Le Phong Bao Vuong and Mengjie Zhang. Automatic data record detection in web pages, in: KSEM, 2007, pp. 349-361.
10. Xiaoying Gao, Mengjie Zhang and Peter Andreae, Automatic pattern construction for web information extraction, in: International Journal of Uncertainty, Fuziness, and Knowledge Based Systems (Vol. 12)(4), 2004, pp. 447-470.
11. Bora Gazen and Steven Minton. Overview of autofeed: An unsupervised learning system for generating webfeeds, in: AAAI, 2006.
12. A.K. Jain, M.N. Murty and P.J. Flynn, Data clustering: a review, ACM Computing Surveys 31(3) (1999), 264-323.
13. L. Kaufman and P.J. Rousseeuw, Finding groups in data: An introduction to cluster analysis, March 1990.
14. Nickolas Kushmerick, Daniel S. Weld and Robert B. Doorenbos, Wrapper induction for information extraction, in: Intl. Joint Conference on Artificial Intelligence (IJCAI), 1997, pp. 729-737.
15. Alberto H.F. Laender, BerthierA.Ribeiro-Neto, Altigrams.da Silva and Juliana S. Teixeira, A brief survy of web data extraction tools, SIGMOD Record 31(2) (2002).
16. K. Lerman, C. Knoblock and S. Minton, Automatic data extraction from lists and tables in web sources, in: Proceedings of the workshop on Advances in Text Extraction and Mining (IJCAI-2001), 2001.
17. B. Liu, R. Grossman and Y. Zhai, Mining data records in web pages, in: Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, 2003, pp. 601-606.
18. Tom Mitchell, Machine Learning, McGraw Hill, 1997.
19. Ion Muslea, Repository of online information sources used in information extraction tasks. www.isi.edu/info-agents/rise/repository.html, 2005.
20. Ion Muslea, Extraction patterns for information extraction tasks: A survey, in: Proceedings of AAAI Workshop on Machine Learning for Information Extraction. Orlando, Florida, July 1999.
21. Ion Muslea, Steve Minton and Craig Knoblock, A hierarchical approach to wrapper induction, in: Oren Etzioni, Jörg P. Müller and Jeffrey M. Bradshaw, eds, Proceedings of the Third International Conference on Autonomous Agents (Agents'99), Seattle, WA, USA, 1999. ACM Press, pp. 190-197.
22. Object Management Group. W3c document object model. www.w3.org/dom/, 2005.
23. Nikolaos Papadakis, Dimitrios Skoutas, Konstantinos Raftopoulos and Theodora A. Varvarigou, Stavies: A system for information extraction from unknown web data sources through automatic web wrapper generation using clustering techniques, IEEE Trans Knowl Data Eng 17(12) (2005), 1638-1652.
24. G. Salton, Introduction to Modern Information Retrieval, McGraw-Hill, 1983.
25. G. Salton, A. Wong and C.S. Yang, A vector space model for automatic indexing, Commun ACM 18(11) (1975), 613-620.
26. T.F. Smith and M.S. Waterman, Identification of common molecular subsequences, Journal of Molecular Biology 147 (1981), 195-197.
27. Jordi Turbo, Alicia Ageno and Neus Catala, Adaptive information extraction, ACM Computing Surveys 38(2) (2006).
28. Le Phong Bao Vuong and Xiaoying Gao, Using clustering for web information extraction, in: Australian Conference on Artificial Intelligence, 2007, pp. 415-424.
29. LePhong Bao Vuong, Xiaoying Gao and Mengjie Zhang, Data extraction from semi-structured web pages by clustering, in: Web Intelligence, 2006, pp. 374-377.
30. Ian H. Witten and Eibe Frank, Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufmann, 2nd edition, 2005.
31. Yanhong Zhai and Bing Liu, Web data extraction based on partial tree alignment, in: WWW '05: Proceedings of the 14th international conference on World Wide Web, New York, NY, USA, 2005. ACM, pp. 76-85.