Automatic information extraction from semi-structured Web pages by pattern discovery

Decision Support Systems

Volumn 35, Issue 1, 2003, Pages 129-147

  Chang, Chia Hui ^a   Hsu, Chun Nan ^b   Lui, Shao Cheng ^c  

^a NATIONAL CENTRAL UNIVERSITY   (Taiwan)

^b INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

^c CHUNGHWA TELECOM CO LTD   (Taiwan)

Author keywords

Information extraction; Multiple string alignment; PAT trees; Semi structured data; Wrapper generation

Indexed keywords

DATA STRUCTURES; INFORMATION RETRIEVAL; QUERY LANGUAGES; TREES (MATHEMATICS);

WRAPPER GENERATION;

WEBSITES;

EID: 0037375290     PISSN: 01679236     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-9236(02)00100-8     Document Type: Article

References (30)

1. Berners-Lee T., Hendler J., Lassila O. The semantic web. Scientific American. 284(5):May 2001;34-43.
2. Boyer R.S., Moore J.S. A fast string searching algorithm. Communications of the ACM. 20:1977;762-772.
3. BrightPlanet.com LLC. The deep web: surfacing hidden value, http://www.completeplanet.com/tutorials/deepweb/index.asp July, 2000.
4. Chang C.-H., Lui S.-C. IEPAD: information extraction based on pattern discovery. Proceedings of the 10th International Conference on World Wide Web, Hong-Kong. Lecture Notes in Artificial Intelligence. vol. 2336:2001;223-231 Springer.
5. Chang C.-H., Lui S.-C., Wu Y.-C. Applying pattern mining to web information extraction. Proceedings of the 5th Pacific-Asia Conference on Knowledge Discovery and Data Mining, Hong Kong, China. 2001;4-15 ACM Press.
6. Chawathe S., Garcia-Molina H., Hammer J. The TSIMMIS project: integration of heterogeneous information sources. Proceedings of the 10th Meeting of the Information Society of Japan, Tokyo, Japan. 1994;7-18.
7. Chidlovskii B., Borghoff U., Chevalier P. Towards sophisticated wrapping of Web-based information repositories. Proceedings of the 5th International RIAO Conference, Montreal, Quebec, Canada. 1997;123-135.
8. Chidlovskii B., Ragetli J., Rijke M. Automatic wrapper generation for web search engines. Proceedings of the 1st International Conference on Web-Age Information Management (WAIM'2000), LNCS Series, Shanghai, China. 2000.
9. Chien L.F. PAT-tree-based keyword extraction for Chinese information retrieval. Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Philadelphia, PA, USA. 1997;50-58 ACM Press.
10. Proceedings of the Sixth Message Understanding Conference (MUC-6). 1995;Morgan Kaufmann Publisher, San Francisco, CA, USA.
11. Doorenbos R.B., Etzioni O., Weld D.S. A scalable comparison-shopping agent for the world-wide web. Proceedings of the 1st International Conference on Autonomous Agents, New York, NY, USA. 1997;39-48 ACM Press.
12. Embley D., Jiang Y., Ng Y.-K. Record-boundary discovery in web documents. Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'99), Philadelphia, PA, USA. 1999;467-478 ACM Press.
13. Gonnet G.H., Baeza-Yates R.A., Snider T. New indices for text: PAT trees and PAT arrays. Frakes W.B., Baeza-Yates R. Information Retrieval: Data Structures and Algorithms. 1992;66-82 Prentice Hall, New Jersey. Chapter 5.
14. Grumbach S., Mecca G. In search of the lost schema. Beeri C., Buneman P. Database Theory-ICDT '99, 7th International Conference, Proceedings. Lecture Notes in Computer Science. vol. 1540:1999;314-331 Springer, Jerusalem, Israel.
15. Gusfield D. Algorithms on Strings, Trees, and Sequences. 1997;Cambridge Univ. Press, Cambridge, UK.
16. Hsu C.-N., Dung M.-T. Generating finite-state transducers for semi-structured data extraction from the web. Information Systems. 23(8):1998;521-538.
17. Hsu C.-N., Chang C.-C. Finite-state transducers for semi-structured text mining. Proceedings of IJCAI-99 Workshop on Text Mining: Foundations, Techniques and Applications, Stockholm, Sweden. 1999;38-49 Pergamon Press, NY.
18. Knoblock C., Minton S., Ambite J. et al. Modeling web sources for information integration. Proceedings of the 15th National Conference on Artificial Intelligence and Tenth Innovative Applications of Artificial Intelligence Conference, Madison, WI, USA. 1998;211-218 AAAI Press, Los Altos, CA.
19. Knuth D.E., Morris J.H., Pratt V.B. Fast pattern matching in strings. SIAM Journal on Computing. 6:1977;323-350.
20. Kurtz S., Schleiermacher C. REPuter: fast computation of maximal repeats in complete genomes. Bioinformatics. 15(5):1999;426-427.
21. Kushmerick N. Gleaning the web. IEEE Intelligent Systems. 14(2):March/April 1999;20-22.
22. Kushmerick N., Weld D., Doorenbos R. Wrapper induction for information extraction. Proceedings of the 15th International Joint Conference on Artificial Intelligence (IJCAI '97), Nagoya, Japan. 1997;729-737 Morgan Kaufmann, New Jersey.
23. Morrison D.R. PATRICIA - practical algorithm to retrieve information coded in alphanumeric. Journal of ACM. 15(4):Jan 1968;514-534.
24. Muslea I. Extraction patterns for information extraction tasks: a survey. Proceedings of AAAI'99: Workshop on Machine Learning for Information Extraction. 1999;AAAI Press, Menlo Park, CA, USA.
25. Muslea I., Minton S., Knoblock C. A hierarchical approach to wrapper induction. Proceedings of the 3rd International Conference on Autonomous Agents. 1999;190-197 ACM Press, New York, NY, USA.
26. Selberg E., Etzioni O. Multi-Engine Search and Comparison Using the MetaCrawler. Proc. of the Fourth Intl. WWW Conference, Boston, USA. 1995;. http://www.w3.org/Conferences/wwww4/.
27. Soderland S. Learning information extraction rules for semi-structured and free text. Machine Learning. 34(1-3):1996;233-272.
28. The World-Wide Web Consortium (W3C), Extensible markup language (XML), http://www.w3.org/XML/, 1997.
29. Warnick W.L., Lederman A., Scott R.L. et al. Searching the deep web-directed Query engine applications at the department of energy. DLib Magazine. 7(1):Jan 2001.
30. Web Design Group, Wilbur-HTML 3.2, http://www.htmlhelp.com/reference/wilbur/, 1997.