Adapting Web information extraction knowledge via mining site-invariant and site-dependent features

ACM Transactions on Internet Technology

Volumn 7, Issue 1, 2007, Pages

  Wong, Tak Lam ^a   Lam, Wai ^b  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Machine learning; Text mining; Web mining; Wrapper adaptation

Indexed keywords

DATA ACQUISITION; DATA MINING; LEARNING SYSTEMS; WORLD WIDE WEB;

INFORMATION EXTRACTION; TEXT MINING; WEB MINING; WRAPPER ADAPTATION;

INFORMATION ANALYSIS;

EID: 33847732258     PISSN: 15335399     EISSN: 15576051     Source Type: Journal    
DOI: 10.1145/1189740.1189746     Document Type: Article

References (42)

1. AMBITE, J., BARISH, G., KNOBLOCK, C., MUSLEA, M., OH, J., AND MINTON, S. 2002. Getting from here to there: Interactive planning and agent execution for optimizing travel. In Proceedings of the Fourteenth Innovative Applications of Artificial Intelligence Conference, 862-869.
2. BILENKO, M. AND MOONEY, R. 2003. Adaptive duplicate detection using learnable string similarity measures. In Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD), 39-48.
3. BLEI, D., BAGNELL, J., AND MCCALLUM, A. 2002. Learning with scope, with application to information extraction and classification. In Proceedings of the Eighteenth Conference on Uncertainty in Artificial Intelligence (UAI), 53-60.
4. BRIN, S. 1998. Extracting patterns and relations from the World Wide Web. In Proceedings of the International Workshop on the Web and Databases, 172-183.
5. CALIFF, M. E. AND MOONEY, R. J. 2003. Bottom-up relational learning of pattern matching rules for information extraction. J. Mach. Learn. Res. 4, 177-210.
6. CHAWATHE, S., GARCIA-MOLINA, H., HAMMER, J., IRELAND, K., PAPAKONSTANINOU, Y., ULLMAN, J., AND WIDOM, J. 1994. The TSIMMIS project: Integration of heterogeneous information sources. In Proceedings of the Information Processing Society of Japan, 7-18.
7. 2 an adaptive algorithm for information extraction from Web-related texts. In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (IJCAI), 1251-1256.
8. COHEN, W. 1999. Reasoning about textual similarity in a Web-based information access system. Autonomous Agents and Multi-Agent Systems 2(1), 65-86.
9. COHEN, W. AND FAN, W. 1999. Learning page-independent heuristics for extracting data from Web pages. Comput. Netw. 31(11-16), 1641-1652.
10. COHEN, W. W., HURST, M., AND JENSEN, L. 2002. A flexible learning system for wrapping tables and lists in HTML documents. In Proceedings of the Eleventh International World Wide Web Conference (WWW), 232-241.
11. CRESCENZI, V., MECCA, G., AND MERIALDO, P. 2001. ROADRUNNER: Towards automatic data extraction from large Web sites. In Proceedings of the 27th Very Large Databases Conference (VLDB), 109-118.
12. DOORENBOS, R. B., ETZIONI, O., AND WELD, D. S. 1997. A scalable comparison-shopping agent for the World-Wide Web. In Proceedings of the First International Conference on Autonomous Agents, 39-48.
13. DOWNEY, D., ETZIONI, O., AND SODERLAND, S. 2005. A probabilistic model of redundancy in information extraction. In Proceedings of the Eleventh International Joint Conference on Artificial Intelligence (IJCAI), 1034-1041.
14. ETZIONI, O., CAFARELLA, M., DOWNEY, D., POPESCU, A. M., SHAKED, T., SODERLAND, S., AND WELD, D. 2005. Unsupervised named-entity extraction from the Web: An experimental study. Artif. Intell. 165(1), 91-134.
15. FREITAG, D. AND MCCALLUM, A. 1999. Information extraction with HMMs and shrinkage. In Proceedings of the AAAI-99 Workshop on Machine Learning for Information Extraction.
16. FRENCH, J. C., POWELL, A. L., AND SCHULMAN, E. 1997. Applications of approximate word matching in information retrieval. In Proceedings of the Sixth International Conference on Information and Knowledge Management (CIKM), 9-15.
17. GHANI, R. AND JONES, R. 2002. A comparison of efficacy and assumptions of bootstrapping algorithms for training information extraction systems. In Proceedings of the Workshop on Linguistic Knowledge Acquisition and Representation: Bootstrapping Annotated Data at the Linguistic Resources and Evaluation Conference.
18. GOLGHER, P. AND DA SLLVA, A. 2001. Bootstrapping for example-based data extraction. In Proceedings of the Tenth ACM International Conference on Information and Knowledge Management (CIKM), 371-378.
19. GUSFIELD, D. 1997. Algorithms on Strings, Trees, and Sequences. Cambridge University Press.
20. HOGUE, A. AND KARGER, D. 2005. Thresher: Automating the unwrapping of semantic content from the World Wide web. In Proceedings of the Fourteenth International World Wide Web Conference (WWW), 86-95.
21. HSU, C. AND DUNG, M. 1998. Generating finite-state transducers for semi-structured data extraction from the Web. J. Info. Sys., Special Issue on Semistructured Data 23(8), 521-528.
22. KUSHMERICK, N. 2000a. Wrapper induction: Efficiency and expressiveness. Artif. Intell. 118(1-2), 15-68.
23. KUSHMERICK, N. 2000b. Wrapper verification. W.W.W. J. 3(2), 79-94.
24. KUSHMERICK, N. AND GRACE, B. 1998. The wrapper induction environment. In Proceedings of the Workshop on Software Tools for Developing Agents (AAAI), 131-132.
25. KUSHMERICK, N. AND THOMAS, B. 2002. Adaptive information extraction: Core technologies for information agents. In Intelligents Information Agents R&D In Europe: An AgentLink Perspective, 79-103.
26. LAM, W., WANG, W., AND YUE, C. W. 2003. Web discovery and filtering based on textual relevance feedback learning. Computational Intell. 19(2), 136-163.
27. LERMAN, K., MINTON, S., AND KNOBLOCK, C. 2003. Wrapper maintenance: A machine-learning approach. J. Artif. Intell. Res. 18, 149-181.
28. LIN, W. Y. AND LAM, W. 2000. Learning to extract hierarchical information from semi-structured documents. In Proceedings of the Ninth International Conference on Information and Knowledge Management (CIKM), 250-257.
29. LIU, B., GROSSMAN, R., AND ZHAI, Y. 2003. Mining data records in Web pages. In Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data. Mining (SIGKDD), 601-606.
30. MUSLEA, L, MINTON, S., AND KNOBLOCK, C. 2000. Selective sampling with redundant views. In Proceedings of the Seventeenth National Conference on Artificial Intelligence (AAAI), 621-626.
31. MUSLEA, I., MINTON, S., AND KNOBLOCK, C. 2001. Hierarchical wrapper induction for semistructured information sources. J. Autonomous Agents and Multi-Agent Systems 4(1-2), 93-114.
32. RILOFF, E. AND JONES, R. 1999. Learning dictionaries for information extraction by multi-level bootstrapping. In Proceedings of the Sixteenth National Conference on Artificial Intelligence (AAAI), 1044-1049.
33. SODERLAND, S. 1999. Learning information extraction rules for semi-structured and free text. Mach. Learn. 34(1-3), 233-272.
34. SRIHARI, R. AND LI, W. 1999. Question answering supported by information extraction. In Proceedings of the Eighth Text REtrieval Conference (TREC-8), 185-196.
35. TEJADA, S., KNOBLOCK, C., AND MINTON, S. 2001. Learning object identification rules for information integration. Info. Syst. 26(8), 607-635.
36. TEJADA, S., KNOBLOCK, C., AND MINTON, S. 2002. Learning domain-independent string transformation weights for high accuracy object identification. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD), 350-359.
37. VAPNIK, V. N. 1995. The Nature of Statistical Learning Theory. Springer.
38. WANG, J. AND LOCHOVSKY, F. H. 2003. Data extraction and label assignment for Web databases. In Proceedings of the Twelfth International World Wide Web Conference (WWW), 187-196.
39. WONG, T. L. AND LAM, W. 2002. Adapting information extraction knowledge for unseen web sites. In Proceedings of the 2002 IEEE International Conference on Data Mining (ICDM), 506-513.
40. WONG, T. L. AND LAM, W. 2004a. A probabilistic approach for adapting information extraction wrappers and discovering new attributes. In Proceedings of the IEEE International Conference on Data Mining (ICDM), 257-264.
41. WONG, T. L. AND LAM, W. 2004b. Text mining from site-invariant and dependent features for information extraction knowledge adaptation. In Proceedings of the 2004 SIAM International Conference on Data Mining (SDM), 45-56.
42. WONG, T. L. AND LAM, W. 2005. Learning to refine ontology for a new Web site using a Bayesian approach. In Proceedings of the 2005 SIAM International Conference on Data Mining (SDM). 298-309.