Clustering Web pages based on their structure

Data and Knowledge Engineering

Volumn 54, Issue 3, 2005, Pages 279-299

  Crescenzi, Valter ^a   Merialdo, Paolo ^a   Missier, Paolo ^b  

^a ROMA TRE UNIVERSITY   (Italy)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Clustering; Information extraction; Web mining; Web modelling; Wrapper induction

Indexed keywords

ALGORITHMS; DATA ACQUISITION; DATA MINING; HTML; INFORMATION RETRIEVAL; MATHEMATICAL MODELS; XML;

CLUSTERING; INFORMATION EXTRACTION; WEB MINING; WEB MODELING; WRAPPER INDUCTION;

WORLD WIDE WEB;

EID: 18844436436     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2004.11.004     Document Type: Conference Paper

References (29)

1. Document Object Model (DOM) Level 1 specification, W3C Recommendation, http://www.w3.org/TR/REC-DOM-level-1 (October 1998).
2. P. Atzeni, G. Mecca, and P. Merialdo Managing web-based data: Database models and transformations. IEEE Internet Computing 6 4 2002 33 37
3. P. Atzeni, G. Mecca, P. Merialdo, To Weave the Web, in: Proceedings of 23rd International Conference on Very Large Data Bases, Athens, Greece, August 25-29, 1997, pp. 206-215
4. G.O. Arocena, and A.O. Mendelzon Weboql: Restructuring documents, databases, and webs TAPOS-Theory and Practice of Object Systems 5 3 1999 127 141
5. Z. Bar-Yossef, S. Rajagopalan, Template detection via data mining and its applications, in: Proceedings of the 11th International Conference on World Wide Web, ACM Press, 2002, pp. 580-591
6. S. Chakrabarti, B. Dom, S. Kumar, P. Raghavan, S. Rajagopalan, A. Tomkins, D. Gibson, and J. Kleinberg Mining the web's link structure Computer 32 8 1999 60 67
7. S. Chakrabarti, M. van den Berg, and B. Dom Focused crawling: a new approach to topic-specific Web resource discovery Computer Networks (Amsterdam, Netherlands) 31 11-16 1999 1623 1640
8. C.-H. Chang, S.-C. Lui, Iepad: information extraction based on pattern discovery, in: Proceedings of the Tenth International World Wide Web Conference, Hong Kong, China, May 1-5, 2001, pp. 681-688
9. V. Crescenzi, G. Mecca, P. Merialdo, roadRunner: Towards automatic data extraction from large Web sites, in: Proceedings of the 27th International Conference on Very Large Data Bases, Roma, Italy, September 11-14, 2001, pp. 109-118
10. V. Crescenzi, G. Mecca, P. Merialdo, Wrapping-oriented classification of web pages, in: Proceedings of the ACM Symposium on Applied computing, Madrid, Spain, March 11-14, 2002, ACM Press, pp. 1108-1112
11. V. Crescenzi, P. Merialdo, P. Missier, Fine-grain web site structure discovery, in: Proceedings of the 5th ACM International Workshop on Web information and data management, New Orleans, Lousiana, USA, November 7-8, 2003, ACM Press, pp. 15-22
12. J. Dean, and M.R. Henzinger Finding related pages in the world wide web Computer Networks 31 1999 1467 1479
13. S. Flesca, G. Manco, E. Masciari, L. Pontieri, A. Pugliese, Detecting structural similarities between xml documents, in: Proceedings of the 5th International Workshop on the Web and Databases, Madison, Wisconsin, USA, June 6-7, 2002 pp. 55-60
14. M. Garofalakis, A. Gionis, R. Rastogi, S. Seshadri, K. Shim, XTRACT: A system for extracting document type descriptors from XML documents, in: ACM SIGMOD International Conference on Management of Data, Dallas, Texas, USA, May 14-19, 2000 pp. 165-176
15. E. Glover, K. Tsioutsiouliklis, S. Lawrence, D. Pennock, G. Flake, Using Web structure for classifying and describing Web pages, in: Proceedings of the 11th International World Wide Web Conference, Honolulu, Hawaii, USA, May 7-11, 2002, pp. 562-569
16. P. Grunwald, The minimum description length principle and reasoning under uncertainty, Ph.D. thesis, University of Amsterdam, 1998 (1998)
17. T. Hong, and K. Clark Using grammatical inference to automate information extraction from the Web Principles of data mining and knowledge discovery, 5th European Conference, Freiburg, Germany, September 3-5 Lecture Notes in Computer Science 2168 2001 Springer 216 227
18. H.-Y. Kao, S.-H. Lin, J.-M. Ho, and M.-S. Chen Mining web informative structures and contents based on entropy analysis IEEE Transactions on Knowledge and Data Engineering 16 1 2004 41 44
19. J.P. Lage, A.S. da Silva, P.B. Golgher, and A.H.F. Laender Automatic generation of agents for collecting hidden Web pages for data extraction Data and Knowledge Engineering 49 2 2004 177 196
20. Z. Liu, F. Li, and W.K. Ng Wiccap data model: Mapping physical websites to logical views Proceedings of the 21st International Conference on Conceptual Modeling, Tampere, Finland, October 7-11 Lecture Notes in Computer Science 2503 2002 Springer 120 134
21. Z. Liu, W.K. Ng, E.-P. Lim, An automated algorithm for extracting website skeleton, in: Proceedings of the 9th International Conference on Database Systems for Advanced Applications, Jeju Island, Korea, March 17-19, 2004, pp. 799-811
22. Z. Liu, W.K. Ng, E.-P. Lim, and F. Li Towards building logical views of websites Data and Knowledge Engineering 49 2 2004 197 222
23. S. Raghavan, H. Garcia-Molina, Crawling the hidden web, in: Proceedings of the 27th International Conference on Very Large Data Bases, Roma, Italy, September 11-14, 2001, pp. 129-138
24. J. Rissanen Modeling by shortest data description Automatica 14 1978 465 471
25. H. Small Co-citation in the scientific literature: a new measure on the relationship between two documents Journal of the American Society for Information Science 24 4 1973 28 31
26. E. Spertus, Mining structural information on the web, in: Proceeding of the 6th International World Wide Web Conference, Santa Clara, California USA, April 7-11, 1997, pp. 587-595
27. C. Van Rijsbergen, Information Retrieval, second ed., Dept. of Computer Science, University of Glasgow, 1979
28. J. Wang, F. Lochovsky, Data extraction and label assignment for web databases, in: Proceedings of the 12th International World Wide Web Conference Budapest, Hungary, 20-24 May, 2003, pp. 187-196
29. J. Wang, F. Lochovsky, Data-rich section extraction from html pages, in: Proceedings of the 3rd International Conference on Web Information Systems Engineering, Singapore, 12-14 December, 2002, IEEE Computer Society, pp. 313-322