Automatic sitemaps generation: Exploring website structures using block extraction and hyperlink analysis

Expert Systems with Applications

Volumn 38, Issue 4, 2011, Pages 3944-3958

  Lin, Shian Hua ^a   Chu, Kuan Pak ^a   Chiu, Chun Ming ^a  

^a NATIONAL CHI NAN UNIVERSITY   (Taiwan)

Author keywords

Block extraction; Hyperlink analysis; Sequence analysis; Sitemap; Web mining

Indexed keywords

BLOCK EXTRACTION; HYPERLINKS; SEQUENCE ANALYSIS; SITEMAP; WEB MINING;

ALGORITHMS; ENTROPY; HYPERTEXT SYSTEMS; WEB BROWSERS;

WEBSITES;

EID: 78650686752     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2010.09.056     Document Type: Article

References (32)

1. P.F. Agris Decoding the genome: A modified view Nucleic Acids Research 32 1 2004 223 238
2. S.F. Altschul, W. Gish, W. Miller, E.W. Myers, and D.J. Lipman Basic local alignment search tool Journal of Molecular Biology 215 3 1990 403 410
3. N. Ashish, and C. Knoblock Wrapper generation for semi-structured internet sources ACM SIGMOD Record 26 4 1997 8 15
4. Bharat, K.; Henzinger, M. R. (1998). Improved algorithms for topic distillation in a hyperlinked environment. In Proceedings of the 21st ACM SIGIR conference on Research and Development in Information Retrieval, New York, NY, USA (pp. 104-111).
5. Brin, S.; Page, L. (1998). The anatomy of a large-scale hypertextual web search engine. In Proceedings of the 7th international World Wide Web conference, Brisbane, Australia (pp. 107-117).
6. Cai, D.; He, X.; Wen, J. R.; Ma, W. Y. (2004). Block-level link analysis. In Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval, Sheffield, UK (pp. 440-447).
7. Chakrabarti, S.; Dom, B.; Raghavan, P.; Rajagopalan, S.; Gibson, D.; Kleinberg, J. M. (1998). Automatic resource compilation by analyzing hyperlink structure and associated text. In Proceedings of the 7th international World Wide Web conference, Brisbane, Australia (pp. 65-74).
8. S. Chakrabarti, B. Dom, S. Kumar, P. Raghavan, S. Rajagopalan, and A. Tomkins Mining the Web's link structure IEEE Computer 32 8 1999 60 67
9. S. Chakrabarti, M. Van Den Berg, and B. Dom Focused crawling: A new approach for topic-specific resource discovery Computer Networks 31 1999 1623 1640
10. Chakrabarti, S.; Joshi, M.; Tawde, V. (2001). Enhanced topic distillation using text, markup tags, and hyperlinks. In Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval, New Orleans, LA, USA (pp. 208-216).
11. S. Debnath, P. Mitra, N. Pal, and C.L. Giles Automatic identification of informative sections of web pages IEEE Transactions on Knowledge and Data Engineering 17 9 2005 1233 1246
12. Diligenti, M.; Coetzee, F. M.; Lawrence, S.; Giles, C. L.; Gori, M. (2000). Focused crawling using context graphs. In Proceedings of the 26th international conference on Very Large Data Bases, Cairo, Egypt (pp. 527-534).
13. T.R. Gruber A translation approach to portable ontology specifications Knowledge Acquisition 5 2 1993 199 220
14. S. Henikoff, and J.G. Henikoff Amino acid substitution matrices from protein blocks Proceedings of the National Academy of Sciences 89 22 1992 10915 10919
15. C.W. Hsu, and C.L. Lin A comparison of methods for multiclass support vector machines IEEE Transactions on Neural Networks 13 2 2002 415 425
16. Kao, H. Y.; Lin, S. H.; Ho, J. M.; Chen, M.S. (2002). Entropy-based link analysis for mining web informative structures. In Proceedings of the 11th ACM international conference on Information and Knowledge Management, McLean, VA, USA (pp. 574-581).
17. H.Y. Kao, S.H. Lin, J.M. Ho, and M.S. Chen Mining web information structures and contents based on entropy analysis IEEE Transactions on Knowledge and Data Engineering 16 1 2004 41 55
18. Kleinberg, J. M. (1998). Authoritative sources in a hyperlinked environment. In Proceedings of the 9th ACM SIAM Symposium on Discrete Algorithms, Baltimore, MD, USA (pp. 668-677).
19. Kushmerick, N.; Weld, D. S.; Doorenbos, R. B. (1997). Wrapper induction for information extraction. In Proceedings of the fifteenth International Joint Conference on Artificial Intelligence, Nagoya, Japan (pp. 729-737).
20. K.C. Lee, and S. Lee A cognitive map simulation approach to adjusting the design factors of the electronic commerce web sites Expert Systems with Applications 24 2003 1 11
21. Lin, S. H.; Ho, J. M. (2002). Discovering informative content blocks from web documents. In Proceedings of the 8th ACM SIGKDD international conference on Knowledge Discovery and Data Mining, Edmonton, Canada (pp. 588-593).
22. Page, L.; Brin, S.; Motwani, R.; Winograd, T. (1998). The pagerank citation ranking: Bringing order to the web. Technical report, Computer Systems Laboratory, Stanford University.
23. A. Sethi, P. O'donoghue, and Z. Luthey-Schulten Evolutionary profiles from the QR factorization of multiple sequence alignments Proceedings of the National Academy of Sciences of the United States of America 102 11 2005 4045 4050
24. J. Setubal, and J. Meidanis Introduction to Computational Molecular Biology 1997 PWS Publishing Company Boston, MA
25. C.J.A. Sigrist, L. Cerutti, N. Hulo, A. Gattiker, L. Falquet, and M. Pagni PROSITE: A documented database using patterns and profiles as motif descriptors Briefings in Bioinformatics 3 3 2002 265 274
26. T.F. Smith, and M.S. Waterman Identification of common molecular subsequences Journal of Molecular Biology 147 1 1981 195 197
27. Song, R.; Liu, H.; Wen, J. R.; Ma, W. Y. (2004). Learning block importance models for web pages. In Proceedings of the 13th international conference on World Wide Web, New York, NY, USA (pp. 203-211).
28. J.D. Thompson, D.G. Higgins, and T.J. Gibson CLUSTAL W: improving the sensitivity of progressive multiple sequence alignment through sequence weighting, positions-specific gap penalties and weight matrix choice Nucleic Acids Research 22 22 1994 4673 4680
29. J.C. Wootton, and S. Federhen Statistics of local complexity in amino acid sequences and sequence databases Computers and Chemistry 17 2 1993 149 163
30. J.C. Wootton, and S. Federhen Analysis of compositionally biased regions in sequence databases Methods in Enzymology 266 1996 554 571
31. Yi, L.; Liu, B. (2003). Eliminating noisy information in web pages for data mining. In Proceedings of the 9th ACM SIGKDD international conference on Knowledge Discovery and Data Mining, Washington, D.C.; USA (pp. 296-305).
32. Yu, S.; Cai, D.; Wen, J. R.; Ma, W. Y. (2003). Improving pseudo-relevance feedback in web information retrieval using web page segmentation. In Proceeding of the 12th international conference on World Wide Web, Budapest, Hungary (pp. 11-18).