Enhancing URL normalization using metadata of web pages

Proceedings of the 2008 International Conference on Computer and Electrical Engineering, ICCEE 2008

Volumn , Issue , 2008, Pages 331-335

  Soon, Lay Ki ^a   Lee, Sang Ho ^a  

^a Soongsil University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

ELECTRICAL ENGINEERING; INTERNET; MARKUP LANGUAGES; METADATA;

PAGE SIZES; URL NORMALIZATIONS; WEB PAGES;

WEBSITES;

EID: 62949146333     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCEE.2008.112     Document Type: Conference Paper

References (8)

1. Bar-Yossef, Z., Keidar, I., Schonfeld, U., "Do Not Crawl in the DUST: Different URLs with Similar Text", in the Proceedings of the International World Wide Web Conference (WWW 2007), May 2007, pp. 111-120.
2. Berners-Lee, T., Fielding, R., Masinter, L., "Uniform Resource Identifier (URI): General Syntax", available at http://gbiv.com/protocols/ uri/rfc/rfc3986.html.
3. Chakrabarti, S.: Mining the Web, Discovering Knowledge from Hypertext Data, Morgan Kaufmann Publishers, Elservier, San Francisco, CA, 2003.
4. Han, J., Kamber, M.: Data Mining Concepts and Techniques, Morgan Kaufmann Publishers, Elsevier, San Francisco, CA, 2006.
5. Kim, S. J., Jeong, H. S., and Lee, S. H., "Reliable Evaluations of URL Normalization", in Proceedings of the 2006 International Conference on Computational Science & its Applications (ICCSA), Glasgow, 2006, pp. 609-617.
6. Lee, S. H., Kim, S. J., Hong, S. H., "On URL Normalization", in Proceedings of the 2005 International Conference on Computational Science & its Applications (ICCSA), Singapore, May 2005, pp. 1076-1085.
7. Pant, G., Srinivasan, P., Menczer, F., "Crawling the Web", Web Dynamics 2004, pp. 153-178.
8. Web Data Extractor, available at: http://www.webextractor.com/