The evolution of link-attributes for pages and its implications on Web crawling

Proceedings - IEEE/WIC/ACM International Conference on Web Intelligence, WI 2004

Volumn , Issue , 2004, Pages 578-581

  Meng, Tao ^a   Yan, Hongfei ^a   Wang, Jimin ^a   Li, Xiaoming ^a  

^a PEKING UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DATABASE SYSTEMS; GRAPH THEORY; SEARCH ENGINES; SERVERS; TELECOMMUNICATION LINKS;

CRAWLERS; VERTEXES; WEB GRAPHS; WEB SERVERS;

WEBSITES;

EID: 15544387140     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. Hongfei Yan, Jianyong Wang, and etc. Architectural Design and Evaluation of an Efficient Web-crawling system, in Journal of Systems and Software. 2002
2. L. Page, S. Brin, R. Motwani, and T. Winograd. The PageRank citation ranking: Bringing order to the web. Stanford Digital Libraries Working Paper, 1998.
3. Gopal Pandurangan, and etc. Using PageRank to Characterize Web Structure, In Proc. of 8th Annual Int. Computing and Combinatorics Conf., 2002
4. Andrei Broder, Ravi Kumar, and etc. Graph structure in the web: experiments and models. In Proc.of the Ninth Int. World-Wide Web Conf., 2000.
5. J. Kleinberg, R. Kumar, and etc. The WEB as a graph: measurements, models, and methods, Int. Conf. on Combinatorics and Computing, 1999.
6. J.Cho, H.Garcia-Molina. The evolution of the web and implications for an incremental crawler. In Proc. Of 26th Int. Conf. On VLDB, September 2000.
7. Brian Brewington, George Cybenko. Computer Networks, Amsterdam, Netherlands: 1999
8. J.cho and H.Garcia-Molina. Synchronizing a database to improve freshness. In Proc. Of the ACM SIGMOD Int. Conf., pages 117-128, May 2000.
9. Dennis Fetterly, Mark Manasse, and etc. A large-scale study of the evolution of Web pages. In Proc. of the 12th Int. World-Wide Web Conference, 2003.
10. Meng Tao, Yan Hong-fei, and etc. Characterizing Temporal Locality in Change of Webpages, Working Paper of Network Lab, Peking University, China, 2004
11. V.Shkapenyuk, T.Suel, Design and Implemention of a high-performance distributed web crawler. In Proc. Of the Int. Conf. on Data Engineering, February 2002.