A large-scale study of the evolution of Web pages

Software - Practice and Experience

Volumn 34, Issue 2, 2004, Pages 213-237

  Fetterly, Dennis ^a   Manasse, Mark ^a   Najork, Marc ^a   Wiener, Janet L ^b  

^a MICROSOFT RESEARCH   (United States)

^b HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Degree of change; Rate of change; Web characterization; Web evolution; Web pages

Indexed keywords

CLIENT SERVER COMPUTER SYSTEMS; DATA ACQUISITION; DATA MINING; HTML; HTTP; INFORMATION RETRIEVAL; SEARCH ENGINES;

WEB CHANGE; WEB CHARACTERIZATION; WEB CRAWLS; WEB EVOLUTION;

WEBSITES;

EID: 1142268953     PISSN: 00380644     EISSN: None     Source Type: Journal    
DOI: 10.1002/spe.577     Document Type: Article

References (13)

1. Google Information for Webmasters. http://www.google.com/webmasters/2.html [16 October 2003].
2. Fetterly D, Manasse M, Najork M, Wiener J. A large-scale study of the evolution of Web pages. Proceedings of the 12th International World Wide Web Conference, May 2003. ACM Press, 2003; 669-678.
3. Cho J, Garcia-Molina H. The evolution of the Web and implications for an incremental crawler. Proceedings of the 26th International Conference on Very Large Databases, September 2000. Morgan Kaufmann, 2000; 200-209.
4. Sun Q, Simon D, Wang Y, Russell W, Padmanabhan V, Qiu L. Statistical identification of encrypted Web browsing traffic. Proceedings IEEE Symposium on Security and Privacy, May 2002. IEEE Computer Society, 2002; 19-30.
5. Douglis F, Feldmann A, Krishnamurthy B, Mogul J. Rate of change and other metrics: A live study of the world wide Web. USENIX Symposium on Internetworking Technologies and Systems, December 1997. USENIX Association, 1997; 147-158.
6. Brewington B, Cybenko G. How dynamic is the Web? Proceedings of the 9th International World Wide Web Conference, May 2000. Elsevier, 2000; 257-276.
7. Broder A, Glassman S, Manasse M, Zweig G. Syntactic clustering of the Web. Proceedings of the 6th International World Wide Web Conference, April 1997; 391-404.
8. Najork M, Wiener J. Breadth-first search crawling yields high-quality pages. Proceedings of the 10th International World Wide Web Conference, May 2001. ACM Press, 2001; 114-118.
9. Najork M, Heydon A. High-performance Web crawling. SRC Research Report 173, Compaq Systems Research Center, Palo Alto, CA, September 2001.
10. Broder A. Some applications of Rabin's fingerprinting method. Sequences II: Methods in Communications, Security, and Computer Science, Capocelli R, De Santis A, Vaccaro U (eds.). Springer-Verlag: Berlin, 1993; 143-152.
11. Rabin M. Fingerprinting by random polynomials. Report TR-15-81, Center for Research in Computing Technology, Harvard University, 1981.
12. Bharat K, Broder A. Mirror, mirror on the Web: A study of host pairs with replicated content. Proceedings of the 8th International World Wide Web Conference, May 1999. Elsevier, 1999; 1579-1590.
13. Page L, Brin S, Motwani R, Winograd T. The PageRank citation ranking: Bringing order to the Web. Technical Report 1999-66, Database Group, Stanford University, 1998.