A large-scale study of the evolution of web pages

Proceedings of the 12th International Conference on World Wide Web, WWW 2003

Volumn , Issue , 2003, Pages 669-678

  Fetterly, Dennis ^a   Manasse, Mark ^b   Najork, Marc ^b   Wiener, Janet ^a  

^a HEWLETT PACKARD LABORATORIES   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

degree of change; rate of change; web characterization; web evolution; web pages

Indexed keywords

DATA TRANSFORMATION; DEGREE OF CHANGE; LARGE-SCALE STUDIES; OTHER PROPERTIES; RATE OF CHANGE; TOP LEVEL DOMAINS; WEB CHARACTERIZATION; WEB EVOLUTION;

SEARCH ENGINES; WEBSITES;

HTTP;

EID: 84880492977     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/775152.775246     Document Type: Conference Paper

References (11)

1. B. Brewington, G. Cybenko. How dynamic is the web? In Proc. of the 9th International World Wide Web Conference, May 2000.
2. K. Bharat and A. Broder. Mirror, mirror on the web: a study of host pairs with replicated content. In Proc. of the 8th International World Wide Web Conference, May 1999.
3. A. Broder. Some applications of Rabin's fingerprinting method. In R. Capocelli, A. De Santis, and U. Vaccaro, editors, Sequences II: Methods in Communications, Security, and Computer Science, Springer-Verlag, 1993.
4. A. Broder, S. Glassman, M. Manasse, and G. Zweig. Syntactic clustering of the web. In Proc. of the 6th International World Wide Web Conference, Apr. 1997.
5. J. Cho and H. Garcia-Molina. The evolution of the web and implications for an incremental crawler. In Proc. of the 26th International Conference on Very Large Databases, Sep. 2000.
6. F. Douglis, A. Feldmann, B. Krishnamurthy, J. Mogul. Rate of change and other metrics: a live study of the world wide web. In USENIX Symposium on Internetworking Technologies and Systems, Dec. 1997.
7. Google Information for Webmasters. http://www.google.com/webmasters/2. html
8. M. Najork and A. Heydon. High-performance web crawling. SRC Research Report 173, Compaq Systems Research Center, Palo Alto, CA, Sep. 2001.
9. M. Najork and J. Wiener. Breadth-first search crawling yields high-quality pages. In Proc. of the 10th International World Wide Web Conference, May 2001.
10. M. Rabin. Fingerprinting by random polynomials. Report TR-15-81, Center for Research in Computing Technology, Harvard University, 1981.
11. Q. Sun, D. Simon, Y. Wang, W. Russell, V. Padmanabhan, and L. Qiu. Statistical identification of encrypted web browsing traffic. In Proc. of the IEEE Symposium on Security and Privacy, May 2002.