What's new on the Web? The evolution of the Web from a search engine perspective

Thirteenth International World Wide Web Conference Proceedings, WWW2004

Volumn , Issue , 2004, Pages 1-12

  Ntoulas, Alexandros ^a   Cho, Junghoo ^a   Olston, Christopher ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Change prediction; Degree of change; Link structure evolution; Rate of change; Search engines; Web characterization; Web evolution; Web pages

Indexed keywords

CHANGE PREDICTION; DEGREE OF CHANGE; LINK STRUCTURE EVOLUTION; RATE OF CHANGE; WEB CHARACTERIZATION; WEB EVOLUTION;

ALGORITHMS; HYPERMEDIA SYSTEMS; HYPERTEXT SYSTEMS; INFORMATION TECHNOLOGY; INTERFACES (COMPUTER); MEASUREMENTS; QUERY LANGUAGES; SEARCH ENGINES;

WORLD WIDE WEB;

EID: 15844394231     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Google Directory http://dir.google.com.
2. Google Search, http://www.google.com.
3. The Internet Archive http://www.archive.org.
4. Nielsen NetRatings for Search Engines. avaiable from searchenginewatch. com at http://searchenginewatch.com/reports/article.php/2156451.
5. Online Computer Library Center http://wcp.oclc.org.
6. Open Directory Project http://www.dmoz.org.
7. The WebArchive Project, UCLA Computer Science, http://webarchive.cs.ucla. edu.
8. Z. Bar-Yossef, A. Berg, S. Chien, J. Fakcharoenphol, and D. Weitz. Approximating aggregate queries about web pages via random walks. In Proceedings of Twenty-Sixth VLDB Conference, Cairo, Egypt, 2000.
9. B. E. Brewington and G. Cybenko. How dynamic is the web? In Proceedings of the Ninth WWW Conference, Amsterdam, The Netherlands, 2000.
10. S. Brin, J. Davis, and H. García-Molina. Copy detection mechanisms for digital documents. In Proceedings of the ACM SIGMOD Annual Conference, 1995.
11. S. Brin and L. Page. The anatomy of a large-scale hypertextual Web search engine. In Proceedings of the Seventh WWW Conference, Brisbane, Australia, 1998.
12. A. Broder, R. Kumar, F. Maghoul, P. Raghavan, S. Rajagopalan, R. Stata, A. Tomkins, and J. Wiener. Graph structure in the web. In Proceedings of the Ninth WWW Conference, Amsterdam, The Netherlands, 2000.
13. A. Z. Broder, S. C. Classman, M. S. Manasse, and G. Zweig. Syntactic clustering of the web. In Proceedings of the Sixth WWW Conference, 1997.
14. S. Chakrabarti, B. E. Dom, S. R. Kumar, P. Raghavan, S. Rajagopalan, A. Tomkins, D. Gibson, and J. Kleinberg. Mining the Web's link structure. Computer, 32(8):60-67, 1999.
15. J. Cho and H. Garcia-Molina. The evolution of the web and implications for an incremental crawler. In Proceedings of the Twenty-Sixth VLDB Conference, pages 200-209, Cairo, Egypt, 2000.
16. J. Cho and H. Garcia-Molina. Synchronizing a database to improve freshness. In Proceedings of the ACM SIGMOD International Conference on Management of Data, pages 117-128, Dallas, Texas, 2000.
17. E. Coffman, Jr., Z. Liu, and R. R. Weber. Optimal robot scheduling for web search engines. Journal of Scheduling, 1(1): 15-29, June 1998.
18. F. Douglis, A. Feldmann, and B. Krishnamurthy. Rate of change and other metrics: a live study of the world wide web. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, Monterey, 1997.
19. D. Fetterly, M. Manasse, M. Najork, and J. L. Wiener. A large-scale study of the evolution of web pages. In Proceedings of the Twelfth WWW Conference, Budapest, Hungary, 2003.
20. R. Kumar, P. Raghavan, S. Rajagopalan, D. Sivakumar, A. Tomkins, and E. Upfal. Stochastic models for the web graph. In IEEE Symposium on Foundations of Computer Science (FOCS), 2000.
21. L. Lim, M. Wang, S. Padmanabhan, J. S. Vitter, and R. Agarwal. Dynamic maintenance of web indexes using landmarks. In Proceedings of the Twelfth WWW Conference, Budapest, Hungary, 2003.
22. L. Lim, M. Wang, S. Padmanabhan, J. S. Vitter, and R. C. Agarwal. Characterizing web document change. In Proceedings of the Second International Conference on Advances in Web-Age Information Management, pages 133-144. Springer-Verlag, 2001.
23. B. H. Murray and A. Moore. Sizing the internet. White paper, Cyveillance, Inc., 2000.
24. J. Pitkow and P. Pirolli. Life, death, and lawfulness on the electronic frontier. In Proceedings of the ACM Conference on Human Factors in Computing Systems, Atlanta, Georgia, 1997.
25. G. Salton and M. J. McGill. Introduction to Modern Information Retrieval. McGraw-Hill, first edition, 1983.