The evolution of the web and implications for an incremental crawler

Proceedings of the 26th International Conference on Very Large Data Bases, VLDB'00

Volumn , Issue , 2000, Pages 200-209

  Cho, Junghoo ^a   Garcia Molina, Hector ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BATCH MODES;

WEBSITES;

EID: 84877324786     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. S. Chakrabarti, M. van den Berg, and B. Dom. Focused crawling: A new approach to topic-specific web resource discovery. In Proceedings of the &h World- Wide Web Confereniie. 1999.
2. J. Cho and H. Garcia-Molina. Estimating frequency of change. Technical report. Stanford University. 2000. http//dbpubs . stanford.edu/pub/2000-4
3. J. Cho and H. Garcia-Molina, Synchronizing a database to improve freshness. In Proceedings of the 2000 ACM SIGMOD. 2000.
4. J. Cho. H. Garcia-Molina. and L. Page. Efficient crawling through URL ordering. In Proceedings of the 7th World-Wide Web Conference, 1998.
5. E. Coffman, Jr. Z. Liu. and R. R. Weber. Optimal robot schedulng for web search engines. Technical report. INRIA, 1997.
6. F. Douglis, A. Feldmann, and B. Krishnamurthy. Rate of change and other metrics: A live study of the world wide web. In USENIX Symposium o,i Internet-working Tec'hnologie.s and Sv.sferns, 1999.
7. T. Haveliwala. Efficient computation of pagerank. Technical report, Stanford University, 1999. http://dbpubs. stanfOrd.edu/pub/1999-31.
8. J. M. Kletnberg. Authorjtive sources in a hyperlinked environment. In Proceedings of 9th ACM -SIAM Ss'mpo.siuin on Discrete Algorithms. 1998.
9. M. K. McKusick, W. N, Joy. S. i. Leffler. and R. S. Fabry. A fast file system for UNIX. ACM Tran.soction.s on Computer Systems. 2(3):181-l97, 1984.
10. L. Page and S. Brin. The anatomy of a large-scale hypertextual web search engine. In Proceedings of the 7th World. Wide Web Conference, 1998.
11. J. Pitkow and P. Pirolli. Life, death, and lawfulness on the electronic frontier. In Proceedings of International Conference on Computer and Human biteracuon. 1997.
12. H. M. Taylor and S. Karlin. An Introduction To Stochastic Modeling. Academic Press. 3rd edition, 1998.
13. C. E. Wills and M. Mikhailov. Towards a better understanding of web resources and server responses for improved caching. In Proceedings of the 8th World-Wide Web Conference, 1999.