Designing efficient sampling techniques to detect webpage updates

16th International World Wide Web Conference, WWW2007

Volumn , Issue , 2007, Pages 1147-1148

  Tan, Qingzhao ^a   Zhuang, Ziming ^a   Mitra, Prasenjit ^a   Giles, C Lee ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Sampling; Search engine; Web crawler

Indexed keywords

ADAPTIVE SYSTEMS; MATHEMATICAL MODELS; SEARCH ENGINES;

ADAPTIVE STRATEGIES; ARCHIVING SYSTEMS; WEB CRAWLERS;

WEBSITES;

EID: 35348878593     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1242572.1242738     Document Type: Conference Paper

References (6)

1. The wayback machine, http://www.archive.org/web/web.php.
2. CHO, J., AND GARCIA-MOLINA, H. Effective page refresh policies for web crawlers. ACM TODS 28, 4 (2003), 390-426.
3. CHO, J., AND NTOULAS, A. Effective change detection using sampling. In VLDB '02 (2002).
4. FETTERLY, D., MANASSE, M., NAJORK, M., AND WIENER, J. L. A large-scale study of the evolution of web pages. In Proceedings of WWW '04 (Budapest, Hungary, 2004).
5. GRIMMETT, G., AND STIRZAKER, D. Probability and Random Processes, 2nd ed. Oxford University Press, 1992.
6. PAGE, L., BRIN, S., MOTWANI, R., AND WINOGRAD, T. The pagerank citation ranking: Bringing order to the web. Tech. rep., Stanford Digital Library Technologies Project, 1998.