SHARC: Framework for quality-conscious web archiving

Proceedings of the VLDB Endowment

Volumn 2, Issue 1, 2009, Pages 586-597

  Denev, Dimitar ^a   Mazeika, Arturas ^a   Spaniol, Marc ^a   Weikum, Gerhard ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

Author keywords

Data quality; Web archiving

Indexed keywords

WEBSITES;

BUSINESS ANALYSTS; DATA QUALITY; DIGITAL CONTENTS; ON-LINE ALGORITHMS; QUALITY CONSCIOUS; QUALITY MEASURES; SCHEDULING STRATEGIES; WEB ARCHIVING;

WEB CRAWLER;

EID: 79952765091     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/1687627.1687694     Document Type: Article

References (23)

1. E. Adar, J. Teevan, S. T. Dumais, J. L. Elsas. The Web changes everything: Understanding the dynamics of web content. In WSDM, pp. 282-291, 2009.
2. A. Segev, A. Shoshani, Logical modeling of temporal data. SIGMOD Rec., 16(3):454-466, 1987.
3. R. Baeza-Yates, A. Gionis, F. Junqueira, V. Murdock, V. Plachoura, F. Silvestri. Design trade-offs for search engine caching. ACM Trans. Web, 2(4):1-28, 2008.
4. B. E. Brewington, G. Cybenko. Keeping up with the changing web. Computer, 33(5):52-58, May 2000.
5. C. Castillo, M. Marin, A. Rodriguez, R. Baeza-Yates. Scheduling algorithms for web crawling. In WebMedia, pp. 10-17, 2004.
6. J. Cho, H. Garcia-Molina. Synchronizing a database to improve freshness. SIGMOD Rec., 29(2):117-128, 2000.
7. J. Cho, H. Garcia-Molina. Estimating frequency of change. Trans. Inter. Tech., 3(3):256-290, 2003.
8. J. Cho, H. Garcia-Molina, L. Page. Efficient crawling through url ordering. In WWW, pp. 161-172, 1998.
9. J. Cho, A. Ntoulas. Effective change detection using sampling. In VLDB, pp. 514-525. 2002.
10. J. Cho, U. Schonfeld. Rankmass crawler: a crawler with high personalized pagerank coverage guarantee. In VLDB, pp.375-386. 2007.
11. L. Colby, A. Kawaguchi, D. Lieuwen, I. Singh Mumick, K. Ross. Supporting multiple view maintenance policies. SIGMOD Rec., 26(2):405-416, 1997.
12. J. Masanès, editor. Web Archiving, Springer, 2006.
13. T. Härder, A. Bühmann. Value complete, column complete, predicate complete. The VLDB Journal, 17(4):805-826, 2008.
14. R. Klamma, C. Haasler. Wikis as social networks: Evolution and dynamics. In SNA-KDD, 2008.
15. H.-T. Lee, D. Leonard, X. Wang, D. Loguinov. Irlbot: scaling to 6 billion pages and beyond. In WWW, pp. 427-436, 2008.
16. M. Levene, A. Poulovassilis, eds. Web Dynamics - Adapting to Change in Content, Size, Topology and Use. Springer, 2004.
17. G. Mohr, M. Kimpton, M. Stack, I. Ranitovic. Introduction to heritrix, an archival quality web crawler. In IWAW, 2004.
18. M. Najork, J. L. Wiener. Breadth-first search crawling yields high-quality pages. In WWW, pp. 114-118, 2001.
19. A. Ntoulas, J. Cho, C. Olston. What's new on the web?: the evolution of the web from a search engine perspective. In WWW, pp. 1-12, 2004.
20. C. Olston, S. Pandey. Recrawl scheduling based on information longevity. In WWW, pp. 437-446, 2008.
21. C. Olston, J. Widom. Best-effort cache synchronization with source cooperation. In SIGMOD, pp. 73-84, 2002.
22. N. Tolia, M. Satyanarayanan. Consistency-preserving caching of dynamic database content. In WWW, 2007.
23. Debunking the Wayback Machine http://practice.com/2008/12/29/debunking-the-wayback-machine