Archiving the web using page changes patterns: A case study

Proceedings of the ACM/IEEE Joint Conference on Digital Libraries

Volumn , Issue , 2011, Pages 113-122

  Ben Saad, Myriam ^a   Gançarski, Stéphane ^a  

^a UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

Author keywords

pattern; web archiving; web page changes

Indexed keywords

EXPERIMENTAL EVALUATION; FUTURE GENERATIONS; MEDICAL DATA ANALYSIS; MOVING OBJECT TRACKING; NETWORK MONITORING; PATTERN; PATTERN MINING; RECURRENT EVENTS; SCIENTIFIC DATA PROCESSING; TEMPORAL EVOLUTION; TV CHANNELS; WEB ARCHIVES; WEB ARCHIVING; WEB PAGE CHANGES;

DATA PROCESSING; DATA REDUCTION; DIGITAL LIBRARIES; FINANCIAL DATA PROCESSING; MEDICAL COMPUTING; WEBSITES;

USER INTERFACES;

EID: 79960525082     PISSN: 15525996     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1998076.1998098     Document Type: Conference Paper

References (36)

1. S. Abiteboul, G. Cobena, J. Masanes, and G. Sedrati. A First Experience in Archiving the French Web. In Proceedings of the 6th European Conference on Research and Advanced Technology for Digital Libraries, 2002.
2. E. Adar, J. Teevan, and S. T. Dumais. Resonance on the web: web dynamics and revisitation patterns. In Proceedings of the 27th international conference on Human factors in computing systems, Boston, MA, USA, 2009.
3. E. Adar, J. Teevan, S. T. Dumais, and J. L. Elsas. The web changes everything: understanding the dynamics of web content. In Proceedings of the Second ACM International Conference on Web Search and Data Mining, Barcelona, Spain, 2009.
4. S. Baron and M. Spiliopoulou. Monitoring the evolution of web usage patterns. In Lecture Notes in Computer Science, pages 181-200. Springer, 2004.
5. M. Ben Saad and S. Gançarski. Using visual pages analysis for optimizing web archiving. In EDBT/ICDT PhD Workshops, 2010.
6. B. Brewington and G. Cybenko. How dynamic is the web? In World Wide Web conference (WWW'2000), pages 257-276, 2000.
7. B. E. Brewington and G. Cybenko. Keeping up with the changing web. Computer, 33(5):52-58, 2000.
8. D. J. C. Lampos, M. Eirinaki and M. Vazirgiannis. Archiving the greek web. In 4th International Web Archiving Workshop (IWAW04), Bath, UK, 2004.
9. C. Castillo, M. Marin, A. Rodriguez, and R. Baeza-Yates. Scheduling algorithms for web crawling. In LA-WEBMEDIA '04: Proceedings of the WebMedia & LA-Web 2004 Joint Conference 10th Brazilian Symposium on Multimedia and the Web 2nd Latin American Web Congress, pages 10-17, 2004.
10. H. Cheng, X. Yan, J. Han, and C. wei Hsu. Discriminative frequent pattern analysis for effective classification. In ICDE, pages 716-725, 2007.
11. J. Cho and H. Garcia-Molina. The Evolution of the Web and Implications for an Incremental Crawler. In VLDB '00: Proceedings of the 26th International Conference on Very Large Data Bases, 2000.
12. J. Cho and H. Garcia-Molina. Effective page refresh policies for web crawlers. ACM Trans. Database Syst., 28(4):390-426, 2003.
13. J. Cho and H. Garcia-Molina. Estimating frequency of change. ACM Trans. Interet Technol., 3(3), 2003.
14. J. Cho, H. Garcia-molina, and L. Page. Efficient crawling through url ordering. In Computer Networks and ISDN Systems, pages 161-172, 1998.
15. D. Denev, A. Mazeika, M. Spaniol, and G. Weikum. Sharc: framework for quality-conscious web archiving. Proc. VLDB Endow., 2(1):586-597, 2009.
16. J. Edwards, K. McCurley, and J. Tomlin. An adaptive model for optimizing performance of an incremental web crawler. In Proceedings of the 10th international conference on World Wide Web, WWW '01, pages 106-113, 2001.
17. D. Gomes, A. L. Santos, and M. J. Silva. Managing duplicates in a web archive. In SAC '06: Proceedings of the 2006 ACM symposium on Applied computing, 2006.
18. D. Gruhl, R. Guha, D. Liben-nowell, and A. Tomkins. Information diffusion through blogspace. In WWW '04, pages 491-501, 2004.
19. J. Han, H. Cheng, D. Xin, and X. Yan. Frequent pattern mining: current status and future directions. Data Mining and Knowledge Discovery, 15:55-86, 2007. (Pubitemid 47142811)
20. Z. Li, Z. Chen, S. M. Srinivasan, and Y. Zhou. C-miner: Mining block correlations in storage systems. In Proceedings of the 3rd USENIX Conference on File and Storage Technologies, pages 173-186, 2004.
21. Z. Li, S. Lu, S. Myagmar, and Y. Zhou. Cp-miner: a tool for finding copy-paste and related bugs in operating system code. In Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6, pages 20-20, 2004.
22. J. Masanès. Web Archiving. Springer-Verlag New York, Inc., Secaucus, NJ, USA, 2006.
23. C. Olston and S. Pandey. Recrawl scheduling based on information longevity. In Proceeding of the 17th international conference on World Wide Web, WWW '08, pages 437-446, 2008.
24. S. Pandey and C. Olston. User-centric web crawling. In Proceedings of the 14th international conference on World Wide Web, WWW '05, pages 401-411, 2005.
25. Z. Pehlivan, M. Ben Saad, and S. Gançarski. Vi-diff: Understanding web pages changes. In 21st International Conference on Database and Expert Systems Applications (DEXA'10), Bilbao, Spain, 2010.
26. K. Saxena and R. Shukla. Significant interval and frequent pattern discovery in web log data. CoRR, abs/1002.1185, 2010.
27. K. C. Sia, J. Cho, and H.-K. Cho. Efficient monitoring algorithm for fast news alerts. IEEE Transactions on Knowledge and Data Engineering, 19:950-961, 2007. (Pubitemid 46853312)
28. K. C. Sia, J. Cho, K. Hino, Y. Chi, S. Zhu, and B. L. Tseng. Monitoring RSS feeds based on user browsing pattern. In ICWSM '07: International Conference on Weblogs and Social Media, 2007.
29. R. Song, H. Liu, J.-R. Wen, and W.-Y. Ma. Learning block importance models for web pages. In WWW '04: Proceedings of the 13th international conference on World Wide Web, 2004.
30. M. Spaniol, D. Denev, A. Mazeika, G. Weikum, and P. Senellart. Data quality in web archiving. In WICOW '09: Proceedings of the 3rd workshop on Information credibility on the web, pages 19-26, 2009.
31. M. Spaniol, A. Mazeika, D. Denev, and G. Weikum. "catch me if you can": Visual analysis of coherence defects in web archiving. In 9th International Web Archiving Workshop (IWAW 2009) : Workshop Proceecdings, pages 27-37, Corfu, Greece, 2009.
32. J. Srivastava, R. Cooley, M. Deshpande, and P.-N. Tan. Web usage mining: discovery and applications of usage patterns from web data. SIGKDD Explor. Newsl., 1:12-23, January 2000.
33. T. Ueda, Y. Hirate, and H. Yamana. Exploiting idle cpu cores to improve file access performance. In ICUIMC '09: Proceedings of the 3rd International Conference on Ubiquitous Information Management and Communication, pages 529-535, 2009.
34. R. Vaarandi. A data clustering algorithm for mining patterns from event logs. In IEEE IPOM'03 Proceedings, pages 119-126, 2003.
35. J. L. Wolf, M. S. Squillante, P. S. Yu, J. Sethuraman, and L. Ozsen. Optimal crawling strategies for web search engines. In Proceedings of the 11th international conference on World Wide Web, WWW '02, pages 136-147, 2002.
36. L. H. Yang, M. L. Lee, and W. Hsu. Efficient mining of xml query patterns for caching. In Proceedings of the 29th international conference on Very large data bases - Volume 29, VLDB '2003, pages 69-80, 2003.