Modelling information persistence on the web

ICWE'06: The Sixth International Conference on Web Engineering

Volumn , Issue , 2006, Pages 193-200

  Gomes, Daniel ^a   Silva, Mário J ^a  

^a UNIVERSITY OF LISBON   (Portugal)

Author keywords

Content persistence; Tomba; URL persistence

Indexed keywords

DATA PROCESSING; DATA STRUCTURES; INFORMATION ANALYSIS; INFORMATION SYSTEMS; STATISTICS; WEBSITES;

CONTENT PERSISTENCE; LOGARITHMIC FUNCTIONS; TOMBA; URL PERSISTENCE;

WEB SERVICES;

EID: 34250632009     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1145581.1145623     Document Type: Conference Paper

References (17)

1. L. Bent, M. Rabinovich, G. M. Voelker, and Z. Xiao. Characterization of a large web site population with implications for content delivery. In Proceedings of the 13th international conference on World Wide Web, pages 522-533. ACM Press, 2004.
2. B. E. Brewington and G. Cybenko. How dynamic is the web? Computer Networks (Amsterdam, Netherlands: 1999), 33(1-6):257-276, 2000.
3. C. Castillo. Effective Web Crawling. PhD thesis, University of Chile, November 2004.
4. J. Cho and H. Garcia-Molina. The evolution of the web and implications for an incremental crawler. In VLDB 2000, Proceedings of 26th International Conference on Very Large Data Bases, pages 200-209, September 2000.
5. J. Cho and H. Garci9a-Molina. Estimating frequency of change. ACM Trans. Inter. Tech., 3(3):256-290, 2003.
6. J. Cho, H. García-Molina, and L. Page. Efficient crawling through URL ordering. Computer Networks and ISDN Systems, 30(1-7):161-172, 1998.
7. F. Douglis, A. Feldmann, B. Krishnamurthy, and J. C. Mogul. Rate of change and other metrics: a live study of the world wide web. In USENIX Symposium on Internet Technologies and Systems, 1997.
8. D. Fetterly, M. Manasse, M. Najork, and J. Wiener. A large-scale study of the evolution of web pages. In WWW '03: Proceedings of the 12th international conference on World Wide Web, pages 669-678, New York, NY, USA, 2003. ACM Press.
9. T. A. S. Foundation. Apache HTTP Server Version 1.3: Module mod_include, November 2004.
10. D. Gomes, A. L. Santos, and M. J. Silva. Managing duplicates in a web archive. In L. M. Liebrock, editor, Proceedings of the 21th Annual ACM Symposium on Applied Computing (ACM-SAC-06), Dijon, France, April 2006.
11. D. Gomes and M. J. Silva. Characterizing a national community web. ACM Trans. Inter. Tech., 5(3):508-531, 2005.
12. A. Heydon and M. Najork. Mercator: A scalable, extensible web crawler. World Wide Web, 2(4):219-229, 1999.
13. W. Koehler. Web page change and persistence - a four-year longitudinal study. J. Am. Soc. Inf. Sci. Technol., 53(2):162-171, 2002.
14. S. Lawrence, F. Coetzee, E. Glover, G. Flake, D. Pennock, B. Krovetz, F. Nielsen, A. Kruger, and L. Giles. Persistence of information on the web: analyzing citations contained in research articles. In CIKM '00: Proceedings of the ninth international conference on Information and knowledge management, pages 235-242, New York, NY, USA, 2000. ACM Press.
15. J. Markwell and D. W. Brooks, 'link rot' limits the usefulness of web-based educational materials in biochemistry and molecular biology. Biochemistry and Molecular Biology Education, 31(1):69-72, 2003.
16. A. Ntoulas, J. Cho, and C. Olston. What's new on the web?: the evolution of the web from a search engine perspective. In Proceedings of the 13th international conference on World Wide Web, pages 1-12. ACM Press, 2004.
17. D. Spinellis. The decay and failures of web references. Communications of the ACM, 46(1):71-77, 2003.