Building a large and efficient hybrid peer-to-peer internet caching system

IEEE Transactions on Knowledge and Data Engineering

Volumn 16, Issue 6, 2004, Pages 754-769

  Xiao, Li ^a   Zhang, Xiaodong ^b   Andrzejak, Artur ^c   Chen, Songqing ^b  

^a Michigan State University   (United States)

^b The College of William and Mary   (United States)

^c ZUSE INSTITUTE BERLIN   (Germany)

Author keywords

Browser caching; Communication anonymity; Data integrity; Internet systems; Peer to peer systems; Proxy caching

Indexed keywords

BROWSER CACHING; COMMUNICATION ANONYMITY; DATA INTEGRITY; INTERNET SYSTEMS; PEER-TO-PEER SYSTEMS; PROXY CACHING;

ALGORITHMS; DATA ACQUISITION; INFORMATION RETRIEVAL; MATHEMATICAL MODELS; NETWORK PROTOCOLS; PERSONAL COMPUTERS; PROGRAM DOCUMENTATION; WEB BROWSERS;

INTERNET;

EID: 3042636811     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2004.1     Document Type: Article

References (43)

1. M. Abrams, C.R. Standridge, G. Abdulla, S. Williams, and E.A. Fox, "Caching Proxies: Limitations and Potentials," Proc. Fourth Int'l World Wide Web Conf., Dec. 1995.
2. S. Albers, S. Arora, and S. Khanna, "Page Replacement for General Caching Problems," Proc. 10th Ann. ACM-SIAM Symp. Discrete Algorithms (SODA '99), pp. 31-40, 1999.
3. P. Barford, A. Bestavros, A. Bradley, and M. Crovella, "Changes in Web Client Access Patterns: Characteristics and Caching Implications," World Wide Web J., vol. 2, no. 1, pp. 15-28, Jan. 1999.
4. L.A. Belady, "A Study of Replacement Algorithms for Virtual Storage Computers," IBM Systems J., vol. 5, pp. 78-101, 1966.
5. L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker, "Web Caching and Zipf-Like Distributions: Evidence and Implications," Proc. IEEE INFOCOM, 1999.
6. Boeing log files, ftp://researchsmp2.cc.vt.edu/pub/boeing/, 2003.
7. BU traces, ftp://cs-ftp.bu.edu/techreports/1995-010-www.client -traces.tar.gz and ftp://cs-ftp.bu.edu/techreports/1999-011-user trace-98.gz, 2003.
8. P. Cao and S. Irani, "Cost-Aware WWW Proxy Caching Algorithms," Proc. USENIX Symp. Internet Technologies and Systems, Dec. 1997.
9. H. Che, Z. Wang, and Y. Tung, "Analysis and Design of Hierarchical Web Caching Systems," Proc. IEEE INFOCOM 2001, Apr. 2001.
10. E. Cohen and H. Kaplan, "LP-Based Analysis of Greedy-Dual-Size, " Proc. 10th Ann. ACM-SIAM Symp. Discrete Algorithms, pp. 879-880, Jan. 1999.
11. M.D. Dahlin, R.Y. Wang, T.E. Anderson, and D.A. Patterson, "Cooperative Caching: Using Remote Client Memory to Improve File System Performance," Proc. First Symp. Operating Systems Design and Implementation, Nov. 1994.
12. B.M. Duska, D. Marwood, and M.J. Feeley, "The Measured Access Characteristics of World-Wide-Web Client Proxy Caches," Proc. USENIX Symp. Internet Technologies and. Systems, Dec. 1997.
13. S.G. Dykes and K.A. Robbins, "A Viability Analysis of Cooperative Proxy Caching," Proc. IEEE INFOCOM 2001, Apr. 2001.
14. L. Fan, P. Cao, J. Almeida, and A.Z. Broder, "Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol," Proc. 1998 SIGCOMM Conf., pp. 254-265, 1998.
15. E. Gabber, P. Gibbons, D. Kristol, Y. Matias, and A. Mayer, "Consistent, Yet Anonymous, Web Access with LPWA," Comm. ACM, vol. 42, no. 2, pp. 42-47, Feb. 1999.
16. E. Gabber, P. Gibbons, Y. Matias, and A. Mayer, "How to Make Personalized Web Browsing Simple, Secure, and Anonymous," Proc. Conf. Financial Cryptography, 1997.
17. S. Gadde, M. Rabinovich, and J. Chase, "Reduce, Reuse, Recycle: An Approach to Building Large Internet Caches," Proc. Sixth Workshop Hot Topics in Operating Systems, May 1997.
18. L. Gong, "JXTA: A Network Programming Environment," IEEE Internet Computing, vol. 5, no. 3, May/June 2001.
19. S.D. Gribble and E.A. Brewer, "System Design Issues for Internet Middleware Services: Deductions from a Large Client Trace," Proc. 1997 Usenix Symp. Internet Technologies and Systems, Dec. 1997.
20. S. Jin and A. Bestavros, "Popularity-Aware GreedyDual-Size Web Proxy Caching Algorithms," Proc. 20th Int'l Conf. Distributed Computing Systems (ICDCS '00), Apr. 2000.
21. S. Irani, "Page Replacement with Multi-Size Pages and Applications to Web Caching," Proc. 29th Ann. ACM Symp. Theory of Computing (STOC '97), pp. 701-710, 1997.
22. S. Iyer, A. Rowstron, and P. Druschel, "Squirrel: A Decentralized Peer-to-Peer Web Caching," Proc. 21st ACM. Symp. Principles of Distributed Computing, 2002.
23. T. Kelly, "Thin-Client Web Access Patterns: Measurements from a Cache-Busting Proxy," Computer Comm. vol. 25, pp. 357-366, 2002.
24. M.R. Korupolu and M. Dahlin, "Coordinated Placement and Replacement for Large-Scale Distributed Cached," IEEE Trans. Knowledge and Data Eng., vol. 13, 2001.
25. M.R. Korupolu, C.G. Plaxton, and R. Rajaraman, "Placement Algorithms for Hierarchical Cooperative Caching," Proc. 10th Ann. ACM-SIAM Symp. Discrete Algorithms (SODA '99), pp. 586-595, Jan. 1999.
26. A. Mahanti, C. Williamson, and D. Eager, "Traffic Analysis of a Web Proxy Caching Hierarchy," IEEE Network, special issue on Web performance, vol. 14, no. 3, pp. 16-23, May/June 2000.
27. R. Malpani, J. Lorch, and D. Berger, "Making World Wide Web Caching Servers Cooperate," Proc. Fourth Int'l World Wide Web Conf., Dec. 1995.
28. A.J. Menezes, P.C. Van Oorschot, and S.A. Vanstone, Handbook of Applied Cryptography. CRC Press, 1996.
29. Nat'l Lab Applied Network Research, http://www.ircache.net/, Sanitized access logs: ftp://ircache.nlanr.net/Traces/, and Statistics: http://www.ircache.net/Cache/Statistics/, 2003.
30. K. Psounis and B. Prabhakar, "A Randomized Web-Cache Replacement Scheme," Proc. IEEE INFOCOM 2001, Apr. 2001.
31. R. Rivest, "The MD5 Message-Digest Algorithm," Internet RFC/STD/FYI/BCP Archives, request for comments: 1321, (http://www. faqs.org/rfcs/rfcl321.html), Apr. 1992.
32. A. Rousskov and V. Soloviev, "A Performance Study of the Squid Proxy on HTTP/1.0," World Wide Web, vol. 2, nos. 1-2, pp. 47-67, Jan. 1999. Also available at "On Performance of Caching Proxies," Proc. SIGMETRICS '98, pp. 272-273, 1998.
33. A. Rousskov and V. Soloviev, "A Performance Study of the Squid Proxy on HTTP/1.0," World Wide Web, vol. 2, nos. 1-2, pp. 47-67, Jan. 1999. Also available at "On Performance of Caching Proxies," Proc. SIGMETRICS '98, pp. 272-273, 1998.
34. R. Tewari, M. Dahlin, H.M. Vin, and J.S. Kay, "Design Considerations for Distributed Caching on the Internet," Proc. 19th IEEE Int'l Conf. Distributed Computing Systems (ICDCS), May 1999.
35. A. Wolman, G. Voelker, N. Sharma, N. Cardwell, M. Brown, T. Landray, D. Pinnel, A. Karlin, and H. Levy, "Organization-Based Analysis of Web-Object Sharing and Caching," Proc. Second USENIX Symp. Internet Technologies and Systems, Oct. 1999.
36. A. Wolman, G. Voelker, N. Sharma, N. Cardwell, A. Karlin, and H. Levy, "On the Scale and Performance of Cooperative Web Proxy Caching," Proc. 17th ACM Symp. Operating System Principles (SOSP), pp. 16-31, Dec. 1999.
37. Z. Xiao and K.P. Birman, "Providing Efficient, Robust Error Recovery through Randomization," Proc. Int'l Workshop Applied Reliable Group Comm., (jointly held with the 21st Int'l Conf. Distributed Computing Systems), Apr. 2001.
38. L. Xiao and X. Zhang, "Exploiting Neglected Data Locality in Browsers," Proc. 10th Int'l World Wide Web Conf. (WWW10), May 2001. (an extended abstract)
39. L. Xiao, Z. Xu, and X. Zhang, "Low Cost and Reliable Mutual Anonymity Protocols in Peer-to-Peer Networks," IEEE Trans. Parallel and Distributed Systems, vol. 14, no. 9, pp. 829-840, Sept. 2003.
40. L. Xiao, X. Zhang, and Z. Xu, "A Reliable and Scalable Peer-to-Peer Web Document Sharing System," Proc. 2002 Int'l Parallel and Distributed Processing Symp., (IPDPS '2002), 2002.
41. J. Yang, W. Wang, and R. Muntz, "Collaborative Web Caching Based on Proxy Affinities," Proc. ACM SIGMETRICS 2000, pp. 78-89, June 2000.
42. P.S. Yu and E.A. MacNair, "Performance Study of a Collaborative Method for Hierarchical Caching in Proxy Servers," Proc. Seventh Int'l World Wide Web Conf., Apr. 1998.
43. H. Zhu and T. Yang, "Class-Based Cache Management for Dynamic Web Content," Proc. IEEE INFOCOM 2001, Apr. 2001.