An overview of data replication on the Internet

Proceedings of the International Symposium on Parallel Architectures, Algorithms and Networks, I-SPAN

Volumn 2002-January, Issue , 2002, Pages 31-36

  Loukopoulos, T ^a   Ahmad, I ^b   Papadias, D ^a  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^b The University of Texas at Arlington   (United States)

Author keywords

Computer science; Delay; Internet; Large scale systems; Manipulator dynamics; Network servers; Parallel architectures; Spine; USA Councils; Web server

Indexed keywords

COMPUTER SCIENCE; INTERNET; LARGE SCALE SYSTEMS; PARALLEL ARCHITECTURES; TURNAROUND TIME;

DELAY; MANIPULATOR DYNAMICS; NETWORK SERVER; SPINE; USA COUNCILS; WEB SERVERS;

NETWORK ARCHITECTURE;

EID: 84948463539     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISPAN.2002.1004257     Document Type: Conference Paper

References (62)

1. R. Ahuja, T. Magnanti and J. Orlin, "Network Flows: Theory, Algorithms, and Applications," Prentice Hall, 1993.
2. Y. Amir, A. Peterson, and D. Shaw, "Seamlessly Selecting the Best Copy from Internet-Wide Replicated Web Servers," in Proc. of the 12th Int. Symposium on Distributed Computing, Andros, Greece, Sept. 1998.
3. D. Andresen, T. Yang, V. Hohmedahl and O. Ibarra, "SWEB: Toward a Scalable World Wide Web Server on Multicomputers," in Proc. of the 10th Int. Symp. on Parallel Processing, Honolulu, pp. 850-856, April 1996.
4. P.M.G. Apers, "Data Allocation in Distributed Database Systems," ACM Trans. on Database Systems, 13(3), Sep. 1988, pp. 263-304.
5. L. Aversa and A. Bestavros, "Load Balancing a Cluster of Web Servers Using Distributed Packet Rewriting," in Proc. of the IEEE Int. Performance, Computing, and Communication Conference (IPCCC'2000), Phoenix, AZ, February 2000.
6. B. Awerbuch, Y. Bartal and A. Fiat, "Optimally-Competitive Distributed File Allocation," in Proc. of the 25th Annual ACM STOC, Victoria, B.C., Canada, 1993, pp. 164-173.
7. M. Baentsch, L. Baum, G. Molter, S. Rothkugel and P. Sturm, "Enhancing the Web Infrastructure - from Caching to Replication," IEEE Internet Computing, pp. 18-27, Mar-Apr. 1997.
8. M. Beck and T. Moore, "The Internet-2 Distributed Storage Infrastructure Project: An Architecture for Internet Content Channels," in Proc. of the 3rd Int. WWW Caching Workshop, Manchester, UK, June 1998.
9. L. Bellatreche, K. Karlapalem and L. Qing, "An Iterative Approach for Rules and Data Allocation in Distributed Deductive Database Systems," in Proc. of the 7th International Conference on Information and Knowledge Management (ACM CIKM'98), pp. 356-363, November 1998, Washington D.C.
10. T. Berners-Lee, R. Cailliau, A. Luotonen, H. Nielsen and A. Secret, "The World-Wide Web," Communications of the ACM, vol. 37, no. 8, pp. 76-82, Aug. 1993.
11. A. Bestavros, "WWW Traffic Reduction and Load Balancing through Server-based Caching," IEEE Concurrency: Special Issue on Parallel and Distributed Technology, Vol.5, pp. 56-67, Jan.-Mar. 1997.
12. A. Bestavros, M. Crovella, J. Liu and D. Martin, "Distributed Packet Rewriting and its Application to Scalable Server Architectures," in Proc. of the 6th Int. Conference on Network Protocols (ICNP'98), Austin, Texas, Oct. 1998.
13. C. Bisdikian and B. Patel, "Cost-Based Program Allocation For Distributed Multimedia-on-Demand Systems," IEEE Multimedia, 3(3), pp. 62-72, 1996.
14. V. Cardellini, M. Colajanni and P. Yu, "Redirection Algorithms for Load Sharing in Distributed Web-Server Systems," in Proc. of the 19th IEEE Int. Conf. on Distributed Computing Systems ICDCS'99, Austin, Texas, May 1999.
15. V. Cardellini, M. Colajanni and P. Yu, "DNS Dispatching Algorithms with State Estimators for Scalable Web-Server Clusters," World Wide Web Journal, Baltzer Science, Vol. 2, No. 3, pp. 101-113, Aug. 1999.
16. V. Cardellini, M. Colajanni and P. Yu, "High Performance Web-Server Systems," in Proc. of the 13th Int. Symp. On Computer and Information Sciences (ISCIS'98), Ankara, Turkey, pp. 288-293, Oct. 1998.
17. R. Casey, "Allocation of Copies of a File in an Information Network," in Proc. of the Spring Joint Computer Conf., IFIPS, 1972, pp. 617-625.
18. W. Chu, "Optimal File Allocation in a Multiple Computer System," IEEE Trans. Computers, vol. C-18, no. 10, 1969.
19. CISCO, "Distributed Director," White paper at: http://www.cisco.com/warp/public/cc/cisco/mkt/scale/distr/tech/dd-wp.htm.
20. CISCO, "Scaling the Internet Web Servers," White paper at: http://www.cisco.com/warp/public/cc/cisco/mkt/scale/locald/tech/scale-wp.htm
21. M. Colajanni, P. Yu and D. Dias, "Scheduling Algorithms for Distributed Web Servers," in Proc. of the 17th IEEE Int. Conf. On Distributed Computing Systems (ICDCS'97), May 1997.
22. M. Crovella and R. Carter, "Dynamic Server Selection in the Internet," in Proc. of the 3rd IEEE Workshop on the Architecture and Implementation of High Performance Communication Subsystems (HPCS'95), June 1995.
23. B. Davison's Web Caching Bibliography, available at: http://www.cs.rutgers.edu/~davison/web-caching/bibliography.html
24. Digital Island, available at: http://www.digitalisland.com.
25. J. Doyle, "Routing in TCP/IP volume I," Macmillan Technical Publishing, first edition, 1998.
26. L.W. Dowdy and D.V. Foster, "Comparative Models of the File Assignment problem," ACM Computing Surveys, Vol.14(2), June 1982.
27. V. Duvvuri, P. Shenoy and R. Tewari, "Adaptive Leases: A Strong Consistency Mechanism for the World Wide Web," in Proc. of the IEEE INFOCOM'99 Conf., 1999.
28. K.P. Eswaran, "Placement of Records in a File and File Allocation in a Computer Network," Information Processing, 1974, pp. 304-307.
29. Exodus, available at: http://www.exodus.com.
30. Z. Fei, S. Bhattacharjee, E. Zegura, and M. Ammar, "A Novel Server Selection Technique for Improving the Response Time of a Replicated Service," in Proc. of the IEEE INFOCOM '98 Conf., March 1998.
31. P. Francis, S. Jamin, V. Paxson, L. Zhang, D. Gryniewicz, and Y. Jin, "An Architecture for a Global Internet Host Distance Estimation Service," in Proc. of the IEEE INFOCOM '99 Conf., March 1999.
32. M. Garey and D. Johnson, "Computers and Intractability," NY, NY: W.H. Freeman and Co., 1979.
33. M. Gullickson, C. Eichholz, A. Chervenak and E. Zegura, "Using Experience to Guide Web Server Selection," Multimedia Computing and Networking, January 1999.
34. A. Guyton and M. Schwartz, "Locating Nearby Copies of Replicated Internet Servers," in Proc. of the ACM SIGCOMM'95 Conf., Cambridge, MA, pp. 288-298, Aug. 1995.
35. J. Heidemann and V. Visweswaraiah, "Automatic Selection of Nearby Web Servers," in Proc. of the 1998 SIGMETRICS/Performance Workshop on Internet Server Performance, June 1998.
36. Inktomi Content Delivery Suite, available at: http://www.inktomi.com.
37. S. Irani, "A Competitive Analysis of Paging," available at: http://www.ics.uci.edu/~irani/.
38. S. Jamin, C. Jin, Y. Jin, D. Riaz, Y. Shavitt and L. Zhang, "On the Placement of Internet Instrumentation," in Proc. of the IEEE INFOCOM'00 Conf., March 2000.
39. S. Jamin, C. Jin, T. Kurc, D. Raz and Y. Shavitt, "Constrained Mirror Placement on the Internet," in Proc. of the IEEE INFOCOM 2001 Conf., Alaska, USA.
40. Y.K. Kwok, K. Karlapalem, I. Ahmad and N.M. Pun, "Design and Evaluation of Data Allocation Algorithms for Distributed Database Systems," IEEE Journal on Sel. areas in Commun.(Special Issue on Distributed Multimedia Systems), Vol. 14, No. 7, pp. 1332-1348, Sept. 1996.
41. B. Li, M. Golin, G. Italiano and X. Deng, "On the Optimal Placement of Web Proxies in the Internet," in Proc. of the IEEE INFOCOM'00 Conf., March 2000.
42. T.D.C. Little and D. Venkatesh, "Popularity-Based Assignment of Movies to Storage Devices in a Videoon-Demand System," ACM/Springer Multimedia Systems, 1994.
43. T. Loukopoulos and I. Ahmad, "Static and Adaptive Data Replication Algorithms for Fast Information Access in Large Distributed systems," in Proc. of the 20th IEEE Int. Conf. on Distributed Computing Systems, Taipei, Taiwan, 2000.
44. S. Mahmoud and J. Riordon, "Optimal Allocation of Resources in Distributed Information Networks," ACM Trans. Database Systems, 1(1), March 1976, pp. 66-78.
45. P. Mirchandani and R. Francis, "Discrete Location Theory," John Wiley and Sons, 1990.
46. P. Mockapetris, "Domain Names - Implementation and Specification," RFC 1035, ISI, Nov. 1987.
47. K. Moore, J. Cox and S. Green, "Sonar - A Network Proximity Service," Internet Draft, Network Working Group, draft-moore-sonar-01.txt, Feb. 1996.
48. J. Morris, M. Satyanarayanan, M. Conner, J. Howard, D. Rosenthal and F. Smith, "Andrew: A Distributed Personal Computing Environment," Communications of the ACM, Vol. 29, No.3, Mar. 1986, pp. 184-201.
49. B. Narendran, S. Rangarajan and S. Yajnik, "Data Distribution Algorithms for Load Balanced Fault-Tolerant Web Access," in Proc. of the 16th Symposium on Reliable Distributed Systems (SRDS '97), Oct. 22-24, 1997 Durham, NC.
50. Probe Research Inc. available at: http://www.proberesearch.com.
51. L. Qiu, V. Padmanabhan and G. Voelker, "On the Placement of Web Server Replicas," in Proc. of the IEEE INFOCOM'01 Conf., Anchorage, AK, USA April 2001.
52. M. Rabinovich, I. Rabinovich, R. Rajaraman and A. Aggarwal, "A Dynamic Object Replication and Migration Protocol for an Internet Hosting Service," in Proc. of the 19th IEEE Int. Conf. on Distributed Computing Systems (ICDCS'99), May 1999.
53. M. Rabinovich, "Issues in Web Content Replication," in Data Engineering Bulletin, Invited Paper, Vol.21 No.4, Dec. 1998.
54. M. Sayal, Y. Breitbart, P. Scheuermann and R. Vingralek, "Selection Algorithms for Replicated Web Servers," in Proc. of the 1998 Workshop on Internet Server Performance, June 1998.
55. A. Shaikh, R. Tewari and M. Agrawal, "On the Effectiveness of DNS-based Server Selection," in Proc. of the IEEE INFOCOM'01 Conf., Alaska, USA, Apr. 2001.
56. W. Tang, F. Du, M. Mutka, L. Ni and A.-H. Esfahanian, "Supporting Global Replicated Services by a Routing-Metric-Aware DNS," in Proc. of the 2nd Int. Workshop on Advanced Issues of E-Commerce and Web-Based Information Systems (WECWIS 2000), June, 2000.
57. R. Tewari and N. Adam, "Distributed File Allocation with Consistency Constraints," in Proc. of the 12th IEEE International Conference on Distributed Computing Systems (ICDCS'92), June 1992.
58. A. Vigneron, L. Gao, M. Golin, G. Italiano and B. Li, "An Algorithm for Finding a k-median in a Directed Tree," in Information Processing Letters, 74 (2000), pp. 81-88.
59. C. Yoshikawa, B. Chun, P. Eastham, A. Vahdat, T. Anderson and D. Culler, "Using Smart Clients to Build Scalable Services," in Proc. of the 1997 USENIX Annual Technical Conference, Jan. 6-10, 1997, Anaheim, CA, pp. 105-117, USENIX, January 1997.
60. C. E. Wills and H. Shang, "The Contribution of DNS Lookup Costs to Web Object Retrieval," Technical Report WPI-CS-TR-00-12, Computer Science Department, Worcester Polytechnic Institute, July 2000.
61. O. Wolfson, S. Jajodia and Y. Huang, "An Adaptive Data Replication Algorithm," ACM Transactions on Database Systems, Vol. 22(4), June 1997, pp. 255-314.
62. World-Wide Web Consortium, "The HTTP Distribution and Replication Protocol," available at: http://www.w3.org/TR/NOTE-drp.