Improved single-round protocols for remote file synchronization

Proceedings - IEEE INFOCOM

Volumn 3, Issue , 2005, Pages 1665-1676

  Irmak, Utku ^a   Mihaylov, Svilen ^a   Suel, Torsten ^a  

^a POLYTECHNIC UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BANDWIDTH CONSUMPTION; LINUX DISTRIBUTIONS; REMOTE FILE SYNCHRONIZATION; SINGLE-ROUND PROTOCOLS;

DATA ACQUISITION; PROBLEM SOLVING; SYNCHRONIZATION; TELECOMMUNICATION NETWORKS; WEBSITES;

NETWORK PROTOCOLS;

EID: 25844459542     PISSN: 0743166X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/INFCOM.2005.1498448     Document Type: Conference Paper

References (41)

1. K. Abdel-Ghaffar and A. El Abbadi. An optimal strategy for comparing file copies. IEEE Transactions on Parallel and Distributed Systems, 5(1):87-93, January 1994.
2. S. Agarwal, D. Starobinski, and A. Trachtenberg. On the scalability of data synchronization protocols for PDAs and mobile devices. IEEE Network Magazine, special issue on Scalability in Communication Networks, July 2002.
3. S. Balasubramaniam and B. Pierce. What is a file synchronizer? In Proc. of the ACM/IEEE MOBICOM'98 Conference, pages 98-108, October 1998.
4. D. Barbara and R. Lipton. A class of randomized strategies for low-cost comparison of file copies. IEEE Transactions on Parallel and Distributed Systems, 2(2):160-170, April 1991.
5. J. Byers, M. Luby, and M. Mitzenmacher. A digital fountain approach to the reliable distribution of bulk data. IEEE Journal on Selected Areas in Communications, pages 1528-1540, October 2002.
6. V. Chauhan and A. Trachtenberg. Reconciliation puzzles. In Proc. of the IEEE GlobeCom Conference, November 2004. to appear.
7. G. Cormode. Sequence Distance Embeddings. PhD thesis, University of Warwick, January 2003.
8. G. Cormode, M. Paterson, S. Sahinalp, and U. Vishkin. Communication complexity of document exchange. In Proc. of the ACM-SIAM Symp. on Discrete Algorithms, January 2000.
9. L. Cox, C. Murray, and B. Noble. Pastiche: Making backup cheap and easy. In Proc. of the 5th Symp. on Operating System Design and Implementation, December 2002.
10. A. Evfimievski. A probabilistic algorithm for updating files over a communication link. In Proc. of the 9th Annual ACM-SIAM Symposium on Discrete Algorithms, pages 300-305, January 1998.
11. J. Hunt, K.-P. Vo, and W. Tichy. Delta algorithms: An empirical analysis. ACM Transactions on Software Engineering and Methodology, 7, 1998.
12. R. Karp and M. Rabin. Efficient randomized pattern-matching algorithms. IBM Journal of Research and Development, 31(2): 249-260, 1987.
13. D. Korn and K.-P. Vo. Engineering a differencing and compression data format. In Proceedings of the Usenix Annual Technical Conference, pages 219-228, June 2002.
14. E. Kushilevitz and N. Nisan. Communication Complexity. Cambridge University Press, 1997.
15. J. Langford. Multiround rsync. January 2001. Unpublished manuscript.
16. J. MacDonald. File system support for delta compression. MS Thesis, UC Berkeley, May 2000.
17. T. Madej. An application of group testing to the file comparison problem. In Proc. of the 9th Int. Conf. on Distributed Computing Systems, pages 237-243, June 1989.
18. J. Metzner. A parity structure for large remotely located replicated data files. IEEE Transactions on Computers, 32(8):727-730, August 1983.
19. J. Metzner. Efficient replicated remote file comparison. IEEE Transactions on Computers, 40(5):651-659. May 1991.
20. Y. Minsky, A. Trachtenberg, and R. Zippel. Set reconciliation with almost optimal communication complexity. Technical Report TR2000-1813, Cornell University, 2000.
21. A. Muthitacharoen, B. Chen, and D. Mazières. A low-bandwidth network file system. In Proc. of the 18th ACM Symp. on Operating Systems Principles, pages 174-187, October 2001.
22. P. Noel. An efficient algorithm for file synchronization. Master's thesis. Polytechnic University, 2004.
23. A. Orlitsky. Worst-case interactive communication II: Two messages are not optimal. IEEE Transactions on Information Theory, 37(4):995-1005, July 1991.
24. A. Orlitsky. Interactive communication of balanced distributions and of correlated files. SIAM Journal of Discrete Math, 6(4):548-564, 1993.
25. A. Orlitsky and K. Viswanathan. Practical algorithms for interactive communication. In IEEE Int. Symp. on Information Theory, June 2001.
26. A. Orlitsky and K. Viswanathan. One-way communication and error-correcting codes. In Proc. of the 2002 IEEE Int. Symp. on Information Theory, page 394, June 2002.
27. C. Park and J. J. Metzner. Efficient location of discrepancies in multiple replicated large files. IEEE Transactions on Parallel and Distributed Systems, 13(6):597-610, June 2002.
28. B. Pierce. Unison file synchronizer. http://www.cis.upenn.edu/~bcpierce/ unison/.
29. N. Ramsey and E. Csirmaz. An algebraic approach to file synchronization. In Proc. of the 9th ACM Int. Symp. on Foundations of Software Engineering, pages 175-185, 2001.
30. S. Rhea, K. Liang, and E. Brewer. Value-based web caching. In Proc. of the 12th Int. World Wide Web Conference, May 2003.
31. L. Rizzo. Effective erasure codes for reliable computer communication protocols. Computer Communication Review, April 1997.
32. S. Schleimer, D. Wilkerson, and A. Aiken. Winnowing: Local algorithms for document fingerprinting. In Proc. of the 2003 ACM SIGMOD Int. Conf. on Management of Data, pages 76-85, 2003.
33. T. Schwarz, R. Bowdidge, and W. Burkhard. Low cost comparison of file copies. In Proc. of the 10th Int. Conf. on Distributed Computing Systems, pages 196-202, 1990.
34. N. Spring and D. Wetherall. A protocol independent technique for eliminating redundant network traffic. In Proc. of the ACM SIGCOMM Conference, 2000.
35. D. Starobinski, A. Trachtenberg, and S. Agarwal. Efficient PDA synchronization. IEEE Transactions on Mobile Computing, 2(1), 2003.
36. T. Suel and N. Memon. Algorithms for delta compression and remote file synchronization. In Khalid Sayood, editor, Lossless Compression Handbook. Academic Press, 2002.
37. T. Suel, P. Noel, and D. Trendafilov. Improved file synchronization techniques for maintaining large replicated collections over slow networks. In Proc. of the Int. Conf. on Data Engineering, March 2004.
38. D. Trendafilov, N. Memon, and T. Suel. zdelta: a simple delta compression tool. Technical Report TR-CIS-2002-02, Polytechnic University, CIS Department, June 2002.
39. A. Tridgell. Efficient Algorithms for Sorting and Synchronization. PhD thesis, Australian National University, April 2000.
40. A. Tridgell, P. Barker, and P. MacKerras. rsync in http. In Conference of Australian Linux Users, 1999.
41. A. Tridgell and P. MacKerras. The rsync algorithm. Technical Report TR-CS-96-05, Australian National University, June 1996.