Alternatives for detecting redundancy in storage systems data

Proceedings of the FREENIX Track: 2004 USENIX Annual Technical Conference

Volumn , Issue , 2004, Pages

  Policroniades, Calicrates ^a   Pratt, Ian ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DIGITAL STORAGE; TREES (MATHEMATICS);

CAMBRIDGE UNIVERSITY; COMPARATIVE ANALYSIS; COMPRESSED DATUM; COMPUTER LABORATORY; DATA PROFILES; DIVERSE DATA SETS; FILE CONTENTS; STORAGE SYSTEMS;

INFORMATION MANAGEMENT;

EID: 84870815282     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. S. Balasubramaniam and Benjamin C. Pierce. What is a File Synchronizer? In Proceedings of the 4th Annual ACM/IEEE International Conference on Mobile Computing and Networking, pages 98-108. ACM Press, 1998.
2. Kenneth Barr and Krste Asanovic. Energy Aware Lossless Data Compression. In Proceedings of the First International Conference on Mobile Systems, Applications, and Services (MobiSys), San Francisco, CA, USA, May 2003.
3. William J. Bolosky, Scott Corbin, David Goebel, and John R. Douceur. Single Instance Storage in Windows 2000. In Proceedings of the 4th Usenix Windows System Symposium, August 2000.
4. Andrei Z. Broder. Some Applications of Rabin's Fingerprinting Method. In Renato Capocelli, Alfredo De Santis, and Ugo Vaccaro, editors, Sequences II: Methods in Communications, Security, and Computer Science, pages 143-152. Springer-Verlag, 1993.
5. Andrei Z. Broder. On the Resemblance and Containment of Documents. In Proceedings of Compression and Complexity of Sequences (SEQUENCES'97), 1997.
6. Andrei Z. Broder. Identifying and Filtering Near-Duplicate Documents. In Proceedings of Combinatorial Pattern Matching: 11th Annual Symposium, Montreal, Canada, June 2000.
7. Calvin Chan and Hahua Lu. Fingerprinting Using Polynomial (Rabin's Method). Faculty of Science, University of Alberta, CMPUT690 Term Project, December 2001.
8. Landon P. Cox, Christopher D. Murray, and Brian D. Noble. Pastiche: Making Backup Cheap and Easy. ACM SIGOPS Operating Systems Review, 36(SI):285-298, 2002.
9. Timothy E. Denehy and Windsor W. Hsu. Duplicate management for reference data. Research Report RJ 10305 (A0310-017), IBM, October 2003.
10. Fred Douglis and Arun Iyengar. Application-specific Delta-encoding via Resemblance Detection. In Proceedings of 2003 USENIX Technical Conference, pages 113-126, San Antonio, Texas, USA, 2003.
11. Richard G. Guy, Peter L. Reiher, David Ratner, Michial Gunter, Wilkie Ma, and Gerald J. Popek. Rumor: Mobile Data Access Through Optimistic Peer-to-Peer Replication. In Proceedings of ER Workshop on Mobile Data Access, pages 254-265, 1998.
12. Val Henson. An Analysis of Compare-by-Hash. In Proceedings of the 9th Workshop on Hot Topics in Operating Systems, Lihue, Hawaii, USA, May 2003.
13. Richard M. Karp and Michael O. Rabin. Efficient Randomised Pattern Matching Algorithms. Technical Report TR-31-81, Center for Research in Computing Technology, Harvard University, 1981.
14. Purushottam Kulkarni, Fred Douglis, Jason LaVoie, and John M. Tracey. Redundancy Elimination Within Large Collections of Files. In Proceedings of 2004 USENIX Technical Conference, Boston, Massachusetts, USA, 2004.
15. Udi Manber. Finding Similar Files in a Large File System. In Proceedings of the USENIX Winter 1994 Technical Conference, pages 1-10, San Fransisco, CA, USA, 1994.
16. Tim Moreton. Pasta: a Distributed Scalable File System for the Pastry Routing Substrate. University of Cambridge, Computer Laboratory Part II Project, 2002. http://www.cl.cam.ac.uk/tdm25.
17. Tim D. Moreton, Ian A. Pratt, and Timothy L. Harris. Storage, Mutability and Naming in Pasta. In Proceedings of the International Workshop on Peer-to-Peer Computing, Networking, May 2002.
18. Athicha Muthitacharoen, Benjie Chen, and David Maziéres. A Low-Bandwidth Network File System. In Proceedings of the Symposium on Operating Systems Principles (SOSP'01), pages 174-187, 2001.
19. Sean Quinlan and Sean Dorward. Venti: a New Approach to Archival Storage. In Proceedings of the First USENIX Conference on File and Storage Technologies (FAST'02), Monterey, CA, USA, 2002.
20. Michael O. Rabin. Fingerprinting by Random Polynomials. Technical Report TR-15-81, Center for Research in Computing Technology, Harvard University, 1981.
21. Michael O. Rabin. Discovering Repetitions in Strings. In A. Apostolico and Z. Galil, editors, Combinatorial Algorithms on Words, pages 279-288. Springer-Verlag, Berlin, 1985.
22. Dickon Reed, Ian Pratt, Paul Menage, Stephen Early, and Neil Stratford. Xenoservers: Accountable Execution of Untrusted Programs. In Proceedings of the 7th Workshop on Hot Topics in Operating Systems (HotOS-VII), pages 136-141, March 1999.
23. Sean C. Rhea, Kevin Liang, and Eric Brewer. Value-Based Web Caching. In Proceedings of the 12th International Conference on World Wide Web, pages 619-628. ACM Press, 2003.
24. Drew Roselli, Jacob R. Lorch, and Thomas E. Anderson. A Comparison of File System Workloads. In Proceedings of 2000 USENIX Annual Technical Conference, San Diego, California, USA, June 2000.
25. Constantine P. Sapuntzakis, Ramesh Chandra, Ben Pfaff, Jim Chow, Monica S. Lam, and Mendel Rosenblum. Optimizing the Migration of Virtual Computers. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI), December 2002.
26. Jeff Sidell, Paul M. Aoki, Adam Sah, Carl Staelin, Michael Stonebraker, and Andrew Yu. Data Replication in Mariposa. In Proceedings of the 12th International Conference on Data Engineering, pages 485-494, 1996.
27. Neil T. Spring and David Wetherall. A Protocol-Independent Technique for Eliminating Redundant Network Traffic. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (SIG-COMM'00), pages 87-95. ACM Press, 2000.
28. Andrew Tridgell. Efficient Algorithms for Sorting and Synchronization. PhD thesis, Australian National University, April 2000.
29. Unison, File Synchronizer. http://www.cis.upenn.edu/bcpierce.
30. Werner Vogels. File system usage in Windows NT 4.0. In Proceedings of the Symposium on Operating Systems Principles (SOSP'99), pages 93-109, 1999.
31. Jacob Ziv and Abraham Lempel. A Universal Algorithm for Sequential Data Compression. IEEE Transaction on Information Theory, IT-23(3):337-343, May 1977.