Evaluating the usefulness of content addressable Storage For high-performance data intensive applications

Proceedings of the 17th International Symposium on High Performance Distributed Computing 2008, HPDC'08

Volumn , Issue , 2008, Pages 35-44

  Nath, Partho ^a   Urgaonkar, Bhuvan ^b   Sivasubramaniam, Anand ^b  

^a CISCO SYSTEMS   (United States)

^b The Pennsylvania State University   (United States)

Author keywords

Caching; Compression; Content addressable storage

Indexed keywords

CACHING; COMPRESSION; CONTENT ADDRESSABLE STORAGE; DATA REPLICATIONS; DATA REPRESENTATIONS; DISK SPACES; DO-MAINS; EFFECTIVE SPACES; EMPIRICAL EVALUATIONS; ENTERPRISE APPLICATIONS; ENTERTAINMENT SERVICES; ERROR RESILIENCES; LESSONS LEARNED; NETWORK BANDWIDTHS; PERFORMANCE DATUMS; STORAGE SPACES; TRADING OFFS;

BANDWIDTH; DIE CASTING; DISKS (STRUCTURAL COMPONENTS); HIGH PERFORMANCE LIQUID CHROMATOGRAPHY; TELECOMMUNICATION SYSTEMS;

APPLICATIONS;

EID: 57349192776     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1383422.1383428     Document Type: Conference Paper

References (49)

1. BSSN Pugh Benchmark, http://www.cactuscode.org/Benchmarks/bench-bssn- pugh.
2. NAS PARALLEL BENCHMARKS. http://www.nas.nasa.gov/Resources/ Software/npb.html.
3. Oracle berkeley db. http://www.oracle.com/database/berkeley-db.html.
4. M. Ajtai, R. Burns, R. Fagin, D. D. E. Long, and L. Stockmeyer. Compactly encoding unstructured inputs with differential compression. J. ACM, 49(3):318-367, 2002.
5. The babar experiment. http://www-public.slac.Stanford.edu/babar/.
6. Belle, http://belle.kek.jp/.
7. D. Bhagwat, K. Pollack, D. D. E. Long, T. Schwarz, E. L. Miller, and J.-F. Paris. Providing high reliability in a minimum redundancy archival storage system. In MASCOTS '06: Proceedings of the 14th IEEE International Symposium on Modeling, Analysis, and Simulation, 2006.
8. J. R. Black. Compare-by-hash: A reasoned analysis. In Proceedings of the 2006 USENIX Annual Technical Conference (USENIX'06), Boston, MA, June 2006.
9. W. J. Bolosky, S. Corbin, D. Goebel, and J. R. Douceur. Single Instance Storage in Windows 2000. In Proceedings of the 4th USENIX Windows Systems Symposium, 2000.
10. W. J. Bolosky, J. R. Douceur, D. Ely, and M. Theimer. Feasibility of a serverless distributed file system deployed on an existing set of desktop pcs. SIGMETRICS Perform. Eval. Rev., 28(l):34-43, 2000.
11. A. Broder. Some applications of rabin's fingerprinting method. In Sequences II: Methods in Communications, Security, and Computer Science, pages 143-152. Springer-Verlag, 1993.
12. A. Z. Broder. Identifying and filtering near-duplicate documents. In COM '00: Proceedings of the 11th Annual Symposium on Combinatorial Pattern Matching, 2000.
13. C. Chan and H. Lu. Fingerprinting using polynomial (rabin's method). Faculty of Science, University of Alberta, CMPUT690 Term Project, December 2001.
14. L. P. Cox, C. D. Murray, and B. D. Noble. Pastiche: Making Backup Cheap and Easy. In OSDI: Symposium on Operating Systems Design and Implementation, 2002.
15. F. Dabek, M. F, Kaashoek, D. Karger, R. Morris, and I. Stoica. Wide-area cooperative storage with cfs. In SOSP '01: Proceedings of the eighteenth ACM symposium on Operating systems principles, pages 202-215, New York, NY, USA, 2001. ACM Press.
16. Data Domain, http://www.datadomain.com.
17. OSDL Database Test 2. http://www.osdl.org/.
18. J. R. Douceur, A. Adya, W. J. Bolosky, D. Simon, and M. Theimer. Reclaiming space from duplicate files in a serverless distributed file system. In ICDCS '02: Proceedings of the 22 nd International Conference on Distributed Computing Systems (ICDCS'02), page 617, Washington, DC, USA, 2002. IEEE Computer Society.
19. EMC Corp. EMC Centera Content Addressed Storage System, 2003. http://www.emc.com/.
20. S. Ghemawat, H. Gobioff, and S. T. Leung. The Google File System. In Proc. of the 2003 19th ACM Symposium on Operating System Principles, October 2003.
21. V. Henson. An analysis of compare-by-hash. In Proceedings of the 9th Workshop on Hot Topics in Operating Systems (HotOS IX), pages 13-18, May 2003.
22. N. Jain, M. Dahlin, and R. Tewari. Taper: Tiered approach for eliminating redundancy in replicas. In USENIX Conference onf File and Storage Technologies (FAST05), 2005.
23. M. Kozuch and M. Satyanarayanan. Internet Suspend/Resume. In Proceedings of the Workshop on Mobile Computing Systems and Applications, 2002.
24. P. Kulkarni, F. Douglis, J. D. LaVoie, and J. M. Tracey. Redundancy Elimination Within Large Collections of Files. In USENIX Annual Technical Conference, General Track, 2004.
25. J. Li, M. Krohn, D. Mazierères, and D. Shasha. Secure untrusted data repository (SUNDR). In Proceedings of the 6th Symposium on Operating Systems Design and Implementation, pages 91-106, December 2004.
26. J. McKnight, T. Asaro, and B. Babineau. Digital archiving: End-user survey and market forecast 2006-2010. The Enterprise Strategy Group, Jan 2006.
27. J. C. Mogul, Y. M. Chan, and T. Kelly. Design, Implementation, and Evaluation of Duplicate Transfer Detection in HTTP. In Proceedings of the First Symposium on Networked Systems Design and Implementation, San Francisco, CA, March 2004.
28. http://www.venge.net/monotone/docs/Hash-Integrity.html.
29. T. D. Moreton, I. A. Pratt, and T. L. Harris. Storage, Mutability and Naming in Pasta. In Revised Papers from the NETWORKING 2002 Workshops on Web Engineering and Peer-to-Peer Computing, 2002.
30. A. Muthitacharoen, B. Chen, and D. Mazieres. A Low-Bandwidth Network File System. In Proceedings of the 18th ACM Symposium on Operating Systems Principles, Chateau Lake Louise, Banff, Canada, Oct. 2001.
31. A. Muthitacharoen, R. Morris, T. M. Gil, and B. Chen. Ivy: a read/write peer-to-peer file system. SIGOPS Oper. Syst. Rev., 36(SI):31-44, 2002.
32. P. Nath, M. Kozuch, D. O'Hallaron, J. Harkes, M. Satyanarayanan, N. Tolia, and M. Toups. Design tradeoffs in applying content addressable storage to enterprise-scale systems based on virtual machines. In Proceedings of the 2006 USENIX Annual Technical Conference (USENIX'06), Boston, MA, June 2006.
33. NCBI GenBank. http://www.ncbi.nlm.nih.gov/Genbank/.
34. K. Olsen, J. B. Minster, Y. Cui, A. Chourasia, R. Moore, Y. Hu, J. Zhu, R Maechling, and T. Jordan. SCEC TeraShake Simulations: High Resolution Simulations of Large Southern San Andreas Earthquakes Using the TeraGrid. In Proceedings of the TeraGrid 2006 Conference.
35. TeraByte Scale Enterprise databases. http://members.microsoft.com/ customerevidence/Common/FileOpen.aspx?FileName=7405-FirstPremier-TDM-SQL-Server- Case-Study-Final.doc.
36. Terabyte scale enterprise databases. http://www.wintercorp.com/VLDB/2005- TopTen-Survey/2005TopTenWinners.pdf.
37. Terabyte scale enterprise databases, http://www.webtechniques.com/ archives/1999/02/data/.
38. S. Quinlan and S. Dorward. Venti: A New Approach to Archival Storage. In Proceedings of the FAST 2002 Conference on File and Storage Technologies, January 2002.
39. S. Quinlan, J. McKie, and R. Cox. Fossil, an archival file-server, http://www.cs.bell-labs.com/sys/doc/fossil.pdf.
40. M. Rabin. Fingerprinting by Random Polynomials. In Harvard University Center for Research in Computing Technology Technical Report TR-15-81, 1981.
41. S. Rhea, K. Liang, and E. Brewer. Value-Based Web Caching. In Proceedings of the Twelfth International World Wide Web Conference, May 2003.
42. Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H. Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications. In Proceedings of the ACM SIGCOMM 2001, San Diego, CA, August 2001.
43. T. Suel, P. Noel, and D. Trendafilov. Improved file synchronization techniques for maintaining large replicated collections over slow networks, icde, 00, 2004.
44. N. Tolia, J. Harkes, M. Kozuch, and M. Satyanarayanan. Integrating Portable and Distributed Storage. In Proceedings of the 3rd USENIX Conference on File and Storage Technologies, 2004.
45. Tolia, N., Kozuch, M., Satyanarayanan, M., Karp, B., Bressoud, T., Perrig, A. Opportunistic Use of Content-Addressable Storage for Distributed File Systems. In Proceedings of the 2003 USENIX Annual Technical Conference, San Antonio, TX, June 2003.
46. A. Tridgell. Efficient Algorithms for Sorting and Synchronization. PhD thesis, The Australian National University, 1999.
47. M. Vilayannur, P. Nath, and A. Sivasubramaniam. Providing Tunable Consistency for a Parallel File Store. In Proceedings of the Fourth USENIX Conference on File and Storage Technologies (FAST'05), 2005.
48. L. L. You, K T. Pollack, and D. D. E. Long. Deep store: An archival storage system architecture. In ICDE '05: Proceedings of the 21st International Conference on Data Engineering (ICDE'05), 2005.
49. J. Ziv and A. Lempel. Compression of individual sequences via variable-rate coding. IEEE Transactions on Information Theory, 24(5), 1978.