High throughput data-compression for cloud storage

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6265 LNCS, Issue , 2010, Pages 1-12

  Nicolae, Bogdan ^a  

^a UNIVERSITÉ DE RENNES 1   (France)

Author keywords

[No Author keywords available]

Indexed keywords

BAND-WIDTH UTILIZATION; CLOUD COMPUTING; CLOUD STORAGES; COMPUTATIONAL OVERHEADS; DATA MANAGEMENT; DATA SEQUENCES; DATA VOLUME; DATA-INTENSIVE APPLICATION; DISTRIBUTED DATA; DISTRIBUTED DATA MANAGEMENTS; DISTRIBUTED INFRASTRUCTURE; HIGH BANDWIDTH; HIGH-SPEED; HIGH-THROUGHPUT DATA; MASSIVE DATA; PARALLEL DATA TRANSFER; STORAGE SERVICES; STORAGE SPACES;

BANDWIDTH; BANDWIDTH COMPRESSION; DATA TRANSFER; DISTRIBUTED COMPUTER SYSTEMS; INFORMATION MANAGEMENT; PEER TO PEER NETWORKS; THROUGHPUT;

DATA COMPRESSION;

EID: 78049391938     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-15108-8_1     Document Type: Conference Paper

References (22)

1. Bryant, R.E.: Data-intensive supercomputing: The case for disc. Tech. rep., CMU (2007)
2. Buyya, R.E.: Market-oriented cloud computing: Vision, hype, and reality of delivering computing as the 5th utility. In: IEEE International Symposium on Cluster Computing and the Grid, p. 1 (2009)
3. Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Communications of the ACM 51(1), 107-113 (2008)
4. DeWitt, D., Gray, J.: Parallel database systems: the future of high performance database systems. Commun. ACM 35(6), 85-98 (1992)
5. Ghandeharizadeh, S., Papadopoulos, C., Pol, P., Zhou, R.: Nam: a network adaptable middleware to enhance response time of web services. In: MASCOTS '03: 11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer Telecommunications Systems, pp. 136-145 (12-15, 2003)
6. Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. SIGOPS - Operating Systems Review 37(5), 29-43 (2003)
7. The Apache Hadoop Project, http://www.hadoop.org
8. HDFS. The Hadoop Distributed File System, http://hadoop.apache.org/ common/docs/r0.20.1/hdfs design.html
9. Isard, M., Budiu, M., Yu, Y., Birrell, A., Fetterly, D.: Dryad: distributed dataparallel programs from sequential building blocks. SIGOPS Oper. Syst. Rev. 41(3), 59-72 (2007)
10. Jeannot, E., Knutsson, B., Björkman, M.: Adaptive online data compression. In: HPDC '02: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, p. 379. IEEE Computer Society, Washington (2002)
11. Jégou, Y., Lantéri, S., Leduc, J., Noredine, M., Mornet, G., Namyst, R., Primet, P., Quetier, B., Richard, O., Talbi, E.G., Iréa, T.: Grid'5000: a large scale and highly reconfigurable experimental grid testbed. International Journal of High Performance Computing Applications 20(4), 481-494 (2006)
12. Krintz, C., Sucu, S.: Adaptive on-the-fly compression. IEEE Trans. Parallel Distrib. Syst. 17(1), 15-24 (2006)
13. Nicolae, B., Antoniu, G., Bougé, L.: BlobSeer: How to enable efficient versioning for large object storage under heavy access concurrency. In: Data Management in Peer-to-Peer Systems, St-Petersburg, Russia (2009); Workshop held within the scope of the EDBT/ICDT 2009 joint Conference
14. Nicolae, B., Antoniu, G., Bougé, L.: Enabling high data throughput in desktop grids through decentralized data and metadata management: The blobseer approach. In: Sips, H., Epema, D., Lin, H.-X. (eds.) Euro-Par 2009. LNCS, vol. 5704, pp. 404-416. Springer, Heidelberg (2009)
15. Nicolae, B., Moise, D., Antoniu, G., Bougé, L., Dorier, M.: BlobSeer: Bringing high throughput under heavy concurrency to Hadoop Map/Reduce applications. In: Proc. 24th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2010 (in press, 2010)
16. Oberhumer, M.F.X.J.: Lempel-ziv-oberhumer (2009), http://www.oberhumer. com/opensource/lzo
17. Pavlo, A., Paulson, E., Rasin, A., Abadi, D.J., DeWitt, D.J., Madden, S., Stonebraker, M.: A comparison of approaches to large-scale data analysis. In: SIGMOD '09: Proceedings of the 35th SIGMOD international conference on Management of data, pp. 165-178. ACM, New York (2009)
18. Raghuveer, A., Jindal, M., Mokbel, M.F., Debnath, B., Du, D.: Towards efficient search on unstructured data: an intelligent-storage approach. In: CIKM '07: Proceedings of the sixteenth ACM Conference on information and knowledge management, pp. 951-954. ACM, New York (2007)
19. Seward, J.: Bzip2 (2001), http://bzip.org
20. Vaquero, L.M., Rodero-Merino, L., Caceres, J., Lindner, M.: A break in the clouds: towards a cloud definition. SIGCOMM Comput. Commun. Rev. 39(1), 50-55 (2009)
21. Wiseman, Y., Schwan, K., Widener, P.: Efficient end to end data exchange using configurable compression. SIGOPS Oper. Syst. Rev. 39(3), 4-23 (2005)
22. Ziv, J., Lempel, A.: A universal algorithm for sequential data compression. IEEE Transactions on Information Theory 23, 337-343 (1977)