On the benefits of transparent compression for cost-effective cloud data storage

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6790 LNCS, Issue , 2011, Pages 167-184

  Nicolae, Bogdan ^a  

^a INRIA SACLAY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

BANDWIDTH CONSUMPTION; CLOUD DATA; COMPUTATIONAL OVERHEADS; COMPUTATIONAL RESOURCES; CONCURRENT ACCESS; DATA ACCESS; DATA SEQUENCES; DATA SETS; DESIGN AND DEVELOPMENT; DISTRIBUTED DATA; HIGH THROUGHPUT; NEW MODEL; NUMBER OF DATUM; PERFORMANCE LEVEL; PERFORMANCE REQUIREMENTS; PERSISTENT STORAGE; RUNTIMES; STORAGE COSTS; STORAGE SPACES; USER DATA; VIRTUAL MACHINES; DISTRIBUTED DATA MANAGEMENTS;

BANDWIDTH; BANDWIDTH COMPRESSION; CLOUD COMPUTING; COSTS; DATA TRANSFER; KNOWLEDGE BASED SYSTEMS; KNOWLEDGE MANAGEMENT; MIDDLEWARE; PEER TO PEER NETWORKS; COST EFFECTIVENESS; DIGITAL STORAGE; DISTRIBUTED COMPUTER SYSTEMS; ECONOMIC AND SOCIAL EFFECTS; FAULT TOLERANT COMPUTER SYSTEMS; INFRASTRUCTURE AS A SERVICE (IAAS);

DATA COMPRESSION; INFORMATION MANAGEMENT;

EID: 80051679422     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-23074-5_7     Document Type: Article

References (35)

1. Armbrust, M., Fox, A., Griffith, R., Joseph, A., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., Zaharia, M.: A view of cloud computing. Commun. ACM 53, 50-58 (2010)
2. Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst. 25(6), 599-616 (2009)
3. Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Communications of the ACM 51(1), 107-113 (2008)
4. Gagné, M.: Cooking with Linux: still searching for the ultimate linux distro? Linux J. 2007(161), 9 (2007)
5. Gantz, J.F., Chute, C., Manfrediz, A., Minton, S., Reinsel, D., Schlichting, W., Toncheva, A.: The diverse and exploding digital universe: An updated forecast of worldwide information growth through 2011. IDC (2007)
6. Ghandeharizadeh, S., Papadopoulos, C., Pol, P., Zhou, R.: Nam: a network adaptable middleware to enhance response time of web services. In: MASCOTS 2003: Proceedings of the 11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer Telecommunications Systems, pp. 136-145 (12-15 2003)
7. Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. SIGOPS - Operating Systems Review 37(5), 29-43 (2003) (Pubitemid 40929686)
8. The Apache Hadoop Project, http://www.hadoop.org
9. HDFS. The Hadoop Distributed File System, http://hadoop.apache.org/ common/docs/r0.20.1/hdfs-design.html
10. Isard, M., Budiu, M., Yu, Y., Birrell, A., Fetterly, D.: Dryad: distributed data-parallel programs from sequential building blocks. SIGOPS Oper. Syst. Rev. 41(3), 59-72 (2007) (Pubitemid 47281575)
11. Jeannot, E., Knutsson, B., Björkman, M.: Adaptive online data compression. In: HPDC 2002: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, p. 379. IEEE Computer Society,Washington, DC, USA (2002)
12. Jégou, Y., Lantéri, S., Leduc, J., Noredine, M., Mornet, G., Namyst, R., Primet, P., Quetier, B., Richard, O., Talbi, E.G., Iréa, T.: Grid'5000: a large scale and highly reconfigurable experimental grid testbed. International Journal of High Performance Computing Applications 20(4), 481-494 (2006)
13. Krintz, C., Sucu, S.: Adaptive on-the-fly compression. IEEE Trans. Parallel Distrib. Syst. 17(1), 15-24 (2006) (Pubitemid 43137967)
14. Marshall, P., Keahey, K., Freeman, T.: Elastic site: Using clouds to elastically extend site resources. In: CCGRID 2010: Proceedings of the 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, pp. 43-52. IEEE Computer Society, Washington, DC, USA (2010)
15. Montes, J., Nicolae, B., Antoniu, G., Sánchez, A., Pérez, M.: Using Global Behavior Modeling to Improve QoS in Cloud Data Storage Services. In: CloudCom 2010: Proceedings of the 2nd IEEE International Conference on Cloud Computing Technology and Science, Indianapolis, USA, pp. 304-311 (2010)
16. Moreno-Vozmediano, R., Montero, R.S., Llorente, I.M.: Elastic management of cluster-based services in the cloud. In: ACDC 2009: Proceedings of the 1st Workshop on Automated Control for Datacenters and Clouds, pp. 19-24. ACM, New York (2009)
17. Nicolae, B.: BlobSeer: Towards Efficient Data Storage Management for Large-Scale, Distributed Systems. Ph.D. thesis, University of Rennes 1 (November 2010)
18. Nicolae, B.: High throughput data-compression for cloud storage. In: Globe 2010: Proceedings of the 3rd International Conference on Data Management in Grid and P2P Systems, Bilbao, Spain, pp. 1-12 (2010)
19. Nicolae, B., Antoniu, G., Bougé, L.: Enabling high data throughput in desktop grids through decentralized data and metadata management: The BlobSeer approach. In: Sips, H., Epema, D., Lin, H.-X. (eds.) Euro-Par 2009. LNCS, vol. 5704, pp. 404-416. Springer, Heidelberg (2009)
20. Nicolae, B., Antoniu, G., Bougé, L., Moise, D., Carpen-Amarie, A.: Blobseer: Next-generation data management for large scale infrastructures. J. Parallel Distrib. Comput. 71, 169-184 (2011)
21. Nicolae, B., Bresnahan, J., Keahey, K., Antoniu, G.: Going Back and Forth: Efficient Multi-Deployment and Multi-Snapshotting on Clouds. In: HPDC 2011: Proceedings of the 20th International ACM Symposium on High-Performance Parallel and Distributed Computing, San José, CA, USA (2011)
22. Nicolae, B., Moise, D., Antoniu, G., Bougé, L., Dorier, M.: Blobseer: Bringing high throughput under heavy concurrency to hadoop map/reduce applications. In: IPDPS 2010: Proc. 24th IEEE International Parallel and Distributed Processing Symposium, Atlanta, USA, pp. 1-12 (2010)
23. Nurmi, D., Wolski, R., Grzegorczyk, C., Obertelli, G., Soman, S., Youseff, L., Zagorodnov, D.: The Eucalyptus open-source cloud-computing system. In: CCGRID 2009: Proceedings of the 9th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, pp. 124-131. IEEE Computer Society, Los Alamitos (2009)
24. Patterson, D.A.: Technical perspective: the data center is the computer. Commun. ACM 51(1), 105-105 (2008)
25. Pavlo, A., Paulson, E., Rasin, A., Abadi, D.J., DeWitt, D.J., Madden, S., Stone-braker, M.: A comparison of approaches to large-scale data analysis. In: SIGMOD 2009: Proceedings of the 35th SIGMOD International Conference on Management of Data, pp. 165-178. ACM, New York (2009)
26. Raghuveer, A., Jindal, M., Mokbel, M.F., Debnath, B., Du, D.: Towards efficient search on unstructured data: an intelligent-storage approach. In: CIKM 2007: Proceedings of the 16th ACM Conference on Information and Knowledge Management, pp. 951-954. ACM, New York (2007)
27. Reimer, D., Thomas, A., Ammons, G., Mummert, T., Alpern, B., Bala, V.: Opening black boxes: using semantic information to combat virtual machine image sprawl. In: VEE 2008: Proceedings of the 4th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, pp. 111-120. ACM, New York (2008)
28. Vaquero, L.M., Rodero-Merino, L., Caceres, J., Lindner, M.: A break in the clouds: towards a cloud definition. SIGCOMM Comput. Commun. Rev. 39(1), 50-55 (2009)
29. Wiseman, Y., Schwan, K., Widener, P.: Efficient end to end data exchange using configurable compression. SIGOPS Oper. Syst. Rev. 39(3), 4-23 (2005) (Pubitemid 44856585)
30. Ziv, J., Lempel, A.: A universal algorithm for sequential data compression. IEEE Transactions on Information Theory 23, 337-343 (1977)
31. Amazon Elastic Compute Cloud (EC2), http://aws.amazon.com/ec2/
32. Amazon Elastic Map Reduce, http://aws.amazon.com/elasticmapreduce/
33. BZIP2, http://bzip.org
34. Lempel-Ziv-Oberhumer, http://www.oberhumer.com/opensource/lzo
35. The Nimbus project, http://www.nimbusproject.org