TomusBlobs: Towards communication-efficient storage for MapReduce applications in Azure

Proceedings - 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2012

Volumn , Issue , 2012, Pages 427-434

  Tudoran, Radu ^a   Costan, Alexandru ^a   Antoniu, Gabriel ^a   Soncu, Hakan ^b  

^a INRIA   (France)

^b MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION PERFORMANCE; ASSOCIATED COSTS; BROAD SPECTRUM; CLOUD DATA; CRITICAL ISSUES; DATA STORAGE SYSTEMS; DATA-INTENSIVE APPLICATION; HIGH-THROUGHPUT; IT IMPACT; MAP-REDUCE; REAL-WORLD APPLICATION; RESOURCE USAGE; STORAGE SERVICES; STORAGE SOLUTIONS; SYNTHETIC BENCHMARK; VIRTUAL DISK;

DATA HANDLING; DATA STORAGE EQUIPMENT; ELASTICITY; GRID COMPUTING; OPTIMIZATION;

BENCHMARKING;

EID: 84863663079     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2012.104     Document Type: Conference Paper

References (21)

1. Amazon Web Service, http://aws.amazon.com/
2. Azure Microsoft Windows, http://www.microsoft.com/windowsazure/
3. B. Bond, Best Practices for Developing on Window Azure, http://azurescope.cloudapp.net/BestPractices/
4. A-Brain, http://www.msr-inria.inria.fr/Projects/a-brain
5. B. Calder,J. Wang, A. Ogus et al, Windows Azure Storage: A Highly Available Cloud Storage Service with Strong Consistency, ACM Symposium on Operating Systems Principles, 2011
6. P.H. Carns, W. B. Ligon, R. B. Ross and R. Thakur, PVFS: a parallel file system for linux clusters, In Proc. of the 4th annual Linux Showcase & Conference, 4, 2000
7. Eucalyptus: http://www.eucalyptus.com/
8. T. Gunarathne, W. Tak-Lon, J. Qiu and G. Fox, MapReduce in the Clouds for Science, Cloud Computing Technology and Science (CloudCom), IEEE Second International Conference, 565-572, Indianapolis, IN, USA, 2010.
9. Hadoop, http://hadoop.apache.org/
10. HDFS, http://hadoop.apache.org/hdfs/
11. Q. He, S. Zhou, B. Kobler, D. Duffy and T. McGlynn. Case study for running HPC applications in public clouds. In Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing (HPDC '10), 395-401, New York, NY, USA
12. Z. Hill, J. Li, M. Mao, A. Ruiz-Alvarez and M. Humphrey. Early Observations on the Performance of Windows Azure. High Performance Distributed Computing, 2010, 367-376, New York, NY, USA, 2010
13. G. Juve, E. Deelman, K. Vahi, G. Mehta, B. Berriman, B.P. Berman and P. Maechling, Data Sharing Options for Scientific Workflows on Amazon EC2, SC10, New Orleans, LA, USA, 2010
14. K. Keahey, J. Bresnahan, T. Freeman and David LaBissoniere, Cumulus: Open Source Storage Cloud for Science, SC10 Poster, New Orleans, LA, USA, 2010
15. K. Kobayashi, S. Mikami, H. Kimura and O. Tatebe, The Gfarm File System on Compute Clouds, Parallel and Distributed Processing Workshops and Phd Forum (IPDPSW), 1034-1041, Shanghai, China, 2011
16. D. Moise, A. Carpen-Amarie, G. Antoniu and L. Bougé, A Cost-Evaluation of MapReduce Applications in the Cloud, Grid5000 School, Reims, France, 2011
17. B. Nicolae, G. Antoniu, L. Bougé, D. Moise and A. Carpen-Amarie, BlobSeer: Next Generation Data Management for Large Scale Infrastructures, Journal of Parallel and Distributed Computing 71, 2, 169-184, 2010
18. B. Nicolae, D. Moise, G. Antoniu, L. Bougé and M. Dorier, BlobSeer: Bringing High Throughput under Heavy Concurrency to Hadoop Map-Reduce Applications. International Parallel and Distributed Processing Symposium (IPDPS2010), 1-11, Atlanta, GA, USA, 2010.
19. J.-B. Poline, C. Lalanne, A. Tenenhaus, E. Duchesnay B. Thirion and V. Frouin, Imaging genetics: Bio-informatics and bio-statistics challenges. International Conference on Computational Statistics COMPSTAT, 2010
20. P. Schwan, Lustre: Building a file system for 1000-node clusters, Proceedings of the Linux Symposium, 2003
21. O. Tatebe, K. Hiraga and N. Soda, Gfarm grid file system, New Generation Computing, 28 (3), 257-275, 2010.