Resilin: Elastic MapReduce over multiple clouds

Proceedings - 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2013

Volumn , Issue , 2013, Pages 261-268

  Iordache, Anca ^a   Morin, Christine ^a   Parlavantzas, Nikos ^b   Feller, Eugen ^a   Riteau, Pierre ^c  

^a INRIA   (France)

^b INSA DE RENNES   (France)

^c UNIVERSITY OF CHICAGO   (United States)

Author keywords

Apache Hadoop; Cloud computing; Elastic MapReduce; Multi cloud environment; Virtualization

Indexed keywords

APACHE HADOOP; DISTRIBUTED COMPUTATIONS; EXPERIMENTAL EVALUATION; GEOGRAPHICALLY DISTRIBUTED RESOURCES; MAP-REDUCE; MAP-REDUCE PROGRAMMING; MULTI-CLOUD ENVIRONMENT; VIRTUALIZATIONS;

CLOUD COMPUTING; COMPUTER SOFTWARE; FAULT TOLERANCE; WEB SERVICES; WEBSITES;

GRID COMPUTING;

EID: 84881293789     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2013.48     Document Type: Conference Paper

References (35)

1. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters, " in 6th Symposium on Operating Systems Design and Implementation, 2004, pp. 137-149.
2. Apache Hadoop, http://hadoop.apache.org/, 2012.
3. K. Shvachko, H. Kuang, S. Radia, and R. Chansler, "The Hadoop Distributed File System, " in Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), 2010, pp. 1-10.
4. A. Thusoo, Z. Shao, S. Anthony, D. Borthakur, N. Jain, J. Sarma, R. Murthy, and H. Liu, "Data Warehousing and Analytics Infrastructure at Facebook, " in 2010 ACM SIGMOD International Conference on Management of Data, 2010, pp. 1013-1020.
5. K. V. Shvachko, "Apache Hadoop: The Scalability Update, ";login:, vol. 36, no. 3, pp. 7-13, Jun. 2011.
6. Amazon Elastic MapReduce, http://aws.amazon.com/elasticmapreduce/, 2012.
7. K. Keahey and T. Freeman, "Science Clouds: Early Experiences in Cloud Computing for Scientific Applications, " in First Workshop on Cloud Computing and its Applications, 2008, pp. 1-5.
8. L. Ramakrishnan, P. T. Zbiegel, S. Campbell, R. Bradshaw, R. S. Canon, S. Coghlan, I. Sakrejda, N. Desai, T. Declerck, and A. Liu, "Magellan: Experiences from a Science Cloud, " in 2nd Workshop on Scientific Cloud Computing, 2011, pp. 49-58.
9. Nimbus, http://www.nimbusproject.org/, 2012.
10. OpenNebula, http://www.opennebula.org/, 2012.
11. OpenStack, http://www.openstack.org/, 2012.
12. D. Nurmi et al., "The Eucalyptus Open-source Cloud-computing System, " in 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, 2009, pp. 124-131.
13. FutureGrid, https://portal.futuregrid.org/, 2012.
14. K. Keahey, M. Tsugawa, A. Matsunaga, and J. A. B. Fortes, "Sky Computing, " IEEE Internet Computing, vol. 13, no. 5, pp. 43-51, 2009.
15. M. Cardosa, C. Wang, A. Nangia, A. Chandra, and J. Weissman, "Exploring MapReduce Efficiency with Highly-Distributed Data, " in MapReduce '11, 2011.
16. A. Matsunaga, M. Tsugawa, and J. Fortes, "CloudBLAST: Combining MapReduce and Virtualization on Distributed Resources for Bioinformatics Applications, " in 4th IEEE International Conference on e- Science, 2008, pp. 222-229.
17. Twisted, http://twistedmatrix.com/trac/, 2012.
18. Apache Libcloud, http://libcloud.apache.org/, 2012.
19. paramiko, http://www.lag.net/paramiko/, 2012.
20. J. Bresnahan, K. Keahey, D. LaBissoniere, and T. Freeman, "Cumulus: An Open Source Storage Cloud for Science, " in 2nd Workshop on Scientific Cloud Computing, 2011, pp. 25-32.
21. H. Shengsheng et al., "The HiBench benchmark suite: Characterization of the MapReduce-based data analysis, " in 22nd International Conference on, Data Engineering Workshops, 2010, pp. 41-51.
22. T. Gunarathne et al., "MapReduce in the Clouds for Science, " in Proceedings of the 2010 IEEE Second International Conference on Cloud Computing Technology and Science, 2010, pp. 565-572.
23. Windows Azure, http://www.microsoft.com/windowsazure/, 2012.
24. H. Liu and D. Orban, "Cloud MapReduce: a MapReduce Implementation on top of a Cloud Operating System, " in 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, 2011, pp. 464-474.
25. Seregenti, http://serengeti.cloudfoundry.com/, 2012.
26. Apache Whirr, http://whirr.apache.org/2012.
27. K. Kambatla, A. Pathak, and H. Pucha, "Towards optimizing hadoop provisioning in the cloud, " in USENIX Workshop on Hot Topics in Cloud Computing, 2009, pp. 1-5.
28. R. Moreno-Vozmediano, R. S. Montero, and I. M. Llorente, "Multi-cloud Deployment of Computing Clusters for Loosely Coupled MTC Applications, " in IEEE Transactions on Parallel and Distributed Systems, 2011, pp. 924-930.
29. ElasticHosts, http://www.elastichosts.com/, 2012.
30. J.-S. Vöckler et al., "Experiences Using Cloud Computing for A Scientific Workflow Application, " in ScienceCloud 2011, 2011, pp. 1- 10.
31. G. Pierre et al., "ConPaaS: an integrated runtime environment for elastic cloud applications, " in Proceedings of the Workshop on Posters and Demos Track, ser. PDT '11, 2011, pp. 5:1-5:2.
32. "Contrail Project. D8.1: Requirements and Architecture for the implementation of the High Level Services, " in Deliverable 2011.
33. "Contrail Project. Specification of requirements and architecture for runtime environments, " in Deliverable 2011.
34. M. Dias de Assunção, A. di Costanzo, and R. Buyya, "Evaluating the Cost-Benefit of Using Cloud Computing to Extend the Capacity of Clusters, " in 18th International ACM Symposium on High Performance Distributed Computing, 2009, pp. 141-150.
35. P. Marshall, K. Keahey, and T. Freeman, "Elastic Site: Using Clouds to Elastically Extend Site Resources, " in 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, 2010, pp. 43-52.