Magellan: Experiences from a science cloud

ScienceCloud'11 - Proceedings of the 2nd International Workshop on Scientific Cloud Computing

Volumn , Issue , 2011, Pages 49-58

  Ramakrishnan, Lavanya ^a   Zbiegel, Piotr T ^b   Campbell, Scott ^a   Bradshaw, Rick ^b   Canon, Richard Shane ^a   Coghlan, Susan ^b   Sakrejda, Iwona ^a   Desai, Narayan ^b   Declerck, Tina ^a   Liu, Anping ^b  

^a LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

cloud computing; mapreduce; programming model; science; virtual machines

Indexed keywords

COMPUTING FACILITIES; CUSTOMIZED SOFTWARE; DEPARTMENT OF ENERGY; ENERGY RESEARCH; MAGELLAN; MAP-REDUCE; PROGRAMMING MODEL; RESOURCE PROVIDERS; SCIENCE; SCIENCE APPLICATIONS; SCIENTIFIC APPLICATIONS; VIRTUAL MACHINES;

COMPUTER PROGRAMMING; COMPUTER SYSTEMS; PROGRAM COMPILERS;

CLOUD COMPUTING;

EID: 79961037661     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1996109.1996119     Document Type: Conference Paper

References (28)

1. The FutureGrid Project. https://portal.futuregrid.org/.
2. G. Aldering et al. Overview of the Nearby Supernova Factory. In J. A. Tyson & S. Wolff, editor, Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, volume 4836 of Presented at the Society of Photo-Optical Instrumentation Engineers (SPIE) Conference, pages 61-72, Dec. 2002.
3. bcfg2. http://trac.mcs.anl.gov/projects/bcfg2.
4. Cern Virtual Machines. http://rbuilder.cern.ch/project/cernvm/releases.
5. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI '04, pages 137-150, 2004.
6. E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good. The Cost of Doing Science on the Cloud: The Montage Example. In Proceedings of SC'08, Austin, TX, 2008. IEEE.
7. E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good. The cost of doing science on the cloud: the montage example. In Proceedings of the 2008 ACM/IEEE conference on Supercomputing, pages 1-12. IEEE Press, 2008.
8. C. Evangelinos and C. Hill. Cloud Computing for parallel Scientific HPC Applications: Feasibility of running Coupled Atmosphere-Ocean Climate Models on AmazonâǍŹs EC2. ratio, 2(2.40):2-34, 2008.
9. M. Fenn, S. Goasguen, and J. Lauret. Contextualization in practice: The clemson experience. In ACAT Proceedings, 2010.
10. S. Hazelhurst. Scientific computing using virtual high-performance computing: a case study using the Amazon elastic computing cloud. In Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology, pages 94-103. ACM, 2008.
11. Heckle. http://trac.mcs.anl.gov/projects/Heckle.
12. K. Jackson, L. Ramakrishnan, K. Muriki, S. Canon, S. Cholia, J. Shalf, H. Wasserman, and N. Wright. Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud. In 2nd IEEE International Conference on Cloud Computing Technology and Science, 2010.
13. G. Juve and E. Deelman. Scientific workflows and clouds. Crossroads, 16:14-18, March 2010.
14. K. Keahey. Cloud Computing for Science. In Proceedings of the 21st International Conference on Scientific and Statistical Database Management, page 478. Springer-Verlag, 2009.
15. K. Keahey, R. Figueiredo, J. Fortes, T. Freeman, and M. Tsugawa. Science clouds: Early experiences in cloud computing for scientific applications. Cloud Computing and Applications, 2008, 2008.
16. K. Keahey, T. Freeman, J. Lauret, and D. Olson. Virtual workspaces for scientific applications. In Journal of Physics: Conference Series, volume 78, page 012038. Institute of Physics Publishing, 2007.
17. J. Lauret, M. Walker, S. Goasguen, and L. Hajdu. From Grid to cloud, the STAR experience. SciDAC 2010 Proceedings, 2010.
18. J. Li, D. Agarwal, M. Humphrey, C. van Ingen, K. Jackson, and Y. Ryu. eScience in the Cloud: A MODIS Satellite Data Reprojection and Reduction Pipeline in the Windows Azure Platform. In IPDPS, 2010.
19. J. Napper and P. Bientinesi. Can cloud computing reach the top500? In Proceedings of the combined workshops on UnConventional high performance computing workshop plus memory access workshop, pages 17-20. ACM, 2009.
20. Nist cloud. http://csrc.nist.gov/groups/SNS/cloud-computing/.
21. F. T. C. on a Cloud Computing Cluster: Using Parallel Virtualization for Large-Scale Climate Simulation Analysis. Daren Hasenkamp and Alex Sim and Michael Wehner and Kesheng Wu. In 2nd IEEE International Conference on Cloud Computing Technology and Science, 2010.
22. S. Ostermann, A. Iosup, N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema. An early performance analysis of cloud computing services for scientific computing. Delft University of Technology, Tech. Rep, 2008.
23. M. Palankar, A. Iamnitchi, M. Ripeanu, and S. Garfinkel. Amazon S3 for science grids: a viable solution? In Proceedings of the 2008 international workshop on Data-aware distributed computing, pages 55-64. ACM, 2008.
24. L. Ramakrishnan et al. VGrADS: Enabling e-Science Workows on Grids and Clouds with Fault Tolerance. In Proceedings of the ACM/IEEE SC2009 Conference on High Performance Computing, Networking, Storage and Analysis, Portland, Oregon, Portland, Oregon, November 2009.
25. J. Rehr, F. Vila, J. Gardner, L. Svec, and M. Prange. Scientific computing in the cloud. Computing in Science and Engineering, 99(PrePrints), 2010.
26. M. C. Schatz. CloudBurst: highly sensitive read mapping with MapReduce. Bioinformatics, pages 1363-1369, June 2009.
27. G. Wang and T. E. Ng. The impact of virtualization on network performance of amazon ec2 data center. In Proceedings of IEEE INFOCOM, 2010.
28. From Clusters To Clouds: xCAT 2 Is Out Of The Bag. http://www.linux-mag. com/id/7230/.