SciCumulus: A lightweigh cloud middleware to explore many task computing paradigm in scientific workflows

Proceedings - 2010 IEEE 3rd International Conference on Cloud Computing, CLOUD 2010

Volumn , Issue , 2010, Pages 378-385

  De Oliveira, Daniel ^a   Ogasawara, Eduardo ^a   Baião, Fernanda ^b   Mattoso, Marta ^a  

^a FEDERAL UNIVERSITY OF RIO DE JANEIRO   (Brazil)

^b UNIRIO ^*  (Zambia)

Author keywords

Cloud computing; Many Task Computing (MTC); Middleware; Scientific workflows

Indexed keywords

CLOUD COMPUTING; CLOUD MODELS; CLUSTER SYSTEMS; COMPUTATIONAL TASK; COMPUTING RESOURCE; DATA FRAGMENTATION; DATA TRANSFERRING; HIGH-PERFORMANCE COMPUTING MODELS; LOCAL ENVIRONMENTS; MANY-TASK COMPUTING; MULTIPROCESSOR MACHINES; PARALLEL COMPUTING; PARALLEL PROCESSING; SCIENTIFIC WORKFLOWS; SIMULATED EXPERIMENTS; WORKFLOW EXECUTION;

CLUSTER COMPUTING; GRID COMPUTING; MIDDLEWARE; PARALLEL ARCHITECTURES; SCHEDULING; WORK SIMPLIFICATION;

MANAGEMENT;

EID: 77957932955     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLOUD.2010.64     Document Type: Conference Paper

References (24)

1. D. Oliveira, F. Baião, and M. Mattoso, 2010, "Towards a Taxonomy for Cloud Computing from an e-Science Perspective", Cloud Computing: Principles, Systems and Applications (to be published), Heidelberg: Springer-Verlag.
2. L. Wang, J. Tao, M. Kunze, A.C. Castellanos, D. Kramer, and W. Karl, 2008, Scientific Cloud Computing: Early Definition and Experience, In: 10th IEEE HPCC, p. 825-830, Los Alamitos, CA, USA.
3. A. Matsunaga, M. Tsugawa, and J. Fortes, 2008, CloudBLAST: Combining MapReduce and Virtualization on Distributed Resources for Bioinformatics Applications, IEEE eScience 2008, v. 0, p. 229, 222.
4. C. Hoffa, G. Mehta, T. Freeman, E. Deelman, K. Keahey, B. Berriman, and J. Good, 2008, On the use of cloud computing for scientific workflows, In: IEEE Fourth International Conference on eScience (eScience 2008), Indianapolis, USA, p. 7-12.
5. C. Lin, S. Lu, X. Fei, D. Pai, and J. Hua, 2009, A Task Abstraction and Mapping Approach to the Shimming Problem in Scientific Workflows, In: Proc. Services 2009, p. 284-291.
6. I.J. Taylor, E. Deelman, D.B. Gannon, M. Shields, and (Eds.), 2007, Workflows for e-Science: Scientific Workflows for Grids. 1 ed. Springer.
7. M. Mattoso, C. Werner, G.H. Travassos, V. Braganholo, L. Murta, E. Ogasawara, D. Oliveira, S.M.S.D. Cruz, and W. Martinho, 2010, Towards Supporting the Life Cycle of Large Scale Scientific Experiments, To be published in Int. J. Business Process Integration and Management, n. Special Issue on Scientific Workflows.
8. E. Walker and C. Guiang, 2007, Challenges in executing large parameter sweep studies across widely distributed computing environments, In: Workshop on Challenges of large applications in distributed environments, p. 11-18, Monterey, California, USA.
9. I. Raicu, I. Foster, and Yong Zhao, 2008, Many-task computing for grids and supercomputers, In: Workshop on Many-Task Computing on Grids and Supercomputers, p. 1-11.
10. E. Deelman, G. Mehta, G. Singh, M. Su, and K. Vahi, 2007, "Pegasus: Mapping Large-Scale Workflows to Distributed Resources", Workflows for e-Science, Springer, p. 376-394.
11. Y. Zhao, M. Hategan, B. Clifford, I. Foster, G. von Laszewski, V. Nefedova, I. Raicu, T. Stef-Praun, and M. Wilde, 2007, Swift: Fast, Reliable, Loosely Coupled Parallel Computation, In: Services 2007, p. 206, 199.
12. E. Ogasawara, D. Oliveira, F. Chirigati, C.E. Barbosa, R. Elias, V. Braganholo, A. Coutinho, and M. Mattoso, 2009, Exploring many task computing in scientific workflows, In: MTAGS 09, p. 1-10, Portland, Oregon.
13. J. Freire, D. Koop, E. Santos, and C.T. Silva, 2008, Provenance for Computational Tasks: A Survey, Computing in Science and Engineering, v.10, n. 3, p. 11-21.
14. Amazon EC2, 2010. Amazon Elastic Compute Cloud (Amazon EC2). Amazon Elastic Compute Cloud (Amazon EC2). Dispon?vel em: http://aws.amazon.com/ec2/. Acesso em: 5 Mar 2010.
15. J. Dean and S. Ghemawat, 2008, MapReduce: simplified data processing on large clusters, Commun. ACM, v. 51, n. 1, p. 107-113.
16. R. Buyya, R. Ranjan, and R. Calheiros, 2009, Modeling and Simulation of Scalable Cloud Computing Environments and the CloudSim Toolkit: Challenges, In: Proc. of HPCS 2009HPCS 2009, Leipzig, Germany.
17. S.P. Callahan, J. Freire, E. Santos, C.E. Scheidegger, C.T. Silva, and H.T. Vo, 2006, VisTrails: visualization meets data management, In: Proceedings of the 2006 ACM SIGMOD, p. 745-747, Chicago, IL, USA.
18. L. Meyer, D. Scheftner, J. Vöckler, M. Mattoso, M. Wilde, and I. Foster, 2007, "An Opportunistic Algorithm for Scheduling Workflows on Grids", High Performance Computing for Computational Science - VECPAR 2006, p. 1- 12.
19. X. Fei, S. Lu, and C. Lin, 2009, A MapReduce-Enabled Scientific Workflow Composition Framework, In: ICWS, p. 663-670, Los Alamitos, CA, USA.
20. R. Hasan, R. Sion, and M. Winslett, 2007, Introducing secure provenance: problems and challenges, In: Proceedings of the 2007 ACM workshop on Storage security and survivability, p. 13-18, Alexandria, Virginia, USA.
21. L. Moreau, J. Freire, J. Futrelle, R. McGrath, J. Myers, and P. Paulson, 2008, "The Open Provenance Model: An Overview", Provenance and Annotation of Data and Processes, p. 323- 326.
22. C. Szyperski, 1997, Component Software: Beyond Object- Oriented Programming. Addison-Wesley Professional.
23. N. Juristo and A.M. Moreno, 2001, Basics of Software Engineering Experimentation. 1 ed. Springer.
24. D. Abramson, C. Enticott, and I. Altinas, 2008, Nimrod/K: towards massively parallel dynamic grid workflows, In: SC 08, p. 1-11, Austin, Texas.