Dimensioning the virtual cluster for parallel scientific workflows in clouds

ScienceCloud 2013 - Proceedings of the 4th ACM Workshop on Scientific Cloud Computing

Volumn , Issue , 2013, Pages 5-12

  De Oliveira, Daniel ^a   Viana, Vitor ^c   Ogasawara, Eduardo ^b   Ocaña, Kary ^c   Mattoso, Marta ^c  

^a FLUMINENSE FEDERAL UNIVERSITY   (Brazil)

^b CENTRO FEDERAL DE EDUCAÇÃO TECNOLÓGICA CELSO SUCKOW DA FONSECA   (Brazil)

^c FEDERAL UNIVERSITY OF RIO DE JANEIRO   (Brazil)

Author keywords

cloud computing; parallelization; scientific workflows

Indexed keywords

ADAPTIVE TECHNIQUE; COMPUTATIONAL MODEL; DEADLINE CONSTRAINT; INITIAL CONFIGURATION; PARALLELIZATIONS; SCIENTIFIC EXPERIMENTS; SCIENTIFIC WORKFLOWS; WORKFLOW EXECUTION;

COMPUTER SIMULATION; EXPERIMENTS;

CLOUD COMPUTING;

EID: 84880056275     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2465848.2465852     Document Type: Conference Paper

References (37)

1. L.M. Vaquero, L. Rodero-Merino, J. Caceres, and M. Lindner, 2009, A break in the clouds: towards a cloud definition, SIGCOMM Comput. Commun. Rev., v. 39, n. 1, p. 50-55.
2. G. Juve and E. Deelman, 2010, Scientific workflows and clouds, Crossroads, v. 16 (mar.), p. 14-18.
3. D. Oliveira, F. Baião, and M. Mattoso, 2010, "Towards a Taxonomy for Cloud Computing from an e-Science Perspective", Cloud Computing: Principles, Systems and Applications, Nick Antonopoulos and Lee Gillam edHeidelberg: Springer-Verlag
4. D. Oliveira, E. Ogasawara, F. Baião, and M. Mattoso, 2010, SciCumulus: A Lightweight Cloud Middleware to Explore Many Task Computing Paradigm in Scientific Workflows, In: 3rd International Conference on Cloud Computing, p. 378-385, Washington, DC, USA.
5. D. Oliveira, F. Baiao, and M. Mattoso, 2011, Migrating Scientific Experiments to the Cloud, HPC in the Cloud (mar.)
6. K.A.C.S. Ocaña, D. Oliveira, E. Ogasawara, A.M.R. Dávila, A.A.B. Lima, and M. Mattoso, 2011, "SciPhy: A Cloud-Based Workflow for Phylogenetic Analysis of Drug Targets in Protozoan Genomes", In: Advances in Bioinformatics and Computational Biology, chapter 6832, Springer, p. 66-70.
7. D. Oliveira, K. Ocana, E. Ogasawara, J. Dias, F. Baiao, and M. Mattoso, 2011, A Performance Evaluation of X-Ray Crystallography Scientific Workflow Using SciCumulus, In: IEEE International Conference on Cloud Computing (CLOUD)IEEE Cloud, p. 708-715, Washington, D.C., USA.
8. A. Matsunaga, M. Tsugawa, and J. Fortes, 2008, CloudBLAST: Combining MapReduce and Virtualization on Distributed Resources for Bioinformatics Applications, IEEE eScience 2008, p. 222-229.
9. C. Hoffa, G. Mehta, T. Freeman, E. Deelman, K. Keahey, B. Berriman, and J. Good, 2008, On the use of cloud computing for scientific workflows, In: IEEE Fourth International Conference on eScience (eScience 2008), p. 7-12, Indianapolis, USA.
10. M. Malawski, G. Juve, E. Deelman, and J. Nabrzyski, 2012, Cost- and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds, In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, p. 22:1-22:11, Los Alamitos, CA, USA.
11. E. Deelman, D. Gannon, M. Shields, and I. Taylor, 2009, Workflows and e-Science: An overview of workflow system features and capabilities, Future Generation Computer Systems, v. 25, n. 5, p. 528-540.
12. I.J. Taylor, E. Deelman, D.B. Gannon, and M. Shields, 2007, Workflows for e-Science: Scientific Workflows for Grids. 1 ed. Springer.
13. D. Oliveira, K. Ocaña, F. Baião, and M. Mattoso, 2012, A Provenance-based Adaptive Scheduling Heuristic for Parallel Scientific Workflows in Clouds, Journal of Grid Computing, v. 10, n. 3, p. 521-552.
14. G. Juve, E. Deelman, G.B. Berriman, B.P. Berman, and P. Maechling, 2012, An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2, Journal of Grid Computing, v. 10, n. 1 (mar.), p. 5-21.
15. M. Wilde, M. Hategan, J.M. Wozniak, B. Clifford, D.S. Katz, and I. Foster, 2011, Swift: A language for distributed parallel scripting, Parallel Computing, n. 37(9), p. 633-652.
16. M. Abouelhoda, S. Issa, and M. Ghanem, 2012, Tavaxy: Integrating Taverna and Galaxy workflows with cloud computing support, BMC Bioinformatics, v. 13, p. 77.
17. J. Freire, D. Koop, E. Santos, and C.T. Silva, 2008, Provenance for Computational Tasks: A Survey, Computing in Science and Engineering, v.10, n. 3, p. 11-21. (Pubitemid 351559435)
18. A. Jeongseob, K. Changdae, and J. Han, 2012, Dynamic Virtual Machine Scheduling in Clouds for Architectural Shared Resources, In: Proceedings of the HotCloud '12, Boston, MA.
19. E. Deelman, G. Juve, and B. Berriman, 2012, Using clous for science, is it just kicking the can down the road?, In: CLOSER 2012, Portugal.
20. V. Viana, D. de Oliveira, and M. Mattoso, 2011, Towards a Cost Model for Scheduling Scientific Workflows Activities in Cloud Environments, In: 2011 IEEE World Congress on Services (SERVICES), p. 216-219
21. L.D. Davis, 1991, Handbook Of Genetic Algorithms. 1st ed. Van Nostrand Reinhold.
22. N. Janssens, X. An, K. Daenen, and C. Forlivesi, 2012, Dynamic scaling of call-stateful SIP services in the cloud, In: Proceedings of the 11th international IFIP TC 6 conference on Networking - Volume Part I, p. 175-189, Berlin, Heidelberg.
23. W. Tian, 2009, Adaptive Dimensioning of Cloud Data Centers, In: Proceedings of the 2009 Eighth IEEE International Conference on Dependable, Autonomic and Secure Computing, p. 5-10, Washington, DC, USA.
24. Amazon EC2, 2010, Amazon Elastic Compute Cloud (Amazon EC2), http://aws.amazon.com/ec2/.
25. GoGrid, 2012, Cloud Hosting, Cloud Servers, Hybrid Hosting, Cloud Infrastructure from GoGrid URL: http://www.gogrid.com/.
26. S.P. Callahan, J. Freire, E. Santos, C.E. Scheidegger, C.T. Silva, and H.T. Vo, 2006, VisTrails: visualization meets data management, In: SIGMOD, p. 745-747, Chicago, Illinois, USA.
27. I. Altintas, C. Berkley, E. Jaeger, M. Jones, B. Ludascher, and S. Mock, 2004, Kepler: an extensible system for design and execution of scientific workflows, In: Scientific and Statistical Database Management, p. 423-424, Greece.
28. D. Oliveira, E. Ogasawara, K. Ocana, F. Baiao, and M. Mattoso, 2011, An Adaptive Parallel Execution Strategy for Cloud-based Scientific Workflows, Concurrency and Computation: Practice and Experience, v. 24, p. 1531-1550
29. Apache Software Foundation, 2009, Hadoop, Apache Hadoop Website
30. F. Costa, V. Silva, D. Oliveira, K. Ocana, J. Dias, E. Ogasawara, and M. Mattoso, 2013, Capturing and Querying Workflow Runtime Provenance with PROV: a Practical Approach, In: BigProv'13, EDBT/ICDT Workshops 2013, Genova, Italy.p.282-289
31. L. Moreau and P. Missier, 2011. The PROV Data Model and Abstract Syntax Notation. W3C Working Draft. (Work in progress.). URL: http://www.w3.org/TR/ prov-dm/.
32. E. Ogasawara, J. Dias, D. Oliveira, F. Porto, P. Valduriez, and M. Mattoso, 2011, An Algebraic Approach for Data-Centric Scientific Workflows, Proc. of VLDB Endowment, v. 4, n. 12, p. 1328-1339.
33. C. Boeres, I. Sardiña, and L. Drummond, 2011, An efficient weighted bi-objective scheduling algorithm for heterogeneous systems, Parallel Computing, v. 37, n. 8 (ago.), p. 349-364.
34. D.L. Applegate, R.E. Bixby, V. Chvatal, and W.J. Cook, 2007, The Traveling Salesman Problem: A Computational Study. Princeton University Press.
35. T. Bäck, 1996, Evolutionary algorithms in theory and practice: evolution strategies, evolutionary programming, genetic algorithms. Oxford, UK, Oxford University Press.
36. D.E. Goldberg, 1989, Genetic Algorithms in Search, Optimization, and Machine Learning. 1 ed. Addison-Wesley Professional.
37. K. et al. Meffert, 2012. JGAP - Java Genetic Algorithms and Genetic Programming Package. URL: http://jgap.sf.net.