DEWE: A framework for distributed elastic scientific workflow execution

Conferences in Research and Practice in Information Technology Series

Volumn 163, Issue , 2015, Pages 3-10

  Leslie, Luke M ^a   Sato, Chiaki ^b   Lee, Young Choon ^b   Jiang, Qingye ^b   Zomaya, Albert Y ^b  

^a University of Illinois at Urbana Champaign   (United States)

^b UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Cloud computing; Resource efficiency; Resource management; Scheduling; Scientific workflows

Indexed keywords

CLOUD COMPUTING; DISTRIBUTED COMPUTER SYSTEMS; ELASTICITY; RESOURCE ALLOCATION; SCHEDULING; WEB SERVICES;

AMAZON WEB SERVICES; ANALYSIS AND EVALUATION; ASTRONOMICAL IMAGES; RESOURCE ALLOCATION STRATEGIES; RESOURCE EFFICIENCIES; RESOURCE MANAGEMENT; SCIENTIFIC WORKFLOWS; VISUALIZATION TOOLS;

INFORMATION MANAGEMENT;

EID: 84943178918     PISSN: 14451336     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. "Montage: An astronomical image mosaic engine," http://montage.ipac.caltech.edu/, 2013.
2. J. C. Jacob and D. S. e. a. Katz, "Montage: a grid portal and software toolkit for science-grade astronomical image mosaicking," International Journal of Computational Science and Engineering, vol. 4, no. 2, pp. 73-87, Jul. 2009.
3. "Cybershake," http://scec.usc.edu/scecpedia/ CyberShake, 2013.
4. R. Graves, T. H. Jordan, et al., "Cybershake: A physics-based seismic hazard model for Southern California," Pure and Applied Geophysics, vol. 168, no. 3-4, pp. 367-381, 2010.
5. A. Abramovici, W. E. Althouse, et al., "Ligo: The laser interferometer gravitationalwave observatory," Science, vol. 256, no. 5055, pp. 325-333, 1992.
6. "Ligo: Laser interferometer gravitational-wave observatory," http://www.ligo.caltech.edu/, 2012.
7. S. Bharathi, A. Chervenak, E. Deelman, G. Mehta, M.-H. Su, K. Vahi, "Characterization of scientific workflows," in Proceedings of the 3rd Workshop on Workflows in Support of Large-Scale Science (WORKS), 2008, pp. 1-10.
8. J. Livny, H. Teonadi, M. Livny, M. K. Waldor, "High-Throughput, Kingdom-Wide Prediction and Annotation of Bacterial Non-Coding RNAs," PLoS ONE, vol. 3, pp. e3197+, 2008.
9. M. Litzkow, M. Livny, M. Mutka, "Condor - a hunter of idle workstations," in Proceedings of the 8th International Conference on Distributed Computing Systems (ICDCS), 1988, pp. 104-111.
10. E. Deelman, G. Singh, et al., "Pegasus: A framework for mapping complex scientific workflows onto distributed systems," Journal of Scientific Programming, vol. 13, no. 3, pp. 219-237, 2005.
11. I. Altintas, C. Berkley, E. Jaeger, M. Jones, B. Ludascher, S. Mock, "Kepler: An extensible system for design and execution of scientific workflows," in Proceedings of the 16th International Conference on Scientific and Statistical Database Management (SSDBM), 2004, pp. 423-424.
12. N. Killeen, J. Lohrey, M. Farrell, W. Liu, S. Garic, D. Abramson, G. Egan, "Integration of modern data management practice with scientific workflows," in Proceedings of 8th IEEE Conference on eScience, 2012.
13. D. Abramson, R. Sosic, J. Giddy, B. Hall, "Nimrod: A tool for performing parameterised simulations using distributed workstations," in Proceedings of the 4th International Symposium on High Performance Distributed Computing (HPDC), 1995, pp. 112-121.
14. H. Topcuouglu, S. Hariri, M. Wu, "Performance-effective and low-complexity task scheduling for heterogeneous computing," IEEE Transactions on Parallel and Distributed Systems (TPDS), vol. 13, no. 3, pp. 260-274, 2002.
15. M. Tanaka and O. Tatebe, "Workflow scheduling to minimize data movement using multiconstraint graph partitioning," in Proceedings of the International Symposium on Cluster, Cloud, Grid Computing (CCGrid), 2012, pp. 65-72.
16. Y. Kwok and I. Ahmad, "Dynamic criticalpath scheduling: An effective technique for allocating task graphs to multiprocessors," IEEE Transactions on Parallel and Distributed Systems (TPDS), vol. 7, no. 5, pp. 506-521, 1996.
17. Y. C. Lee and A. Y. Zomaya, "Stretch Out and Compact: Workflow Scheduling with Resource Abundance," in Proceedings of the International Symposium on Cluster, Cloud, Grid Computing (CCGrid), 2013.
18. M. Mao and M. Humphrey, "Auto-scaling to minimize cost and meet application deadlines in cloud workflows," in Proceedings of International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 2011, pp. 49:1-49:12.
19. M. Malawski, G. Juve, E. Deelman, J. Nabrzyski, "Cost- and deadline-constrained provisioning for scientific workflow ensembles in iaas clouds," in Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC), 2012, pp. 22:1-22:11.
20. L. M. Leslie, Y. C. Lee, P. Lu, A. Y. Zomaya, "Exploiting performance and cost diversity in the cloud," in Proceedings of the 6th IEEE International Conference on Cloud Computing (CLOUD), 2013, pp. 107-114.
21. T. Oinn, M. J. Addis, et al., "Taverna: a tool for the composition and enactment of bioinformatics workflows," Bioinformatics, vol. 20, no. 17, pp. 3045-3054, 2004.
22. R. S. Barga, J. Jackson, N. Araujo, D. Guo, N. Gautam, Y. Simmhan, "The trident scientific workflow workbench," in Proceedings of 4th IEEE Conference on eScience, 2008, pp. 317-318.
23. B. Plale, E. C. Withana, C. Herath, K. Chandrasekar, Y. Luo, "Effectiveness of hybrid workflow systems for computational science," in Proceedings of the International Conference on Computational Science (ICCS), vol. 9, 2012, pp. 508-517.
24. M. Mao and M. Humphrey, "A performance study on the VM startup time in the cloud," in Proceedings of the 5th IEEE International Conference on Cloud Computing (CLOUD), 2012, pp. 423-430.