Resource management for elastic cloud workflows

Proceedings - 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2012

Volumn , Issue , 2012, Pages 775-780

  Yu, Li ^a   Thain, Douglas ^a  

^a UNIVERSITY OF NOTRE DAME   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARBITRARY NUMBER; COMPUTING SYSTEM; DISTRIBUTED APPLICATIONS; FLEXIBLE RESOURCES; GENERAL PURPOSE ARCHITECTURES; RESOURCE MANAGEMENT; RESOURCE MANAGEMENT PROBLEMS; RUN-TIME MEASUREMENT; WORK-FLOWS;

COMPUTER SYSTEMS; GRID COMPUTING; NATURAL RESOURCES MANAGEMENT;

RESOURCE ALLOCATION;

EID: 84863660159     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2012.107     Document Type: Conference Paper

References (16)

1. D. Thain, C. Moretti, S. Ahson, and M. Ilyas Abstractions for Cloud Computing with Condor In Cloud Computing and Software Services: Theory and Techniques, pp. 153-171, CRC Press, July, 2010. ISBN: 9781439803158.
2. L. Yu, C. Moretti, A. Thrasher, S. Emrich, K. Judd, and D. Thain Harnessing Parallelism in Multicore Clusters with the All-Pairs, Wavefront, and Makeflow Abstractions. In Journal of Cluster Computing, 13(3), pp. 243-256, September 2010.
3. R. Carmichael, P. Braga-Henebry, D. Thain, and S. Emrich Biocompute 2.0: an improved collaborative workspace for data instensive bio-science In Concurrency and Computation: Pratice and Experience, June 2011.
4. J. Dean, and S. Ghemawat MapReduce: Simplified Data Processing on Large Clusters In OSDI '04: 6th Symposium on Operating Systems Design and Implementation, pp. 137-150, 2004.
5. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly Dryad: distributed data-parallel programs from sequential building blocks In EuroSys '07: Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems, pp. 59-72, 2007.
6. W. Gentzsch. Sun grid engine: Towards creating a compute power grid. In CCGRID '01: Proceedings of the 1st International Symposium on Cluster Computing and the Grid, 2001.
7. Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2/
8. S. Zhou, X. Zheng, J. Wang, and P. Delisle. Utopia: a load sharing facility for large, heterogenous distributed computer systems. In Software: Practice and Experience, 1993.
9. E. Deelman, G. Singh, M.-H. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, B. Berriman, J. Good, A. Laity, J. Jacob, and D. Katz. Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Scientific Programming Journal, 13(3), 2005.
10. D. Hull, K. Wolstencroft, R. Stevens, C. Goble, M. Pocock, P. Li, and T. Oinn. Taverna: a tool for building and running workflows of services. In Nucleic Acids Research, vol. 34, no. Web Server issue, pp. 729732
11. I. Altintas, C. Berkley, E. Jaeger, M. Jones, B. Ludascher, and S. Mock, Kepler: An extensible system for design and execution of scientific work-flows. In Scientific and Statistical Database Management. Proceedings. 16th International Conference on, IEEE, pp. 423-424, 2004
12. J. Goecks, A. Nekrutenko, J. Taylor et al. Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. In Genome biology, vol. 11, no. 8, p. R86, 2010
13. D. Thain, T. Tannenbaum, and M. Livny. Condor and the grid. In F. Berman, G. Fox, and T. Hey, editors, Grid Computing: Making the Global Infrastructure a Reality. John Wiley, 2003.
14. J. Linderoth, S. Kulkarni, J. Goux, and M. Yoder. An Enabling Framework for Master-Worker Applications on the Computational Grid. IEEE High Performance Distributed Computing, pp. 43-50, 2000
15. J. Frey, T. Tannenbaum, I. Foster, M. Livny, and S. Tuecke". Condor-G: A Computation Management Agent for Multi-Institutional Grids. In IEEE High Performance Distributed Computing, 2001
16. I. Raicu, Y. Zhao, C. Dumitrescu, I. Foster, and M. Wilde. Falkon: a Fast and Light-weight tasK executiON framework. In IEEE/ACM Supercomputing, 2007.