Ordinal optimized scheduling of scientific workflows in elastic compute clouds

Proceedings - 2011 3rd IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2011

Volumn , Issue , 2011, Pages 9-17

  Zhang, Fan ^a,b   Cao, Junwei ^a,b   Hwang, Kai ^b,c   Wu, Cheng ^a,b  

^a TSINGHUA UNIVERSITY   (China)

^b TSINGHUA NATIONAL LABORATORY FOR INFORMATION SCIENCE AND TECHNOLOGY   (China)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Cloud computing; Ordinal optimization; Virtual clustering; Workflow scheduling

Indexed keywords

AMAZON EC2; MONTE CARLO; MONTE CARLO SIMULATION; NP-HARD PROBLEM; OPTIMAL SCHEDULE; OPTIMIZED SCHEDULE; OPTIMIZED SCHEDULING; ORDINAL OPTIMIZATION; RELATIVE PERFORMANCE; SCIENTIFIC WORKFLOWS; SIMULATION-BASED; VIRTUAL CLUSTERING; VIRTUAL CLUSTERS; VIRTUAL MACHINES; WORK-FLOWS; WORKFLOW SCHEDULING;

CLOUD COMPUTING; COMPUTATIONAL COMPLEXITY; OPTIMIZATION; SCHEDULING; WEB SERVICES;

MONTE CARLO METHODS;

EID: 84863151018     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CloudCom.2011.12     Document Type: Conference Paper

References (22)

1. A. Abramovici, W. E. Althouse, et. al., "LIGO: The Laser Interferometer Gravitational-Wave Observatory", Science, Vol. 256, No. 5055, pp. 325 - 333, 1992.
2. P. Barham, and B. Dragovic, "Xen and the Art of Virtualization" , Proc. of 19th ACM symp. on Operating Systems Principles, Bolton Landing, NY, pp. 164-177, 2003. (Pubitemid 40929695)
3. A. Benoit, L. Marchal, J. Pineau, Y. Robert, F. Vivien. "Resource-aware Allocation Strategies for Divisible Loads on Large-scale Systems". Proc. of IEEE Int'l Parallel and Distributed Processing Symp.(IPDPS'09), Rome, Italy. 2009.
4. D. A. Brown, P. R. Brady, A. Dietz, J. Cao, B. Johnson, and J. McNabb, "A Case Study on the Use of Workflow Technologies for Scientific Analysis: Gravitational Wave Data Analysis", in Workflows for eScience: Scientific Workflows for Grids, Springer Verlag, pp. 39-59, 2007.
5. J. Cao, S. A. Jarvis, S. Saini and G. R. Nudd, "GridFlow: Workflow Management for Grid Computing", Proc. 3rd IEEE/ACM Int. Symp. on Cluster Computing and the Grid, Tokyo, Japan, 198-205, 2003.
6. A. Dogan, and F. Özgüner. "Biobjective Scheduling Algorithms for Execution Time-Reliability Trade-off in Heterogeneous Computing Systems". The Computer Journal, vol. 48, no.3, pp.300-314, 2005. (Pubitemid 40679527)
7. R. Duan, R. Prodan, and T. Fahringer, "Performance and Cost Optimization for Multiple Large-scale Grid Workflow Applications", Proc. of IEEE/ACM Int'l Conf. on SuperComputing (SC'07), Reno, 2007.
8. R. Freund, et al, "Scheduling Resources in Multi-user, Heterogeneous, Computing Environments with SmartNet", Proc. of the 7th Heterogenous Computing Workshop (HCW'98), Washington, DC, 1998.
9. Y. C. Ho, R. Sreenivas, and P. Vaklili, "Ordinal Optimization of Discrete Event Dynamic Systems", Journal of Discrete Event Dynamic Systems, Vol. 2, No. 2, pp.61-88, 1992.
10. Y. C. Ho, Q. C. Zhao, and Q. S. Jia. Ordinal Optimization, Soft Optimization for Hard problems. Springer, 2007.
11. K.. Hwang, G. Fox, and J. Dongarra, Distributed and Cloud Computing Systems:, Grids,Clouds, and The Future Internet, Morgan Kauffmann, 2011
12. H. Li and R. Buyya, "Model-driven Simulation of Grid Scheduling Strategies", Proc. of 3rd IEEE Int'l Conf. on e- Science and Grid Computing, 2007.
13. K. Lu, and A. Y. Zomaya, "A Hybrid Schedule for Job Scheduling and Load Balancing in Heterogeneous Computational Grids," IEEE Int'l Parallel & Distributed Processing Symp., July 5-8, pp. 121-128, Austria.
14. N. Metropolis and S. Ulam, "The Monte Carlo Method", Journal of the American Statistical Association, 44 (247), pp.335-341, 1949.
15. R. Prodan and M. Wieczorek, "Bi-criteria Scheduling of Scientific Grid Workflows". IEEE Trans. on Automation Science and Engineering, 2009.
16. R. Subrata, A. Y. Zomaya, and B. Landfeldt, "A Cooperative Game Framework for QoS Guided Job Allocation Schemes in Grids," IEEE Trans. on Computers, Vol. 57, No. 10, pp. 1413-1422, 2008.
17. S. Teng, L. H. Lee, and E. P.Chew, "Multi-objective Ordinal Optimization for Simulation Optimization Problems", Automatica, pp.1884-1895, 2007. (Pubitemid 47576051)
18. M. Wieczorek, R. Prodan, and A. Hoheisel, "Taxonomies of the Multi-criteria Grid Workflow Scheduling Problem" CoreGRID, TR6-0106, 2007
19. K. Xu, J. Cao, L. Liu, and C. Wu. "Performance Optimization of Temporal Reasoning for Grid Workflows Using Relaxed Region Analysis". Proc. of the 2nd IEEE Int. Conf. on Advanced Information Networking and Applications Workshops, Okinawa, Japan, pp.187-194, 2008.
20. F. Zhang, J. Cao, L. Liu, and C. Wu, "Fast Autotuning Configurations of Parameters in Distributed Computing Systems Using Ordinal Optimization", Proc. 38th Int. Conf. on Parallel Processing Workshops, Vienna, 190-197, 2009.
21. F. Zhang, J. Cao, X. Song, H. Cai, and C. Wu, "AMREF: An Adaptive MapReduce Framework for Real Time Applications", Proc. of 9th Int. Conf. on Grid and Cloud Computing (GCC'10), China, 2010.
22. Q. C. Zhao, Y. C. Ho, and Q. S. Jia. Vector Ordinal Optimization", Journal of Optimization Theory and Applications, Vol. 125, No. 2, pp. 259-274, May 2005. (Pubitemid 40572570)