Cost-efficient coordinated scheduling for leasing cloud resources on hybrid workloads

Parallel Computing

Volumn 44, Issue , 2015, Pages 1-17

  Li, Jian ^a   Su, Sen ^b   Cheng, Xiang ^b   Song, Meina ^b   Ma, Liyu ^c   Wang, Jie ^d  

^a TSINGHUA UNIVERSITY   (China)

^b BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^c Carnegie Mellon University   (United States)

^d University of Massachusetts Lowell   (United States)

Author keywords

Batch jobs; Cloud computing; Cost efficient; Interactive services

Indexed keywords

ALGORITHMS; CLOUD COMPUTING; COST BENEFIT ANALYSIS; COSTS; ECONOMICS; SCHEDULING;

BATCH JOBS; CLOUD SERVICE PROVIDERS; COORDINATED SCHEDULING; COST-EFFICIENT; INTERACTIVE SERVICES; PRIORITY FUNCTIONS; RESIDUAL RESOURCE; SERVICE RESPONSE TIME;

SCHEDULING ALGORITHMS;

EID: 84924767064     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2015.02.003     Document Type: Article

References (45)

1. Amazon webservices, 〈http://www.aws.amazon.com/ec2〉.
2. Windows azure, 〈http://www.windowsazure.com/en-us/〉.
3. Ulticloud, 〈https://ulticloud.com/〉.
4. X. Cheng, S. Su, Z. Zhang, H. Wang, F. Yang, Y. Luo, and J. Wang Virtual network embedding through topology-aware node ranking ACM SIGCOMM Comput. Commun. Rev. 41 2 2011 38 47
5. A.K. Wonga, and A.M. Goscinskia A unified framework for the deployment, exposure and access of HPC applications as services in clouds Fut. Gener. Comput. Syst. 29 6 2013 1333 1344
6. Z. Li, C. Jin, T. Xu, C. Wilson, Y. Liu, L. Cheng, Y. Liu, Y. Dai, Z.-L. Zhang, Towards network-level efficiency for cloud storage services, in: 14th ACM Internet Measurement Conference (IMC), 2014.
7. Z. Li, C. Wilson, Z. Jiang, Y. Liu, B.Y. Zhao, C. Jin, Z.-L. Zhang, and Y. Dai Efficient batched synchronization in dropbox-like cloud storage services in: Middleware 2013 2013 Springer 307 327
8. K. Le, R. Bianchini, J. Zhang, Y. Jaluria, J. Meng, and T. Nguyen Reducing electricity cost through virtual machine placement in high performance computing clouds in: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis 2011 ACM 22 34
9. Y. Chen, S. Alspaugh, D. Borthakur, and R. Katz Energy efficiency for large-scale mapreduce workloads with significant interactive analysis in: Proceedings of the 7th ACM European Conference on Computer Systems 2012 ACM 43 56
10. Q. Zhu, and G. Agrawal Resource provisioning with budget constraints for adaptive applications in cloud environments IEEE Trans. Services Comput. 5 4 2012 497 511
11. M. Mao, and M. Humphrey Auto-scaling to minimize cost and meet application deadlines in cloud workflows 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC) 2011 IEEE 1 12
12. M. Malawski, G. Juve, E. Deelman, and J. Nabrzyski Cost-and deadline-constrained provisioning for scientific workflow ensembles in iaas clouds in: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis 2012 IEEE Computer Society Press 22 34
13. Y. He, Z. Ye, Q. Fu, and S. Elnikety Budget-based control for interactive services with adaptive execution in: Proceedings of the 9th International Conference on Autonomic Computing 2012 ACM 105 114
14. H. Zhao, M. Pan, X. Liu, X. Li, and Y. Fang Optimal resource rental planning for elastic applications in cloud market in: Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium 2012 IEEE 808 819
15. R. Duan, R. Prodan, and X. Li A sequential cooperative game theoretic approach to scheduling multiple large-scale applications in grids Fut. Gener. Comput. Syst. 30 2014 27 43
16. K. Kurowski, A. Oleksiak, W. Piatek, and J. Weglarz Hierarchical scheduling strategies for parallel tasks and advance reservations in grids J. Schedul. 16 4 2013 349 368
17. Latency - it costs you, 〈http://highscalability.com/latency-everywhere-and-it-costs-you-sales-how-crush-it〉.
18. Z. Shen, S. Subbiah, X. Gu, and J. Wilkes Cloudscale: elastic resource scaling for multi-tenant cloud systems in: Proceedings of the 2nd ACM Symposium on Cloud Computing 2011 ACM 5 17
19. Z. Liu, Y. Chen, C. Bash, A. Wierman, D. Gmach, Z. Wang, M. Marwah, and C. Hyser Renewable and cooling aware workload management for sustainable data centers ACM SIGMETRICS Performance Evaluation Review vol. 40 2012 ACM 175 186
20. Web caching project, 〈https://www.ircache.net〉.
21. Workloads archive, 〈http://gwa.ewi.tudelft.nl/pmwiki/〉.
22. Workflow generator, 〈https://confluence.pegasus.isi.edu/display/pegasus/WorkflowGenerator〉.
23. L. Sha, X. Liu, Y. Lu, and T. Abdelzaher Queueing model based network server performance control in: 23rd IEEE Real-Time Systems Symposium, 2002 (RTSS 2002) 2002 IEEE 81 90
24. X. Liu, J. Heo, L. Sha, and X. Zhu Adaptive control of multi-tiered web applications using queueing predictor in: 10th IEEE/IFIP Network Operations and Management Symposium, 2006 (NOMS 2006) 2006 IEEE 106 114
25. H. Topcuoglu, S. Hariri, and M.-Y. Wu Performance-effective and low-complexity task scheduling for heterogeneous computing IEEE Trans. Parallel Distrib. Syst. 13 3 2002 260 274
26. A. Hirales-Carbajal, A. Tchernykh, R. Yahyapour, J.L. González-García, T. Röblitz, and J.M. Ramírez-Alcaraz Multiple workflow scheduling strategies with user run time estimates on a grid J. Grid Comput. 10 2 2012 325 346
27. J. Yu, R. Buyya, and C. Tham Cost-based scheduling of scientific workflow applications on utility grids in: First International Conference on e-Science and Grid Computing, 2005 2005 IEEE 8 16
28. H.M. Fard, R. Prodan, and T. Fahringer A truthful dynamic workflow scheduling mechanism for commercial multi-cloud environments IEEE Trans. Parallel Distrib. Syst. 24 6 2013 1203 1212
29. Y. Lee, C. Wang, A. Zomaya, and B. Zhou Profit-driven service request scheduling in clouds in: Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing 2010 IEEE Computer Society 15 24
30. Y. Song, M. Zafer, and K. Lee Optimal bidding in spot instance market in: 2012 Proceedings IEEE INFOCOM 2012 IEEE 190 198
31. Q. Zhang, Q. Zhu, and R. Boutaba Dynamic resource allocation for spot markets in cloud computing environments in: 2011 Fourth IEEE International Conference on Utility and Cloud Computing (UCC) 2011 IEEE 178 185
32. Q. Huang, K. Shuang, P. Xu, J. Li, X. Liu, and S. Su Prediction-based dynamic resource scheduling for virtualized cloud systems J. Netw. 9 2 2014 375 383
33. Cloud exchange, 〈http://cloudexchange.org/〉.
34. S. Yi, A. Andrzejak, and D. Kondo Monetary cost-aware checkpointing and migration on amazon cloud spot instances IEEE Trans. Services Comput. 5 4 2011 512 524
35. B. Urgaonkar, G. Pacifici, P. Shenoy, M. Spreitzer, and A. Tantawi An analytical model for multi-tier internet services and its applications ACM SIGMETRICS Performance Evaluation Review vol. 33 2005 ACM 291 302
36. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly Dryad: distributed data-parallel programs from sequential building blocks ACM SIGOPS Oper. Syst. Rev. 41 3 2007 59 72
37. B. Reistad, and D.K. Gifford Static Dependent Costs for Estimating Execution Time vol. 7 1994 ACM
38. D.A. Menascé, S. Bardhan, Epochs: trace-driven analytical modeling of job execution times, Technical Report GMUCS-TR-2014-01, Computer Science Department, George Mason University, 2014.
39. M. Quade, M. Halbrügge, K.-P. Engelbrecht, S. Albayrak, and S. Möller Predicting task execution times by deriving enhanced cognitive models from user interface development models in: Proceedings of the 2014 ACM SIGCHI Symposium on Engineering Interactive Computing Systems 2014 ACM 139 148
40. G. Box, G. Jenkins, Time series analysis, forecasting and control, in: Holden-Day, Incorporated, 1990.
41. B. Javadi, R. Thulasiramy, and R. Buyya Statistical modeling of spot instance prices in public cloud environments in: 2011 Fourth IEEE International Conference on Utility and Cloud Computing (UCC) 2011 IEEE 219 228
42. S. Abrishami, M. Naghibzadeh, and D. Epema Cost-driven scheduling of grid workflows using partial critical paths IEEE Trans. Parallel Distrib. Syst. 23 8 2012 1400 1414
43. S. Su, J. Li, Q. Huang, X. Huang, K. Shuang, and J. Wang Cost-efficient task scheduling for executing large programs in the cloud Parallel Comput. 39 4-5 2013 177 188
44. R. Calheiros, R. Ranjan, A. Beloglazov, C. De Rose, and R. Buyya Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms Softw.: Pract. Exp. 41 1 2011 23 50
45. S. Bharathi, A. Chervenak, E. Deelman, G. Mehta, M. Su, and K. Vahi Characterization of scientific workflows in: Third Workshop on Workflows in Support of Large-Scale Science, 2008 (WORKS 2008) 2008 IEEE 1 10