Priority-based consolidation of parallel workloads in the cloud

IEEE Transactions on Parallel and Distributed Systems

Volumn 24, Issue 9, 2013, Pages 1874-1883

  Liu, Xiaocheng ^a   Wang, Chen ^b   Zhou, Bing Bing ^c   Chen, Junliang ^c   Yang, Ting ^d   Zomaya, Albert Y ^c  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^b CSIRO   (Australia)

^c UNIVERSITY OF SYDNEY   (Australia)

^d TIANJIN UNIVERSITY   (China)

Author keywords

Cloud computing; Parallel computing; Parallel discrete event simulation; Parallel job scheduling; Resource consolidation

Indexed keywords

COMMUNICATION AND SYNCHRONIZATIONS; COMPLEX APPLICATIONS; PARALLEL APPLICATION; PARALLEL DISCRETE EVENT SIMULATIONS; PARALLEL JOB SCHEDULING; PARALLEL SCHEDULING ALGORITHMS; RESOURCE CONSOLIDATION; VIRTUALIZATION TECHNOLOGIES;

CLOUD COMPUTING; DISCRETE EVENT SIMULATION; PARALLEL ARCHITECTURES; PARALLEL PROCESSING SYSTEMS; SCHEDULING ALGORITHMS;

SCHEDULING;

EID: 84881159142     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2012.262     Document Type: Article

References (28)

1. "High Performance Computing (HPC) on AWS,"Amazon Inc., http://aws.amazon.com/hpc-applications/, 2011.
2. L. Barroso and U. Holzle, "The Case for Energy-Proportional Computing," Computer, vol. 40, no. 12, pp. 33-37, Dec. 2007.
3. J. Hamilton, "Cloud Computing Economies of Scale," Proc. AWS Genomics Cloud Computing Workshop, http://www.mvdirona. com/jrh/TalksAndPapers/ JamesHamilton-GenomicsCloud 20100608.pdf, 2010.
4. D. Feitelson, A Survey of Scheduling in Multiprogrammed Parallel Systems. IBM TJ Watson Research Center, 1994.
5. D. Feitelson and B. Nitzberg, "Job Characteristics of a Production Parallel Scientific Workload on the Nasa Ames ipsc/860," Proc. Workshop Job Scheduling Strategies for Parallel Processing, pp. 337-360, 1995.
6. J. Jones and B. Nitzberg, "Scheduling for Parallel Supercomputing: A Historical Perspective of Achievable Utilization," Proc. Workshop Job Scheduling Strategies for Parallel Processing, pp. 1-16, 1999.
7. L.G. Valiant, "A Bridging Model for Parallel Computation," Comm. ACM, vol. 33, no. 8, pp. 103-111, 1990.
8. U. Schwiegelshohn and R. Yahyapour, "Analysis of First-Come- First-Serve Parallel Job Scheduling," Proc. Ninth Ann. ACM-SIAM Symp. Discrete Algorithms, pp. 629-638, 1998.
9. D. Lifka, "The Anl/Ibm SP Scheduling System," Proc. Workshop Job Scheduling Strategies for Parallel Processing, pp. 295-303, 1995.
10. D. Feitelson and M. Jettee, "Improved Utilization and Responsiveness with Gang Scheduling," Proc. Workshop Job Scheduling Strategies for Parallel Processing, pp. 238-261, 1997. (Pubitemid 127119065)
11. Y. Lin, "Parallelism Analyzers for Parallel Discrete Event Simulation," ACM Trans. Modeling and Computer Simulation, vol. 2, no. 3, pp. 239-264, 1992.
12. Z. Juhasz, S. Turner, K. Kuntner, and M. Gerzson, "A Performance Analyser and Prediction Tool for Parallel Discrete Event Simulation," J. Simulation, vol. 4, no. 1, pp. 7-22, 2003.
13. R. Fujimoto, "Parallel and Distributed Simulation," Proc. 31st Conf. Winter Simulation: Simulation - A Bridge to the Future, vol. 1, pp. 122-131, 1999. (Pubitemid 30574748)
14. A. Malik, A. Park, and R. Fujimoto, "Optimistic Synchronization of Parallel Simulations in Cloud Computing Environments," Proc. IEEE Int'l Conf. Cloud Computing (CLOUD '09), pp. 49-56, 2009.
15. R. Fujimoto, A. Malik, and A. Park, "Parallel and Distributed Simulation in the Cloud," Int'l Simulation Magazine, Soc. for Modeling and Simulation, vol. 1, no. 3, 2010.
16. G. D'Angelo, "Parallel and Distributed Simulation from Many Cores to the Public Cloud," Proc. Int'l Conf. High Performance Computing and Simulation (HPCS), pp. 14-23, 2011.
17. Y. Etsion and D. Tsafrir, "A Short Survey of Commercial Cluster Batch Schedulers," Technical Report 2005-13, The Hebrew Univ. of Jerusalem, May 2005.
18. A. Mu'alem and D. Feitelson, "Utilization, Predictability, Workloads, and User Runtime Estimates in Scheduling the IBM sp2 with Backfilling," IEEE Trans. Parallel and Distributed Systems, vol. 12, no. 6, pp. 529-543, June 2001. (Pubitemid 32611060)
19. D. Jackson, Q. Snell, and M. Clement, "Core Algorithms of the Maui Scheduler," Proc. Workshop Job Scheduling Strategies for Parallel Processing, pp. 87-102, 2001. (Pubitemid 33361887)
20. Y. Wiseman and D. Feitelson, "Paired Gang Scheduling," IEEE Trans. Parallel and Distributed Systems, vol. 14, no. 6, pp. 581-592, June 2003.
21. A. Do, J. Chen, C. Wang, Y. Lee, A. Zomaya, and B. Zhou, "Profiling Applications for Virtual Machine Placement in Clouds," Proc. IEEE Int'l Conf. Cloud Computing (CLOUD), pp. 660-667, 2011.
22. Y. Zhang, H. Franke, J. Moreira, and A. Sivasubramaniam, "An Integrated Approach to Parallel Scheduling Using Gang-Scheduling, Backfilling, and Migration," IEEE Trans. Parallel and Distributed Systems, vol. 14, no. 3, pp. 236-247, Mar. 2003.
23. D. Tsafrir, Y. Etsion, and D. Feitelson, "Backfilling Using System- Generated Predictions Rather than User Runtime Estimates," IEEE Trans. Parallel and Distributed Systems, vol. 18, no. 6, pp. 789-803, June 2007. (Pubitemid 46767742)
24. D. Feitelson, "Packing Schemes for Gang Scheduling," Proc. Workshop Job Scheduling Strategies for Parallel Processing, pp. 89-110, 1996.
25. J. Jann, P. Pattnaik, H. Franke, F. Wang, J. Skovira, and J. Riordan, "Modeling of Workload in Mpps," Proc. Workshop Job Scheduling Strategies for Parallel Processing, pp. 95-116, 1997. (Pubitemid 127119059)
26. D. Feitelson, L. Rudolph, U. Schwiegelshohn, K. Sevcik, and P. Wong, "Theory and Practice in Parallel Job Scheduling," Proc. Workshop Job Scheduling Strategies for Parallel Processing, pp. 1-34, 1997. (Pubitemid 127119055)
27. E. Von Puttkamer, "A Simple Hardware Buddy System Memory Allocator," IEEE Trans. Computers, vol. C-100, no. 10, pp. 953-957, Oct. 1975.
28. K. Knowlton, "A Fast Storage Allocator," Comm. ACM, vol. 8, no. 10, pp. 623-624, 1965