Improving HPC application performance in cloud through dynamic load balancing

Proceedings - 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2013

Volumn , Issue , 2013, Pages 402-409

  Gupta, Abhishek ^a   Sarood, Osman ^a   Kale, Laxmikant V ^a   Milojicic, Dejan ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Cloud; High Performance Computing; Load balance

Indexed keywords

APPLICATION PERFORMANCE; COMPUTATIONAL GRANULARITY; EXPERIMENTAL EVALUATION; HIGH PERFORMANCE COMPUTING; HIGH PERFORMANCE COMPUTING (HPC); LOAD-BALANCE; PERFORMANCE AND SCALABILITIES; VIRTUALIZED ENVIRONMENT;

CLOUDS; DYNAMIC LOADS; ELASTICITY; GRID COMPUTING; ITERATIVE METHODS; NETWORK MANAGEMENT; SUPERCOMPUTERS; VIRTUAL REALITY;

BENCHMARKING;

EID: 84881307424     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2013.65     Document Type: Conference Paper

References (26)

1. "Amazon Elastic Compute Cloud, " http://aws.amazon.com/ec2.
2. E. Walker, "Benchmarking Amazon EC2 for High-Performance Scientific Computing, " LOGIN, pp. 18-23, 2008.
3. A. Iosup et al., "Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing, " Parallel and Distributed Systems, IEEE Transactions on, vol. 22, no. 6, pp. 931 -945, june 2011.
4. "Magellan Final Report, " U.S. Department of Energy (DOE), Tech. Rep., 2011, http://science.energy.gov/∼/media/ascr/pdf/program- documents/docs/MagellanFinalReport.pdf.
5. A. Gupta and D. Milojicic, "Evaluation of HPC Applications on Cloud, " in Open Cirrus Summit (Best Student Paper), Atlanta, GA, Oct. 2011, pp. 22 -26. [Online]. Available: http://dx.doi.org/10.1109/OCS.2011.10.
6. "HPC on AWS, " http://aws.amazon.com/hpc-applications.
7. "Nova Scheduling Adaptations, " http://xlcloud.org/bin/ download/Download/Presentations/Workshop26072012Scheduler.pdf.
8. A. Gupta, L. Kale, D. Milojicic, P. Faraboschi, and S. Balle, "HPCAware VM Placement in Infrastructure Clouds, " in IEEE Intl. Conf. on Cloud Engineering IC2E '13, march. 2013.
9. P. Fan, Z. Chen, J. Wang, Z. Zheng, and M. R. Lyu, "Topology-Aware Deployment of Scientific Applications in Cloud Computing, " Cloud Computing, IEEE International Conference on, vol. 0, 2012.
10. O. Sarood, A. Gupta, and L. V. Kale, "Cloud Friendly Load Balancing for HPC Applications: Preliminary Work, " in Parallel Processing Workshops (ICPPW), 2012 41st Intl. Conf. on, sept. 2012, pp. 200 -205.
11. L. Kale and S. Krishnan, "Charm++: A Portable Concurrent Object Oriented System Based on C++, " in OOPSLA, September 1993.
12. L. V. Kale and G. Zheng, "Charm++ and AMPI: Adaptive Runtime Strategies via Migratable Objects, " in Advanced Computational Infrastructures for Parallel and Distributed Applications, M. Parashar, Ed. Wiley-Interscience, 2009, pp. 265-282.
13. "MPI: A Message Passing Interface Standard, " in M. P. I. Forum, 1994.
14. A. Avetisyan et al., "Open Cirrus: A Global Cloud Computing Testbed, " IEEE Computer, vol. 43, pp. 35-43, April 2010.
15. L. Kalé and A. Sinha, "Projections : A Scalable Performance Tool, " in Parallel Systems Fair, Intl. Parallel Processing Symposium, Apr. 1993.
16. "NAS Parallel Benchmarks, " http://www.nas.nasa.gov/Resources/ Software/npb.html.
17. A. Bhatele, S. Kumar, C. Mei, J. C. Phillips, G. Zheng, and L. V. Kale, "Overcoming Scaling Challenges in Biomolecular Simulations across Multiple Platforms, " in IPDPS 2008, April 2008, pp. 1-12.
18. "OpenStack Cloud Computing Software, " http://openstack.org.
19. "KVM - Kernel-based Virtual Machine, " Redhat, Inc., Tech. Rep., 2009.
20. A. J. Younge et al., "Analysis of Virtualization Technologies for High Performance Computing Environments, " Cloud Computing, IEEE Intl. Conf. on, vol. 0, pp. 9-16, 2011.
21. A. Gupta, D. Milojicic, and L. Kale, "Optimizing VM Placement for HPC in Cloud, " in Workshop on Cloud Services, Federation and the 8th Open Cirrus Summit, San Jose, CA, 2012.
22. T. Sterling and D. Stark, "A High-Performance Computing Forecast: Partly Cloudy, " Computing in Sci. and Engg., pp. 42-49, Jul. 2009.
23. G. Zheng, "Achieving High Performance on Extremely Large Parallel Machines: Performance Prediction and Load Balancing, " Ph.D. dissertation, Dept. of CS, Univ. of Illinois at Urbana-Champaign, 2005.
24. O. Sukwong and H. S. Kim, "Is co-scheduling too expensive for smp vms?" ser. EuroSys '11. NY, USA: ACM, 2011, pp. 257-272.
25. R. K. Brunner and L. V. Kalé, "Adapting to Load on Workstation Clusters, " in 7th Symposium on the Frontiers of Massively Parallel Computation. IEEE Computer Society Press, Feb. 1999, pp. 106-112.
26. D. Brown et al., "Scientific Grand Challenges: Crosscutting Technologies for Computing at the Exascale." U.S. DOE PNNL 20168, Report from Workshop on Feb. 2-4, 2010, Washington, DC, Tech. Rep., 2011.