Performance characterization of hypervisor-and container-based virtualization for HPC on SR-IOV enabled infiniband clusters

Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016

Volumn , Issue , 2016, Pages 1777-1784

  Zhang, Jie ^a   Lu, Xiaoyi ^a   Panda, Dhabaleswar K ^a  

^a The Ohio State University   (United States)

Author keywords

Cloud Computing; Container; InfiniBand; PCI Passthrough; SR IOV; Virtualization

Indexed keywords

CLOUD COMPUTING; COMPUTER PERIPHERAL EQUIPMENT; CONTAINERS; DISTRIBUTED COMPUTER SYSTEMS; VIRTUAL REALITY;

COMPREHENSIVE EVALUATION; INFINIBAND; INFINIBAND CLUSTERS; PCI PASSTHROUGH; PERFORMANCE CHARACTERISTICS; PERFORMANCE CHARACTERIZATION; VIRTUALIZATIONS; VIRTUALIZED ENVIRONMENT;

BENCHMARKING;

EID: 84991702040     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPSW.2016.178     Document Type: Conference Paper

References (31)

1. "Amazon EC2," http://aws.amazon.com/ec2/.
2. "Chameleon," http://chameleoncloud.org/.
3. "NAS Parallel Benchmarks," http://www.nas.nasa. gov/Resources/Software/npb.html.
4. AMD-V, http://www.amd.com/br/products/technologies/virtualization/.
5. Docker, https://www.docker.com/.
6. Y. Dong, X. Yang, J. Li, G. Liao, K. Tian, and H. Guan, "High Performance Network Virtualization with SR-IOV," Journal of Parallel and Distributed Computing, 2012.
7. W. Felter, A. Ferreira, R. Rajamony, and J. Rubio, "An Updated Performance Comparison of Virtual Machines and Linux Containers," Tech. Rep. RC25482 (AUS1407-001), 2014.
8. W. Huang, J. Liu, B. Abali, and D. K. Panda, "A Case for High Performance Computing with Virtual Machines," in Proceedings of the 20th Annual International Conference on Supercomputing, ser. ICS '06, New York, NY, USA, 2006.
9. W. Huang, J. Liu, M. Koop, B. Abali, and D. Panda, "Nomad: Migrating OS-bypass Networks in Virtual Machines," in Proceedings of the 3rd International Conference on Virtual Execution Environments, ser. VEE '07, New York, NY, USA, 2007.
10. Z. Huang, R. Ma, J. Li, Z. Chang, and H. Guan, "Adaptive and Scalable Optimizations for High Performance SR-IOV," in Proceeding of 2012 IEEE International Conference Cluster Computing (CLUSTER). IEEE, 2012, pp. 459-467.
11. Intel Virtualization Technology, http://ark.intel.com/Products/VirtualizationTechnology.
12. J. Zhang, X. Lu, J. Jose, M. Li, R. Shi, D. K. Panda, "High Performance MPI Library over SR-IOV Enabled InfiniBand Clusters," in Proceedings of International Conference on High Performance Computing (HiPC), Goa, India, December 17-20 2014.
13. J. Zhang, X. Lu, J. Jose, R. Shi, D. K. Panda, "Can Inter-VM Shmem Benefit MPI Applications on SR-IOV based Virtualized InfiniBand Clusters?" in Proceedings of 20th International Conference Euro-Par 2014 Parallel Processing, Porto, Portugal, August 25-29 2014.
14. J. Jose, M. Li, X. Lu, K. Kandalla, M. Arnold, and D. Panda, "SR-IOV Support for Virtualization on InfiniBand Clusters: Early Experience," in On 13th IEEE/ACM International Symposium Cluster, Cloud and Grid Computing (CCGrid), May 2013, pp. 385-392.
15. Kernel-based Virtual Machine (KVM), http://www.linuxkvm. org/page/Main Page.
16. C. Kniep, "Containerization of High Performance Compute Workloads using Docker," Tech. Rep., 2014.
17. J. Liu, "Evaluating Standard-Based Self-Virtualizing Devices: A Performance Study on 10 GbE NICs with SR-IOV Support," in Proceeding of 2010 IEEE International Symposium Parallel &Distributed Processing (IPDPS). IEEE, 2010, pp. 1-12.
18. J. Liu, W. Huang, B. Abali, and D. K. Panda, "High Performance VMM-bypass I/O in Virtual Machines," in Proceedings of the Annual Conference on USENIX '06 Annual Technical Conference, ser. ATC '06, Berkeley, CA, USA, 2006.
19. qemu-kvm, http://wiki.qemu.org/KVM.
20. C. Ruiz, E. Jeanvoine, and L. Nussbaum, "Performance Evaluation of Containers for HPC," in 10th Workshop on Virtualization in High-Performance Cloud Computing (VHPC), Vienna, Austria, Aug 2015.
21. S. Plimpton, "Fast Parallel Algorithms for Short-Range Molecular Dynamics," J Comp Phys, 117, 1-19, 1995.
22. Single Root I/O Virtualization, http://www.pcisig. com/specifications/iov/single root
23. S. Soltesz, H. Pötzl, M. E. Fiuczynski, A. Bavier, and L. Peterson, "Container-based Operating System Virtualization: A Scalable, Highperformance Alternative to Hypervisors," in Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007, ser. EuroSys '07, Lisbon, Portugal, 2007, pp. 275-287. [Online]. Available: http://doi.acm.org/10.1145/1272996.1273025
24. SPEC MPI 2007, https://www.spec.org/mpi2007/.
25. The Graph500, http://www.graph500.org.
26. Top500 Supercomputing System, http://www.top500.org.
27. VMWare, http://www.vmware.com/.
28. M. Xavier, M. Neves, F. Rossi, T. Ferreto, T. Lange, and C. De Rose, "Performance Evaluation of Container-Based Virtualization for High Performance Computing Environments," in Parallel, Distributed and Network-Based Processing (PDP), 2013 21st Euromicro International Conference on, Belfast, Northern Ireland, Feb 2013, pp. 233-240.
29. Xen, http://www.xen.org/.
30. J. Zhang, X. Lu, M. Arnold, and D. Panda, "MVAPICH2 over Open-Stack with SR-IOV: An Efficient Approach to Build HPC Clouds," in Cluster, Cloud and Grid Computing (CCGrid), 2015 15th IEEE/ACM International Symposium on, May 2015, pp. 71-80.
31. Y. Zhou, B. Subramaniam, K. Keahey, and J. Lange, "Comparison of Virtualization and Containerization Techniques for High Performance Computing," in Proceedings of the 2015 ACM/IEEE conference on Supercomputing, Austin, USA, Nov 2015