High performance MPI library over SR-IOV enabled infiniband clusters

2014 21st International Conference on High Performance Computing, HiPC 2014

Volumn , Issue , 2014, Pages

  Zhang, Jie ^a   Lu, Xiaoyi ^a   Jose, Jithin ^a   Li, Mingzhe ^a   Shi, Rong ^a   Panda, Dhabaleswar K D K ^a  

^a The Ohio State University   (United States)

Author keywords

InfiniBand; IVShmem; MPI; SR IOV; Virtualization

Indexed keywords

DIGITAL LIBRARIES; MESSAGE PASSING; QUEUEING NETWORKS; VIRTUAL REALITY;

COMPREHENSIVE PERFORMANCE; EXPERIMENTAL EVALUATION; HIGH-PERFORMANCE DESIGN; INFINIBAND; INTER-NODE COMMUNICATION; IVSHMEM; MPI; VIRTUALIZATIONS;

BENCHMARKING;

EID: 84988299275     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HiPC.2014.7116876     Document Type: Conference Paper

References (19)

1. M. Rosenblum and T. Garfinkel, "Virtual Machine Monitors: Current Technology and Future Trends," Computer, Vol. 38, no. 5, pp. 39-47, 2005.
2. "Amazon EC2," http://aws.amazon.com/ec2/.
3. J. Jose, M. Li, X. Lu, K. Kandalla, M. Arnold, and D. Panda, "SR-IOV Support for Virtualization on InfiniBand Clusters: Early Experience," in On 13th IEEE/ACM International Symposium Cluster, Cloud and Grid Computing (CCGrid), May 2013, pp. 385-392.
4. MVAPICH2: High Performance MPI over InfiniBand and iWARP, http://mvapich.cse.ohio-state.edu/.
5. OpenMPI: Open Source High Performance Computing, http://www.open-mpi.org/.
6. Single Root I/O Virtualization, http://www.pcisig.com/specifications/iov/single-root.
7. A. C. Macdonell, "Shared-Memory Optimizations for Virtual Machines," PhD Thesis. University of Alberta, Edmonton, Alberta, Fall 2011.
8. J. Zhang, X. Lu, J. Jose, R. Shi, D. K. Panda, "Can Inter-VM Shmem Benefit MPI Applications on SR-IOV based Virtualized InfiniBand Clusters?" in Proceedings of 20th International Conference Euro-Par 2014 Parallel Processing (to be appear), Porto, Portugal, August 25-29 2014.
9. Infiniband Trade Association, http://www.infinibandta.org.
10. Y. Ren, L. Liu, Q. Zhang, Q. Wu, J. Yu, J. Kong, J. Guan, H. Dai, "Residency-Aware Virtual Machine Communication Optimization: Design Choices and Techniques," in Proceedings of IEEE 6th International Conference on Cloud Computing (Cloud 2013), Santa Clara Marriott, CA, USA, June 27-July 2 2013.
11. A. Menon, J. R. Santos, Y Turner, G. J. Janakiraman, and W. Zwaenepoel, "Diagnosing Performance Overheads in the Xen Virtual Machine Environment," in Proceedings of the 1st ACM/USENIX international conference on Virtual execution environments, ser. VEE'05. New York, NY, USA: ACM, 2005, pp. 13-23.
12. P. Apparao, S. Makineni, and D. Newell, "Characterization of Network Processing Overheads in Xen," in Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing, ser. VTDC'06. Washington, DC, USA: IEEE Computer Society, 2006.
13. J. Liu, "Evaluating Standard-Based Self-Virtualizing Devices: A Performance Study on 10 GbE NICs with SR-IOV Support," in Proceeding of 2010 IEEE International Symposium Parallel & Distributed Processing (IPDPS). IEEE, 2010, pp. 1-12.
14. Y. Dong, X. Yang, J. Li, G. Liao, K. Tian, and H. Guan, "High Performance Network Virtualization with SR-IOV," Journal of Parallel and Distributed Computing, 2012.
15. Z. Huang, R. Ma, J. Li, Z. Chang, and H. Guan, "Adaptive and Scalable Optimizations for High Performance SR-IOV," in Proceeding of 2012 IEEE International Conference Cluster Computing (CLUSTER). IEEE, 2012, pp. 459-467.
16. W. Huang, M. J. Koop, Q. Gao, and D. K. Panda, "Virtual Machine aware Communication Libraries for High Performance Computing," in Proceedings of the 2007 ACM/IEEE conference on Supercomputing, ser. SC'07. New York, NY, USA: ACM, 2007, pp. 9:1-9:12.
17. W. Huang, J. Liu, B. Abali, and D. K. Panda, "A Case for High Performance Computing with Virtual Machines," in Proceedings of the 20th Annual International Conference on Supercomputing, ser. ICS'06, New York, NY, USA, 2006.
18. J. Liu, W. Huang, B. Abali, and D. K. Panda, "High Performance VMM-bypass I/O in Virtual Machines," in Proceedings of the Annual Conference on USENIX'06 Annual Technical Conference, ser. ATC'06, Berkeley, CA, USA, 2006.
19. W. Huang, J. Liu, M. Koop, B. Abali, and D. Panda, "Nomad: Migrating OS-bypass Networks in Virtual Machines," in Proceedings of the 3rd International Conference on Virtual Execution Environments, ser. VEE'07, New York, NY, USA, 2007.