Evaluating standard-based self-virtualizing devices: A performance study on 10 GbE NICs with SR-IOV support

Proceedings of the 2010 IEEE International Symposium on Parallel and Distributed Processing, IPDPS 2010

Volumn , Issue , 2010, Pages

  Liu, Jiuxing ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

10 Gigabit Ethernet; KVM; virtio; Virtual machine; Virtualization; VM; I O; SR IOV

Indexed keywords

10-GIGABIT ETHERNET; 10-GIGABIT ETHERNET (10-GBE); CHECK POINTING; CPU CYCLES; CPU UTILIZATION; HIGH-SPEED NETWORKING; LINE RATE; MEMORY ACCESS; MULTIPLE PROCESSORS; NATIVE SYSTEM; NETERION; PCI EXPRESS; PERFORMANCE BENEFITS; PERFORMANCE DEGRADATION; PERFORMANCE EVALUATION; PERFORMANCE ISSUES; PERFORMANCE METRICS; PERFORMANCE STUDY; SINGLE PROCESSORS; SOFTWARE-BASED; SPECIAL HARDWARE; VIRTUAL DEVICES; VIRTUAL MACHINE TECHNOLOGY; VIRTUAL MACHINES; VIRTUALIZATIONS; VIRTUALIZED ENVIRONMENT;

COMPUTER SIMULATION; COMPUTER SOFTWARE; DISTRIBUTED PARAMETER NETWORKS; TELECOMMUNICATION NETWORKS;

ETHERNET;

EID: 77953995401     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2010.5470365     Document Type: Conference Paper

References (36)

1. R. P. Goldberg, "Survey of Virtual Machine Research," IEEE Computer, pp. 34-45, June 1974.
2. M. Rosenblum and T. Garfinkel, "Virtual Machine Monitors: Current Technology and Future Trends," IEEE Computer, vol.38, no.5, pp. 39-47, 2005.
3. A. Whitaker, M. Shaw, and S. D. Gribble, "Scale and Performance in the Denali Isolation Kernel," in Proceedings of 5th USENIX OSDI, Boston, MA, Dec 2002.
4. B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, I. Pratt, A. Warfield, P. Barham, and R. Neugebauer, "Xen and the Art of Virtualization," in Proceedings of the ACM Symposium on Operating Systems Principles, October 2003, pp. 164-177.
5. K. Adams and O. Agesen, "A Comparison of Software and Hardware Techniques for x86 Virtualization," Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 2-13, 2006.
6. R. Uhlig, G. Neiger, D. Rodgers, A. Santoni, F. Martins, A. Anderson, S. Bennett, A. Kagi, F. Leung, and L. Smith, "Intel Virtualization Technology," IEEE Computer, May 2005.
7. AMD, "AMD Secure Virtual Machine Architecture Reference Manual, Rev. 3.01," May 2005.
8. J. Sugerman, G. Venkitachalam, and B. H. Lim, "Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor," in Proceedings of USENIX, 2001.
9. A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori, "kvm: the Linux Virtual Machine Monitor," Linux Symposium, 2006.
10. A. Menon, J. R. Santos, Y. Turner, G. Janakiraman, and W. Zwaenepoel, "Diagnosing Performance Overheads in the Xen Virtual Machine Environment," in Proceedings of the First ACM/Usenix Conference on Virtual Execution Environments (VEE'05), June 2005.
11. A. Menon, A. Cox, and W. Zwaenepoel, "Optimizing Network Virtualization in Xen," Proc. USENIX Annual Technical Conference (USENIX 2006), pp. 15-28, 2006.
12. J. R. Santos, Y. Turner, G. Janakiraman, and I. Pratt, "Bridging the Gap between Software and Hardware Techniques for I/O Virtualization," Proc. USENIX Annual Technical Conference (USENIX 2008), 2008.
13. A. Menon and W. Zwaenepoel, "Optimizing TCP Receive Performance," Proc. USENIX Annual Technical Conference (USENIX 2008), 2008.
14. J. Liu, W. Huang, B. Abali, and D. Panda, "High Performance VMM-Bypass I/O in Virtual Machines," Proc. of USENIX Annual Technical Conference, 2006.
15. H. Raj and K. Schwan, "High Performance and Scalable I/O Virtualization via Self-Virtualized Devices," Proceedings of the 16th International Symposium on High Performance Distributed Computing, pp. 179-188, 2007.
16. P. Willmann, J. Shafer, D. Carr, A. Menon, S. Rixner, A. Cox, and W. Zwaenepoel, "Concurrent Direct Network Access for Virtual Machine Monitors," Proceedings of the International Symposium on High-Performance Computer Architecture, Feb, 2007.
17. PCI-SIG, "PCI I/O Virtualization," http://www.pcisig.com/ speciflcations/iov/.
18. P. Willmann, S. Rixner, and A. L. Cox, "Protection Strategies for Direct Access to Virtualized I/O Devices," Proc. USENIX Annual Technical Conference (USENIX 2008), 2008.
19. M. Ben-Yehuda, J. Xenidis, M. Mostrows, K. Rister, A. Bruemmer, and L. Van Doorn, "The Price of Safety: Evaluating IOMMU Performance," OLS 2007: Proceedings of the 2007 Ottawa Linux Symposium.
20. Neterion, "Neterion X3100 10GbE NICs," http://www.neterion.com/ products/x3100.html.
21. B.-A. Yassour, M. Ben-Yehuda, and O. Wasserman, "Direct Device Assignment for Untrusted Fully-Virtualized Virtual Machines," IBM Research Report H-0263, IBM Research, Tech. Rep., 2008.
22. K. Fraser, S. Hand, R. Neugebauer, I. Pratt, A. W. and M. Williamson, "Safe Hardware Access with the Xen Virtual Machine Monitor," in Proceedings of OASIS ASPLOS Workshop, 2004.
23. R. Russell, "virtio: Towards a de facto Standard for Virtual I/O Devices," SIGOPS Operating System Review, vol.42, no.5, pp. 95-103, 2008.
24. R. Hiremane, "Intel Virtualization Technology for Directed I/O (Intel VT-d)," Technology@Intel Magazine, vol.4, no.10, 2007.
25. Q. Snell, A. Mikler, and J. Gustafson, "NetPIPE: A Network Protocol Independent Performance Evaluator," IASTED International Conference on Intelligent Information Management and Systems, vol.6, 1996.
26. A. Tirumala, F. Qin, J. Dugan, J. Ferguson, and K. Gibbs, "Iperf-The TCP/UDP Bandwidth Measurement Tool," http://dast.nlanr.net/Projects/Iperf, 2004.
27. M. Pettersson, "perfctr patches," http://user.it.uu.se/mikpe/ linux/perfctr/.
28. J. Levon and P. Elie, "Oprofile: A System Profiler for Linux," http://oprofile.sourceforge.net, 2005.
29. J. Salim, R. Olsson, and A. Kuznetsov, "Beyond Soft-net," Proceedings of the 5th conference on 5th Annual Linux Showcase & Conference, 2001.
30. H. Xu, "net: Generic Receive Offload," http://lwn.net/Articles/ 311357/.
31. S. Derr and S. Jeaugey, "CPUSETS for Linux," http://www.bullopensource.org/cpuset/.
32. J. Hurwitz and W. Feng, "End-to-End Performance of 10-Gigabit Ethernet on Commodity Systems," Micro, IEEE, vol.24, no.1, pp. 10-22, 2004.
33. W. Feng, P. Balaji, C. Baron, L. Bhuyan, D. Panda, C. Sci, and E. Riverside, "Performance Characterization of a 10-Gigabit Ethernet TOE," in Proceedings of the IEEE International Symposium on High-Performance Interconnects (HotI), 2005.
34. P. Balaji, W. Feng, and D. Panda, "Bridging the Ethernet-Ethernot Performance Gap," IEEE MICRO, vol.26, no.3, p. 24, 2006.
35. P. Apparao, S. Makineni, and D. Newell, "Characterization of Network Processing Overheads in Xen," in Virtualization Technology in Distributed Computing, First International Workshop on, 2006, pp. 2-2
36. Y. Dong, Z. Yu, and G. Rose, "SR-IOV Networking in Xen: Architecture, Design and Implementation," in WIOV '08: The First Workshop on I/O Virtualization.