IX: A protected dataplane operating system for high throughput and low latency

Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2014

Volumn , Issue , 2014, Pages 49-65

  Belay, Adam ^a   Prekas, George ^b   Klimovic, Ana ^a   Grossman, Samuel ^a   Kozyrakis, Christos ^a   Bugnion, Edouard ^b  

^a STANFORD UNIVERSITY   (United States)

^b EPFL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

QUALITY OF SERVICE; SCHEDULING; SYSTEMS ANALYSIS;

COHERENCE TRAFFIC; END TO END LATENCIES; HARDWARE THREADS; HARDWARE VIRTUALIZATION; KEY-VALUE STORES; NETWORK PROCESSING; SCHEDULING FUNCTIONS; USER-LEVEL NETWORKING;

LINUX;

EID: 84996437051     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (67)

1. M. Alizadeh, A. G. Greenberg, D. A. Maltz, J. Padhye, P. Patel, B. Prabhakar, S. Sengupta, and M. Sridharan. Data Center TCP (DCTCP). In Proceedings of the ACM SIGCOMM 2010 Conference, pages 63-74, 2010.
2. B. Atikoglu, Y. Xu, E. Frachtenberg, S. Jiang, and M. Paleczny. Workload Analysis of a Large-Scale Key-Value Store. In Proceedings of the 2012 ACM SIGMETRICS International conference on Measurement and modeling of computer systems, pages 53-64, 2012.
3. L. A. Barroso. Three things that must be done to save the data center of the future (ISSCC 2014 Keynote). http://www.theregister.co.uk/Print/ 2014/02/11/google_research_three_ things_that_must_be_done_to_save_ the_data_center_of_the_future/, 2014.
4. L. A. Barroso and U. Hölzle. The Case for Energy-Proportional Computing. IEEE Computer, 40(12):33-37, 2007.
5. A. Basu, J. Gandhi, J. Chang, M. D. Hill, and M. M. Swift. Efficient Virtual Memory for Big Memory Servers. In Proceedings of the 40th International Symposium on Computer Architecture (ISCA'13), pages 237-248, 2013.
6. A. Baumann, P. Barham, P.-É. Dagand, T. L. Harris, R. Isaacs, S. Peter, T. Roscoe, A. Schüpbach, and A. Singhania. The Multikernel: A new OS architecture for scalable multicore systems. In Proceedings of the 22nd ACM Symposium on Operating Systems Principles (SOSP'09), pages 29-44, 2009.
7. A. Belay, A. Bittau, A. J. Mashtizadeh, D. Terei, D. Mazières, and C. Kozyrakis. Dune: Safe User-level Access to Privileged CPU Features. In Proceedings of the 10th Symposium on Operating System Design and Implementation (OSDI'12), pages 335-348, 2012.
8. S. M. Bellovin. A Look Back at”Security Problems in the TCP/IP Protocol Suite”. In Proceedings of the 20th Annual Computer Security Applications Conference (ACSAC'04), pages 229-249, 2004.
9. E. Bugnion, S. Devine, K. Govil, and M. Rosenblum. Disco: Running Commodity Operating Systems on Scalable Multiprocessors. ACM Trans. Comput. Syst., 15(4):412-447, 1997.
10. E. Bugnion, S. Devine, M. Rosenblum, J. Sugerman, and E. Y. Wang. Bringing Virtualization to the x86 Architecture with the Original VMware Workstation. ACM Trans. Comput. Syst., 30(4):12, 2012.
11. H.-K. J. Chu. Zero-Copy TCP in Solaris. In Proceedings of the 1996 USENIX Annual Technical Conference, pages 253-264, 1996.
12. A. T. Clements, M. F. Kaashoek, N. Zeldovich, R. T. Morris, and E. Kohler. The Scalable Commutativity Rule: Designing Scalable Software for Multicore Processors. In Proceedings of the 24th ACM Symposium on Operating Systems Principles (SOSP'13), pages 1-17, 2013.
13. T. David, R. Guerraoui, and V. Trigonakis. Everything You Always Wanted to Know About Synchronization but Were Afraid to Ask. In Proceedings of the 24th ACM Symposium on Operating Systems Principles (SOSP'13), pages 33-48, 2013.
14. J. Dean and L. A. Barroso. The Tail at Scale. Commun. ACM, 56(2):74-80, 2013.
15. C. Delimitrou and C. Kozyrakis. Quasar: Resource-Efficient and QoS-Aware Cluster Management. In Proceedings of the 19th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'14), pages 127-144, 2014.
16. M. Dobrescu, N. Egi, K. J. Argyraki, B.-G. Chun, K. R. Fall, G. Iannaccone, A. Knies, M. Manesh, and S. Ratnasamy. RouteBricks: Exploiting Parallelism to Scale Software Routers. In Proceedings of the 22nd ACM Symposium on Operating Systems Principles (SOSP'09), pages 15-28, 2009.
17. A. Dragojević, D. Narayanan, O. Hodson, and M. Castro. FaRM: Fast Remote Memory. In Proceedings of the 11th Symposium on Networked Systems Design and Implementation (NSDI'14), 2014.
18. A. Dunkels. Design and Implementation of the lwIP TCP/IP Stack. Swedish Institute of Computer Science, 2:77, 2001.
19. D. R. Engler, M. F. Kaashoek, and J. O'Toole. Exokernel: An Operating System Architecture for Application-Level Resource Management. In Proceedings of the 15th ACM Symposium on Operating Systems Principles (SOSP'95), pages 251-266, 1995.
20. B. Fan, D. G. Andersen, and M. Kaminsky. MemC3: Compact and Concurrent MemCache with Dumber Caching and Smarter Hashing. In Proceedings of the 10th Symposium on Networked Systems Design and Implementation (NSDI'13), pages 371-384, 2013.
21. M. Fisk and W. Feng. Dynamic Adjustment of TCP Window Sizes. Technical report, Tech. Rep. Los Alamos Unclassified Report (LAUR) 00-3221, Los Alamos National Laboratory, 2000.
22. S. Floyd and V. Jacobson. Random Early Detection Gateways for Congestion Avoidance. IEEE/ACM Trans. Netw., 1(4):397-413, 1993.
23. R. Graham. The C10M Problem. http://c10m.robertgraham.com, 2013.
24. S. Han, S. Marshall, B.-G. Chun, and S. Ratnasamy. MegaPipe: A New Programming Interface for Scalable Network I/O. In Proceedings of the 10th Symposium on Operating System Design and Implementation (OSDI'12), pages 135-148, 2012.
25. B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, R. Katz, S. Shenker, and I. Stoica. Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center. In Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation (NSDI), pages 22-22, 2011.
26. R. Huggahalli, R. R. Iyer, and S. Tetrick. Direct Cache Access for High Bandwidth Network I/O. In Proceedings of the 32st International Symposium on Computer Architecture (ISCA'05), pages 50-59, 2005.
27. Intel Corp. Open Source Kernel Enhancements for Low Latency Sockets using Busy Poll. http://www.intel.com/content/dam/www/public/ us/en/documents/white-papers/ open-source-kernel-enhancements-paper. pdf, 2013.
28. Intel Corp. Intel DPDK: Data Plane Development Kit. http://dpdk.org/, 2014.
29. E. Jeong, S. Woo, M. Jamshed, H. Jeong, S. Ihm, D. Han, and K. Park. mTCP: A Highly Scalable User-level TCP Stack for Multicore Systems. In Proceedings of the 11th Symposium on Networked Systems Design and Implementation (NSDI'14), 2014.
30. E. Jeong, S. Woo, M. Jamshed, H. Jeong, S. Ihm, D. Han, and K. O. Park. mTCP source code release, v. of 2014-02-26. https://github.com/eunyoung14/mtcp, 2014.
31. J. Jose, H. Subramoni, M. Luo, M. Zhang, J. Huang, M. W. ur Rahman, N. S. Islam, X. Ouyang, H. Wang, S. Sur, and D. K. Panda. Memcached Design on High Performance RDMA Capable Interconnects. In International Conference on Parallel Processing (ICPP'11), pages 743-752, 2011.
32. R. Kapoor, G. Porter, M. Tewari, G. M. Voelker, and A. Vahdat. Chronos: Predictable Low Latency for Data Center Applications. In ACM Symposium on Cloud Computing (SOCC'12), page 9, 2012.
33. A. Kivity. KVM: The Linux Virtual Machine Monitor. In Proceedings of the 2007 Ottawa Linux Symposium (OLS), pages 225-230, July 2007.
34. E. Kohler, R. Morris, B. Chen, J. Jannotti, and M. F. Kaashoek. The Click Modular Router. ACM Trans. Comput. Syst., 18(3):263-297, 2000.
35. J. Leverich. Mutilate: High-Performance Memcached Load Generator. https://github.com/leverich/mutilate, 2014.
36. J. Leverich and C. Kozyrakis. Reconciling High Server Utilization and Sub-Millisecond Quality-of-Service. In Proceedings of the 9th EuroSys Conference (Eurosys'14), page 4, 2014.
37. P. Levis, S. Madden, D. Gay, J. Polastre, R. Szewczyk, A. Woo, E. A. Brewer, and D. E. Culler. The Emergence of Networking Abstractions and Techniques in TinyOS. In Proceedings of the 1st Symposium on Networked Systems Design and Implementation (NSDI'04), pages 1-14, 2004.
38. D. Lo, L. Cheng, R. Govindaraju, L. A. Barroso, and C. Kozyrakis. Towards Energy Proportionality for Large-Scale Latency-Critical Workloads. In Proceedings of the 41st International Symposium on Computer Architecture (ISCA'14), pages 301-312, 2014.
39. A. Madhavapeddy, R. Mortier, C. Rotsos, D. J. Scott, B. Singh, T. Gazagnaire, S. Smith, S. Hand, and J. Crowcroft. Unikernels: Library Operating Systems for the Cloud. In Proceedings of the 18th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'13), pages 461-472, 2013.
40. I. Marinos, R. N. M. Watson, and M. Handley. Network Stack Specialization for Performance. In Proceedings of the ACM SIGCOMM 2014 Conference, pages 175-186, 2014.
41. P. E. McKenney and J. D. Slingwine. Read-Copy Update: Using Execution History to Solve Concurrency Problems. In Parallel and Distributed Computing and Systems, pages 509-518, 1998.
42. memcached - a distributed memory object caching system. http://memcached.org, 2014.
43. Microsoft Corp. Receive Side Scaling. http://msdn.microsoft.com/library/windows/hardware/ff556942.aspx, 2014.
44. C. Mitchell, Y. Geng, and J. Li. Using One-Sided RDMA Reads to Build a Fast, CPU-Efficient Key-Value Store. In Proceedings of the 2013 USENIX Annual Technical Conference, pages 103-114, 2013.
45. J. C. Mogul and K. K. Ramakrishnan. Eliminating Receive Livelock in an Interrupt-Driven Kernel. ACM Trans. Comput. Syst., 15(3):217-252, 1997.
46. R. Nishtala, H. Fugal, S. Grimm, M. Kwiatkowski, H. Lee, H. C. Li, R. McElroy, M. Paleczny, D. Peek, P. Saab, D. Stafford, T. Tung, and V. Venkataramani. Scaling Memcache at Facebook. In Proceedings of the 10th Symposium on Networked Systems Design and Implementation (NSDI'13), pages 385-398, 2013.
47. D. Ongaro, S. M. Rumble, R. Stutsman, J. K. Ousterhout, and M. Rosenblum. Fast Crash Recovery in RAMCloud. In Proceedings of the 23rd ACM Symposium on Operating Systems Principles (SOSP'11), pages 29-41, 2011.
48. V. S. Pai, P. Druschel, and W. Zwaenepoel. IO-Lite: A Unified I/O Buffering and Caching System. ACM Trans. Comput. Syst., 18(1):37-66, 2000.
49. A. Pesterev, J. Strauss, N. Zeldovich, and R. T. Morris. Improving Network Connection Locality on Multicore Systems. In Proceedings of the 7th EuroSys Conference (Eurosys'12), pages 337-350, 2012.
50. S. Peter, J. Li, I. Zhang, D. R. K. Ports, A. Krishnamurthy, T. Anderson, and T. Roscoe. Arrakis: The Operating System is the Control Plane. In Proceedings of the 11th Symposium on Operating System Design and Implementation (OSDI'14), 2014.
51. N. Provos and N. Mathewson. libevent: an event notification library. http://libevent.org, 2003.
52. K. Ramakrishnan, S. Floyd, D. Black, et al. The Addition of Explicit Congestion Notification (ECN) to IP. IETF RFC 3168, 2001.
53. L. Rizzo. Revisiting Network I/O APIs: The netmap Framework. Commun. ACM, 55(3):45-51, 2012.
54. S. M. Rumble, D. Ongaro, R. Stutsman, M. Rosenblum, and J. K. Ousterhout. It's Time for Low Latency. In Proceedings of the 13th Workshop on Hot Topics in Operating Systems (HotOS-XIII), 2011.
55. C. P. Sapuntzakis, D. Brumley, R. Chandra, N. Zeldovich, J. Chow, M. S. Lam, and M. Rosenblum. Virtual Appliances for Deploying and Maintaining Software. In Proceedings of the 17th Conference on Systems Administration (LISA'03), pages 181-194, 2003.
56. M. Schwarzkopf, A. Konwinski, M. Abd-El-Malek, and J. Wilkes. Omega: Flexible, scalable schedulers for large compute clusters. In Proceedings of the 8th EuroSys Conference (EuroSys'13), pages 351-364, 2013.
57. Q. O. Snell, A. R. Mikler, and J. L. Gustafson. Net-pipe: A Network Protocol Independent Performance Evaluator. In IASTED International Conference on Intelligent Information Management and Systems, volume 6, 1996.
58. L. Soares and M. Stumm. FlexSC: Flexible System Call Scheduling with Exception-Less System Calls. In Proceedings of the 9th Symposium on Operating System Design and Implementation (OSDI'10), pages 33-46, 2010.
59. Solarflare Communications. Introduction to OpenOnload: Building Application Transparency and Protocol Conformance into Application Acceleration Middleware. http://www.solarflare.com/content/userfiles/documents/solarflare_ openonload_intropaper.pdf, 2011.
60. R. Stutsman and J. K. Ousterhout. Toward Common Patterns for Distributed, Concurrent, Fault-Tolerant Code. In Proceedings of the 14th Workshop on Hot Topics in Operating Systems (HotOS-XIV), 2013.
61. C. A. Thekkath, T. D. Nguyen, E. Moy, and E. D. Lazowska. Implementing Network Protocols at User Level. In Proceedings of the ACM SIGCOMM 1993 Conference, pages 64-73, 1993.
62. R. Uhlig, G. Neiger, D. Rodgers, A. L. Santoni, F. C. M. Martins, A. V. Anderson, S. M. Bennett, A. Kägi, F. H. Leung, and L. Smith. Intel Virtualization Technology. IEEE Computer, 38(5):48-56, 2005.
63. G. Varghese and A. Lauck. Hashed and Hierarchical Timing Wheels: Data Structures for the Efficient Implementation of a Timer Facility. In Proceedings of the 11th ACM Symposium on Operating Systems Principles (SOSP'87), pages 25-38, 1987.
64. V. Vasudevan, A. Phanishayee, H. Shah, E. Krevat, D. G. Andersen, G. R. Ganger, G. A. Gibson, and B. Mueller. Safe and Effective Fine-Grained TCP Retransmissions for Datacenter Communication. In Proceedings of the ACM SIGCOMM 2009 Conference, pages 303-314, 2009.
65. J. R. von Behren, J. Condit, F. Zhou, G. C. Necula, and E. A. Brewer. Capriccio: Scalable Threads for Internet Services. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP'03), pages 268-281, 2003.
66. WhatsApp, Inc. 1 million is so 2011. https://blog.whatsapp.com/index.php/2012/01/1-million-is-so-2011, 2012.
67. D. A. Wheeler. SLOCCount, v2.26. http://www.dwheeler.com/sloccount/, 2001.