Marlin: A memory-based rack area network

ANCS 2014 - 10th 2014 ACM/IEEE Symposium on Architectures for Networking and Communications Systems

Volumn , Issue , 2014, Pages 125-135

  Tu, Cheng Chun ^a   Lee, Chao Tang ^b   Chiueh, Tzi Cker ^b  

^a STONY BROOK UNIVERSITY   (United States)

^b INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE   (Taiwan)

Author keywords

MR IOV; Non transparent bridge; PCIe fabric; Rack disaggregation; Rack area network; RDMA; SR IOV

Indexed keywords

COMPUTER HARDWARE; NETWORK ARCHITECTURE;

DISAGGREGATION; EMPIRICAL MEASUREMENT; HARDWARE RESOURCES; INTER-NODE COMMUNICATION; MEMORY-BASED COMMUNICATION; MR-IOV; RDMA; REMOTE DIRECT MEMORY ACCESS;

MEMORY ARCHITECTURE;

EID: 84924345891     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2658260.2658262     Document Type: Conference Paper

References (48)

1. AMD SeaMicro SM15000 Fabric Compute Systems. http://www.seamicro.com/SM15000.
2. Calxeda ECX1000 Product Brief. http://www.calxeda.com/wp-content/uploads/2012/06/ECX1000-Product-Brief-612.pdf.
3. Intel shows off Rack Scale Architecture and Rack Disaggregation plans. http://semiaccurate.com/.
4. I/O Consolidation White Paper, NextIO, Inc. http://www.nextio.com/resources/files/wp-nextio-consolidation.pdf.
5. kontron VXFabric - PCI Express Switch Fabric for High Performance Embedded Computing. http://www.kontron.com/vxfabric-whitepaper.
6. Mellanox InfiniScale III. http://www.mellanox.com/related-docs/prod-siliconPB-InfiniScale-III.pdf.
7. Micron I/O Virtualization White Paper, Micron Technology, Inc. http://www.micron.com/~/media/Documents/Products/White%20Paper/micron- io-virtualization-wp.pdf.
8. Open Compute Project. http://opencompute.org/.
9. Open Compute Project Virtual IO Charter. http://www.opencompute.org/wp/wp-content/uploads/2012/10/Open-Compute-Project- Virtual-IO-Charter-2012-09-10.pdf.
10. PCI Express System Interconnect Software Architecture for x86-based Systems. http://www.idt.com/.
11. PEX 8717, PCI Express Gen 3 Switch, 16 Lanes, 10 Ports. www.plxtech.com/download/file/2221?
12. The Case for PCIe 3.0 Repeaters, PCI-SIG Developers Conference, 2011.
13. The opposite of virtualization: Calxeda's new quad-core ARM part for cloud servers. http://arstechnica.com/.
14. Multi-Root I/O Virtualization and Sharing 1.0 Specification, PCI-SIG, 2008.
15. Single-Root I/O Virtualization and Sharing Specification, Revision 1.0, PCI-SIG, 2008.
16. M. Ben-Yehuda, J. Mason, J. Xenidis, O. Krieger, L. Van Doorn, J. Nakajima, A. Mallick, and E. Wahlig. Utilizing IOMMUs for virtualization in Linux and Xen. In OLS06.
17. M. A. Blumrich, C. Dubnicki, E. W. Felten, and K. Li. Protected, user-level dma for the shrimp network interface. In High-Performance Computer Architecture, 1996. Proceedings. Second International Symposium on, pages 154-165. IEEE, 1996.
18. M. A. Blumrich, K. Li, R. Alpert, C. Dubnicki, E. W. Felten, and J. Sandberg. Virtual memory mapped network interface for the SHRIMP multicomputer, volume 22. IEEE Computer Society Press, 1994.
19. G. Buzzard, D. Jacobson, M. Mackey, S. Marovich, and J. Wilkes. An implementation of the hamlyn sender-managed interface architecture. ACM SIGOPS Operating Systems Review, 1996.
20. J. Byrne, J. Chang, K. T. Lim, L. Ramirez, and P. Ranganathan. Power-efficient networking for balanced system designs: early experiences with pcie. In Proceedings of the 4th Workshop on Power-Aware Computing and Systems, page 3. ACM, 2011.
21. D. Dunning, G. Regnier, G. McAlpine, D. Cameron, B. Shubert, F. Berry, A. M. Merritt, E. Gronke, and C. Dodd. The virtual interface architecture. Micro, IEEE, 18(2):66-76, 1998.
22. B. Fink and R. Scott. nuttcp, v5. 3.1, 2006.
23. R. Gillett and R. Kaufmann. Using the memory channel network. Micro, IEEE, 17(1):19-25, 1997.
24. R. B. Gillett. Memory channel network for pci. Micro, IEEE, 16(1):12-18, 1996.
25. I. Granovsky. Optimizaing PCIe Port Performance, 2006.
26. T. Hanawa, T. Boku, S. Miura, M. Sato, and K. Arimoto. Pearl: Power-aware, dependable, and high-performance communication link using pci express. In Green Computing and Communications (GreenCom), 2010 IEEE/ACM Int'l Conference on & Int'l Conference on Cyber, Physical and Social Computing (CPSCom), pages 284-291. IEEE, 2010.
27. R. Hiremane. Intel Virtualization Technology for Directed I/O (Intel VT-d). Technology@ Intel Magazine, 4(10), 2007.
28. V. Krishnan. Towards an integrated io and clustering solution using pci express. In Cluster Computing, 2007 IEEE International Conference on, pages 259-266. IEEE, 2007.
29. S. Liang, R. Noronha, and D. K. Panda. Swapping to remote memory over infiniband: An approach using a high performance network block device. In Cluster Computing, 2005. IEEE International, pages 1-10. IEEE, 2005.
30. K. Lim, J. Chang, T. Mudge, P. Ranganathan, S. K. Reinhardt, and T. F. Wenisch. Disaggregated memory for expansion and sharing in blade servers. In ACM SIGARCH Computer Architecture News, volume 37, pages 267-278. ACM, 2009.
31. K. Lim, Y. Turner, J. R. Santos, A. AuYoung, J. Chang, P. Ranganathan, and T. F. Wenisch. System-level implications of disaggregated memory. In High Performance Computer Architecture (HPCA), 2012 IEEE 18th International Symposium on, pages 1-12. IEEE, 2012.
32. K. Malwankar, D. Talayco, and A. Ekici. PCI-Express Function Proxy, Oct. 1 2009. WO Patent WO/2009/120,798.
33. J. Mason. Intel PCIe NTB Driver: ntb-tx-copy-task and ntb-rx-copy-task. http://lxr.linux.no/linux+ v3.9/drivers/ntb/ntb-transport.c.
34. M. Mathis and J. Mahdavi. Forward acknowledgement: Refining tcp congestion control. ACM SIGCOMM Computer Communication Review, 26(4):281-291, 1996.
35. N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner. Openflow: enabling innovation in campus networks. ACM SIGCOMM Computer Communication Review, 38(2):69-74, 2008.
36. D. J. Miller, P. M. Watts, and A. W. Moore. Motivating future interconnects: a differential measurement analysis of pci latency. In Proceedings of the 5th ACM/IEEE Symposium on Architectures for Networking and Communications Systems, pages 94-103. ACM, 2009.
37. R. OpenFabrics. Protocols through ofed software.
38. PLX. Draco DMA Performance, 2013.
39. A. Rao. Seamicro technology overview. Technical report, Technical report, SeaMicro, 2010.
40. J. Regula. Multi-Root Sharing of Single-Root Input/Output Virtualization, Dec. 28 2010. US Patent App. 12/979,904.
41. D. Riley. System and Method for Multi-Host Sharing of a Single-Host Device, May 8 2012. US Patent 8,176,204.
42. L. Rizzo. netmap: a novel framework for fast packet i/o. In USENIX ATC, 2012.
43. M. J. Sullivan. Intel Xeon Processor C5500/C3500 Series Non-Transparent Bridge. Technology@ Intel Magazine, 2010.
44. J. Suzuki, Y. Hidaka, J. Higuchi, T. Baba, N. Kami, and T. Yoshikawa. Multi-Root Share of Single-Root I/O Virtualization (SR-IOV) Compliant PCI Express Device. In High Performance Interconnects (HOTI), 2010 IEEE 18th Annual Symposium on, pages 25-31. IEEE, 2010.
45. A. Tirumala, F. Qin, J. Dugan, J. Ferguson, and K. Gibbs. Iperf: The TCP/UDP Bandwidth Measurement Tool. http://dast.nlanr.net/Projects, 2005.
46. C.-C. Tu, C. tang Lee, and T. cker Chiueh. Secure i/o device sharing among virtual machines on multiple hosts. In ACM ISCA'13.
47. T. Von Eicken, A. Basu, V. Buch, and W. Vogels. U-net: a user-level network interface for parallel and distributed computing (includes url). In ACM SIGOPS Operating Systems Review, volume 29, pages 40-53. ACM, 1995.
48. P. Willmann, S. Rixner, and A. Cox. Protection Strategies for Direct Access to Virtualized I/O Devices. In USENIX Annual Technical Conference, pages 15-28, 2008.