Packet-level telemetry in large datacenter networks

SIGCOMM 2015 - Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication

Volumn , Issue , 2015, Pages 479-491

  Zhu, Yibo ^a,b   Kang, Nanxi ^a,c   Cao, Jiaxin ^a   Greenberg, Albert ^a   Lu, Guohan ^a   Mahajan, Ratul ^a   Maltz, Dave ^a   Yuan, Lihua ^a   Zhang, Ming ^a   Zhao, Ben Y ^b   Zheng, Haitao ^b  

^a MICROSOFT   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c PRINCETON UNIVERSITY   (United States)

Author keywords

Datacenter network; Failure detection; Probe

Indexed keywords

CONVOLUTIONAL CODES; PROBES; TELEMETERING EQUIPMENT;

ANALYSIS SERVER; COMMODITY SWITCHES; DATA CENTER NETWORKS; FAILURE DETECTION; POTENTIAL FAULTS; TELEMETRY SYSTEMS; TRAFFIC VOLUMES; TROUBLESHOOTING NETWORKS;

COMPLEX NETWORKS;

EID: 84962273537     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2785956.2787483     Document Type: Conference Paper

References (36)

1. Data plane development kit. http://www.dpdk.org/.
2. Receive side scaling. https://msdn.microsoft.com/enus/library/windows/hardware/ff567236(v=vs.85).aspx.
3. A. Arefin, A. Khurshid, M. Caesar, and K. Nahrstedt. Scaling data-plane logging in large scale networks. In MILCOM, 2011.
4. P. Bosshart, G. Gibb, H.-S. Kim, G. Varghese, N. McKeown, M. Izzard, F. Mujica, and M. Horowitz. Forwarding metamorphosis: Fast programmable match-action processing in hardware for SDN. In SIGCOMM, 2013.
5. J. Case, M. Fedor, M. Schoffstall, and J. Davin. RFC 1157: Simple network management protocol.
6. R. Chaiken, B. Jenkins, P.-Å. Larson, B. Ramsey, D. Shakib, S. Weaver, and J. Zhou. Scope: Easy and efficient parallel processing of massive data sets. VLDB, 2008.
7. B. Claise. RFC 3954: Cisco systems netflow services export version 9 (2004).
8. N. G. Duffield and M. Grossglauser. Trajectory sampling for direct traffic observation. IEEE/ACM Trans. Netw., June 2001.
9. S. K. Fayaz and V. Sekar. Testing stateful and dynamic data planes with flowtest. In HotSDN, 2014.
10. A. Fogel, S. Fung, L. Pedrosa, M. Walraed-Sullivan, R. Govindan, R. Mahajan, and T. Millstein. A general approach to network configuration analysis. In NSDI, 2015.
11. R. Fonseca, G. Porter, R. H. Katz, S. Shenker, and I. Stoica. X-trace: A pervasive network tracing framework. In NSDI, 2007.
12. R. Gandhi, H. H. Liu, Y. C. Hu, G. Lu, J. Padhye, L. Yuan, and M. Zhang. Duet: Cloud scale load balancing with hardware and software. In SIGCOMM, 2014.
13. N. Gvozdiev, B. Karp, and M. Handley. Loup: Who's afraid of the big bad loop? In HotNets, 2012.
14. N. Handigol, B. Heller, V. Jeyakumar, D. Mazières, and N. McKeown. I know what your packet did last hop: Using packet histories to troubleshoot networks. In NSDI, 2014.
15. C.-Y. Hong, M. Caesar, N. Duffield, and J. Wang. Tiresias: Online anomaly detection for hierarchical operational network data. In ICDCS, 2012.
16. C.-Y. Hong, S. Kandula, R. Mahajan, M. Zhang, V. Gill, M. Nanduri, and R. Wattenhofer. Achieving high utilization with software-drivenWAN. In SIGCOMM, 2013.
17. Infiniband Trade Association. InfiniBand Architecture Volume 1, General Specifications, Release 1.2.1, 2008.
18. Infiniband Trade Association. Supplement to infiniband architecture specification volume 1 release 1.2.2 annex A17: RoCEv2 (ip routable ROCE), 2014.
19. S. Jain, A. Kumar, S. Mandal, J. Ong, L. Poutievski, A. Singh, S. Venkata, J. Wanderer, J. Zhou, M. Zhu, J. Zolla, U. Hölzle, S. Stuart, and A. Vahdat. B4: Experience with a globally-deployed software defined WAN. In SIGCOMM, 2013.
20. V. Jeyakumar, M. Alizadeh, Y. Geng, C. Kim, and D. Mazières. Millions of little minions: Using packets for low latency network programming and visibility. In SIGCOMM, 2014.
21. S. Kandula, S. Sengupta, A. Greenberg, P. Patel, and R. Chaiken. The nature of datacenter traffic: measurements & analysis. In IMC, 2009.
22. P. Kazemian, M. Chan, H. Zeng, G. Varghese, N. McKeown, and S. Whyte. Real time network policy checking using header space analysis. In NSDI, 2013.
23. A. Khurshid, X. Zou, W. Zhou, M. Caesar, and P. B. Godfrey. Veriflow: Verifying network-wide invariants in real time. In NSDI, 2013.
24. T. Koponen, K. Amidon, P. Balland, M. Casado, A. Chanda, B. Fulton, I. Ganichev, J. Gross, N. Gude, P. Ingram, E. Jackson, A. Lambeth, R. Lenglet, S.-H. Li, A. Padmanabhan, J. Pettit, B. Pfaff, R. Ramanathan, S. Shenker, A. Shieh, J. Stribling, P. Thakkar, D. Wendlandt, A. Yip, and R. Zhang. Network virtualization in multi-tenant datacenters. In NSDI, 2014.
25. R. Mahajan, N. Spring, D.Wetherall, and T. Anderson. User-level Internet path diagnosis. In SOSP, 2003.
26. V. Mann, A. Vishnoi, and S. Bidkar. Living on the edge: Monitoring network flows at the edge in cloud data centers. In COMSNETS, 2013.
27. P. Marchetta, A. Botta, E. Katz-Bassett, and A. Pescapé. Dissecting round trip time on the slow path with a single packet. In PAM, 2014.
28. P. Patel, D. Bansal, L. Yuan, A. Murthy, A. Greenberg, D. A. Maltz, and R. Kern. Ananta: cloud scale load balancing. In SIGCOMM, 2013.
29. P. Phaal, S. Panchen, and N. McKee. RFC 3176: Inmon corporation's sflow: A method for monitoring traffic in switched and routed networks, 2001.
30. T. Qiu, Z. Ge, D. Pei, J. Wang, and J. Xu. What happened in my network: mining network events from router syslogs. In IMC, 2010.
31. J. Rasley, B. Stephens, C. Dixon, E. Rozner, W. Felter, K. Agarwal, J. Carter, and R. Fonseca. Planck: Millisecond-scale monitoring and control for commodity networks. In SIGCOMM, 2014.
32. L. Rizzo. netmap: A novel framework for fast packet I/O. In USENIX ATC, 2012.
33. J. Suh, T. Kwon, C. Dixon, W. Felter, and J. Carter. Open sample: A low-latency, sampling-based measurement platform for SDN. In ICDCS, 2014.
34. W. Wu and P. Demar.Wire cap: A novel packet capture engine for commodity NICs in high-speed networks. In IMC, 2014.
35. A. Wundsam, D. Levin, S. Seetharaman, and A. Feldmann. OF Rewind: Enabling record and replay troubleshooting for networks. In ATC, 2011.
36. M. Yu, L. Jose, and R. Miao. Software defined traffic measurement with open sketch. In NSDI, 2013.