Not all microseconds are equal: Fine-grained per-flow measurements with reference latency interpolation

SIGCOMM'10 - Proceedings of the SIGCOMM 2010 Conference

Volumn , Issue , 2010, Pages 27-38

  Lee, Myungjin ^a   Duffield, Nick ^b   Kompella, Ramana Rao ^a  

^a PURDUE UNIVERSITY   (United States)

^b AT AND T LABS RESEARCH   (United States)

Author keywords

active measurement; approximation

Indexed keywords

EID: 78149307667     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1851182.1851188     Document Type: Conference Paper

References (40)

1. Cisco trading floor architecture. http://www.ciscocapital.info/en/US/ docs/solutions/Verticals/Trading-Floor-Architecture-E.html.
2. Corvil tool minimises latency. http://www.computerworlduk.com/technology/ networking/networking/news/index.cfm?newsid=5797.
3. Hp expands high-performance computing offering with infiniband solutions from cisco. http://www.hp.com/hpinfo/newsroom/press/2007/070524xa.html.
4. The london stock exchange uses corvil technology to improve on latency and time to market. http://www.corvil.com/products/casestudies/case-study- london-stock-exchange/.
5. Netfpga. http://www.netfpga.org.
6. Next-generation routers: A comprehensive product analysis. http://www.heavyreading.com/details.asp?sku-id=662&skuitem-itemid= 673&promo-code=&aff-code=&next-url=%2Fdefault.asp%3F.
7. Openflow. http://www.openflow.org.
8. YAF: Yet Another Flowmeter. http://tools.netsa.cert.org/yaf/.
9. ARISTA NETWORKS, INC. 7100 series datasheet. http://www.aristanetworks. com, 2008.
10. CHOI, B., MOON, S., ZHANG, Z.-L., PAPAGIANNAKI, K., AND DIOT, C. Analysis of point-to-point packet delay in an operational network. In IEEE INFOCOM (2004).
11. COPAS, J. Regression, prediction and shrinkage. Journal of the Royal Statistical Society. Series B (Methodological) 45, 2 (1983), 311-354.
12. DUFFIELD, N. Simple network performance tomography. In ACM/USENIX IMC (2003).
13. DUFFIELD, N., GERBER, A., AND GROSSGLAUSER, M. Trajectory engine: A backend for trajectory sampling. In IEEE NOMS (2002).
14. DUFFIELD, N. G., AND GROSSGLAUSER, M. Trajectory sampling for direct traffic observation. In IEEE/ACM Transactions on Networking (2000).
15. EIDSON, J., AND LEE, K. IEEE 1588 standard for a precision clock synchronization protocol for networked measurement and control systems. In Sensors for Industry Conference, 2002. 2nd ISA/IEEE (2002).
16. ESTAN, C., KEYS, K., MOORE, D., AND VARGHESE, G. Building a Better NetFlow. In ACM SIGCOMM (2004).
17. ESTAN, C., AND VARGHESE, G. New directions in traffic measurement and accounting. In ACM SIGCOMM (2002).
18. FLOYD, S., AND JACOBSON, V. Random Early Detection Gateways for Congestion Avoidance. IEEE/ACM Transactions on Networking (1993).
19. HOHN, N., VEITCH, D., PAPAGIANNAKI, K., AND DIOT, C. Bridging router performance and queuing theory. In ACM SIGMETRICS (2004).
20. INCITS. Fibre channel backbone-5 (FC-BB-5), Oct. 2008. Ver. 1.03.
21. IYER, S., KOMPELLA, R. R., AND MCKEOWN, N. Designing Buffers for Router Line Cards. IEEE/ACM Transactions on Networking (ToN) 16, 3 (2008).
22. KOMPELLA, R. R., AND ESTAN, C. The power of slicing in internet flow measurement. In ACM/USENIX IMC (2005).
23. KOMPELLA, R. R., LEVCHENKO, K., SNOEREN, A. C., AND VARGHESE, G. Every MicroSecond Counts: Tracking Fine-grain Latencies Using Lossy Difference Aggregator. In ACM SIGCOMM (2009).
24. KOMPELLA, R. R., SNOEREN, A. C., AND VARGHESE, G. mPlane: An architecture for scalable fault localization. In ACM ReARCH (2009).
25. LEE, M., DUFFIELD, N., AND KOMPELLA, R. R. Two Samples are Enough: Opportunistic Flow-level latency estimation using Netflow. In IEEE Infocom (2010).
26. MARTIN, R. Wall street's quest to process data at the speed of light. http://www.informationweek.com/news/infrastructure/showArticle.jhtml?articleID= 199200297.
27. PAPAGIANNAKI, K., MOON, S., FRALEIGH, C., THIRAN, P., TOBAGI, F., AND DIOT, C. Analaysis of measured single-hop delay from an operational backbone network. IEEE JSAC 21, 6 (2003).
28. PAXSON, V. End-to-end internet packet dynamics. In ACM SIGCOMM (1997).
29. PAXSON, V., AND FLOYD, S. Wide-area traffic: The failure of poisson modeling. IEEE/ACM Transactions on Networking (1995).
30. RAMABHADRAN, S., AND VARGHESE, G. Efficient implementation of a statistics counter architecture. In ACM SIGMETRICS (2003).
31. SHANNON, C., ABEN, E., KC CLAFFY, AND ANDERSEN, D. E. CAIDA Anonymized 2008 Internet Traces Dataset (collection).
32. SOMMERS, J., AND BARFORD, P. Self-Configuring Network Traffic Generation. In ACM/USENIX IMC (2004).
33. SOMMERS, J., BARFORD, P., DUFFIELD, N., AND RON, A. Improving accuracy in end-to-end packet loss measurement. In ACM SIGCOMM (2005).
34. SOMMERS, J., BARFORD, P., DUFFIELD, N., AND RON, A. Accurate and efficient SLA compliance monitoring. In ACM SIGCOMM (2007).
35. VASUDEVAN, V., PHANISHAYEE, A., SHAH, H., KREVAT, E., ANDERSEN, D. G., GANGER, G. R., GIBSON, G. A., AND MUELLER, B. Safe and effective fine-grained TCP retransmissions for datacenter communication. In ACM SIGCOMM (2009).
36. WOVEN SYSTEMS, INC. EFX switch series overview. http://www.wovensystems. com.
37. YAN, N. M., CHEN, Y., BINDEL, D., SONG, H., AND KATZ, R. H. An Algebraic Approach to Practical and Scalable Overlay. In ACM SIGCOMM (2004).
38. YUAN, L., CHUAH, C.-N., AND MOHAPATRA, P. ProgME: towards programmable network measurement. In ACM SIGCOMM (2007).
39. ZHAO, Y., CHEN, Y., AND BINDEL, D. Towards unbiased end-to-end network diagnosis. In ACM SIGCOMM (2006).
40. ZSEBY, T., ZANDER, S., AND CARLE, G. Evaluation of building blocks for passive one-way-delay measurements. In Proceedings of Passive and Active Measurement Workshop (PAM 2001) (2001).