Identifying heavy-hitter flows from sampled flow statistics

IEICE Transactions on Communications

Volumn E90-B, Issue 11, 2007, Pages 3061-3072

  Mori, Tatsuya ^a   Takine, Tetsuya ^b   Pan, Jianping ^c   Kawahara, Ryoichi ^a   Uchida, Masato ^d   Goto, Shigeki ^e  

^a NTT CORPORATION   (Japan)

^b OSAKA UNIVERSITY   (Japan)

^c UNIVERSITY OF VICTORIA   (Canada)

^d KYUSHU INSTITUTE OF TECHNOLOGY   (Japan)

^e WASEDA UNIVERSITY   (Japan)

Author keywords

A priori distribution; Bayes' theorem; Flow statistics; Network measurement; Packet sampling

Indexed keywords

COMMUNICATION SYSTEMS; COMPUTER NETWORKS;

BAYES' THEOREM; FLOW STATISTICS; NETWORK MEASUREMENT; PACKET SAMPLING; PRIORI DISTRIBUTION;

SAMPLING;

EID: 51849152825     PISSN: 09168516     EISSN: 17451345     Source Type: Journal    
DOI: 10.1093/ietcom/e90-b.11.3061     Document Type: Article

References (24)

1. I.B. Aban, M.M. Meerscaert, and A.K. Panorska, "Parameter estimation for the truncated pareto distribution," Journal of the American Statistical Association: Theory and Methods, vol. 101, no. 473, pp. 270-277(8), March 2006.
2. C. Barakat, G. Iannacconne, and C. Diot, "Ranking flows from sampled traffic," Proc. CoNEXT, pp. 188-199, Touluse, Oct. 2005.
3. K.C. Claffy, G.C. Polyzos, and H. Braun, "Application of sampling methodologies to network traffic characterization," Proc. ACM SIGCOMM, pp. 194-203, San Francisco, CA, USA, Sept. 1993.
4. N.G. Duffield, C. Lund, and M. Thorup, "Charging from sampled network usage," ACM SIGCOMM Internet Measurement Workshop, pp. 245-256, California, Nov. 2001.
5. N.G. Duffield, C. Lund, and M. Thorup, "Properties and prediction of flow statistics from sampled packet streams," ACM SIGCOMM Internet Measurement Workshop, pp. 159-171, Marseille, France, Nov. 2002.
6. N.G. Duffield, C. Lund, and M. Thorup, "Estimating flow distributions from sampled flow statistics," Proc. ACM SIGCOMM, pp. 325-336, Aug. 2003.
7. N. Duffield, "Sampling for passive Internet measurement: A review," Statistical Science, vol. 19, no. 3, pp. 472-498, 2004.
8. C. Estan and G. Varghese, "New directions in traffic measurement and accounting," Proc. ACM SIGCOMM, pp. 323-336, Aug. 2002.
9. S.B. Fredj, T. Bonald, A. Proutiere, G. Regnie, and J. Roberts, "Statistical bandwidth sharing: A study of congestion at flow level," Proc. ACM SIGCOMM, pp. 111-122, Aug. 2001.
10. L. Golab, D. DeHaan, E. Demaine, and A. Lopez-Ortiz, "Identifying frequent items in sliding windows over on-line packet streams," ACM SIGCOMM Internet Measurement Conference, pp. 173-178, Florida, Oct. 2003.
11. N. Hohn and D. Veitch, "Inverting sampled traffic," Proc. ACM IMC, pp. 222-233, FL, USA, Oct. 2003.
12. J. Jedwab, P. Phaal, and B. Pinna, "Traffic estimation for the largest sources on a network, using packet sampling with limited storage," HP Technical Report, Managemenr, Mathematics and Security Department, HP Laboratories, Bristol, March 1992, http://www.hpl.hp.com/techreports/92/HPL-92- 35.htm
13. A. Kumar, J. Xu, J. Wang, O. Spatschek, and L. Li, "Space-code bloom filter for efficient per-flow traffic measurement," Proc. IEEE INFOCOM, pp. 1762-1773, Hong Kong, China, March 2004.
14. T. Mori, R. Kawahara, S. Naito, and S. Goto, "On the characteristics of Internet traffic variability: Spikes and elephants," Proc. IEEE/IPSJ SAINT, pp. 99-106, Tokyo, Japan, Jan. 2004.
15. T. Mori, M. Uchida, R. Kawahara, J. Pan, and S. Goto, "Identifying elephant flows through periodically sampled packets," Proc. ACM IMC, pp. 115-120, Taormina, Italy, Oct. 2004.
16. Cisco NetFlow, http://www.cisco.com/warp/public/732/netflow/index.html
17. NLANR: Abilene-I data set, http://pma.nlanr.net/Traces/long/ipls1.html
18. NLANR: Abilene-III data set, http://pma.nlanr.net/Special/ipls3.html
19. IETF Packet Sampling (psamp) Working Group, http://www.ietf.org/html. charters/psamp-charter.html
20. K. Papagiannaki, N. Taft, S. Bhattacharya, P. Thiran, K. Salamatian, and C. Diot, "On the feasibility of identifying elephants in Internet backbone traffic," Sprint ATL Technical Report TR01-ATL-110918, Sprint Labs, Nov. 2001.
21. InMon flow Probe, http://www.inmon.com/products/probes.php
22. K. Thompson, G.J. Miller, and R. Wilder, "Wide-area internet traffic patterns and characteristics," IEEE Netw., vol. 11, no. 6, pp. 10-23, Nov./Dec. 1997.
23. Y. Zhang, L. Breslau, V. Paxson, and S. Shenker, "On the characteristics and origins of Internet flow rates," Proc. ACM SIGCOMM, pp. 309-322, Aug. 2002.
24. T. Zseby, "Deployment of sampling methods for SLA validation with non-intrusive measurements," Proc. Passive and Active Measurement Workshop, pp. 84-94, Fort Collins, Colorado, USA March 2002.