A robust system for accurate real-time summaries of internet traffic

Performance Evaluation Review

Volumn 33, Issue 1, 2005, Pages 85-96

  Keys, Ken ^a   Moore, David ^a   Estan, Cristian ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b University of Wisconsin Madison   (United States)

Author keywords

Adaptive response; Measurement; Passive monitoring; Sampling; Traffic estimation

Indexed keywords

AUTOMATION; COMPUTER NETWORKS; COMPUTER SYSTEMS; ROBUSTNESS (CONTROL SYSTEMS); SERVERS; TELECOMMUNICATION TRAFFIC;

ADAPTIVE RESPONSE; PASSIVE MONITORING; TRAFFIC ESTIMATION;

INTERNET;

EID: 33244458049     PISSN: 01635999     EISSN: 01635999     Source Type: Conference Proceeding    
DOI: 10.1145/1071690.1064223     Document Type: Conference Paper

References (31)

1. IPMON - packet trace analysis. http://ipmon.sprintlabs.com/packstat/ packetoverview.php.
2. PSAMP working group, http : //www. ietf . org/ httnl. charters/psamp- charter . httnl.
3. Z. Bar-Yossef, T. Jayram, R. Kumar, D. Sivakumar, and L. Trevisan. Counting distinct elements in a data stream. In Proc. of the 6th International Workshop on Randomization and Approximation Techniques in Computer Science, 2003.
4. B. Bloom. Space/time trade-offs in hash coding with allowable errors. In Commun. ACM, volume 13, pages 422-426, July 1970.
5. J. L. Carter and M. N. Wegman. Universal classes of hash functions. In Journal of Computer and System Sciences, volume 18, Apr. 1979.
6. S. Chaudhuri, R. Motwani, and V. Narasayya. Random sampling for histogram construction: How much is enough? pages 436-447, June 1998.
7. G. Cormode and S. Muthukrishnan. What's hot and what's not: Tracking most frequent items dynamically. In In Proceedings of PODS, June 2003.
8. C. Cranor, T. Johnson, O. Spatschek, and V. Shkapenyuk. Gigascope: A stream database for network applications. In p-sigmod, June 2003.
9. S. A. Crosby and D. S. Wallach. Denial of Service via Algorithmic Complexity Attacks. In Usenix Security. Usenix, Aug. 2003.
10. N. Duffield, C. Lund, and M. Thorup. Charging from sampled network usage. In SIGCOMM Internet Measurement Workshop, Nov. 2001.
11. N. Duffield, C. Lund, and M. Thorup. Estimating flow distributions from sampled flow statistics. In SIGCOMM, pages 325-336, Aug. 2003.
12. M. Durand and P. Flajolet. Loglog counting of large cardinalities. In ESA, Sept. 2003.
13. C. Estan, K. Keys, D. Moore, and G. Varghese. Building a better NetFlow. In SIGCOMM, Aug. 2004.
14. C. Estan and G. Varghese. New directions in traffic measurement and accounting. In SIGCOMM, Aug. 2002.
15. C. Estan, G. Varghese, and M. Fisk. Bitmap algorithms for counting active flows on high speed links. In Internet Measurement Conference, Oct. 2003.
16. M. Fang, N. Shivakumar, H. Garcia-Molina, R. Motwani, and J. D. Ullman. Computing iceberg queries efficiently. In International Conference on Very Large Data Bases, pages 307-317, Aug. 1998.
17. A. Feldmann, A. Greenberg, C. Lund, N. Reingold, J. Rexford, and F. True. Deriving traffic demands for operational IP networks: Methodology and experience. In SIGCOMM, pages 257-270, Aug. 2000.
18. P. Flajolet and G. N. Martin. Probabilistic counting algorithms for data base applications. Journal of Computer and System Sciences, 31(2): 182-209, Oct. 1985.
19. P. B. Gibbons and Y. Matias. New sampling-based summary statistics for improving approximate query answers, pages 331-342, June 1998.
20. Intel Corporation. E7505 Chipset. http : //www.Intel.com/design/chipsets/ e7505/.
21. Intel Corporation. E8870 Chipset. http : //www.Intel.com/design/chipsets/ e8870/.
22. K. Keys, D. Moore, and C. Estan. A robust system for accurate real-time summaries of Internet traffic: Technical report, http: //www.caida .org/outreach/ papers/2005/tr-2005-01/.
23. K. Keys, D. Moore, R. Koga, E. Lagache, M. Tesch, and k claffy. The architecture of CoralReef: an Internet traffic monitoring software suite. In PAM2001 (Passive and Active Measurement Workshop), Apr. 2001.
24. A. Kumar, J. Xu, J. Wang, O. Spatschek, and L. Li. Space-code bloom filter for efficient per-flow traffic measurement. In Proc. of IEEE INFOCOM, Mar. 2004.
25. D. Moore, K. Keys, R. Koga, E. Lagache, and k. claffy. CoralReef software suite as a tool for system and network administrators. In Usenix LISA, San Diego, CA, 4-7 Dec 2001. Usenix.
26. Cisco NetFlow. http: //www. cisco. com/warp/ public/732/Tech/netflow.
27. Sampled NetFlow. http://www.cisco.com/univercd/cc/td/doc/ product/software/ios120/120newft/ 1201imit/120s/120sll/12s_sanf.htm.
28. ServerWorks, Inc. GC-LE Chipset. http : //www.serverworks.com/products/ GCLE.html.
29. S. Venkataraman, D. Song, P. B. Gibbons, and A. Blum. New streaming algorithms for fast detection of superspreaders. In NDSS, Feb. 2005.
30. Waikato Applied Network Dynamics group. The DAG project, http: //dag. cs. waikato. ac .nz/.
31. K.-Y. Whang, B. T. Vander-Zanden, and H. M. Taylor. A linear-time probabilistic counting algorithm for database applications. ACM Transactions on Database Systems, 15 (2):208-229, 1990.