Streaming solutions for fine-grained network traffic measurements and analysis

Proceedings - 2011 7th ACM/IEEE Symposium on Architectures for Networking and Communications Systems, ANCS 2011

Volumn , Issue , 2011, Pages 227-238

  Khan, Faisal ^a   Hosein, Nicholas ^a   Chuah, Chen Nee ^a   Ghiasi, Soheil ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Algorithm design and analysis; Network Anomaly Detection; Network Management; Real time embedded systems; Streaming Algorithms

Indexed keywords

ALGORITHM DESIGN AND ANALYSIS; CLOSED-LOOP; COMPUTATIONAL BUDGET; DETECTION LATENCY; DOS ATTACKS; ELEPHANT FLOW; NETWORK ANOMALY DETECTION; NETWORK TRAFFIC MEASUREMENT; OPEN LOOPS; PRACTICAL REALIZATIONS; REAL-TIME EMBEDDED SYSTEMS; RESOURCE UTILIZATIONS; STREAMING ALGORITHM; STREAMING ALGORITHMS; STREAMING NETWORKS; WORST-CASE COMPLEXITY;

ALGORITHMS; EMBEDDED SYSTEMS; MEASUREMENTS; NETWORK ARCHITECTURE; REAL TIME SYSTEMS;

NETWORK MANAGEMENT;

EID: 81255200570     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ANCS.2011.45     Document Type: Conference Paper

References (15)

1. Cisco NetFlow. "http: //www.cisco.com/warp/public/732/Tech/ netflow".
2. CAIDA: Cooperative Association for Internet Data Analysis. http://www.caida.org/data/passive/ backscatter-tocs-dataset.xml.
3. N. Brownlee, C. Mills, and G. Ruth. Traffic Flow Measurement: Architecture. RFC 2722, 1999. http://www.ietf.org/rfc/rfc2722.txt.
4. G. Cormode, F. Korn, S. Muthukrishnan, and D. Srivastava. Diamond in the rough: finding hierarchical heavy hitters in multi-dimensional data. In Proceedings of the 2004 ACM SIGMOD international conference on Management of data, SIGMOD '04, pages 155-166, New York, NY, USA, 2004. ACM.
5. G. Cormode and S. Muthukrishnan. An improved data stream summary: the count-min sketch and its applications. J. Algorithms, 55:58-75, April 2005. (Pubitemid 40357145)
6. N. G. Duffield. Sampling for passive internet measurement: A review. Statistical Science, 19(3), 2004.
7. C. Estan and G. Varghese. New Directions in Traffic Measurement and Accounting: Focusing on the elephants, ignoring the mice. ACM Transactions on Computer Systems, 21(3):270-313, 2003.
8. L. Jose, M. Yu, and J. Rexford. Online measurement of large traffic aggregates on commodity switches.
9. J. Jung, B. Krishnamurthy, and M. Rabinovich. Flash crowds and denial of service attacks: characterization and implications for cdns and web sites. In Proceedings of the 11th international conference on World Wide Web, WWW '02, pages 293-304, New York, NY, USA, 2002. ACM.
10. F. Khan, N. Hosein, S. Vernon, and S. Ghiasi. BURAQ: A dynamically reconfigurable system for stateful measurement of network traffic. Field-Programmable Custom Computing Machines, Annual IEEE Symposium on, 0:185-192, 2010.
11. F. Khan, L. Yuan, C.-N. Chuah, and S. Ghiasi. A Programmable Architecture for Scalable and Real-time Network Traffic Measurements. In ANCS '08: Proceedings of the 4th ACM/IEEE Symposium on Architectures for Networking and Communications Systems, pages 109-118, 2008.
12. J. Mai, C.-N. Chuah, A. Sridharan, T. Ye, and H. Zang. Is sampled data sufficient for anomaly detection? In Proceedings of the 6th ACM SIGCOMM conference on Internet measurement, IMC '06, pages 165-176, New York, NY, USA, 2006. ACM.
13. A. Ramachandran, S. Seetharaman, and N. Feamster. Fast monitoring for traffic subpopulations. In IMC '08: Proceedings of the 8th ACM SIGCOMM conference on Internet measurement, pages 257-270, 2008.
14. L. Yuan, C.-N. Chuah, and P. Mohapatra. ProgME: towards programmable network measurement. In SIGCOMM '07: Proceedings of the 2007 conference on Applications, technologies, architectures, and protocols for computer communications, pages 97-108, 2007.
15. Y. Zhang, S. Singh, S. Sen, N. Duffield, and C. Lund. Online identification of hierarchical heavy hitters: algorithms, evaluation, and applications. In IMC, 2004.