An internet traffic analysis method with MapReduce

2010 IEEE/IFIP Network Operations and Management Symposium Workshops, NOMS 2010

Volumn , Issue , 2010, Pages 357-361

  Lee, Youngseok ^a   Kang, Wonchul ^a   Son, Hyeongu ^a  

^a Chungnam National University   (South Korea)

Author keywords

Cloud computing; Hadoop; MapReduce; NetFlow; Traffic monitoring

Indexed keywords

CLOUD COMPUTING; HADOOP; MAPREDUCE; NETFLOWS; TRAFFIC MONITORING;

CLUSTER COMPUTING; COMPUTER NETWORK PERFORMANCE EVALUATION; DATA PROCESSING; GRID COMPUTING; INTERNET; MONITORING; QUALITY ASSURANCE; SAMPLING; TECHNICAL PRESENTATIONS; TRAFFIC SURVEYS;

DATA FLOW ANALYSIS;

EID: 77957915993     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/NOMSW.2010.5486551     Document Type: Conference Paper

References (15)

1. Cisco NetFlow, http://www.cisco.com/web/go/netflow.
2. L. Deri, nProbe: an Open Source NetFlow Probe for Gigabit Networks, TERENA Networking Conference, May 2003.
3. J. Quittek, T. Zseby, B. Claise, and S. Zander, Requirements for IP Flow Information Export (IPFIX), IETF RFC 3917, October 2004.
4. tcpdump, http://www.tcpdump.org.
5. CAIDA CoralReef Software Suite, http://www.caida.org/tools/measurement/ coalreef.
6. M. Fullmer and S. Romig, The OSU Flow-tools Package and Cisco NetFlow Logs, USENIX LISA, 2000.
7. D. Plonka, FlowScan: a Network Traffic Flow Reporting and Visualizing Tool, USENIX Conference on System Administration, 2000.
8. J. Dean and S. Ghemawat, MapReduce: Simplified Data Processing on Large Cluster, OSDI, 2004.
9. Hadoop, http://hadoop.apache.org/.
10. H. Kim, K. Claffy, M. Fomenkov, D. Barman, M. Faloutsos, and K. Lee Internet Traffic Classification Demystified: Myths, Caveats, and the Best Practices, ACM CoNEXT, 2008.
11. C. Morariu, T. Kramis, B. Stiller DIPStorage: Distributed Architecture for Storage of IP Flow Records., 16thWorkshop on Local and Metropolitan Area Networks, September 2008.
12. M. Roesch, Snort - Lightweight Intrusion Detection for Networks, USENIX LISA, 1999.
13. W. Chen and J. Wang, Building a Cloud Computing Analysis System for Intrusion Detection System, CloudSlam 2009.
14. Ashish Thusoo, Joydeep Sen Sarma, Namit Jain, Zheng Shao, Prasad Chakka, Suresh Anthony, Hao Liu, Pete Wyckoff, Raghotham Murthy Hive: a warehousing solution over a map-reduce framework., Proceedings of the VLDB Endowment Volume 2, Issue 2 (August 2009) Pages: 1626-1629
15. HBase, http://hadoop.apache.org/hbase/.