Network prefix-level traffic profiling: Characterizing, modeling, and evaluation

Computer Networks

Volumn 54, Issue 18, 2010, Pages 3327-3340

  Jiang, Hongbo ^a   Ge, Zihui ^b   Jin, Shudong ^c   Wang, Jia ^b  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b AT AND T LABS RESEARCH   (United States)

^c CASE WESTERN RESERVE UNIVERSITY   (United States)

Author keywords

Netflow measurement; Traffic profiling

Indexed keywords

AGGREGATE TRAFFIC; BEHAVIORAL PATTERNS; DATA SERVICES; EMPIRICAL STUDIES; MACHINE LEARNING TECHNIQUES; NETFLOW MEASUREMENT; NETFLOWS; NETWORK MEASUREMENT; STRUCTURAL PATTERN; TRAFFIC BEHAVIOR; TRAFFIC CHARACTERISTICS; TRAFFIC ENGINEERING; TRAFFIC PROFILE; TRAFFIC PROFILING;

FEATURE EXTRACTION; HIGHWAY ENGINEERING; RANGE FINDING; TELECOMMUNICATION TRAFFIC;

NETWORK MANAGEMENT;

EID: 78649491247     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.comnet.2010.06.013     Document Type: Article

References (52)

1. Y. Zhang, M. Roughan, N. Duffield, A. Greenberg, Fast accurate computation of large-scale IP traffic matrices from link loads, in: Proceedings of ACM SIGMETRICS, 2003.
2. Q. Zhao, Z. Ge, J. Wang, J. Xu, Robust traffic matrix estimation with imperfect information: making use of multiple data sources, in: Proceedings of ACM SIGMETRICS, 2006.
3. A.W. Moore, D. Zuevy, Internet traffic classification using Bayesian analysis techniques, in: Proceedings of ACM SIGMETRICS, 2005.
4. K. Xu, Z. Zhang, S. Bhattacharyya, Profiling Internet backbone traffic: behavior models and applications, in: Proceedings of ACM SIGCOMM, 2005.
5. Abilene NetFlow stats. .
6. A. Soule, K. Salamation, N. Taft, R. Emilion, K. Papagiannaki, Flow classification by histograms or how to go on Safari in the Internet, in: Proceedings of ACM SIGMETRICS, 2004.
7. A. Ramachandran, N. Feamster, Understanding the network-level behavior of spammers, in: Proceedings of ACM SIGCOMM, 2006.
8. White Paper-NetFlow Services and Applications. .
9. B.-Y. Choi, S. Bhattacharrya, On the accuracy and overhead of Cisco sampled NetFlow, in: Proceedings of ACM Sigmetrics Workshop on Large-Scale Network Inference (LSNI), 2005.
10. N. Duffield, C. Lund, M. Thorup, Flow sampling under hard resource constraints, in: Proceedings of ACM SIGMETRICS, 2004.
11. H. Zang, A. Nucci, Optimal NetFlow deployment in IP networks, in: Proceedings of 19th International Teletraffic Congress (ITC), 2005.
12. S. Uhlig, O. Bonaventure, B. Quoitin, Interdomain traffic engineering with minimal bgp configurations, in: Proceedings of International Teletraffic Congress, 2003.
13. F. Ricciato, and U. Monaco Routing demands with time-varying bandwidth profiles on a mpls network Computer Networks 47 1 2004 47 61
14. Y. Zhang, Z.M. Mao, J. Wang, A framework for measuring and predicting the impact of routing changes, in: Proceedings of IEEE INFOCOM, 2007.
15. N. Duffield, C. Lund, M. Thorup, Estimating flow distributions from sampled flow statistics, in: Proceedings of ACM SIGCOMM, 2003.
16. K. Anagnostakis, F. Harmantzis, S. Ioannidis, M. Zghaibeh, On the impact of practical p2p incentive mechanisms on user behavior, in: NET Institute Working Paper, No. 06-14, 2006.
17. J. Erman, A. Mahanti, M. Arlitt, Internet traffic identification using machine learning, in: Proceedings of IEEE Globecom, 2006.
18. A. McGregor, M. Hall, P. Lorier, J. Brunskill, Flow clustering using machine learning techniques, in: Proceedings of PAM, 2004.
19. S. Zander, T. Nguyen, G. Armitage, Self-learning IP traffic classification based on statistical flow characteristics, in: Proceedings of PAM, 2005.
20. J. Erman, A. Mahanti, M. Arlitt, Traffic classification using clustering algorithms, in: Proceedings of ACM SIGCOMM MineNet Workshop, 2006.
21. A.K. Jain, and R.C. Dubes Algorithms for Clustering Data 1998 Prentice Hall Englewood Cliffs
22. F. Hernandez-Campos, A.B. Nobel, F.D. Smith, K. Jeffay, Understanding patterns of TCP connection usage with statistical clustering, in: Proceedings of MASCOTS, 2005.
23. S. Wei, J. Mirkovic, E. Kissel, Profiling and clustering Internet hosts, in: Proceedings of the International Conference on Data Mining, 2006.
24. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification 2000 John Wiley & Sons, Inc.
25. K.C. Claffy, H.-W. Braun, and G.C. Polyzos A parameterizable methodology for Internet traffic flow profiling IEEE Journal on Selected Areas in Communications 13 8 1995
26. M. Roughan, S. Sen, O. Spatscheck, N. Duffield, Class-of-service mapping for QoS: a statistical signature-based approach to IP traffic classification, in: Proceedings of ACM SIGCOMM/USENIX IMC, 2004.
27. T. Karagiannis, K. Papagiannaki, M. Faloutsos, BLINC: multilevel traffic classification in the dark, in: Proceedings of ACM SIGCOMM, 2005.
28. A. Lakhina, M. Crovella, C. Diot, Mining anomalies using traffic feature distributions, in: Proceedings of ACM SIGCOMM, 2005.
29. A. Kumar, M. Sung, J. Xu, E.W. Zegura, A data streaming algorithm for estimating subpopulation flow size distribution, in: Proceedings of ACM SIGMETRICS, 2005.
30. R. Teixeira, N. Duffield, J. Rexford, M. Roughan, Traffic matrix reloaded: impact of routing changes, in: Proceedings of PAM, 2005.
31. Correlation Ratio. .
32. A. Soule, K. Salamatian, N. Taft, Combining filtering and statistical methods for anomaly detection, in: Proceedings of ACM SIGCOMM/USENIX IMC, 2005.
33. R. Govindan, A. Reddy, An analysis of internet inter-domain topology and route stability, in: Proceedings of IEEE INFOCOM, 1997.
34. G. Nychis, V. Sekar, D.G. Andersen, H. Kim, H. Zhang, An empirical evaluation of entropy-based traffic anomaly detection, in: Proceedings of ACM SIGCOMM/USENIX IMC, 2008.
35. A. Wagner, B. Plattner, Entropy based worm and anomaly detection in fast IP networks, in: Proceedings of IEEE International Workshop on Enabling Technologies, Infrastructures for Collaborative Enterprises (WETICE), 2005.
36. J. Terrell, K. Jeffay, F.D. Smith, L. Zhang, H. Shen, Z. Zhu, A. Nobel, Multivariate svd analyses for network anomaly detection, in: Proceedings of ACM SIGCOMM (poster), 2005.
37. A. Ramachandran, S. Seetharaman, N. Feamster, V. Vazirani, Fast monitoring of traffic subpopulations, in: Proceedings of ACM SIGCOMM/USENIX IMC, 2008.
38. J.D. Brutlag, Aberrant behavior detection in time series for network monitoring, in: Proceedings of USENIX Systems Administration Conference (LISA), 2000.
39. B. Krishnamurthy, S. Sen, Y. Zhang, Y. Chen, Sketch-based change detection: methods, evaluation, and applications, in: Proceedings of ACM SIGCOMM/USENIX IMC, 2003.
40. Y. Zhang, Z. Ge, A. Greenberg, M. Roughan, Network anomography, in: Proceedings of ACM SIGCOMM/USENIX IMC, 2005.
41. A. Lakhina, M. Crovella, C. Diot, Diagnosing network-wide traffic anomalies, in: Proceedings of ACM SIGCOMM, 2004.
42. Y. Gu, A. McCallum, D. Towsley, Detecting anomalies in network traffic using maximum entropy estimation, in: Proceedings of ACM SIGCOMM/USENIX IMC, 2005.
43. S. Agarwal, C.-N. Chuah, S. Bhattacharyya, C. Diot, The impact of BGP dynamics on intra-domain traffic, in: Proceedings of ACM SIGMETRICS, 2004.
44. F. Palmieri, and U. Fiore A nonlinear, recurrence-based approach to traffic classification Computer Networks 53 6 2009 761 773
45. S. Zander, T. Nguyen, G. Armitage, Automated traffic classification and application identification using machine learning, in: Proceedings of the IEEE Conference on Local Computer Networks, 2005.
46. C. Estan, S. Savage, G. Varghese, Automatically inferring patterns of resource consumption in network traffic, in: Proceedings of ACM SIGCOMM, 2003.
47. K. Xu, Z.-L. Zhang, and S. Bhattacharyya Internet traffic behavior profiling for network security monitoring IEEE/ACM Transactions on Networking 16 6 2008
48. P. Dokas, L. Ertoz, V. Kumar, A. Lazarevic, J. Srivastava, P.-N. Tan, Data mining for network intrusion detection, in: Proceedings of NSF Workshop on Next Generation Data Mining, 2002.
49. A. Lazarevic, L. Ertoz, V. Kumar, A. Ozgur, J. Srivastava, A comparative study of anomaly detection schemes in network intrusion detection, in: Proceedings of Third SLAM Conference on Data Mining, 2003.
50. Y. Jin, E. Sharafuddin, Z.-L. Zhang, Unveiling core network-wide communication patterns through application traffic activity graph decomposition, in: Proceedings of ACM SIGMETRICS, 2009.
51. A. Chen, L. Li, J. Cao, Tracking cardinality distributions in network traffic, in: Proceedings of IEEE INFOCOM, 2009.
52. X. Meng, G. Jiang, H. Zhang, H. Chen, K. Yoshihira, Automatic profiling of network event sequences: algorithm and applications, in: Proceedings of IEEE INFOCOM, 2008.