Unsupervised learning clustering and self-organized agents applied to help network management

Expert Systems with Applications

Volumn 54, Issue , 2016, Pages 29-47

  Carvalho, Luiz Fernando ^a   Barbon, Sylvio ^a   Mendes, Leonardo De Souza ^b   Proença, Mario Lemes ^a  

^a STATE UNIVERSITY OF LONDRINA   (Brazil)

^b UNIVERSITY OF CAMPINAS   (Brazil)

Author keywords

Anomaly detection; Ant Colony Optimization; Network management; Self organized agents; Traffic characterization; Unsupervised learning

Indexed keywords

ANT COLONY OPTIMIZATION; ARTIFICIAL INTELLIGENCE; BUDGET CONTROL; DECISION MAKING; EXPERT SYSTEMS; NETWORK MANAGEMENT; UNSUPERVISED LEARNING;

ANOMALY DETECTION; CURRENT PERFORMANCE; HIGH DETECTION RATE; LARGE-SCALE NETWORK; MANUAL INTERVENTION; MULTIDIMENSIONAL FLOW; PROBABILITY OF ERRORS; TRAFFIC CHARACTERIZATION;

INFORMATION MANAGEMENT;

EID: 84958166080     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2016.01.032     Document Type: Article

References (50)

1. Alazab A., Hobbs M., Abawajy J., Khraisat A., Alazab M. Using response action with intelligent intrusion detection and prevention system against web application malware Information Management & Computer Security 22 2014 431 449
2. Anukool L., Mark C., Christophe D. Mining anomalies using traffic feature distributions Proceedings of the 2005 conference on applications, technologies, architectures, and protocols for computer communications Philadelphia, Pennsylvania, USA 2005 ACM
3. Bharambe A., Ravindran R., Suchdev R., Tanna Y. A robust anomaly detection system Proceedings of the international conference on advances in engineering and technology research (ICAETR) 2014 1 7
4. Bhuyan M.H., Bhattacharyya D.K., Kalita J.K. Network anomaly detection: Methods, systems and tools IEEE Communications Surveys & Tutorials 16 2014 303 336
5. Cerroni W., Moro G., Pasolini R., Ramilli M. Decentralized detection of network attacks through P2P data clustering of SNMP data Computers & Security 52 2015 1 16
6. Corral G., Armengol E., Fornells A., Golobardes E. Explanations of unsupervised learning clustering applied to data security analysis Neurocomputing 72 2009 2754 2762
7. David J., Thomas C. DDoS attack detection using fast entropy approach on flow- based network traffic Procedia Computer Science 50 2015 30 36
8. de Assis M.V.O., Proença M.L. Jr. Scorpius: sFlow network anomaly simulator Journal of Computer Science 11 2015 662 674
9. de Assis M.V.O., Rodrigues J.J.P.C., Lemes Proenca Junior M. A novel anomaly detection system based on seven-dimensional flow analysis Proceedings of the IEEE global communications conference (GLOBECOM) 2013 735 740
10. de Assis M.V.O., Rodrigues J.J.P.C., Proença M.L. Jr. A seven-dimensional flow analysis to help autonomous network management Information Sciences 278 2014 900 913
11. Deneubourg J.L., Goss S., Franks N., Sendova-Franks A., Detrain C., Chrétien L. The dynamics of collective sorting robot-like ants and ant-like robots Proceedings of the first international conference on simulation of adaptive behavior on from animals to animals Paris, France 1990 MIT Press
12. Dorigo M., Birattari M., Stutzle T. Ant colony optimization IEEE Computational Intelligence Magazine 1 2006 28 39
13. Dunn J.C. A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters Journal of Cybernetics 3 1973 32 57
14. Duo L., Chung-Horng L., Seddigh N., Nandy B. Network traffic anomaly detection using adaptive density-based fuzzy clustering Proceedings of the 13th international conference on trust, security and privacy in computing and communications (TrustCom), 2014 2014 823 830
15. Elhag S., Fernández A., Bawakid A., Alshomrani S., Herrera F. On the combination of genetic fuzzy systems and pairwise learning for improving detection rates on intrusion detection systems Expert Systems with Applications 42 2015 193 202
16. Elhdhili M.E., Ben Azzouz L., Kamoun F. CASAN: Clustering algorithm for security in ad hoc networks Computer Communications 31 2008 2972 2980
17. Esling P., Agon C. Time-series data mining ACM Computing Surveys 45 2012 1 34
18. Fang C., Jin W., Ma J. Means algorithms for clustering analysis with frequency sensitive discrepancy metrics Pattern Recognition Letters 34 2013 580 586
19. Fernandes G. Jr., Rodrigues J.J.P.C., Proença M.L. Jr. Autonomous profile-based anomaly detection system using principal component analysis and flow analysis Applied Soft Computing 34 2015 513 525
20. Gulisano V., Callau-Zori M., Fu Z., Jiménez-Peris R., Papatriantafilou M., Patiño-Martínez M. STONE: A streaming DDoS defense framework Expert Systems with Applications 42 2015 9620 9633
21. Hong J., Qingsong Y., Yu G. An improved ant colony clustering algorithm Proceedings of the 3rd international conference on biomedical engineering and informatics (BMEI), 2010 vol. 6 2010 2368 2372
22. Hui F. A novel clustering algorithm with ant colony optimization Proceedings of the Pacific-Asia workshop on computational intelligence and industrial application, 2008. paciia '08. vol. 2 2008 66 69
23. Jiang F., Sui Y., Cao C. An information entropy-based approach to outlier detection in rough sets Expert Systems with Applications 37 2010 6338 6344
24. Kim B., Kim H., Bahk S. FDF: Frequency detection-based filtering of scanning worms Computer Communications 32 2009 847 857
25. Kim G., Lee S., Kim S. A novel hybrid intrusion detection method integrating anomaly detection with misuse detection Expert Systems with Applications 41 2014 1690 1700
26. Kolias C., Kambourakis G., Maragoudakis M. Swarm intelligence in intrusion detection: A survey Computers & Security 30 2011 625 642
27. Laurent A., Olivier F., Abdelkader L., Aiko P., rgen S., nw, lder Survey of SNMP performance analysis studies vol. 19 2009 John Wiley & Sons, Inc 527 548
28. Lee S., Kim G., Kim S. Self-adaptive and dynamic clustering for online anomaly detection Expert Systems with Applications 38 2011 14891 14898
29. Lei J.Z., Ghorbani A.A. Improved competitive learning neural networks for network intrusion and fraud detection Neurocomputing 75 2012 135 145
30. Lima M.F., Sampaio L.D.H., Zarpelão B.B., Rodrigues J.J.P.C., Abrao T., Proença M.L. Networking anomaly detection using DSNs and particle swarm optimization with re-clustering Proceedings of the IEEE global telecommunications conference (GLOBECOM 2010), 2010 1 6
31. Liu D., Zhao Y., Xu H., Sun Y., Pei D., Luo J., Jing X., Feng M. Opprentice: Towards practical and automatic anomaly detection through machine learning Proceedings of the 2015 ACM conference on internet measurement conference Tokyo, Japan 2015 ACM 211 224
32. MacQueen J. Some methods for classification and analysis of multivariate observations Proceedings of the Fifth Berkeley symposium on mathematical statistics and probability Vol. 1 1967 Univ. of Calif. Press 281 297
33. Marnerides A.K., Schaeffer-Filho A., Mauthe A. Traffic anomaly diagnosis in Internet backbone networks: A survey Computer Networks 73 2014 224 243
34. Molnar S., Moczar Z. Three-dimensional characterization of internet flows Proceedings of the IEEE international conference on communications (ICC), 2011 2011 1 6
35. Paul B., Jeffery K., David P., Amos R. A signal analysis of network traffic anomalies Proceedings of the 2nd ACM SIGCOMM workshop on internet measurment Marseille, France 2002 ACM
36. Phaal P., Panchen S., McKee N. InMon corporation's sFlow: A method for monitoring traffic in switched and routed networks RFC 3176 2001
37. Poli A.A., Cirillo M.C. On the use of the normalized mean square error in evaluating dispersion model performance Atmospheric Environment. Part A. General Topics 27 1993 2427 2434
38. Proença M.L. Jr., Coppelmans C., Bottoli M., Souza Mendes L. Baseline to help with network management e-Business and telecommunication networks 2006 Springer Netherlands 158 166
39. Rousseeuw P.J. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis Journal of Computational and Applied Mathematics 20 1987 53 65
40. Sakoe H., Chiba S. Dynamic programming algorithm optimization for spoken word recognition IEEE Transactions on Acoustics, Speech and Signal Processing 26 1978 43 49
41. Sànchez-Artigas M., García-López P., Gómez-Skarmeta A.F., Santa J. TR-clustering: Alleviating the impact of false clustering on P2P overlay networks Computer Networks 52 2008 3185 3204
42. Shelokar P.S., Jayaraman V.K., Kulkarni B.D. An ant colony approach for clustering Analytica Chimica Acta 509 2004 187 195
43. Shuying C., Xuesong Q., Zhipeng G., Ke L., Feng Q. A flow-based anomaly detection method using sketch and combinations of traffic features Proceedings of the international conference on network and service management (CNSM), 2010 302 305
44. Singh R., Kumar H., Singla R.K. An intrusion detection system using network traffic profiling and online sequential extreme learning machine Expert Systems with Applications 42 2015 8609 8624
45. Tellenbach B., Burkhart M., Schatzmann D., Gugelmann D., Sornette D. Accurate network anomaly classification with generalized entropy metrics Computer Networks 55 2011 3485 3502
46. Tom F. An introduction to ROC analysis Vol. 27 2006 Elsevier Science Inc 861 874
47. Wang W., Yang B., Chen Y.V. Detecting subtle port scans through characteristics based on interactive visualization Proceedings of the 3rd annual conference on Research in information technology Atlanta, Georgia, USA 2014 ACM 33 38
48. Yun Y., Ke C. Temporal data clustering via weighted clustering ensemble with different representations IEEE Transactions on Knowledge and Data Engineering 23 2011 307 320
49. Zarpelão B.B., Mendes L.d.S., Proença L.M. Jr. Anomaly detection aiming pro-active management of computer network based on digital signature of network segment Journal of Network and Systems Management 15 2007 267 283
50. Zhiyuan T., Jamdagni A., Xiangjian H., Nanda P., Ren Ping L. A system for denial-of-service attack detection based on multivariate correlation analysis IEEE Transactions on Parallel and Distributed Systems, 25 2014 447 456