Efficient classification using parallel and scalable compressed model and its application on intrusion detection

Expert Systems with Applications

Volumn 41, Issue 13, 2014, Pages 5972-5983

  Chen, Tieming ^a   Zhang, Xu ^a   Jin, Shichao ^b   Kim, Okhee ^b  

^a ZHEJIANG UNIVERSITY OF TECHNOLOGY   (China)

^b PEKING UNIVERSITY   (China)

Author keywords

Classification; Compressed model; Intrusion detection; MapReduce; Parallelization

Indexed keywords

INTRUSION DETECTION; MULTIPROCESSING SYSTEMS;

AFFINITY PROPAGATION; ATTRIBUTE REDUCTION; CLASSIFICATION METHODS; EXPERIMENTAL APPLICATION; ITS APPLICATIONS; MAP-REDUCE; MODEL COMPRESSION; PARALLELIZATIONS;

CLASSIFICATION (OF INFORMATION);

EID: 84899721363     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2014.04.009     Document Type: Article

References (50)

1. I. Ahmad, A. Abdullah, and A. Alghamdi et al. Optimized intrusion detection mechanism using soft computing techniques Telecommunication Systems 2011 1 9
2. I. Aljarah, and S.A. Ludwig Towards a scalable intrusion detection system based on parallel PSO clustering using mapreduce Proceeding of the fifteenth annual conference companion on Genetic and evolutionary computation conference companion 2013 ACM 169 170
3. F. Amiri, M.M. Rezaei Yousefi, and C. Lucas et al. Mutual information-based feature selection for intrusion detection systems Journal of Network and Computer Applications 34 4 2011 1184 1199
4. V. Bolón-Canedo, N. Sánchez-Maroño, and A. Alonso-Betanzos Feature selection and classification in multiple class datasets: An application to KDD Cup 99 dataset Expert Systems with Applications 38 5 2011 5947 5957
5. A.A. Cardenas, P.K. Manadhata, and S.P. Rajan Big data analytics for security IEEE Security & Privacy 11 6 2013 0074 0076
6. C.C. Chang, and C.J. Lin LIBSVM: A library for support vector machines ACM Transactions on Intelligent Systems and Technology (TIST) 2 3 2011 27
7. Daniela, B., Kavé, S., & Margin, M. (2010). A signal processing view on packet sampling and anomaly detection. In IEEE INFOCOM (pp. 713-721).
8. J.J. Davis, and A.J. Clark Data preprocessing for anomaly based network intrusion detection: A review Computers & Security 30 6 2011 353 375
9. H.T. Elshoush, and I.M. Osman Alert correlation in collaborative intelligent intrusion detection systems - A survey Applied Soft Computing 11 7 2011 4349 4365
10. K.M. Faraoun, and A. Boukelif Neural networks learning improvement using the K-means clustering algorithm to detect network intrusions International Journal of Computational Intelligence 3 2 2006 161 168
11. D.M. Farid, and M.Z. Rahman Anomaly network intrusion detection based on improved self adaptive bayesian algorithm Journal of Computers 5 1 2010 23 31
12. B.J. Frey, and D. Dueck Clustering by passing messages between data points Science 315 5814 2007 972 976
13. V. Giorgos, A. Spyros, P. Michalis, P.M. Evangelos, and L. Sotiris Gnort: High performance network intrusion detection using graphics processors Recent Advances in Intrusion Detection 2008 116 134
14. Hadoop, (2014). http://hadoop.apache.org.
15. R.C. Holte Very simple classification rules perform well on most commonly used datasets Machine Learning 11 1 1993 63 90
16. M.D. Holtz, B.M. David, and R.T. de Sousa Júnior Building scalable distributed intrusion detection systems based on the mapreduce framework Revista Telecomunicacoes 2 2011 22 31
17. S.J. Horng, M.Y. Su, and Y.H. Chen et al. A novel intrusion detection system based on hierarchical clustering and support vector machines Expert systems with Applications 38 1 2011 306 313
18. Information and Computer Science of University of California, (1999). http://kdd.ics.uci.edu/databases/kddcup99/kddcup99.html.
19. H. Jiang, G. Zhang, and G. Xie et al. Scalable high-performance parallel design for network intrusion detection systems on many-core processors Proceedings of the ninth ACM/IEEE symposium on Architectures for networking and communications systems 2013 IEEE Press 137 146
20. I. Kang, M.K. Jeong, and D. Kong A differentiated one-class classification method with applications to intrusion detection[J] Expert Systems with Applications 39 4 2012 3899 3905
21. L. Khan, M. Awad, and B. Thuraisingham A new intrusion detection system using support vector machines and hierarchical clustering The VLDB Journal-The International Journal on Very Large Data Bases 16 4 2007 507 521
22. M. Kurdziel, and K. Boryczko Finding exemplars in dense data with affinity propagation on clusters of GPUs Concurrency and Computation: Practice and Experience 25 8 2013 1137 1152
23. W. Lee, and S.J. Stolfo A framework for constructing features and models for intrusion detection systems ACM transactions on Information and system security (TiSSEC) 3 4 2000 227 261
24. Y. Li, J. Xia, and S. Zhang et al. An efficient intrusion detection system based on support vector machines and gradually feature removal method Expert Systems with Applications 39 1 2012 424 430
25. H.J. Liao, K.Y. Tung, and C.H. Richard Lin et al. Intrusion detection system: A comprehensive review Journal of Network and Computer Applications 36 1 2013 16 24
26. G. Liu, Z. Yi, and S. Yang A hierarchical intrusion detection model based on the PCA neural networks Advances in computational intelligence and learning in 14th European symposium on artificial neural networks, March 2007 Neurocomputing 70 7-9 2007 1561 1568
27. B. Luo, and J. Xia A novel intrusion detection system based on feature generation with visualization strategy Expert Systems with Applications 41 9 2014 4139 4147
28. Martin, R. (1999). Snort: Lightweight intrusion detection for networks. In USENIX Systems Administration Conference - LISA (pp. 229-238).
29. Y. Meng Adaptive false alarm filter using machine learning in intrusion detection Practical Applications of Intelligent Systems 2012 Springer Berlin, Heidelberg pp. 573-584
30. Z. Muda, W. Yassin, and M.N. Sulaiman et al. Intrusion detection with K-means clustering and oner classification Journal of Information Assurance & Security 7 6 2012
31. T. Pietraszek Using adaptive alert classification to reduce false positives in intrusion detection Recent Advances in Intrusion Detection 2004 Springer Berlin, Heidelberg pp. 102-124
32. P.G. Prathibha, and E.D. Dileesh Design of a hybrid intrusion detection system using snort and hadoop International Journal of Computer Applications 73 10 2013 5 10
33. R. Rouhi, F. Keynia, and M. Amiri Improving the intrusion detection systems performance by correlation as a sample selection method Journal of Computer Sciences and Applications 1 3 2013 33 38
34. S. Sakr, A. Liu, and A.G. Fayoumi The family of MapReduce and large-scale data processing systems ACM Computing Surveys (CSUR) 46 1 2013 11
35. J. Song, Z. Zhu, and P. Scully et al. Selecting features for anomaly intrusion detection: A novel method using fuzzy c means and decision tree classification Cyberspace Safety and Security 2013 Springer International Publishing pp. 299-307
36. G.P. Spathoulas, and S.K. Katsikas Reducing false positives in intrusion detection systems Computers & Security 29 1 2010 35 44
37. C. Srilatha, A. Ajith, and P.T. Johnson Feature duduction and ensemble design of intrusion detection systems Computer & Security - COMPSEC 24 4 2005 295 307
38. Srinivas, M., & Andrew, H. S. (2003). Feature selection for intrusion detection using neural networks and support vector machines. In Annual meeting of the transportation research board.
39. L. Sun, and C. Guo Incremental affinity propagation clustering based on message passing IEEE Transactions on Knowledge and Data Engineering 99 1 2014 1 10
40. The 3rd Cybersecurity Data Mining Competition, (2012). http://www.csmining.org/cdmc2012/.
41. C.F. Tsai, and C.Y. Lin A triangle area based nearest neighbors approach to intrusion detection Pattern Recognition 43 1 2010 222 229
42. C. Varun, B. Arindam, and K. Vipin Anomaly detection: A survey ACM Computing Surveys 41 3 2009 1 58
43. F. Wang, S. Chawla, and D. Surian Latent outlier detection and the low precision problem Proceedings of the ACM SIGKDD workshop on outlier detection and description 2013 ACM 46 52
44. W. Wang, and X. Zhang High-speed web attack detection through extracting exemplars from HTTP traffic Proceedings of the 2011 ACM symposium on applied computing 2011 ACM 1538 1543
45. W. Wang, X. Zhang, and G. Pitsilis Abstracting audit data for lightweight intrusion detection Information systems security 2011 Springer Berlin, Heidelberg pp. 201-215
46. D. Wegener, M. Mock, and D. Adranale et al. Toolkit-based high-performance data mining of large data on mapreduce clusters Data mining workshops, ICDMW'09, IEEE international conference 2009 IEEE 296 301
47. M. Wei, L. Xia, and J. Jin et al. Research of intrusion detection based on clustering analysis Proceedings of the 2012 international conference on cybernetics and informatics 2013 Springer New York 1973 1979
48. Wenke, L., & Salvatore, J. S. (1998). Data mining approaches for intrusion detection. In USENIX security symposium.
49. Yang, L., Tian-Bo, L., Li, G., Zhi-Hong, T., & Lin, Q. (2009) Optimizing network anomaly detection scheme using instance selection mechanism. In Global telecommunications conference (pp. 1-7).
50. J.P. Zhang, F.C. Chen, and L.X. Liu et al. Online stream clustering using density and affinity propagation algorithm 2013 4th IEEE international conference on software engineering and service science (ICSESS) 2013 IEEE 828 832