Feature selection and classification in multiple class datasets: An application to KDD Cup 99 dataset

Expert Systems with Applications

Volumn 38, Issue 5, 2011, Pages 5947-5957

  Bolon Canedo V ^a   Sanchez Marono N ^a   Alonso Betanzos, A ^a  

^a UNIVERSITY OF A CORUÑA   (Spain)

Author keywords

Classification; Discretization; Feature selection; Filters; KDD Cup 99 dataset

Indexed keywords

CLASSIFICATION; DATA SETS; DISCRETIZATIONS; FEATURE SELECTION; FILTERS;

CLASSIFICATION (OF INFORMATION); CLASSIFIERS;

FEATURE EXTRACTION;

EID: 79151484606     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2010.11.028     Document Type: Article

References (46)

1. E.L. Allwein, R.E. Schapire, and Y. Singer Reducing multiclass to binary: A unifying approach for margin classifiers Journal of Machine Learning Research 1 2001 113 141
2. A. Alonso-Betanzos, N. Sanchez-Maroño, F.M. Carballal-Fortes, J. Suarez-Romero, and B. Perez-Sanchez Classification of computer intrusions using functional networks. A comparative study Proceedings of the european symposium on artificial neural networks (ESANN) 2007 25 27
3. C.M. Bishop Neural networks for pattern recognition 1995 Oxford University Press New York
4. Blake, C. L.; & Merz, C. J. (1998). UCI repository of machine learning databases. Department of Information and Computer Science, University of California, Irvine. Accessed 27.07.09.
5. V. Bolón-Canedo, N. Sánchez-Maroño, and A. Alonso-Betanzos A combination of discretization and filter methods for improving classification performance in KDD Cup 99 dataset Proceedings of the international joint conference on neural networks (IJCNN) 2009 359 366
6. A. Bosin, N. Dess, and B. Pes Capturing heuristic and intelligent methods for improving micro-array data classification Proceedings of the intelligent data engineering and automated learning (IDEAL) 2007 790 799
7. L. Bruzzone, and S.B. Serpico A technique for feature selection in multiclass problems International Journal of Remote Sensing 21 3 2000 549 563
8. E. Castillo, O. Fontenla-Romero, B. Guijarro-Berdiñas, and A. Alonso-Betanzos A global optimum approach for one-layer neural networks Neural Computation 14 6 2002 1429 1449
9. S. Chebrolu, A. Abraham, and J.P. Thomas Feature deduction and ensemble design of intrusion detection systems Journal of Computers & Security 24 4 2005 295 307
10. B. Chiblovskii, and L. Lecerf Scalable feature selection for multiclass problems Proceedings of the 2008 european conference on machine learning and knowledge discovery in databases (ECML PKDD'08) 2008 227 240
11. M. Dash, and H. Liu Consistency-based search in feature selection Artificial Intelligence Journal 151 1-2 2003 155 176
12. T.G. Dietterich, and G. Bakiri Solving multiclass learning problems via error-correcting output codes Journal of Artificial Intelligence Research 2 1995 263 286
13. J. Dougherty, R. Kohavi, and M. Sahami Supervised and unsupervised discretization of continuous features Proceedings of the 12th international conference on machine learning (ICMC) 1995 194 202
14. C. Elkan Results of the KDD'99 Classifier learning Journal ACM SIGKDD Explorations Newsletter 1 2 2000 63 64
15. U.M. Fayyad, and K.B. Irani Multi-interval discretization of continuous-valued attributes for classification learning Proceedings of the 13th international joint conference on artificial intelligence (IJCAI) 1993 1022 1029
16. G. Forman An extensive empirical study of feature selection metrics for text classification The Journal of Machine Learning Research 3 2003 1289 1305
17. M. Fugate, and J.R. Gattiker Computer intrusion detection with classification and anomaly detection, using SVMs International Journal of Pattern Recognition and Artificial Intelligence 17 3 2003 441 458
18. J. Fürnkranz Round Robin classification Journal of Machine Learning Research 2 2002 721 747
19. K. Grabczewski, and N. Jankowski Transformations of symbolic data for continuous data oriented models Lecture Notes in Computer Science 2003 359 366
20. I. Guyon, S. Gunn, M. Nikravesh, and L. Zadeh Feature extraction, foundations and applications 2006 Springer
21. Hall, M. A. (1999). Correlation-based feature selection for machine learning. Ph.D. thesis, University of Waikato, Hamilton, New Zealand.
22. G. Holmes, B. Pfahringer, R. Kirkby, E. Frank, and M. Hall Multiclass alternating decision trees Proceedings of the european conference on machine learning (ECML) 2002 161 172
23. D. Janssens, T. Brijs, K. Vanhoof, and G. Wets Evaluating the performance of cost-based discretization versus entropy and error-based discretization Computers and Operations Research Journal 33 11 2006 3107 3123
24. N. Japkowicz The class imbalance problem: A systematic study Journal of Intelligent Data Analysis 6 5 2002 429 449
25. H.G. Kayacik, A.N. Zincir-Heywood, and M.I. Heywood Selecting features for intrusion detection: A feature relevance analysis on KDD 99 intrusion detection datasets Proceedings of the third annual conference on privacy, security and trust 2005
26. KDD Cup 99 dataset. Accessed 14.07.09.
27. T.M. Khoshgoftaar, K. Gao, and N.H. Ibrahim Evaluating indirect and direct classification techniques for network intrusion detection Journal of Intelligent Data Analysis 9 3 2005 309 326
28. R. Kohavi, and G. John Wrappers for feature subset selection Artificial Intelligence Journal, Special Issue on Relevance 97 1-2 1997 273 324
29. R.P. Lippmann, D.J. Fried, I. Graf, J.W. Haines, K.R. Kendall, and D. McClung Evaluating intrusion detection systems: The 1998 DARPA off-line intrusion detection evaluation Proceedings of the DARPA information survivability conference and exposition 1998 2
30. H. Liu, F. Hussain, C.L. Tan, and M. Dash Discretization: An enabling technique Data Mining and Knowledge Discovery Journal 6 4 2002 393 423
31. H. Liu, and R. Setiono A probabilistic approach to feature selection - A filter solution Proceedings of the 13th international conference on machine learning (ICMC) 1996 319 327
32. H. Liu, and R. Setiono Feature selection via discretization Journal of IEEE Transactions on Knowledge and Data Engineering 9 4 1997 642 645
33. O.L. Mangasarian, and E.W. Wild Proximal support vector machine classifiers Proceedings KDD-2001: Knowledge discovery and data mining 2001 77 86
34. S. Mukkamala, G. Janowski, and A.H. Sung Intrusion detection using neural networks and support vector machines Proceedings of hybrid information systems advances in soft computing 2001 121 138
35. S. Mukkamala, and A.H. Sung Feature ranking and selection for intrusion detection systems using support vector machines International conference on information and knowledge engineering (ICIKE) 2002 503 509
36. S. Mukkamala, A.H. Sung, and A. Abraham Intrusion detection using an ensemble of intelligent paradigms Journal of Network and Computer Applications 28 2 2005 167 182
37. B. Pfahringer Winning the KDD99 Classification Cup: Bagged boosting Journal of ACM SIGKDD Explorations Newsletter 1 2 2000 65 66
38. W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling Numerical recipes in C 1992 Cambridge University Press
39. J.R. Quinlan C4.5: Programs for machine learning 1993 Morgan Kaufmann
40. I. Rish An empirical study of the naive Bayes classifier Proceedings of IJCAI-01 workshop on empirical methods in artificial intelligence 2001 41 46
41. S. Stolfo, W. Fan, W. Lee, A. Prodomidis, and R.K. Chan Cost-based modeling for fraud and intrusion detection: Results from the JAM project Proceedings of the DARPA information survivability conference and exposition 2000
42. I.H. Witten, and E. Frank Data mining: Practical machine learning tools and techniques 2nd ed. 2005 Morgan Kaufmann San Francisco
43. Y. Yang, and G.I. Webb Proportional k-Interval Discretization for naive-Bayes classifiers Proceedings of the 12th european conference on machine learning (EMCL) 2001 564 575
44. Y. Yang, and G.I. Webb A comparative study of discretization methods for naive-Bayes classifiers Proceedings of the Pacific rim knowledge acquisition workshop (PKAW) 2002 159 173
45. N. Yukinawa, S. Oba, K. Kato, and S. Ishii Optimal aggregation of binary classifiers for multi-class cancer diagnosis using gene expression profiles IEEE/ACM Transactions on Computational Biology and Bioinformatics 2007 31
46. Z. Zhao, and H. Liu Searching for interacting features Proceedings of international joint conference on artificial intelligence (IJCAI) 1991 1156 1167