An information theoretic approach for feature selection

Security and Communication Networks

Volumn 5, Issue 2, 2012, Pages 178-185

  Kumar, Gulshan ^a   Kumar, Krishan ^b  

^a Malout Institute of Management and Information Technology   (India)

^b Shaheed Bhagat Singh College of Engineering & Technology   (India)

Author keywords

Feature selection; Mutual information; Redundancy; Relevance

Indexed keywords

COMPUTATION THEORY; FEATURE EXTRACTION; FUNCTION EVALUATION; INFORMATION THEORY; INTRUSION DETECTION; REDUNDANCY;

CLASSIFICATION OF DATA; CLASSIFICATION RESULTS; CONDITIONAL INTERACTIONS; FEATURE SELECTION METHODS; INFORMATION-THEORETIC APPROACH; MUTUAL INFORMATIONS; RELEVANCE; RELEVANCE AND REDUNDANCIES;

CLASSIFICATION (OF INFORMATION);

EID: 84856248608     PISSN: 19390114     EISSN: 19390122     Source Type: Journal    
DOI: 10.1002/sec.303     Document Type: Article

References (26)

1. Bellman R. Adaptive Control Processes: A Guided Tour. Princeton University Press: Princeton, 1961.
2. Kohavi R, John GH. Wrappers for feature subset selection. Artificial Intelligence 1997; 1(2): 273-324.
3. Daelemans W. Combined optimization of feature selection and algorithm parameter interaction in machine learning of language. In 14th European Conference on Machine Learning (ECML-2003), 2003; 84-95.
4. Guyon I, Elisseeff A. An introduction to variable and feature selection. Journal of Machine Learning Research 2003; 3: 1157-1182.
5. Ramaswami M, Bhaskaran R. A study on feature selection techniques in educational data mining. Journal of Computing 2009; 1(1): 7-11.
6. Yu L, Liu H. Efficient feature selection via analysis of relevance and redundancy. Journal of Machine Learning Research 2004; 5: 1205-1224.
7. Peng H, Long F, Ding C. Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 2005; 27(8): 1226-1238.
8. Kira K, Rendell L. A practical approach to feature selection. In Proceedings of 9th International Conference on Machine Learning, Morgan Kaufmann, Los Altos, CA, 1992; 249-256.
9. Hall MA. Correlation-based feature subset selection for machine learning. Ph.D. Dissertation, Department of Computer Science, University of Waikato, Hamilton, New Zealand, 1999.
10. Quinlan R. C4.5 Programs for Machine Learning. Morgan Kaufmann Publishers: San Mateo, CA, 1993.
11. Liu H, Sun J, Liu L, Zhang H. Feature selection with dynamic mutual information. Pattern Recognition 2009; 42: 1330-1339.
12. Ai-ani A, Deriche M. An optimal feature selection technique using the concept of mutual information. In ISSPA, 2001; 477-480.
13. Jain AK, Zongker D. Feature selection: evaluation, application, and small sample performance. IEEE Transactions on Pattern Analysis and Machine Intelligence 1997; 19(2): 153-158.
14. Yang HH, Moody J. Feature Selection Based on Joint Mutual Information. Advances in Intelligent Data Analysis and Computational Intelligent Methods and Application, 1999.
15. Yang HH, Moody J. Data Visualization and Feature Selection: New Algorithms for NonGaussian Data. Advances in NIPS, 2000; 687-693.
16. Battiti R. Using mutual information for selecting features in supervised neural networks learning. IEEE Transactions on Neural Networks 1994; 5(4): 537-550.
17. Kwak N, Choi CH. Input feature selection for classification problems. IEEE Transactions on Neural Networks 2002; 13(1): 143-159.
18. Dash M, Liu H. Consistency-based search in feature selection. Artificial Intelligence 2003; 151: 155-176.
19. Vidal-Naquet M, Ullman S. Object recognition with informative features and linear classification. In IEEE Conference on Computer Vision and Pattern Recognition, 2003.
20. Fleuret F. Fast binary feature selection with conditional mutual information. The Journal of Machine Learning Research 2004; 5: 1531-1555.
21. Lin D, Tang X. Conditional infomax learning: an integrated framework for feature extraction and fusion. In Proceedings of European Conference on Computer Vision, 2006.
22. KDD99, KDD cup 1999 data, 1999, [23 July 2010].
23. Tsai C-F, Hsu Y-F, Lin C-Y, Lin W-Y. Intrusion detection by machine learning: a review. Expert Systems with Applications 2009; 36(10): 11994-12000.
24. Kumar G, Kumar K, Sachdeva M. An empirical comparative analysis of feature reduction methods for intrusion detection. International Journal of Information and Telecommunication 2010; 1: 44-51 ISSN: 0976-5972.
25. Witten IH, Frank E. Data Mining-Practical Machine Learning Tools and Techniques with JAVA Implementations, (2nd edn). Morgan Kaufmann Publishers: Los Altos, CA, 2005.
26. Kumar G, Kumar K, Sachdeva M. The Use of Artificial Intelligence based Techniques for Intrusion Detection - A Review. Artificial Intelligence Review 2010; 34(4): 369-387. DOI: 10.1007/s10462-010-9179-5, Springer Netherlands, ISSN: 0269-2821 (print version), 1573-7462 (electronic version).