Impact of a metric of association between two variables on performance of filters for binary data

Neurocomputing

Volumn 143, Issue , 2014, Pages 248-260

  Javed, Kashif ^a   Babri, Haroon A ^a   Saeed, Mehreen ^b  

^a UNIVERSITY OF ENGINEERING AND TECHNOLOGY   (Pakistan)

^b NATIONAL UNIVERSITY OF COMPUTER AND EMERGING SCIENCES   (Pakistan)

Author keywords

Binary data; Classification; Feature selection; Filters

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER APPLICATIONS; FEATURE EXTRACTION; FILTERS (FOR FLUIDS); NEURAL NETWORKS;

BINARY DATA; CORRELATION COEFFICIENT; MUTUAL INFORMATIONS; OBJECTIVE FUNCTIONS; RELEVANCE AND REDUNDANCIES; TWO PARAMETER;

REDUNDANCY;

ARTICLE; CLASSIFIER; CORRELATION ANALYSIS; CORRELATION COEFFICIENT; CRITERION VARIABLE; DATA ANALYSIS; DIGITAL FILTERING; EXPERIMENTAL STUDY; FAST CORRELATION BASED FILTER; INFORMATION PROCESSING; MARKOV BLANKET FILTER; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; METRIC SYSTEM; MINIMAL REDUNDANCY MAXIMAL RELEVANCE FILTER; PRIORITY JOURNAL; PROCESS DESIGN; VALIDATION PROCESS;

EID: 84904807402     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.05.066     Document Type: Article

References (43)

1. Peng H., Long F., Ding C. Feature selection based on mutual information. criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27:1226-1238.
2. D. Koller, M. Sahami, Toward Optimal Feature Selection, Technical Report 1996-77, Stanford InfoLab, 1996.
3. L. Yu, H. Liu, Feature selection for high-dimensional data: a fast correlation based filter solution, in: Proceedings of the 20th International Conference on Machine Learning (ICML), 2003, pp. 856-863.
4. Yin L., Ge Y., Xiao K., Wang X., Quan X. Feature selection for high-dimensional imbalanced data. Neurocomputing 2013, 105:3-11.
5. Doquire G., Verleysen M. Mutual information-based feature selection for multilabel classification. Neurocomputing 2013, 122:148-155.
6. K. Javed, Development of feature selection algorithms for high-dimensional binary data (Ph.D. thesis), Department of Electrical Engineering, University of Engineering and Technology, Lahore, Pakistan, 2012.
7. Kohavi R., John G. Wrappers for feature subset selection. Artif. Intell. 1997, 97:273-324.
8. Dash M., Liu H. Feature selection for classification. Intell. Data Anal. 1997, 1:131-156.
9. Guyon I., Elisseeff A. An introduction to variable and feature selection. J. Mach. Learn. Res. 2003, 3:1157-1182.
10. Guyon I., Gunn S., Nikravesh M., Zadeh L. Feature Extraction: Foundations and Applications 2006, Springer.
11. Hall M., Holmes G. Benchmarking attribute selection techniques for discrete class data mining. IEEE Trans. Knowl. Data Eng. 2003, 15:1437-1447.
12. Guyon I., Weston J., Barnhill S., Vapnik V. Gene selection for cancer classification using support vector machines. Mach. Learn. 2002, 46:389-422.
13. S. Das, Filters, wrappers, and a boosting based hybrid for feature selection, in: Proceedings of the 18th International Conference on Machine Learning (ICML), 2001, pp. 74-81.
14. Brown G., Pocock A., Zhao M.-J., Lujan M. Conditional likelihood maximisation. a unifying framework for information theoretic feature selection. J. Mach. Learn. Res. 2012, 13:27-66.
15. A. Argyriou, T. Evgeniou, M. Pontil, Multi-task feature learning, in: NIPS, 2006, pp. 41-48.
16. F. Nie, H. Huang, X. Cai, C. Ding, Efficient and robust feature selection via joint ℓ2,1-norms minimization, in: NIPS, 2010, pp. 1813-1821.
17. Duch W. Filter methods. Feature Extraction: Foundations and Applications 2006, 89-117. Springer. I. Guyon, M. Nikravesh, S. Gunn, L. Zadeh (Eds.).
18. Arauzo-Azofra A., Aznarte J., Benitez J. Empirical study of feature selection methods based on individual feature evaluation for classification problems. Expert Syst. Appl. 2011, 38:8170-8177.
19. Javed K., Saeed M., Babri H.A. The correctness problem: evaluating the ordering of binary features in rankings. Knowl. Inf. Syst. 2014, 39:543-563.
20. Bouguila N. On multivariate binary data clustering and feature weighting. Comput. Stat. Data Anal. 2010, 54:120-134.
21. Myllykangas S., Tikka J., Bohling T., Knuutila S., Hollmen J. Classification of human cancers based on DNA copy number amplification modeling. BMC Med. Gen. 2008, 1.
22. A. Juan, E. Vidal, Bernoulli mixture models for binary images, in: Proceedings of the 17th International Conference on Pattern Recognition (ICPR), 2004, pp. 367-370.
23. Wilbur J., Ghosh J., Nakatsu C., Brouder S., Doerge R. Variable selection in high-dimensional multivariate binary data with application to the analysis of microbial community DNA fingerprints. Biometrics 2002, 58:378-386.
24. S. Dolnicar, F. Leisch, Behavioral market segmentation of binary guest survey data with bagged clustering, in: Proceedings of the International Conference on Artificial Neural Networks (ICANN), 2001, pp. 111-118.
25. Saeed M., Javed K., Babri H.A. Machine learning using Bernoulli mixture models. clustering, rule extraction and dimensionality reduction. Neurocomputing 2013, 119:366-374.
26. Lazar C., Taminau J., Meganck S., Steenhoff D., Coletta A., Molter C., Schaetzen V., Duque R., Bersini H., Nowe A. A survey on filter techniques for feature selection in gene expression microarray analysis. IEEE/ACM Trans. Comput. Biol. Bioinform. 2012, 9:1106-1119.
27. Saeys Y., Inza I., Larranage P. A review of feature selection techniques in bioinformatics. Bioinformatics 2007, 23:2507-2517.
28. Bolon-Canedo V., Sanchez-Marono N., Alonso-Betanzos A. A review of feature selection methods on synthetic data. Knowl. Inf. Syst. 2013, 34:483-519.
29. Battiti R. Using mutual information for selecting features in supervised neural net learning. IEEE Trans. Neural Netw. 1994, 5:537-550.
30. Yu L., Liu H. Efficient feature selection via analysis of relevance and redundancy. J. Mach. Learn. Res. 2004, 5:1205-1224.
31. G. Brown, A new perspective for information theoretic feature selection, in: JMLR Workshop and Conference Proceedings: AISTATS, vol. 5, 2009, pp. 49-56.
32. Guo B., Damper R., Gunn S., Nelson J. A fast separability based feature selection method for high-dimensional remotely sensed image classification. Pattern Recognit. 2008, 41:1653-1662.
33. Press W., Flannery B., Teukolsky S., Vetterling W. Numerical Recipes in C 1988, Cambridge University Press.
34. H. Liu, R. Setiono, Chi2: feature selection and discretization of numeric attributes, in: Proceedings of IEEE 7th International Conference on Tools with Artificial Intelligence, 1995, pp. 338-391.
35. Cover T., Thomas J. Elements of Information Theory 1991, John Wiley and Sons.
36. Vajda I. Theory of Statistical Inference and Information 1979, Kluwer Academic Press.
37. Javed K., Babri H., Saeed M. Feature selection based on class-dependent densities for high-dimensional binary data. IEEE Trans. Knowl. Data Eng. 2012, 24:465-477.
38. van der Heijden F., Duin R., de Ridder D., Tax D. Classification, Parameter Estimation, and State Estimation: An Engineering Approach using MATLAB 2004, John Wiley and Sons.
39. MathWorks, MATLAB: The Language of Technical Computing, 〈〉, 2010. http://www.mathworks.com/products/matlab/index.html.
40. I. Guyon, A. Saffari, G. Dror, G. Cawley, Agnostic learning vs. prior knowledge challenge, in: Proceedings of International Joint Conference on Neural Networks (IJCNN), 2007, pp. 829-834.
41. A. Frank, A. Asuncion, UCI Machine Learning Repository, 〈〉, 2010. http://archive.ics.uci.edu/ml.
42. A. Saffari, I. Guyon, Quick Start Guide for Challenge Learning Object Package (CLOP), Technical Report, Graz University of Technology and Clopinet, 〈〉, 2006. http://clopinet.com/clop/.
43. T. Minka, A Comparison of Numerical Optimizers for Logistic Regression, 〈〉, 2003. http://research.microsoft.com/~minka/papers/.