Feature selection based on dependency margin

IEEE Transactions on Cybernetics

Volumn 45, Issue 6, 2015, Pages 1209-1221

  Liu, Yong ^a   Tang, Feng ^a   Zeng, Zhiyong ^a  

^a STATE KEY LABORATORY OF INDUSTRIAL CONTROL TECHNOLOGY   (China)

Author keywords

Conditionally independent; dependency margin; feature selection; forward greedy search; redundant feature

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); LEARNING SYSTEMS;

CONDITIONALLY INDEPENDENT; DEPENDENCY MARGIN; GREEDY SEARCH; GREEDY SEARCH ALGORITHMS; MACHINE LEARNING APPLICATIONS; PRE-PROCESSING STEP; REDUNDANT FEATURES; SUPERVISED CLASSIFICATION;

FEATURE EXTRACTION;

EID: 85027931612     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2014.2347372     Document Type: Article

References (42)

1. H. Liu et al., "Evolving feature selection," IEEE Intell. Syst., vol. 20, no. 6, pp. 64-76, Nov./Dec. 2005.
2. R. Diao, F. Chao, T. Peng, N. Snooke, and Q. Shen, "Feature selection inspired classifier ensemble reduction," IEEE Trans. Cybern., vol. 44, no. 8, pp. 1259-1268, Aug. 2014.
3. L. Yu and H. Liu, "Efficient feature selection via analysis of relevance and redundancy," J. Mach. Learn. Res., vol. 5, pp. 1205-1224, Jan. 2004.
4. D. Koller and M. Sahami, "Toward optimal feature selection," in Proc. 13th Int. Conf. Mach. Learn. (ICML), Bari, Italy, Jul. 1996, pp. 284-292.
5. Q. Hu, W. Pedrycz, D. Yu, and J. Lang, "Selecting discrete and continuous features based on neighborhood decision error minimization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 1, pp. 137-150, Feb. 2010.
6. J. M. Peña and R. Nilsson, "On the complexity of discrete feature selection for optimal classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 8, pp. 1517-1522, Aug. 2010.
7. S. Li and D. Wei, "Extremely high-dimensional feature selection via feature generating samplings," IEEE Trans. Cybern., vol. 44, no. 6, pp. 737-747, Jun. 2014.
8. B. Xue, M. Zhang, and W. N. Browne, "Particle swarm optimization for feature selection in classification: A multi-objective approach," IEEE Trans. Cybern., vol. 43, no. 6, pp. 1656-1671, Dec. 2013.
9. C. Hou, F. Nie, X. Li, D. Yi, and Y. Wu, "Joint embedding learning and sparse regression: A framework for unsupervised feature selection," IEEE Trans. Cybern., vol. 44, no. 6, pp. 793-804, Jun. 2014.
10. M. H. C. Law, M. A. T. Figueiredo, and A. K. Jain, "Simultaneous feature selection and clustering using mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1154-1166, Sep. 2004.
11. X. He, M. Ji, C. Zhang, and H. Bao, "A variance minimization criterion to feature selection using Laplacian regularization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 10, pp. 2013-2025, Oct. 2011.
12. J. Zhao, K. Lu, and X. He, "Locality sensitive semi-supervised feature selection," Neurocomputing, vol. 71, nos. 10-12, pp. 1842-1849, 2008.
13. L. Wolf and A. Shashua, "Feature selection for unsupervised and supervised inference: The emergence of sparsity in a weight-based approach," J. Mach. Learn. Res., vol. 6, pp. 1855-1887, Jan. 2005.
14. H. Liu and L. Yu, "Toward integrating feature selection algorithms for classification and clustering," IEEE Trans. Knowl. Data Eng., vol. 17, no. 4, pp. 491-502, Apr. 2005.
15. R. Kohavi and G. H. John, "Wrappers for feature subset selection," Artif. Intell., vol. 97, nos. 1-2, pp. 273-324, 1997.
16. D. D. Lewis, "Feature selection and feature extraction for text categorization," in Proc. Speech Nat. Lang. Workshop, San Francisco, CA, USA, 1992, pp. 212-217.
17. H. Peng, F. Long, and C. H. Q. Ding, "Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1226-1238, Aug. 2005.
18. M. Dash and H. Liu, "Consistency-based search in feature selection," Artif. Intell., vol. 151, nos. 1-2, pp. 155-176, 2003.
19. Q. Hu, D. Yu, J. Liu, and C. Wu, "Neighborhood rough set based heterogeneous feature subset selection," Inform. Sci., vol. 178, no. 18, pp. 3577-3594, 2008.
20. M. Bressan and J. Vitrià, "On the selection and classification of independent features," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 10, pp. 1312-1317, Oct. 2003.
21. P. Maji and P. Garai, "Fuzzy-rough simultaneous attribute selection and feature extraction algorithm," IEEE Trans. Cybern., vol. 43, no. 4, pp. 1166-1177, Aug. 2013.
22. A. L. Oliveira and A. L. Sangiovanni-Vincentelli, "Constructive induction using a non-greedy strategy for feature selection," in Proc. 9th Int. Workshop Mach. Learn., 1992, pp. 355-360.
23. X. Geng, T. Y. Liu, T. Qin, and H. Li, "Feature selection for ranking," in Proc. 30th Annu. Int. ACM SIGIR Conf., 2007, pp. 407-414.
24. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection," J. Mach. Learn. Res., vol. 3, pp. 1157-1182, Jan. 2003.
25. M. A. Hall, "Correlation-based feature selection for discrete and numeric class machine learning," in Proc. 17th Int. Conf. Mach. Learn. (ICML), Stanford, CA, USA, Jun./Jul. 2000, pp. 359-366.
26. L. Yu and H. Liu, "Redundancy based feature selection for microarray data," in Proc. 10th ACM SIGKDD Int. Conf. Knowl. Discov. Data Mining, 2004, pp. 737-742.
27. G. Forman, "An extensive empirical study of feature selection metrics for text classification," J. Mach. Learn. Res., vol. 3, pp. 1289-1305, Jan. 2003.
28. K. Javed, H. A. Babri, and M. Saeed, "Feature selection based on class-dependent densities for high-dimensional binary data," IEEE Trans. Knowl. Data Eng., vol. 24, no. 3, pp. 465-477, Mar. 2012.
29. A. Appice, M. Ceci, S. Rawles, and P. A. Flach, "Redundant feature elimination for multi-class problems," in Proc. 21st Int. Conf. Mach. Learn., 2004, p. 5.
30. L. Zhou, L. Wang, and C. Shen, "Feature selection with redundancy constrained class separability," IEEE Trans. Neural Netw., vol. 21, no. 5, pp. 853-858, May 2010.
31. J. Biesiada and W. Duch, "Feature selection for high-dimensional data-A Pearson redundancy based filter," in Computer Recognition Systems 2. Berlin, Germany: Springer, 2008, pp. 242-249.
32. C. Ding and H. Peng, "Minimum redundancy feature selection from microarray gene expression data," in Proc. IEEE Comput. Soc. Conf. Bioinformat. (CSB), Washington, DC, USA, Aug. 2003, pp. 523-528.
33. P. Antal, A. Millinghoffer, G. Hullám, C. Szalai, and A. Falus, "A Bayesian view of challenges in feature selection: Feature aggregation, multiple targets, redundancy and interaction," in Proc. Conf. Workshop J. Mach. Learn. Res., vol. 4. 2008, pp. 74-89.
34. G. H. John, R. Kohavi, and K. Pfleger, "Irrelevant features and the subset selection problem," in Proc. 11th Int. Conf. Mach. Learn., New Brunswick, NJ, USA, Jul. 1994, pp. 121-129.
35. L. Yu and H. Liu, "Redundancy based feature selection for microarray data," in Proc. 10th ACM SIGKDD Int. Conf. Knowl. Discov. Data Mining (KDD), New York, NY, USA, 2004, pp. 737-742.
36. R. Duangsoithong and T. Windeatt, "Relevant and redundant feature analysis with ensemble classification," in Proc. 7th Int. Conf. Adv. Pattern Recognit. (ICAPR), Kolkata, India, Feb. 2009, pp. 247-250.
37. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Francisco, CA, USA: Morgan Kaufmann, 1988.
38. M. Robnik-Sikonja and I. Kononenko, "Theoretical and empirical analysis of ReliefF and RReliefF," Mach. Learn., vol. 53, nos. 1-2, pp. 23-69, 2003.
39. I. H. Witten, E. Frank, and M. A. Hall, Data Mining: Practical Machine Learning Tools and Techniques, 3rd ed. Burlington, MA, USA: Morgan Kaufmann, 2011.
40. Y. Sun, "Iterative relief for feature weighting: Algorithms, theories, and applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 1035-1051, Jun. 2007.
41. T. Ahonen, A. Hadid, and M. Pietikäinen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
42. T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.