On the complexity of discrete feature selection for optimal classification

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 32, Issue 8, 2010, Pages 1517-1522

  Peña, Jose M ^a   Nilsson, Roland ^b  

^a LINKÖPING UNIVERSITY   (Sweden)

^b HARVARD MEDICAL SCHOOL   (United States)

Author keywords

Classifier design and evaluation; Feature evaluation and selection; Machine learning.

Indexed keywords

BAYES RISK; CLASSIFIER DESIGN AND EVALUATION; DISCRETE SAMPLE; EXHAUSTIVE SEARCH; FEATURE EVALUATION AND SELECTION; FEATURE SELECTION; FEATURE SELECTION PROBLEM; FEATURE SUBSET; MACHINE-LEARNING; MONOTONICITY CONSTRAINT; OPTIMAL CLASSIFICATION;

CLASSIFIERS; LEARNING SYSTEMS; MACHINE DESIGN; PROBABILITY DISTRIBUTIONS; RANDOM VARIABLES; RISKS; SET THEORY;

FEATURE EXTRACTION;

EID: 77953811631     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2010.84     Document Type: Article

References (11)

1. T. Cover and J. Van Campenhout, "On the Possible Orderings in the Measurement Selection Problem," IEEE Trans. Systems, Man, and Cyber netics, vol.7, no.9, pp. 657-661, Sept. 1977.
2. L. Devroye, L. Györfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition. Springer, 1996.
3. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik, "Gene Selection for Cancer Classification Using Support Vector Machines," Machine Learning, vol.46, pp. 389-422, 2002.
4. R. Kohavi and G.H. John, "Wrappers for Feature Subset Selection," Artificial Intelligence, vol.97, pp. 273-324, 1997.
5. R. Nilsson, J.M. Peña, J. Björkegren, and J. Tegnér, "Consistent Feature Selection for Pattern Recognition in Polynomial Time," J. Machine Learning Research, vol.8, pp. 589-612, 2007.
6. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, 1988.
7. J.M. Peña, R. Nilsson, J. Björkegren, and J. Tegnér, "Towards Scalable and Data Efficient Learning of Markov Boundaries," Int'l J. Approximate Reasoning, vol.45, pp. 211-232, 2007.
8. I. Steinwart, "On the Influence of the Kernel on the Consistency of Support Vector Machines," J. Machine Learning Research, vol.2, pp. 67-93, 2001.
9. I. Tsamardinos and C. Aliferis, "Towards Principled Feature Selection: Relevancy, Filters and Wrappers," Proc. Ninth Int'l Workshop Artificial Intelligence and Statistics, 2003.
10. I. Tsamardinos, C.F. Aliferis, and A. Statnikov, "Algorithms for Large Scale Markov Blanket Discovery," Proc. 16th Int'l Florida Artificial Intelligence Research Soc. Conf., pp. 376-380, 2003.
11. J. Van Campenhout, "The Arbitrary Relation between Probability of Error and Measurement Subset," J. Am. Statistical Assoc., vol.75, pp. 104-109, 1980.