Performance of feature-selection methods in the classification of high-dimension data

Pattern Recognition

Volumn 42, Issue 3, 2009, Pages 409-424

  Hua, Jianping ^a   Tembe, Waibhav D ^a   Dougherty, Edward R ^a,b  

^a TRANSLATIONAL GENOMICS RESEARCH INSTITUTE   (United States)

^b Texas AandM University   (United States)

Author keywords

Classification; Feature selection; Microarray

Indexed keywords

BIOINFORMATICS; CLASSIFIERS; LEARNING SYSTEMS; PHOTOLITHOGRAPHY; WAVE FILTERS;

BIOINFORMATICS APPLICATIONS; BIOLOGICAL TECHNOLOGIES; CLASSIFICATION; CLASSIFICATION ERRORS; CLASSIFIER DESIGNS; COMPARATIVE STUDIES; DESIGN CLASSIFIERS; DIFFERENT DISTRIBUTIONS; DIMENSION DATUM; DIMENSIONAL DATUM; DISTRIBUTION MODELS; FEATURE SELECTION; FEATURE SELECTIONS; FILTER METHODS; GENERAL TRENDS; IMPROVED PERFORMANCES; MODEL-BASED; POTENTIAL FEATURES; REAL DATA SETS; REAL DATUM; RELIEFF; SAMPLE SIZES; SELECTION ALGORITHMS; SELECTION METHODS; SYNTHETIC DATUM; UNIVARIATE; WORSE PERFORMANCES; WRAPPER METHODS;

MATHEMATICAL MODELS;

EID: 54549099006     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.08.001     Document Type: Article

References (36)

1. Golub T., Slonim D., Tamayo P., Huard C., Gaasenbeek M., Mesirov J., Coller H., Loh M., Downing J., Caligiuri M., Bloomfield C., and Lander E. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286 (1999) 531-537
2. Bittner M., Meltzer P., Chen Y., Jiang Y., Seftor I., Hendrix M., Radmacher M., Simon R., Yakhini Z., Ben-Dor A., Sampas N., Dougherty E., Wang E., Marincola F., Gooden C., Lueders J., Glatfelter A., Pollock P., Carpten J., Gillanders E., Leja D., Dietrich K., Beaudry C., Berens M., Alberts D., Sondak V., Hayward N., and Trent J. Molecular classification of cutaneous malignant melanoma by gene expression profiling. Nature 406 (2000) 536-540
3. van 't Veer L.J., Dai H., van de Vijver M.J., He Y.D., Hart A.A., Mao M., Peterse H.L., van der Kooy K., Marton M.J., Witteveen A.T., Schreiber G.J., Kerkhoven R.M., Roberts C., Linsley P.S., Bernards R., and Friend S.H. Gene expression profiling predicts clinical outcome of breast cancer. Nature 415 6871 (2002) 530-536
4. Hughes G. On the mean accuracy of statistical pattern recognizers. IEEE Trans. Inf. Theory 14 1 (1968) 55-63
5. Trunk G.V. A problem of dimensionality: a simple example. IEEE Trans. Pattern Anal. Mach. Intell. 1 3 (1979) 306-307
6. Raudys I.J. Determination of optimal dimensionality in statistical pattern classification. Pattern Recognition 11 (1979) 263-270
7. Jain A.K., and Waller W.G. On the optimal number of features in the classification of multivariate Gaussian data. Pattern Recognition 10 (1978) 365-374
8. Hua J., Xiong Z., Lowey J., Suh E., and Dougherty E. Optimal number of features as a function of sample size for various classification rules. Bioinformatics 21 8 (2005) 1509-1515
9. Hua J., Xiong Z., and Dougherty E. Determination of the optimal number of features for quadratic discriminant analysis via the normal approximation to the discriminant distribution. Pattern Recognition 38 3 (2005) 403-421
10. Le C.T. Introductory Biostatistics (2003), Wiley, Hoboken, NJ
11. Pudil P., Novovicova J., and Kittler J. Floating search methods in feature selection. Pattern Recognition Lett. 15 (1994) 1119-1125
12. Li F., and Yang Y. Analysis of recursive gene selection approaches from microarray data. Bioinformatics 21 19 (2005) 3741-3747
13. Jain A.K., and Zongker D. Feature selection: evaluation, application, and small sample performance. IEEE Trans. Pattern Anal. Mach. Intell. 19 2 (1997) 153-158
14. Saeys Y., Inza I., and Larranaga P. A review of feature selection techniques in bioinformatics. Bioinformatics 23 19 (2007) 2507-2517
15. Kudo M., and Sklansky J. Classifier-independent feature selection for two-stage feature selection. In: Amin A., Dori H.F.D., and Pudil P. (Eds). Lecture Notes in Computer Science, Advances in Pattern Recognition vol. 1451 (1998), Springer, Berlin 548-554
16. Kudo M., and Sklansky J. Comparison of algorithms that select features for pattern classifiers. Pattern Recognition 33 (2000) 24-41
17. Li T., Zhang C., and Ogihara M. A comparative study of feature selection and multiclass classification methods for tissue classification based on gene expression. Bioinformatics 20 15 (2004) 2429-2437
18. Lee J.W., Lee J.B., Park M., and Song S.H. An extensive comparison of recent classification tools applied to microarray data. Comput. Stat. Data Anal. 48 4 (2005) 869-885
19. Natsoulis G., El Ghaoui L., Lanckriet G.R.G., Tolley A.M., Leroy F., Dunlea S., Eynon B.P., Pearson C.I., Tugendreich S., and Jarnagin K. Classification of a large microarray data set: algorithm comparison and analysis of drug signatures. Genome Res. 15 5 (2005) 724-736
20. Silva P., Hashimoto R., Kim S., Barrera J., Brandao L., Suh E., and Dougherty E. Feature selection algorithms to find strong genes. Pattern Recognition Lett. 26 10 (2005) 1444-1453
21. Jeffery I.B., Higgins D.G., and Culhane A.C. Comparison and evaluation of methods for generating differentially expressed gene lists from microarray data. BMC Bioinformatics 7 (2006) 359
22. Hanczar B., Hua J., and Dougherty E.R. Decorrelation of the true and estimated classifier errors in high-dimensional settings. EURASIP J. Bioinformatics Syst. Biol. (2007) 38473
23. Su Y., Murali T.M., Pavlovic V., Schaffer M., and Kasif S. Rankgene: identification of diagnostic genes based on expression data. Bioinformatics 19 12 (2003) 1578-1579
24. Kira K., and Rendel L. The feature selection problem: traditional methods and a new algorithm. In: Press M. (Ed). Proceedings of Tenth National Conference on Artificial Intelligence (1992) 129-134
25. I. Kononenko, Estimating attributes: analysis and extensions of relief, in: Machine Learning: ECML-94, Lecture Notes in Computer Science, vol. 784, Springer, Berlin, Heidelberg, 1994, pp. 171-182.
26. Dougherty E., and Brun M. On the number of close-to-optimal feature sets. Cancer Inf. 2 (2006) 189-196
27. Carlborg O., and Haley C.S. Epistasis: too often neglected in complex trait studies?. Nat. Rev. Genet. 5 8 (2004) 618-625
28. Fukunaga K., and Narendra P. A branch and bound algorithm for computing k-nearest neighbors. IEEE Trans. Comput. C-24 (1976) 750-753
29. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, Software available at 〈http://www.csie.ntu.edu.tw/~cjlin/libsvm〉, 2001.
30. Braga-Neto U., and Dougherty E. Bolstered error estimation. Pattern Recognition 37 (2004) 1267-1281
31. Sima C., Attoor S., Braga-Neto U., Lowey J., Suh E., and Dougherty E. Impact of error estimation on feature-selection algorithms. Pattern Recognition 38 12 (2005) 2472-2482
32. Zhan F., Huang Y., Colla S., Stewart J., Hanamura I., Gupta S., Epstein J., Yaccoby S., Sawyer J., Burington B., Hollmig K., Pineda-Roman M., Tricot G., van Rhee F., Walker R., Zangari M., Crowley J., Barlogie B., and Shaughnessy J. The molecular classification of multiple myeloma. Blood 108 (2006) 2020-2028
33. Zhan F., Barlogie B., Arzoumanian V., Huang Y., Williams D., Hollmig K., Pineda-Roman M., Tricot G., van Rhee F., Zangari M., Dhodapkar M., and Shaughnessy J. Gene-expression signature of benign monoclonal gammopathy evident in multiple myeloma is linked to good prognosis. Blood 109 (2007) 1692-1700
34. Yeoh E.-J., Ross M.E., Shurtleff S.A., Williams W.K., Patel D., Mahfouz R., Behm F.G., Raimondi S.C., Relling M.V., Patel A., Cheng C., Campana D., Wilkins D., Zhou X., Li J., Liu H., Pui C.-H., Evans W.E., Naeve C., Wong L., and Downing J.R. Classification, subtype discovery, and prediction of outcome in pediatric acute lymphoblastic leukemia by gene expression profiling. Cancer Cell 1 2 (2002) 133-143
35. Valk P.J.M., Verhaak R.G.W., Beijen M.A., Erpelinck C.A.J., Barjesteh van Waalwijk van Doorn-Khosrovani S., Boer J.M., Beverloo H.B., Moorhouse M.J., van der Spek P.J., Lowenberg B., and Delwel R. Prognostically useful gene-expression profiles in acute myeloid leukemia. N. Engl. J. Med. 350 16 (2004) 1617-1628
36. Sima C., and Dougherty E. What should be expected from feature selection in small-sample settings. Bioinformatics 22 19 (2006) 2430-2436