Stepwise feature selection using generalized logistic loss

Computational Statistics and Data Analysis

Volumn 52, Issue 7, 2008, Pages 3709-3718

  Park, Changyi ^a   Koo, Ja Yong ^b   Kim, Peter T ^c   Lee, Jae Won ^b  

^a University of Seoul   (South Korea)

^b Korea University   (South Korea)

^c UNIVERSITY OF GUELPH   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; DATA REDUCTION; MICROARRAYS; PROBLEM SOLVING; SUPPORT VECTOR MACHINES; TUMORS;

GENERALIZED LOGISTIC LOSS; HINGE LOSS; RECURSIVE FEATURE ELIMINATION; SIMULATED DATASETS;

FEATURE EXTRACTION;

EID: 40249089904     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2007.12.011     Document Type: Article

References (28)

1. Alizedeh A.A., et al. Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling. Nature 403 (2000) 503-510
2. Alon, U., Barkai, N., Notterman, D., Gish, K., Ybarra, S., Mack, D., Levine, A., 1999. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon cancer tissues probed by oligonucleotide arrays. In: Proceedings of the National Academy of Sciences of the United States of America 96, pp. 6745-6750
3. Ambroise, C., McLachlan, G.J., 2002. Selection bias in gene extraction on the basis of microarray gene-expression data. In: Proceedings of the National Academy of Sciences of the United States of America 99, pp. 6562-6566
4. Bradley, P.S., Mangasarian, O.L., 1998. Feature selection via concave minimization and support vector machines. In: Proceedings of 13th International Conference on Machine Learning, 82-90
5. Cortes C., and Vapnik V. Support-vector networks. Mach. Learn. 20 (1995) 273-297
6. Ding Y., and Wilkins D. Improving the performance of SVM-RFE to select genes in microarray. Data. BMC Bioinformatics 7 Suppl 2 (2006) S12
7. Duan K.-B., Rajapakse J.C., Wang H., and Azuaje F. Multiple SVM-RFE for gene selection in cancer classification with expression data. IEEE Trans. Nanobioscience 4 (2005) 228-234
8. Friedman J. Multivariate adaptive regression splines (with discussions). Ann. Stat. 19 (1991) 1-141
9. Gordon G.J., et al. Translation of microarray data into clinically relevant cancer diagnostic tests using gene expression ratios in lung cancer and mesothelioma. Cancer Res. 62 (2002) 4963-4967
10. Guyon I., and Elisseeff A. An introduction to variable and feature selection. J. Mach. Learn. Res. 3 (2003) 1157-1182
11. Guyon I., Weston J., Barnhill S., and Vapnik V. Gene selection for cancer classification using support vector machines. Mach. Learn. 46 (2002) 389-422
12. Hastie T., Tibshirani R., and Friedman J. The elements of statistical learning: Data mining, inference, and prediction (2001), Springer, New York
13. Ishak, A.B., Ghattas, B., 2005. An Efficient Method for Variable Selection Using SVM-Based Criteria. Preprint, Institut de Mathématiques de Luminy
14. Koo, J.-Y., Kooperberg, C., 2005. Quantile multivariate adaptive regression splines. Manuscript
15. Koo, J.-Y., Lee, Y., Kim, Y., Park, C., 2006. A bahadur representation of the linear support vector machine. Technical Report No. 792. Department of Statistics, The Ohio State University
16. Lee Y., Kim Y., Lee S., and Koo J.-Y. Structured multicategory support vector machine with ANOVA decomposition. Biometrika 93 (2006) 555-571
17. Lee Y., Lin Y., and Wahba G. Multicategory support vector machines, theory, and application to the classification of microarray data and satellite radiance data. J. Amer. Statist. Assoc. 99 (2004) 67-81
18. Mao Y., Zhou X., Pi D., Sun Y., and Wong S.T.C. Multiclass cancer classification by using fuzzy support vector machine and binary decision tree with gene selection. J. Biomedicine Biotechnology 2005 (2005) 160-171
19. Niijima S., and Kuhara S. Recursive gene selection based on maximum margin criterion: A comparison with SVM-RFE. BMC Bioinformatics 7 (2006) 543
20. Rao C.R. Linear Statistical Inference and its Applications. 2nd ed. (1973), Wiley, New York
21. Schwarz G. Estimating the dimension of a model. Ann. Stat. 6 (1978) 461-464
22. Singh D., Febbo P.G., Ross K., Jackson D.G., Manola J., Ladd C., Tamayo P., Renshaw A.A., D'Amico A.V., Richie J.P., Lander E.S., Loda M., Kantoff P.W., Golub T.R., and Sellers W.R. Gene expression correlates of clinical prostate cancer behavior. Cancer Cell 1 (2002) 203-209
23. Tang E.K., Suganthan P., and Yao X. Gene selection algorithms for microarray data based on least square support vector machine. BMC Bioinformatics 7 (2006) 95
24. Zhang H.H. Variable selection for support vector machines via smoothing spline ANOVA. Statist. Sinica 16 (2006) 659-674
25. Zhang, J., Jin, R., Yang, Y., Hauptmann, A.G., 2003. Modified logistic regression: An approximation to SVM and its applications in large-scale text categorization. In: Proceedings of the Twentieth International Conference on Machine Learning, ICML-2003, Washington, DC
26. Zhang T., and Oles F.J. Text categorization based on regularized linear classification methods. Information Retrieval 4 (2001) 5-31
27. Zhou X., and Tuck D.P. MSVM-RFE: Extensions of SVM-RFE for multiclass gene selection on DNA microarray data. Bioinformatics 23 (2007) 1106-1114
28. Zhu, J., Rosset, S., Hastie, T., Tibshirani, R., 2003. 1-norm Support Vector Machines. Technical Report. Stanford University