Variable selection in kernel Fisher discriminant analysis by means of recursive feature elimination

Computational Statistics and Data Analysis

Volumn 51, Issue 3, 2006, Pages 2043-2055

  Louw, N ^a   Steel, S J ^a  

^a STELLENBOSCH UNIVERSITY   (South Africa)

Author keywords

Feature space; Generalisation error; Input space; Kernel methods; Linear discriminant analysis

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATION THEORY; DATA REDUCTION; ERROR ANALYSIS; PROBLEM SOLVING;

FEATURE SPACES; GENERALISATION ERRORS; INPUT SPACES; KERNEL FISHER DISCRIMINANT ANALYSIS (KFDA); KERNEL METHODS; LINEAR DISCRIMINANT ANALYSIS;

STATISTICAL METHODS;

EID: 33750731977     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2005.12.018     Document Type: Article

References (23)

1. Alon U., Barkai N., Notterman D.A., Gish K., Ybarra S., Mack D., and Levine A.J. Broad patterns of gene expression revealed by clustering analysis of tumour and normal colon tissues probed by oligonucleotide arrays. Cell Biol. 96 (1999) 6745-6750
2. Ambroise C., and McLachlan G.J. Selection bias in gene extraction on the basis of microarray gene expression data. Proc. Nat. Acad. Sci. USA 99 (2002) 6562-6566
3. Bradley P.S., Mangasarian O.L., and Street W.N. Feature selection via mathematical programming. INFORMS J. Comput. 10 (1998) 209-217
4. Chen N., Lu W., Yang J., and Li G. Support Vector Machine in Chemistry (2004), World Scientific Publishing, Singapore
5. Cristianini, N., Kandola, J., Elisseeff, A., Shawe-Taylor, J., 2002. On Kernel-Target Alignment. In: Dietterich, T., Becker, S., Cohn, D. (Eds.), Advances in Neural Information Processing Systems, vol. 14. MIT Press, Cambridge, MA.
6. Golub T.R., Slonim D.K., Tamayo P., Huard C., Gaasenbeek M., Mesirov J.P., Coller H., Loh M.L., Downing J.R., Caligiuri M.A., Bloomfield C.D., and Lander E.S. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286 (1999) 531-537
7. Guyon I., and Elisseeff A. An introduction to variable and feature selection. J. Mach. Learning Res. 3 (2003) 1157-1182
8. Guyon I., Weston J., Barnhill S., and Vapnik V. Gene selection for cancer classification using support vector machines. Mach. Learning 46 (2002) 389-422
9. Herbrich R. Learning Kernel Classifiers (2001), MIT Press, London
10. Krishnapuram, B., Carin, L., Hartemink, A., 2004. Gene Expression Analysis: Joint Feature Selection and Classifier Design. In: Schölkopf, B., Tsuda, K., Vert, J.-P. (Eds.), Kernel Methods in Computational Biology. MIT Press, Cambridge, MA.
11. Li Y., Campbell C., and Tipping M. Bayesian automatic relevance determination algorithms for classifying gene expression data. Bioinformatics 18 (2002) 1332-1339
12. Louw N., and Steel S.J. A review of kernel Fisher discriminant analysis for statistical classification. South African Statist. J. 39 (2005) 1-21
13. McLachlan G.J. Discriminant Analysis and Statistical Pattern Recognition (1992), Wiley, New York
14. McLachlan G.J., Do K.-A., and Ambroise C. Analyzing Microarray Gene Expression Data (2004), Wiley, New York
15. Mika, S., Rätsch, G., Weston, J., Schölkopf, B., Müller, K.-R., 1999. Fisher discriminant analysis with kernels. In: Hu, Y.-H., Larsen, J., Wilson, E., Douglas, S. (Eds.), Neural Networks for Signal Processing, IX, 41-48. IEEE Press, New York.
16. Miller A.J. Subset selection in regression. Second ed. (2002), Chapman & Hall, London
17. Rakotomamonjy A. Variable selection using SVM based criteria. J. Mach. Learning Res. 3 (2003) 1357-1370
18. Rätsch G., Onoda T., and Müller K.-R. Soft margins for AdaBoost. Mach. Learning 42 (2001) 287-320
19. Schölkopf B., and Smola A.J. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond (2002), MIT Press, London
20. Shawe-Taylor J., and Cristianini N. Kernel Methods for Pattern Analysis (2004), Cambridge University Press, Cambridge
21. Weston, J., Mukherjee, S., Chapelle, O., Pontil, M., Poggio, T., Vapnik, V., 2001. Feature Selection for SVMs. In: Neural Information Processing Systems. MIT Press, Cambridge, MA.
22. Weston J., Elisseeff A., Schölkopf B., and Tipping M. Use of the zero norm with linear models and kernel methods. J. Mach. Learning Res. 3 (2003) 1439-1461
23. Zhu J., and Hastie T. Classification of gene microarrays by penalized logistic regression. Biostatistics 5 (2004) 427-443