Low rank updated LS-SVM classifiers for fast variable selection

Neural Networks

Volumn 21, Issue 2-3, 2008, Pages 437-449

  Ojeda, Fabian ^a   Suykens, Johan A K ^a   De Moor, Bart ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Least squares support vector machines; Leave one out error; Low rank matrix modifications; Variable selection

Indexed keywords

COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; DATABASE SYSTEMS; ERROR ANALYSIS; LINEAR EQUATIONS; MATRIX ALGEBRA;

LEAST SQUARES SUPPORT VECTOR MACHINES; LEAVE-ONE-OUT ERROR; LOW RANK MATRIX MODIFICATIONS; VARIABLE SELECTION;

SUPPORT VECTOR MACHINES;

ALGORITHM; ANALYTICAL ERROR; ARTICLE; COMPUTER ANALYSIS; COMPUTER SIMULATION; KERNEL METHOD; LEAST SQUARE SUPPORT VECTOR MACHINE; MACHINE LEARNING; MICROARRAY ANALYSIS; PRIORITY JOURNAL; SUPPORT VECTOR MACHINE; VALIDATION PROCESS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTATIONAL BIOLOGY; COMPUTER SIMULATION; GENE EXPRESSION PROFILING; LEAST-SQUARES ANALYSIS; PATTERN RECOGNITION, AUTOMATED;

EID: 40649092045     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2007.12.053     Document Type: Article

References (27)

1. Alon U., Barkai N., Notterman D.A., Gish K., Ybarra S., Mack D., et al. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proceedings of the National Academy of Sciences 96 12 (1999) 6745-6750
2. Ambroise C., and McLachaln G.J. Selection bias in gene extraction on the basis of microarray gene-expression data. Proceedings of the National Academy of Sciences 99 10 (2002) 6562-6566
3. Bishop C. Neural networks for pattern recognition (1995), Oxford, UP
4. Cawley, G. C. (2006). Leave-one-out cross-validation based model selection criteria for weighted LS-SVMs. In Proc of the international joint conference on computational neural networks
5. Cawley G.C., and Talbot N.L. Fast exact leave-one-out cross-validation of sparse least-squares support vector machines. Neural Networks 17 (2004) 1467-1475
6. Cawley G.C., and Talbot N.L.C. Preventing over-fitting in model selection via bayesian regularisation of the hyper-parameters. Journal of Machine Learning Research 8 (2007) 841-861
7. Dongarra J., Bunch J., Moler C., and Stewart G. Linpack users' guide (1979), SIAM, Philadelphia
8. Fine S., and Scheinberg K. Efficient svm training using low-rank kernel representations. Journal of Machine Learning Research 2 (2001) 243-264
9. Gill P.E., Golub G.H., Murray W., and Saunders M.A. Methods for modifying matrix factorizations. Mathematics of Computation 28 126 (1974) 505-535
10. Golub G.H., and Van Loan C.F. Matrix Computations. 2 (1989), The Jonhs Hopkins University Press
11. Guyon I., Weston J., Barnhill S., and Vapnik V. Gene selection for cancer classification using support vector machines. Machine Learning 46 (2002)
12. Kohavi R., and John G. Wrappers for feature selection. Artificial Intelligence 97 (1997) 273-324
13. Lachenbruch P. An almost unbiased method for the probability of misclassification in discriminant analysis. Biometrics 23 (1967) 639-645
14. Ojeda, F., Suykens, J. A. K., & De Moor, B. (2007). Variable selection by rank-one updates for least squares support vector machines. In Proceedings of the international joint conference on neural networks
15. Rätsch G., Onoda T., and Müller K.-R. Soft margins for AdaBoost. Machine Learning 42 3 (2001) 287-320
16. Saunders G., Gammerman A., and Vovk V. Ridge regression learning algorithm in dual variables. Proc. 15th international conf. on machine learning (1998), Morgan Kaufmann, San Francisco, CA 515-521
17. Seeger, M. (2005). Low rank updates for the cholesky decomposition, Technical report. Tuebingen, Germany: Max Planck Society
18. Shilton A., Palaniswami M., Ralph D., and Chung A. Incremental training of support vector machines. IEEE Transactions on Neural Networks 16 1 (2005) 114-131
19. Suykens J.A.K., Van Gestel T., De Brabanter J., De Moor B., and Vandewalle J. Least squares support vector machines (2002), World Scientific, Singapore
20. Suykens J.A.K., and Vandewalle J. Least squares support vector machine classifiers. Neural Processing Letters 9 3 (1999) 293-300
21. Tang E.K., Suganthan P., and Yao X. Gene selection for microarray data based on least squares support vector machine. BMC Bioinformatics 7 95 (2006)
22. Van Gestel T., Baesens B., Suykens J.A.K., Espinoza M., Baestaens D., Vanthienen J., et al. Bankruptcy prediction with least squares support vector machine classifiers. International conference on computational intelligence for financial enigeering 1 (2003)
23. Van Gestel T.K., Suykens J.A.K., Baesens B., Viaene S., Vanthienen J., Dedene G., et al. Benchmarking least squares support vector machine classifiers. Machine Learning 1 (2004) 5-32
24. Vapnik V. Statistical Learning Theory (1998), Wiley
25. Vapnik V., and Chapelle O. Bounds on error expectation for support vector machines. Neural Computation 12 9 (2000) 2013-2036
26. Xiong M., Fang X., and Zhao J. Biomarker identification by feature wrappers. Genome Research 11 (2001) 1878-1887
27. Zhou X., and Mao K. LS bound based gene selection for DNA microarray data. Bioinformatics 21 8 (2005)