Robustified least squares support vector classification

Journal of Chemometrics

Volumn 23, Issue 9, 2009, Pages 479-486

  Debruyne, Michiel ^a   Serneels, Sven ^b   Verdonck, Tim ^a  

^a UNIVERSITY OF ANTWERP   (Belgium)

^b LS Services and Consultancy   (Belgium)

Author keywords

Classification; Least squares support vector machines; Outliers; Reweighting; Robustness

Indexed keywords

STATISTICS;

CLASSIFICATION ALGORITHM; LEAST SQUARE SUPPORT VECTOR MACHINES; LEAST SQUARES SUPPORT VECTOR CLASSIFICATIONS; MISCLASSIFICATION PERCENTAGES; OUTLIER; RE-WEIGHTING; ROBUST CLASSIFICATION; ROBUSTNESS; SUPPORT VECTOR MACHINES ALGORITHMS; SUPPORT VECTORS MACHINE;

SUPPORT VECTOR MACHINES;

EID: 70349584934     PISSN: 08869383     EISSN: 1099128X     Source Type: Journal    
DOI: 10.1002/cem.1241     Document Type: Article

References (39)

1. Estimation of Dependences based on Empirical Data (2ndedn). Springer Verlag: Berlin, Germany, 2006.
2. Cristianini N, Shawe-Taylor J. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press: Cambridge, UK, 2000.
3. Suykens JAK, Van Gestel T, De Brabanter J, De Moor B, Vandewalle J. Least Squares Support Vector Machines. World Scientific: Singapore, 2002.
4. Steinwart I, Christmann A. Support Vector Machines. Springer: New York, 2008.
5. Huber PJ. Robust Statistics Wiley: New York, 1981.
6. Hampel FR, Ronchetti EM, Rousseeuw PJ, Stahel WA. Robust Statistics: The Approach Based on Influence Functions. Wiley: New York, 1986.
7. Rousseeuw PJ, Leroy A. Robust Regression and Outlier Detection. Wiley: New York, 1987.
8. Maronna R, Martin D, Yohai V. Robust Statistics-Theory and Methods. Wiley: New York, 2006.
9. Li Y, Jiang JH, Chen ZP, Xu CJ, Yu RQ. Robust linear discriminant analysis for chemical pattern recognition. J. Chemometr. 1999; 13: 3-13.
10. Hubert M, Van Driessen K. Fast and robust discriminant analysis. Comput. Stat. Data Anal. 2004; 45: 301-320.
11. Vanden Branden K, Hubert M. Robust classification in high dimensions based on the SIMCA method. Chemometr Intell. Lab. Syst. 2005; 79: 10-21.
12. Liang Y-Z, Kvalheim OM. Robust methods for multivariate analysis-a tutorial review. Chemometr. Intell. Lab. Syst. 1996; 32: 1-10.
13. Brys G, Hubert M, Rousseeuw PJ. A robustification of independent component analysis. J. Chemometr. 2005; 19: 364-375.
14. Frosch Moller S, von Frese J, Bro R. Robust methods for multivariate data analysis. J. Chemometr. 2005; 19: 549-563.
15. Rousseeuw PJ, Debruyne M, Engelen S, Hubert M. Robustness and outlier detection in chemometrics. Crit. Rev. Anal. Chem. 2006; 36: 221-242.
16. Daszykowski M, Kaczmarek K, Vander Heyden Y, Walczak B. Robust statistics in data analysis-a review. Basic concepts. Chemometr. Intell. Lab. Syst. 2007; 85: 203-219.
17. Croux C, Filzmoser P, Oliveira MR. Algorithms for projection-pursuit robust principal component analysis. Chemometr. Intell. Lab. Syst. 2007; 87: 218-225.
18. Christmann A, Steinwart I. On robust properties of convex risk minimization methods for pattern recognition. J. Mach. Learn. Res. 2004; 5: 1007-1034.
19. Schölkopf B, Smola A. LearningwithKernels. MIT Press: Cambridge, MA, 2002.
20. Shawe-Taylor J, Cristianini N. Kernel Methods for Pattern Analysis. Cam-bridge University Press: Cambridge, UK, 2004.
21. The LSSVMLab Toolbox Website. http://www.esat.kuleuven.ac.be/sista/lssvmlab/toolbox.html
22. Pelckmans K, Suykens JAK, Van Gestel T, De Brabanter J, Lukas L, Hamers B, De Moor B, Vandewalle J. LS-SVMlab: a Matlab/C toolbox for Least Squares Support Vector Machines. Internal Report ESAT-SISTA, K.U.Leuven 2002; 02-44.
23. Möttönen J, Oja H. Multivariate spatial sign and rank methods. J. Non-parametr. Stat. 1995; 5: 201-213.
24. Serfling R. Nonparametric multivariate descriptive measures based on spatial quantiles. J. Stat. Plan. Inference 2004; 123: 259-278.
25. Visuri S, Koivunen V, Oja H. Sign and rank covariance matrices. J. Stat. Plan. Inference 2000; 91: 557-575.
26. Suykens JAK, De Brabanter J, Lukas L, Vandewalle J. Weighted least squares support vector machines: robustness and sparse approximation. Neurocomputing, Special issue on fundamental and information processing aspects of neurocomputing 2002; 48: 85-105.
27. Caputo B, Sim K, Furesjo F, Smola A. Appearance-based object recognition using SVMs: which Kernel should I use? Proceedings of NIPS Workshop on Statistical Methods for Computational Experiments in Visual Processing and Computer Vision, 2002.
28. Debruyne M, Hubert M, Suykens JAK. Model selection in kernel based regression using the influence function. J. Mach. Learn. Res. 2008; 9: 2377-2400.
29. Jaakkola T, Diekhans M, Haussler D. A discriminative framework for detecting remote protein homologies. J. Comput. Biol. 2000; 7: 95-114.
30. Leslie C, Eskin E, Noble WS. The spectrum kernel: a string kernel for svm protein classification. Proceedings of the Pacific Symposium on Biocomputing, Altman RB, Dunker AK, Hunter L, Lauerdale K, Klein TE (eds). World Scientific, 2002; 566-575.
31. Leslie C, Eskin E, Weston J, Noble WS. Mismatch string kernels for svm protein classification. Advances in Neural Information Processing Systems, Vol. 15, Becker S, Thrun S, Obermayer K (eds). MIT Press: Cambridge, MA, 2003.
32. Saigo H, Vert J, Ueda N, Akutsul T. Protein homology detection using string alignment kernels. Bioinformatics 2004; 20: 1682-1689.
33. Asuncion A, Newman DJ. UCI Machine Learning Repository. [http://www.ics.uci.edu/~mlearn/MLRepository.html] 2007, Irvine, CA, University of California, School of Information and Computer Sci-ence.
34. Lemberge P, De Raedt I, Janssens KH, Wei F, Van Espen PJ. Quantitative Z-analysis of the 16-17th century archaelogical glass vessels using PLS regression of EPXMA and -XRF data. J. Chemometr. 2000; 14: 751-763.
35. Hubert M, Rousseeuw PJ, VandenBranden K. ROBPCA: a new approach to robust principal component analysis. Technometrics 2005; 47: 64-79.
36. Osborne BG, Fearn T, Miller AR, Douglas S. Application of near infrared reglectance spectroscopy to the compositional analysis of biscuits and biscuit dough. J. Sci. Food Agric. 1984; 35: 99-105.
37. Hubert M, Verboven S. A robust PCR method for high-dimensional regressors. J. Chemometr. 2003; 17: 438-452.
38. Alon U, Barkai N, Notterman DA, Gish K, Ybarra S, Mack D, Levine AJ. Broad patterns of gene expression revealed by clustering of tumor and normal colon tissues probed by oligonucleotide arrays. Proc. Natl. Acad. Sci. 1999; 96: 6475-6750.
39. Iizuka N, Oka M, Yamada-Okabe H, Nishida M, Maeda Y, Mori N, Takao T, Tamesa T, Tangoku A, Tabuchi H, Hamada K, Nakayama H, Ishitsuka H, Miyamoto T, Hirabayashi A, Uchimura S, Hamamoto Y. Oligonucleotide microarray for prediction of early intrahepatic recurrence of hepatocellular carcinoma after curative resection. Lancet 2003; 361: 923-929.