About kernel latent variable approaches and SVM

Journal of Chemometrics

Volumn 19, Issue 5-7, 2005, Pages 341-354

  Czekaj, Tomasz ^a   Wu, Wen ^b   Walczak, Beata ^a,c  

^a UNIVERSITY OF SILESIA   (Poland)

^b GLAXOSMITHKLINE   (United Kingdom)

^c VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

Author keywords

Genomics; Kernel PCR; Kernel PLS; Kernel Ridge Regression; Medical diagnostics; SVMs

Indexed keywords

DIAGNOSIS; REGRESSION ANALYSIS; SUPPORT VECTOR MACHINES;

GENOMICS; KERNEL APPROACHES; KERNEL PCR; KERNEL PLS; KERNEL RIDGE REGRESSIONS; LATENT VARIABLE; MEDICAL DIAGNOSTICS; PREDICTIVE POWER; REGULARISATION; SVM;

GENOME;

EID: 32444444605     PISSN: 08869383     EISSN: 1099128X     Source Type: Journal    
DOI: 10.1002/cem.937     Document Type: Article

References (69)

1. Vapnik VN. The Nature of Statistical Learning Theory. Springer-Verlag: Berlin, 1995, ISBN 0-387-94559-8.
2. Vapnik VN. Statistical Learning Theory. John Wiley & Sons: New York, USA, 1998.
3. Vapnik VN, Chervonenkis AY. On the uniform convergence of relative frequencies of events to their probabilities. Theory Probability Appl. 1971; 16: 264-280.
4. Vapnik VN, Chervonenkis AY. The necessary and sufficient conditions for consistency in the empirical risk minimization method. Pattern Recognit. Image Anal. 1991; 1: 283-305.
5. Bousquet O, Elisseeff A. Stability and generalization. J Machine Learn. Res. 2002; 2: 499-526.
6. Massart DL, Vandeginste BGM, Buydens LMC, de Jong S, Lewi PJ, Smeyers-Verbeke J. Handbook of Chemometrics and Qualimetrics: Part A. Elsevier: Amsterdam, Netherlands, 1997.
7. Vandeginste BGM, Massart DL, Buydens LMC, de Jong S, Lewi PJ, Smeyers-Verbeke J. Handbook of Chemometrics and Qualimetrics: Part B. Elsevier: Amsterdam, Netherlands, 1998.
8. Martens H, Naes T. Mutivariate Calibration. John Wiley & Sons: Chichester, UK, 1989.
9. Naes T, Isaksson T, Fearn T, Davies T. A User-Friendly Guide to Multivariate Calibration and Classification. NIR Publications: Chichester, UK, 2002.
10. Frank IE, Friedman JH. A statistical view of some chemometrics regression tools. Technometrics 1993; 35: 109-135.
11. Hoerl AE, Kennard RW. Ridge regression: biased estimation for nonorthogonal problems. Technometrics 1970; 12: 55-67.
12. Tikhonov AN, Arsenin VY. Solutions of III-Posed Problem. W.H. Winston: Washington DC, USA, 1977.
13. Morozov VA. On the solution of functional equations by the method of regularization. Soviet Math. Dokl. 1966; 7: 414-417.
14. Mallows CL. Some comments on CP. Technometrics 1973; 15: 661-675.
15. Hansen PC. Analysis of discrete ill-posed problems by means of the L-curve. Soc. Ind. Appl. Math. Rev. 1992; 34: 561-580.
16. Golub GH, Heath M, Wahba G. Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics 1979; 21: 215-223.
17. Evgeniou T, Pontil M, Poggio T. Regularization networks and support vector machines. Adv. Comput. Math. 2000; 13: 1-50.
18. Girosi F, Jones M, Poggio T. Regularization theory and neural networks architectures. Neural Comput. 1995; 7: 219-269.
19. Girosi F. An equivalence between sparse approximation and support vector machines. Neural Comput. 1998; 10: 1455-1480.
20. Smola A, Scholkopf B, Muller K-R. The connection between regularization operators and support vector kernels. Neural Netw. 1998; 11: 637-649.
21. Cortes C, Vapnik VN. Support-Vector Network. Machine Lear. 1995; 20: 273-297.
22. Cristianini N, Shawe-Taylor J. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge University Press: Cambridge, UK, 2000.
23. Burges CJC. A tutorial on support vector machines for pattern recognition. Data Mining Knowledge Discov. 1998; 2: 121-167.
24. Smola A, Scholkopf B. A Tutorial on Support Vector Regression. NeuroCOLT Technical Report NC-RR-98-030, Royal Holloway College, University of London, UK, 1998.
25. Drucker H, Burges CJC, Kaufman L, Smola A, Vapnik VN. Support vector regression machines. In Advances in Neural Information Processing Systems. Vol. 9, Mozer M, Jordan M, Petsche T (eds). NIPS: Denver, USA, 1996 [The MIT Press: Cambridge, MA, USA, 1997; 155-161].
26. Schoelkopf B, Bartlett P, Smola AJ, Williamson R. Shrinking the tube: a new support vector regression algorithm. In Advances in Neural Information Processing Systems. Vol. 11, Kearns MS, Solla SA, Cohn DA (eds). NIPS: Denver, USA, 1998 [The MIT Press: Cambridge, MA, USA, 1999; 330-336].
27. Vapnik VN, Golowich SE, Smola A. Support vector method for function approximation, regression estimation, and signal processing. In Advances in Neural Information Processing Systems. Vol. 9, Mozer M, Jordan M, Petsche T (eds). NIPS: Denver, USA, 1996 [The MIT Press: Cambridge, Massachusetts, USA, 1997; 281-287].
28. de Jong S. SIMPLS: an alternative approach to partial least squares regression. Chemometrics Intelligent Lab. Syst. 1993; 18: 251-263.
29. Campbell C. Kernel methods: a survey of current techniques. Neurocomputing 2002; 48: 63-84.
30. Aronszajn N. Theory of reproducing kernels. Trans. Am. Math. Soc. 1950; 68: 337-404.
31. Wahba G. Support vector machines, reproducing kernel Hilbert spaces and the randomised GACV. In Advances in Kernel Methods - Support Vector Learning. Scholkopf B, Burges CJC, Smola AJ (eds). The MIT Press: Cambridge, MA, USA, 1999; 69-88.
32. Poggio T. On optimal nonlinear associative recall. Biol. Cybern. 1975; 19: 201-209.
33. Mercer J. Functions of positive and negative type and their connection with the theory of integral equations. Philos. Trans. R. Soc. Lond. 1909; A 209: 415-446.
34. Suykens AK, Van Gestel T, De Brabanter J, De Moor B, Vandewalle J. Least Squares Support Vector Machines. World Scientific Publishing Co.: Singapore, 2002.
35. Evgeniou T. Learning with Kernel Machine Architectures, PhD thesis, Massachusetts Institute of Technology. The MIT Press: Cambridge, MA, USA, 2000, available at: http: //cbcl.mit.edu/projects/cbcl/publications/theses/thesis- evgeniou.pdf [29 March 2005].
36. Walczak B, Massart DL. The radial basis functions - partial least squares approach as a flexible non-linear regression techniques. Anal. Chim. Acta 1996; 331: 177-185.
37. Walczak B, Massart DL. Application of radial basis functions - partial least squares to non-linear pattern recognition problems: diagnosis of process faults. Anal. Chim. Acta 1996; 331: 187-193.
38. Walczak B, Massart DL. ERRATUM. Chemometrics Intelligent Lab. Syst. 2000; 51: 219-238 [As Erratum of the article: Local modelling with Radial Basis Functions Networks].
39. Centner V, Verdu-Andres J, Walczak B, Jouan-Rimbaud D, Despagne F, Pasti L, Poppi R, Massart DL, de Nord O. A comparison of multivariate calibration techniques applied to experimental NIR data sets. Appl. Spectrosc. 2000; 54: 608-623.
40. Estienne F, Pasti L, Centner V, Walczak B, Despagne F, Jouan Rimbaud D, de Noord OE, Massart DL. A comparison of multivariate calibration techniques applied to experimental NIR data sets. Part II: Predictive ability under extrapolation conditions. Chemometrics Intelligent Lab. Syst. 2001; 58: 195-211.
41. Estienne F, Despagne F, Walczak B, de Noord OE, Massart DL. A comparison of multivariate calibration techniques applied to experimental NIR data sets. Part III: robustness against instrumental perturbation conditions. Chemometrics Intelligent Lab. Syst. 2004; 73: 207-218.
42. Stokbro K, Umberger DK, Hertz JA. Exploiting neurons with localized receptive fields to learn chaos. Complex Syst. 1990; 4: 603-622.
43. Bakshi BR, Stephanopoulos G. Wave-net: a multiresolution, hierarchical neural network with localized learning. AIChE J. 1993; 39: 57-81.
44. Lapedes AS, Farber R. Non-Linear Signal Processing using Neural Networks: Prediction and System Modeling. Technical Report, Los Alamos National Laboratory, Los Alamos, New Mexico, USA, 1987.
45. Ydstie BE. Forecasting and control using adaptive connectionist networks. Comput. Chem. Eng. 1990; 14: 583-599.
46. Chen X, Cheung ST, So S, Fan ST, Barry C, Higgins J, Lai K, Ji J, Dudoit S, Ng IOL, van de Rijn M, Botstein D, Brown PO. Gene expression patterns in human liver cancers. Mol. Biol. Cell 2002; 13: 1929-1939.
47. http://genome-www5.stanford.edu/cgi-bin/publication/viewPublication.pl? pub_no = 107 [29 September 2004].
48. Quackenbush J. Microarray data normalization and transformation. Nat. Genet. 2002; 32: 496-501.
49. Eilers PHC. Fast computation of trends in scatterplots. Kwantitatieve Methoden 2004; 71: 38-45.
50. Kennard RW, Stone LA. Computer-aided design of experiments. Technometrics 1969; 11: 137-148.
51. Slonim DK. From pattern to pathways: gene expression data analysis comes of age. Nat. Genet. 2002; 32: 502-508.
52. Yoo C, Thorsson V, Cooper GF. Discovery of causal relationships in a gene-regulation pathway from a mixture of experimental and observational DNA microarray data. Pacific Symposium on Biocomputing. World Scientific: New Jersey, USA, 2002; 498-509.
53. Walsh B, Henderson D. Microarrays and beyond: what potential do current and future genomics tools have for breeders? J. Anim. Sci. 2004; 82: E292-E299.
54. Centner V, Massart DL, de Noord OE, de Jong S, Vandeginste B, Sterna C. Elimination of uninformative variables for multivariate calibration. Anal. Chem. 1996; 68: 3851-3858.
55. http: //www.mathworks.com/
56. http: //svmlight.joachims.org/ [29 March 2005].
57. Belousov AI, Verzakov SA, von Frese J. A flexible classification approach with optimal generalization performance: support vector machines. Chemometrics Intelligent Lab. Syst. 2002; 64: 15-25.
58. Belousov AI, Verzakov SA, von Frese J. Applicational aspects of support vector machines. J. Chemometrics 2002; 16: 482-489.
59. Chauchaerd F, Cogdill R, Roussel S, Roger JM, Bellon-Maurel V. Application of LS-SVM to non-linear phenomena in NIR spectroscopy: development of a robust and portable sensor for acidity prediction in grapes. Chemometrics Intelligent Lab. Syst. 2004; 71: 141-150.
60. Thissen U, van Brakel R, de Weijer AP, Melssen WJ, Buydens LMC. Using support vector machines for time series prediction. Chemometrics Intelligent Lab. Syst. 2003; 69: 35-49.
61. Thissen U, Pepers M, Üstün B, Melssen WJ, Buydens LMC. Comparing support vector machines to PLS for spectral regression applications. Chemometrics Intelligent Lab. Syst. 2004; 73: 169-179.
62. Yao XJ, Panaye A, Doucet JP, Chen HF, Zhang RS, Fan BT, Liu MC, Hu ZD. Comparative classification study of toxicity mechanisms using support vector machines and radial basis function neural networks. Anal. Chim. Acta 2005; 535: 259-273.
63. Devos A, Simonetti AW, van der Graaf M, Lukas L, Suykens JAK, Vanhamme L, Buydens LMC, Heerschap A, Van Huffel S. The use of multivariate MR imaging intensities versus metabolic data from MR spectroscopic imaging for brain tumour classification. J. Magn. Reson. 2005; 173: 218-228.
64. Brudzewski K, Osowski S, Markiewicz T, Ulaczyk J. Classification of gasoline with supplement of bio-products by means of an electronic nose and SVM neural network. Sens. Actuators B: Chem. 2005 (in press).
65. Cogdill RP, Dardenne P. Least-squares support vector machines for chemometrics: an introduction and evaluation. J. Near Infrared Spectrosc. 2004; 12: 93-100.
66. Rosipal R, Trejo LJ, Matthews B. Kernel PLS-SVC for linear and Nonlinear Classification. In Proceedings of the Twentieth International Conference on Machine Learning (ICML-2003), Washington DC, USA, 2003.
67. Bennett KP, Embrechts MJ. An optimization perspective on partial least squares. In Advances in Learning Theory: Methods, Models and Applications, Suykens JAK, Horvath G, Basu S, Micchelli C, Vandewalle J (eds). NATO Science Series III: Computer & Systems Sciences, Vol. 190. IOS Press Amsterdam: Amsterdam, Netherlands, 2003; 227-250.
68. Martinetz M, Berkovich S, Schulten K. A neural-gas network for vector quantization and its application to time series prediction. IEEE Transactions on Neural Networks 1993; 4: 558-569.
69. Kohonen T. Self-Organisation and Associative Memory (3rd edn). Springer: Berlin, Germany, 1990.