Kernel partial least squares for nonlinear regression and discrimination

Neural Network World

Volumn 13, Issue 3, 2003, Pages 291-300

  Rosipal, Roman ^a,b  

^a NASA AMES RESEARCH CENTER   (United States)

^b INSTITUTE OF CHEMISTRY   (Slovakia)

Author keywords

Kernel based learning; Partial least squares; Support vector machines

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; EIGENVALUES AND EIGENFUNCTIONS; MATRIX ALGEBRA; PRINCIPAL COMPONENT ANALYSIS; RADIAL BASIS FUNCTION NETWORKS; REGRESSION ANALYSIS;

KERNEL PARTIAL LEAST SQUARES; KERNEL-BASED LEARNING; NONLINEAR REGRESSION; SUPPORT VECTOR MACHINES;

LEARNING SYSTEMS;

EID: 0037624001     PISSN: 12100552     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (19)

1. Aronszajn N.: Theory of reproducing kernels, Transactions of the American Mathematical Society, 1950, 68, pp. 337-404.
2. Barker M., Rayens W. S.: Partial least squares for discrimination, Journal of Chemometrics, 2003, 17, pp. 166-173.
3. Höskuldsson A.: PLS Regression Methods, Journal of Chemometrics, 1988, 2, pp. 211-228.
4. Lewi, P. J.: Pattern recognition, reflection from a chemometric point of view, Chemometrics and Intelligent Laboratory Systems, 1995, 28, pp. 23-33.
5. Mercer J.: Functions of positive and negative type and their connection with the theory of integral equations. Philosophical Transactions Royal Society London, 1909, A209, pp. 415-446.
6. Rännar S., Lindgren F., Geladi P., Wold S.: A PLS kernel algorithm for data sets with many variables and fewer objects, Chemometrics and Intelligent Laboratory Systems, 1994, 8, pp. 111-125.
7. Rätsch G., Onoda, T., Müller K. R.: Soft margins for AdaBoost, Machine Learning, 2001, 42, 3, pp. 287-320.
8. Rosipal R., Trejo L. J.: Kernel Partial Least Squares Regression in Reproducing Kernel Hilbert Space, Journal of Machine Learning Research, 2001, 2, pp. 97-123.
9. Sampson P. D., Streissguth, A. P., Barr H. M., Bookstein F. L.: Neurobehavioral effects of prenatal alcohol: Part II. Partial Least Squares analysis, Neurotoxicology and tetralogy, 1989, 11, 5, pp. 477-491.
10. Schölkopf B., Smola A. J., Müller K. R.: Nonlinear Component Analysis as a Kernel Eigen-value Problem, Neural Computation, 1998, 10, pp. 1299-1319.
11. Wold S., Ruhe H., Wold H., Dunn III W. J.: The collinearity problem in linear regression. The PLS approach to generalized inverse, SIAM Journal of Scientific and Statistical Computations, 1984, 5, pp. 735-743.
12. Hastie T., Tibshirani R., Friedman J.: The Elements of Statistical Learning, Springer, 2001.
13. Schölkopf B., Smola A. J.: Learning with Kernels - Support Vector Machines, Regularization, Optimization and Beyond, The MIT Press, 2002.
14. Vapnik V. N.: Statistical Learning Theory, Wiley, New York, 1998.
15. Wahba G.: Splines Models of Observational Data, SIAM, 59, Series in Applied Mathematics, Philadelphia, 1990.
16. Wold H.: Soft Modeling by Latent Variables; the Nonlinear Iterative Partial Least Squares Approach, Perspectives in Probability and Statistics, 1975, J. Gani (ed.), pp. 520-540.
17. Mika S., Rätsch G., Weston J., Schölkopf B., Müller K. R.: Fisher discriminant analysis with kernels, Neural Networks for Signal Processing IX, Y.-H. Hu, J. Larsen, E. Wilson, and S. Douglas (eds.), 1999, pp. 41-48.
18. Rosipal R., Trejo L. J., Matthews B.: Kernel PLS-SVC for Linear and Nonlinear Classification, Proceedings of the Twentieth International Conference on Machine Learning (ICML-2003), Washington DC, 2003.
19. Wegelin J. A.: A survey of Partial Least Squares (PLS) methods, with emphasis on the two-block case, Department of Statistics, University of Washington, Seattle, 2000.