Primal space sparse kernel Partial Least Squares regression for large scale problems

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn 1, Issue , 2004, Pages 561-566

  Hoegaerts, L ^a   Suykens, J A K ^a   Vandewalle, J ^a   De Moor, B ^a  

^a Katholieke Universiteit Leuven   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

INTEGRATION; INTERPOLATION; LEAST SQUARES APPROXIMATIONS; OPTIMIZATION; PARAMETER ESTIMATION; PERSONNEL TRAINING; VECTORS;

DATASETS; KERNEL PARTIAL LEAST SQUARES (KPLS); REPRODUCING KERNEL HILBERT SPACE (RKHS); SPARSE REPRESENTATION;

LEARNING ALGORITHMS;

EID: 10944232592     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. B. Schölkopf and A. Smola, Learning with kernels. MIT Press, 2002.
2. J. A. K. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, and J. Vandewalle, Least Squares Support Vector Machines. World Scientific, Singapore, 2002.
3. G. Wahba, Spline Models for Observational Data, ser. CBMS-NSF Regional Conference Series in Applied Mathematics. Philadelphia, PA: SIAM, 1990, vol. 59.
4. C. Williams, C. Rasmussen, A. Schwaighofer, and V. Tresp, "Observations on the Nyström method for Gaussian processes," Institute for Adaptive and Neural Computation, Division of Informatics, University of Edinburgh, Tech. Rep., 2002.
5. S. Fine and K. Scheinberg, "Efficient SVM training using low-rank kernel representations," Journal of Machine Learning Research, vol. 2, no. 2, pp. 243-264, 2002.
6. K.-M. Lin and C.-J. Lin, "A study on reduced support vector machines," Neural Networks, IEEE Transactions on, vol. 14, no. 6, pp. 1449-1459, Nov 2003.
7. Y. Lee and O. L. Mangasarian, "RSVM: Reduced support vector machines," First SIAM International Conference on Data Mining, Chicago, April 2001, technical Report 00-07, July, 2000.
8. A. J. Smola and B. Schölkopf, "Sparse greedy matrix approximation for machine learning," in Proc. 17th International Conf. on Machine Learning. Morgan Kaufmann, San Francisco, CA, 2000, pp. 911-918.
9. R. Rifkin, G. Yeo, and T. Poggio, Advances in Learning Theory: Methods, Models and Applications, Eds. Suykens, Horvath, Basu, Micchelli, and Vandewalle, ser. NATO Science Series III: Computer and Systems Sciences. Amsterdam: IOS Press, 2003, vol. 190.
10. E. J. Nyström, "Uber die praktische auflosung von linearen Integralgleichungen mit anwendungen auf randwertaufgaben der potentialtheorie," Commentationes PhysicoMathematica, vol. 4, no. 15, pp. 1-52, 1928.
11. C. Williams and M. Seeger, "Using the Nyström method to speed up kernel machines," in Advances in Neural Information Processing Systems, eds. T. K. Leen, T. G. Diettrich, V. Tresp, vol. 13. MIT Press, 2001, pp. 682-688.
12. M. Momma and K. Bennett, "Sparse kernel partial least squares regression," in Proceedings of Conference on Learning Theory (COLT 2003), 2003, pp. 216-230.
13. N. Aronszajn, "Theory of reproducing kernels," Transactions of the American mathematical society, vol. 686, pp. 337-404, 1950.
14. G. Kimeldorf and G. Wahba, "Tchebycheffi an spline functions," J. Math. Ana. Applic., vol. 33, pp. 82-95, 1971.
15. C. Baker, The numerical treatment of integral equations. Oxford Clarendon Press, 1977.
16. W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical Recipes: The Art of Scientific Computing, 1st ed. Cambridge (UK) and New York: Cambridge University Press, 1986.
17. B. Schölkopf, A. Smola, and K. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Computation, vol. 10(5), pp. 1299-1319, 1998.
18. L. Hoegaerts, J. A. K. Suykens, J. Vandewalle, and B. De Moor, "Subset based least squares subspace regression in rkhs," Technical Report 03-171, ESAT-SCD-SISTA, K.U.Leuven (Leuven, Belgium), november 2003, (submitted), 2004.
19. H. Wold, "Path models with latent variables: the nipals approach," in Quantitative Sociology: International Perspectives on Mathematical and Statistical Model Building, H. M. Balock, Ed. NY: Academic Press, 1975, pp. 307-357.
20. F. Lindgren, P. Geladi, and S. Wold, "The kernel algorithm for pls," Journal of Chemometrics, vol. 7, pp. 45-59, 1993.
21. R. Rosipal and L. J. Trejo, "Kernel partial least squares regression in reproducing kernel hilbert space," Journal of Machine Learning Research, vol. 7, pp. 97-123, Dec 2001.
22. Bennett and M. J. Embrechts, Advances in Learning Theory: Methods, Models and Applications, J.A.K. Suykens, G. Horvath, S. Basu, C. Micchelli, J. Vandewalle (Eds.). NATO Science Series III: Computer & Systems Sciences.IOS Press Amsterdam, 2003, vol. 190, ch. An Optimization Perspective on Partial Least Squares, pp. 227-250.
23. P. L. Lai and C. Fyfe, "Kernel and nonlinear canonical correlation analysis," International Journal of Neural Systems, vol. 10, no. 5, pp. 365-377, 2000.
24. F. Bach and M. Jordan, "Kernel independent component analysis," Journal of Machine Learning Research, vol. 3, pp. 1-48, 2002.
25. C. Blake and C. Merz, "Uci repository of machine learning databases," 1998. [Online]. Available: http://www.ics.uci.edu/~mlearn/ MLRepository.html
26. F. Ramsey and D. Schafer, The Statistical Sleuth: A Course in Methods of Data Analysis. Belmont, CA: Wadsworth Publishing Company, 1997.