Efficient computations via scalable sparse kernel partial least squares and boosted latent features

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2005, Pages 654-659

  Momma, Michinari ^a  

^a FAIR ISAAC CORPORATION   (United States)

Author keywords

Boosted Latent Features; Partial Least Squares; Scalable and sparse kernel method

Indexed keywords

KERNEL BOOSTED LATENT FEATURES (KBLF); KERNEL PARTIAL LEAST SQUARES (KPLS); PARTIAL LEAST SQUARES;

COMPUTATION THEORY; COMPUTATIONAL METHODS; OPTIMIZATION; REGRESSION ANALYSIS;

DATA MINING;

EID: 32344442046     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1081870.1081952     Document Type: Conference Paper

References (19)

1. DELVE: Data for evaluating learning in valid experiments. http://www.cs.toronto.edu/~delve/.
2. K. P. Bennett and M. J. Embrechts. An optimization perspective on kernel partial least squares. In Proceedings of the NATO Advanced Study Institute on Learning Theory and Practice (LTP 2002), 2003.
3. T. D. Bie, M. Momma, and N. Cristianini. Efficiently learning the metric with side-information. In Algorithmic Learning Theory (ALT2003), pages 175-189. Springer-Verlag Heidelberg, 2003.
4. C. L. Blake and C. J. Merz. UCI Repository of machine learning databases, 1998. http://www.ics.uci.edu/~mlearn/MLRepository.html.
5. R. Collobert and S. Bengio. Support vector machines for large-scale regression problems. IDIAP-RR-00-17, 2000.
6. N. Cristianini and J. Shawe-Taylor. An Introduction to Support Vector Machines and Other Kernel-Based Methods. Cambridge University Press, 2000.
7. S. de Jong. SIMPLS: an alternetive approach to partial least squares regression. Chemometrics and Intelligent Laboratory Systems, 18:251-273, 1993.
8. [81 M. C. Denham. Implementing partial least squares. Statics and Computing, 5:191-202, 1995.
9. J. H. Friedman and B. E. Popescu. Gradient directed regularization of linear regression and classification. Technical report, Stanford University, 2004.
10. I. S. Heiland. On the structure of partial least squares regression. Communications in Statistics, Simulation and Computation, 17-2:581-607, 1988.
11. L. Hoegaerts, J. Suykens, J. Vandewalle, and B. D. Moor. Primal space kernel partial least squares regression for large scale problems. In Proceedings of IEEE International Joint Conference on Neural Networks (IJCNN 2004).
12. L. Mason, J. Baxter, P. Bartlett, and M. Frean. Boosting algorithms as gradient descent in function space. Technical report, RSISE, Australian National University, 1999.
13. M. Momma. Efficient computations via scalable sparse kernel partial least squares and boosted latent features. Technical report, 2005. http://www.rpi.edu/~momman/.
14. M. Momma and K. Bennett. Constructing orthogonal latent features for arbitrary loss. In I. Guyon, S. Gunn, M. Nikravesh, and L. Zadeh, editors, Feature Extraction, Foundations and Applications, Springer, 2004.
15. M. Momma and K. P. Bennett. Sparse kernel partial least squares regression. In Proceedings of The Sixteenth Annual Conference on Learning Theory, pages 216-230, 2003.
16. P. B. Nair, A. Choudhury, and A. J. Keane. Some greedy learning algorithms for sparse regression and classification with mercer kernels. Journal of Machine Learning Research, 3:781-801, 2002.
17. R. Rosipal, M. Girolami, and L. J. Trejo. Kernel PLS-SVC for linear and nonlinear classification. In Proceedings of the Twentieth International Conference on Machine Learning (ICML-2003), 2003.
18. R. Rosipal and L. T. Trejo. Kernel partial least squares regression in reproducing kernel Hubert space. Journal of Machine Learning Research, 2:97-123, 2001.
19. H. Wold. Estimation of principal components and related models by iterative least squares. In Multivariate Analysis, pages 391-420, New York, 1966, Academic Press.