Covariate shift in Hilbert space: A solution via surrogate kernels

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 2, 2013, Pages 1425-1432

  Zhang, Kai ^a   Zheng, Vincent W ^b   Wang, Qiaojun ^c   Kwok, James T ^d   Yang, Qiang ^d   Marsic, Ivan ^c  

^a NEC LABORATORIES AMERICA   (United States)

^b ADVANCED DIGITAL SCIENCES CENTER   (Singapore)

^c RUTGERS UNIVERSITY   (United States)

^d HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); HILBERT SPACES; LEARNING SYSTEMS; MATRIX ALGEBRA; VECTOR SPACES;

ALGORITHM PERFORMANCE; DIFFERENT DISTRIBUTIONS; EMPIRICAL KERNEL MAP; KERNEL-BASED LEARNING; LEARNING SCENARIOS; MERCER'S THEOREMS; SAMPLE DISTRIBUTIONS; TRAINING AND TESTING;

VARIATIONAL TECHNIQUES;

EID: 84897514685     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Belkin, M., Niyogi, P., and Sindhwani, V. Manifold regularization: A geometric framework for learning from labeled and unlabeled examples. Journal of Machine Learning Research, (7):2399 - 2434, 2006.
2. Bickel, S., Brückner, M., and Scheffer., T. Discriminative learning for differing training and test distributions. In International Conference on Machine Learning, 2007.
3. Bickel, S., Sawade, C., and Scheffer, T. Transfer learning by distribution matching for targeted advertising tex. In Advances in Neural Information Processing Systems 21, pp. 145-152, 2009.
4. Daume′ III, H. and Marcu, D. Domain adaptation for statistical classifiers. Journal of Artifical Intelligence Research, 26:101-126, 2006.
5. Huang, J., Smola, A., Gretton, A., Borgwardt, K.M., and Schölkopf, B. Correcting sample selection bias by unlabeled data. In Advances in Neural Information Processing Systems 19, pp. 601-608, 2007.
6. Joachims, T. Transductive inference for text classification using support vector machines. In International Conference on Machine Learning, 1999.
7. Kulis, B., Saenko, K., and Darrell, T. What you saw is not what you get: Domain adaptation using asymmetric kernel transforms. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 1785-1792, 2012.
8. Kumar, S., Mohri, M., and Talwalkar, A. Sampling methods for the nyström method. Journal of Machine Learning Research, 13:981-1006, 2012.
9. Mansour, Y., Mohri, M., and Rostamizadeh, A. Domain adaptation with multiple sources. In Advances in Neural Information Processing Systems, 2009.
10. Pan, J. and Yang, Q. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22: 1345-1359, 2010.
11. Pan, S. J., Tsang, I.W., Kwok, J.T., and Yang, Q. Domain adaptation via transfer component analysis. IEEE Transactions on Neural Networks, 22:199-210, 2011.
12. Schölkopf, B. and Smola, A. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT press, 2001.
13. Schölkopf, B., Smola, A., and Müller, Klaus-Robert. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10:1299-1319, 1998.
14. Shawe-Taylor, J., Williams, C., Cristianini, N., and Kandola, J. On the eigenspectrum of the Gram matrix and the generalization error of kernel-PCA. IEEE Transactions on Information Theory, 51:2510-2522, 2005. (Pubitemid 41136405)
15. Shimodaira, H. Improving predictive inference under covariate shift by weighting the log-likelihood function. Journal of Statistical Planninq and Inference, 90:227-244, 2000.
16. Sugiyama, M., Nakajima, S., Kashima, H., Bünau, P., and Kawanabe, M. Direct importance estimation with model selection and its application to covariate shift adaptation. In Advances in Neural Information Processing Systems 20, pp. 1433-1440, 2008.
17. Williams, C. and Seeger, M. Using the nyström method to speed up kernel machines. In Advances in Neural Information Processing Systems 13, 2001.
18. Yu, Y. and Szepesvári, C. Analysis of kernel mean matching under covariate shift. In International Conference on Machine Learning, pp. 478-486, 2012.
19. Zadrozny, B. Learning and evaluating classifiers under sample selection bias. In International Conference on Machine Learning, pp. 903-910, 2004.
20. Zhang, K., Tsang, I., and Kwok, J. Improved nyström lowrank approximation and error analysis. In International Conference on Machine Learning, pp. 1232-1239, 2008.