Single-Source Domain Adaptation with Target and Conditional Shift

Regularization, Optimization, Kernels, and Support Vector Machines

Volumn , Issue , 2014, Pages 427-456

  Zhang, Kun ^a   Schölkopf, Bernhard ^a   Muandet, Krikamol ^a   Wang, Zhikun ^a   Zhou, Zhi Hua ^b   Persello, Claudio ^a  

^a MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^b NANJING UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84963683886     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1201/b17558-22     Document Type: Chapter

References (41)

1. J. Candela, M. Sugiyama, A. Schwaighofer, and N. Lawrence, editors. Dataset Shift in Machine Learning. MIT Press, 2009.
2. Y. S. Chan and H. T Ng. Word sense disambiguation with distribution estimation. In Proceedings of the 19th International Joint Conference on Artificial Intelligence, pages 1010–1015, Scotland, 2005.
3. K. Fukumizu, F. R. Bach, M. I. Jordan, and C. Williams. Dimensionality reduction for supervised learning with reproducing kernel Hilbert spaces. Journal of Machine Learning Research, 5:73–99, 2004.
4. K. Fukumizu, A. Gretton, X. Sun, and B. Schölkopf. Kernel measures of conditional dependence. In J.C. Platt, D. Koller, Y. Singer, and S. Roweis, editors, Advances in Neural Information Processing Systems 20, pages 489–496, Cambridge, MA, 2008. MIT Press.
5. A. Gretton, K. Borgwardt, M. Rasch, B. Schölkopf, and A. Smola. A kernel method for the two-sample-problem. In NIPS 19, pages 513–520, Cambridge, MA, 2007. MIT Press
6. A. Gretton, A. Smola, J. Huang, M. Schmittfull, K. Borgwardt, and B. Schölkopf. Covariate shift and local learning by distribution matching. In J. Quiñonero-Candela, M. Sugiyama, A. Schwaighofer, and N. Lawrence, editors, Dataset shift in machine learning, pages 131–160. MIT Press, Cambridge, MA, 2008.
7. A. Gretton, B. Sriperumbudur, D. Sejdinovic, H. Strathmann, S. Balakrishnan, M. Pontil, and K. Fukumizu. Optimal kernel choice for large-scale two-sample tests. In NIPS 25. MIT Press, 2012.
8. J. Ham, Y. Chen, M. M. Crawford, and J. Ghosh. Investigation of the random forest framework for classification of hyperspectral data. IEEE Trans. Geosci. Remote Sens., 43(3):492–501, 2005.
9. P.O. Hoyer, D. Janzing, J. Mooji, J. Peters, and B. Schölkopf. Nonlinear causal discovery with additive noise models. In Advances in Neural Information Processing Systems 21, Vancouver, B.C., Canada, 2009.
10. J. Huang, A. Smola, A. Gretton, K. Borgwardt, and B. Schölkopf. Correcting sample selection bias by unlabeled data. In NIPS 19, pages 601– 608, 2007.
11. D. Janzing, J. Mooij, K. Zhang, J. Lemeire, J. Zscheischler, P. Daniuvsis, B. Steudel, and B. Schölkopf. Information-geometric approach to inferring causal directions. Artificial Intelligence, pages 1–31, 2012.
12. N. Japkowicz and S. Stephen. The class imbalance problem: A systematic study. Intelligent Data Analysis, 6:429–450, 2002.
13. J. Jiang. A literature survey on domain adaptation of statistical classifiers, 2008. http://sifaka.cs.uiuc.edu/jiang4/domain_adaptation/survey.
14. Y. Lin, Y. Lee, and G. Wahba. Support vector machines for classification in nonstandard situations. Machine Learning, 46:191–202, 2002.
15. C. Manski and S. Lerman. The estimation of choice probabilities from choice-based samples. Econometrica, 45:1977–1988, 1977.
16. J. Mooij, O. Stegle, D. Janzing, K. Zhang, and B. Schölkopf. Probabilistic latent variable models for distinguishing between cause and effect. In Advances in Neural Information Processing Systems 23 (NIPS 2010), Curran, NY, USA, 2010.
17. S. J. Pan and Q. Yang. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22:1345–1359, 2010.
18. J. Pearl. Causality: Models, Reasoning, and Inference. Cambridge University Press, Cambridge, 2000
19. C. Persello. Interactive domain adaptation for the classification of remote sensing images using active learning. IEEE Geoscience and Remote Sensing Letters, 10:736–740, 2013.
20. C. P. Robert and G. Casella. Monte Carlo Statistical Methods. Springer Press, New York, 2nd edition, 2004.
21. C. Saunders, A. Gammerman, and V. Vovk. Ridge regression learning algorithm in dual variables. In 15th International Conference on Machine Learning, pages 515–521, Madison, WI, 1998.
22. B. Schölkopf, D. Janzing, J. Peters, E. Sgouritsa, K. Zhang, and J. Mooij. On causal and anticausal learning. In Proc. 29th International Conference on Machine Learning (ICML 2012), Edinburgh, Scotland, 2012.
23. B. Schölkopf, A. Smola, and K. Muller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10:1299–1319, 1998.
24. S. Shimizu, P.O. Hoyer, A. Hyvärinen, and A.J. Kerminen. A linear non- Gaussian acyclic model for causal discovery. Journal of Machine Learning Research, 7:2003–2030, 2006.
25. H. Shimodaira. Improving predictive inference under covariate shift by weighting the log-likelihood function. Journal of Statistical Planning and Inference, 90:227–244, 2000.
26. A. Smola, A. Gretton, L. Song, and B. Schölkopf. A Hilbert space embedding for distributions. In Proceedings of the 18th International Conference on Algorithmic Learning Theory, pages 13–31. Springer-Verlag, 2007.
27. L. Song, B. Boots, S. Siddiqi, G. Gordon, and A. Smola. Hilbert space embeddings of hidden Markov models. In Proceedings of the 26th International Conference on Machine Learning, Haifa, Israel, 2010.
28. L. Song, J. Huang, A. Smola, and K. Fukumizu. Hilbert space embeddings of conditional distributions with applications to dynamical systems. In International Conference on Machine Learning (ICML 2009), June 2009.
29. P. Spirtes, C. Glymour, and R. Scheines. Causation, Prediction, and Search. MIT Press, Cambridge, MA, 2nd edition, 2001.
30. B. Sriperumbudur, K. Fukumizu, and G. Lanckriet. Universality, characteristic kernels and RKHS embedding of measures. Journal of Machine Learning Research, 12:2389–2410, 2011.
31. A. Storkey. When training and test sets are different: Characterizing learning transfer. In J. Candela, M. Sugiyama, A. Schwaighofer, and N. Lawrence, editors, Dataset Shift in Machine Learning, pages 3–28. MIT Press, 2009.
32. M. Sugiyama, M. Krauledat, and K. R. Müller. Covariate shift adaptation by importance weighted cross validation. Journal of Machine Learning Research, 8:985–1005, December 2007.
33. M. Sugiyama, T. Suzuki, S. Nakajima, H. Kashima, P. von Bünau, and M. Kawanabe. Direct importance estimation for covariate shift adaptation. Annals of the Institute of Statistical Mathematics, 60:699–746, 2008.
34. J. Tian and J. Pearl. Causal discovery from changes: a bayesian approach. In Proceedings of the 17th Conference on Uncertainty in Artificial Intelligence (UAI2001), pages 512–521, 2001.
35. J. Woodward. Making things happen: A theory of causal explanation. Oxford University Press, New York, 2003.
36. Y. Yu and Z. H. Zhou. A framework for modeling positive class expansion with single snapshot. In PAKDD 2008, 2008.
37. B. Zadrozny. Learning and evaluating classifiers under sample selection bias. In 21st International Conference on Machine Learning, pages 114– 121, Banff, Canada, 2004.
38. K. Zhang and A. Hyvärinen. Acyclic causality discovery with additive noise: An information-theoretical perspective. In Proc. European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD) 2009, Bled, Slovenia, 2009.
39. K. Zhang and A. Hyvärinen. On the identifiability of the post-nonlinear causal model. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence, Montreal, Canada, 2009.
40. K. Zhang, J. Peters, D. Janzing, and B. Schölkopf. Kernel-based conditional independence test and application in causal discovery. In Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (UAI 2011), Barcelona, Spain, 2011.
41. K. Zhang, B. Schölkopf, K. Muandet, and Z. Wang. Domain adaptation under target and conditional shift. In Proceedings of the 30th International Conference on Machine Learning, JMLR: W&CP Vol. 28, 2013