Direct density ratio estimation for large-scale covariate shift adaptation

Journal of Information Processing

Volumn 17, Issue , 2009, Pages 138-155

  Tsuboi, Yuta ^a   Kashima, Hisashi ^a   Hido, Shohei ^a   Bickel, Steffen ^b   Sugiyama, Masashi ^c  

^a IBM RESEARCH   (United States)

^b UNIVERSITY OF POTSDAM   (Germany)

^c TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 70549087225     PISSN: 03875806     EISSN: 18826652     Source Type: Journal    
DOI: 10.2197/ipsjjip.17.138     Document Type: Article

References (32)

1. Baldi, P. and Brunak, S.: Bioinformatics: The Machine Learning Approach, MIT Press, Cambridge (1998).
2. Bickel, S.: ECML 2006 Discovery Challenge Workshop (2006).
3. Bickel, S. and Scheffer, T.: Dirichlet-Enhanced Spam Filtering based on Biased Samples, Advances in Neural Information Processing Systems, MIT Press, Cambridge, MA, pp.161-168 (2007).
4. Bickel, S., Brückner, M. and Scheffer, T.: Discriminative Learning for Differing Training and Test Distributions, Proc. 24th international conference on Machine learning, pp.81-88, ACM Press (2007).
5. Blitzer, J., McDonald, R. and Pereira, F.: Domain adaptation with structural correspondence learning, Proc. Conference on Empirical Methods in Natural Language Processing, pp.120-128 (2006).
6. Borgwardt, K.M., Gretton, A., Rasch, M.J., Kriegel, H.-P., Schölkopf, B. and Smola, A.J.: Integrating Structured Biological Data by Kernel Maximum Mean Discrepancy, Bioinformatics, Vol.22, No.14, pp.e49-e57 (2006).
7. Candela, J.Q., Lawrence, N., Schwaighofer, A. and Sugiyama, M.: NIPS 2006 Workshop on Learning When Test and Training Inputs Have Different Distributions (2006).
8. Cohn, D.A., Ghahramani, Z. and Jordan, M.I.: Active Learning with Statistical Models, Journal of Artificial Intelligence Research, Vol.4, pp.129-145 (1996).
9. Daumé III, H.: Frustratingly easy domain adaptation, Proc. 45th Annual Meeting of the Association for Computational Linguistics, pp.256-263 (2007).
10. Fedorov, V.V.: Theory of Optimal Experiments, Academic Press, New York (1972).
11. Fishman, G.S.: Monte Carlo: Concepts, Algorithms, and Applications, Springer- Verlag, Berlin (1996).
12. Härdle, W., Müller, M., Sperlich, S. and Werwatz, A.: Nonparametric and Semiparametric Models, Springer, Berlin (2004).
13. Hawking, D., Voorhees, E., Craswell, N. and Bailey, P.: Overview of the TREC-8 Web Track, Proc. 8th Text REtrieval Conference, pp.131-150 (1999).
14. Heckman, J.J.: Sample Selection Bias as a Specification Error, Econometrica, Vol.47, No.1, pp.153-162 (1979).
15. Hirotaka, H., Akiyama, T., Sugiyama, M. and Peters, J.: Adaptive Importance Sampling with Automatic Model Selection in Value Function Approximation, Proc. 23rd AAAI Conference on Artificial Intelligence, Chicago, USA, pp.1351-1356 (2008).
16. Huang, J., Smola, A.J., Gretton, A., Borgwardt, K.M. and Schölkopf, B.: Correcting Sample Selection Bias by Unlabeled Data, Advances in Neural Information Processing Systems, Cambridge, MA, pp.601-608, MIT Press (2007).
17. Jiang, J. and Zhai, C.: Instance Weighting for Domain Adaptation in NLP, Proc. 45th Annual Meeting of the Association for Computational Linguistics, pp.264-271 (2007).
18. Kanamori, T. and Shimodaira, H.: Active Learning Algorithm Using the Maximum Weighted Log-Likelihood Estimator, Journal of Statistical Planning and Inference, Vol.116, No.1, pp.149-162 (2003).
19. Lafferty, J., McCallum, A. and Pereira, F.: Conditional Random Fields: Probabilistic models for segmenting and labeling sequence data, Proc. 18th International Conference on Machine Learning, pp.282-289 (2001).
20. Shelton, C.R.: Importance Sampling for Reinforcement Learning with Multiple Objectives, Ph.D. Thesis, Massachusetts Institute of Technology (2001).
21. Shimodaira, H.: Improving Predictive Inference under Covariate Shift by Weighting the Log-Likelihood Function, Journal of Statistical Planning and Inference, Vol.90, No.2, pp.227-244 (2000).
22. Steinwart, I.: On the Influence of the Kernel on the Consistency of Support Vector Machines, Journal of Machine Learning Research, Vol.2, pp.67-93 (2001).
23. Sugiyama, M.: Active Learning in Approximately Linear Regression Based on Conditional Expectation of Generalization Error, Journal of Machine Learning Research, Vol.7, pp.141-166 (2006).
24. Sugiyama, M., Krauledat, M. and Müller, K.-R.: Covariate Shift Adaptation by Importance Weighted Cross Validation, Journal of Machine Learning Research, Vol.8, pp.985-1005 (2007).
25. Sugiyama, M. and Müller, K.-R.: Input-Dependent Estimation of Generalization Error under Covariate Shift, Statistics & Decisions, Vol.23, No.4, pp.249-279 (2005).
26. Sugiyama, M., Nakajima, S., Kashima, H., von Bünau, P. and Kawanabe, M.: Direct Importance Estimation with Model Selection and Its Application to Covariate Shift Adaptation, Advances in Neural Information Processing Systems, Cambridge, MA, MIT Press (2008).
27. Sutton, R.S. and Barto, G.A.: Reinforcement Learning: An Introduction, MIT Press, Cambridge, MA (1998).
28. Tsuboi, Y., Kashima, H., Mori, S., Oda, H. and Matsumoto, Y.: Training Conditional Random Fields Using Incomplete Annotations, Proc. 22nd International Conference on Computational Linguistics, pp.897-904 (2008).
29. Wahba, G.: Spline Model for Observational Data, Society for Industrial and Ap- plied Mathematics, Philadelphia and Pennsylvania (1990).
30. Wiens, D.P.: Robust Weights and Designs for Biased Regression Models: Least Squares and Generalized M-Estimation, Journal of Statistical Planning and Inference, Vol.83, No.2, pp.395-412 (2000).
31. Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G. and Vaughan, T.M.: Brain-Computer Interfaces for Communication and Control, Clinical Neurophysiology, Vol.113, No.6, pp.767-791 (2002).
32. Zadrozny, B.: Learning and Evaluating Classifiers under Sample Selection Bias, Proc. 21st International Conference on Machine Learning, New York, NY, ACM Press (2004).