A risk minimization framework for domain adaptation

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2009, Pages 1347-1356

  Long, Bo ^a   Lamkhede, Sudarshan ^a   Vadrevu, Srinivas ^a   Zhang, Ya ^a   Tseng, Belle ^a  

^a YAHOO RESEARCH   (United States)

Author keywords

Domain adaptation; Label relation; Risk minimization; Source domain; Target domain

Indexed keywords

DATA DISTRIBUTION; DIFFERENT DOMAINS; DIFFERENT SIZES; DOMAIN ADAPTATION; EMPIRICAL RISKS; ERROR BOUND; GENERIC ALGORITHM; HIGH QUALITY; LEARNING FRAMEWORKS; NEW CONCEPT; NOISE LEVELS; NON-TRIVIAL; REAL WORLD DATA; RISK MINIMIZATION; SEARCH RESULTS; TARGET DOMAIN; TRAINING SETS;

KNOWLEDGE MANAGEMENT; LABELS; OPTIMIZATION; TARGETS;

LEARNING ALGORITHMS;

EID: 74549138576     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1645953.1646123     Document Type: Conference Paper

References (38)

1. R. Ando and T. Zhang. A high-performance semi-supervised learning method for text chunking. In Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, pages 1-9. Association for Computational Linguistics Morristown, NJ, USA, 2005.
2. A. Argyriou, T. Evgeniou, and M. Pontil. Multi-task feature learning. In Advances in Neural Information Processing Systems: Proceedings of the 2006 Conference, page 41. MIT Press, 2007.
3. A. Argyriou, C. Micchelli, M. Pontil, and Y. Ying. A spectral regularization framework for multi-task structure learning. Advances in Neural Information Processing Systems, 20, 2008.
4. S. Bickel, M. Brückner, and T. Scheffer. Discriminative learning for differing training and test distributions. In Proceedings of the 24th international conference on Machine learning, pages 81-88. ACM New York, NY, USA, 2007.
5. J. Blitzer, K. Crammer, A. Kulesza, F. Pereira, and J. Wortman. Learning bounds for domain adaptation. Advances in Neural Information Processing Systems, 20, 2008.
6. J. Blitzer, R. McDonald, and F. Pereira. Domain adaptation with structural correspondence learning. In Proceedings of the Empirical Methods in Natural Language Processing (EMNLP), 2006.
7. A. Blum and T. Mitchell. Combining labeled and unlabeled data with co-training. In Proceedings of the eleventh annual conference on Computational learning theory, pages 92-100. ACM New York, NY, USA, 1998.
8. E. Bonilla, K. Chai, and C. Williams. Multi-task gaussian process prediction. Advances in Neural Information Processing Systems, 20:153-160.
9. W. Dai, G. Xue, Q. Yang, and Y. Yu. Co-clustering based classification for out-of-domain documents. In Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 210-219. ACM New York, NY, USA, 2007.
10. W. Dai, Q. Yang, G. Xue, and Y. Yu. Boosting for transfer learning. In Proceedings of the 24th international conference on Machine learning, pages 193-200. ACM New York, NY, USA, 2007.
11. H. Daume. Frustratingly easy domain adaptation. In Annual meeting-association for computational linguistics, volume 45, page 256, 2007.
12. H. Daumé. Cross-task knowledge-constrained self training. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, pages 680-688, Honolulu, Hawaii, 2008. Association for Computational Linguistics.
13. H. Daume III and D. Marcu. Domain adaptation for statistical classifiers. Journal of Artificial Intelligence Research, 26:101-126, 2006.
14. J. Davis and P. Domingos. Deep transfer via second-order markov logic. In AAAI Workshop: Transfer Learning for Complex Tasks, 2008.
15. T. Evgeniou and M. Pontil. Regularized multi-task learning. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 109-117. ACM New York, NY, USA, 2004.
16. J. Friedman. Greedy function approximation: a gradient boosting machine. Annals of Statistics, pages 1189-1232, 2001.
17. J. Heckman. Sample selection bias as a specification error. Econometrica: Journal of the econometric society, pages 153-161, 1979.
18. J. Huang, A. Smola, A. Gretton, K. Borgwardt, and B. Scholkopf. Correcting sample selection bias by unlabeled data. Advances in neural information processing systems, 19:601, 2007.
19. N. Japkowicz and S. Stephen. The class imbalance problem: A systematic study. Intelligent Data Analysis, 6(5):429-449, 2002.
20. J. Jiang. A Literature Survey on Domain Adaptation of Statistical Classifiers. 2007.
21. J. Jiang and C. Zhai. Instance weighting for domain adaptation in NLP. In Annual meeting-assosciation for computational linguistics, volume 45, page 264, 2007.
22. T. Joachims. Transductive inference for text classification using support vector machines. In Sixteenth International Conference on Machine Learning, 1999.
23. N. Lawrence and J. Platt. Learning to learn with the informative vector machine. In Proceedings of the twenty-first international conference on Machine learning. ACM New York, NY, USA, 2004.
24. S. Lee, V. Chatalbashev, D. Vickrey, and D. Koller. Learning a meta-level prior for feature relevance from multiple related tasks. In Proceedings of the 24th international conference on Machine learning, pages 489-496. ACM New York, NY, USA, 2007.
25. X. Liao, Y. Xue, and L. Carin. Logistic regression with an auxiliary data source. In MACHINE LEARNING-INTERNATIONAL WORKSHOP THEN CONFERENCE-, volume 22, page 505, 2005.
26. X. Ling, W. Dai, G.-R. Xue, Q. Yang, and Y. Yu. Spectral domain-transfer learning. In KDD '08: Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 488-496, New York, NY, USA, 2008. ACM.
27. P. Luo, F. Zhuang, H. Xiong, Y. Xiong, and Q. He. Transfer learning from multiple source domains via consensus regularization. In CIKM '08: Proceeding of the 17th ACM conference on Information and knowledge management, pages 103-112, New York, NY, USA, 2008. ACM.
28. L. Mihalkova, T. Huynh, and R. Mooney. Mapping and revising markov logic networks for transfer learning. In Proceedings of teh national conference on artificial intelligence, volume 22, page 608, 2007.
29. L. Mihalkova and R. Mooney. Transfer learning by mapping with minimal target data. In Proceedings of the AAAI-08 Workshop on Transfer Learning for Complex Tasks, 2008.
30. K. Nigam, A. McCallum, S. Thrun, and T. Mitchell. Text classification from labeled and unlabeled documents using EM. Machine learning, 39(2):103-134, 2000.
31. S. J. Pan and Q. Yang. A survey on transfer learning. Technical Report HKUST-CS08-08, Department of Computer Science and Engineering, Hong Kong University of Science and Technology, Hong Kong, China, November 2008.
32. R. Raina, A. Battle, H. Lee, B. Packer, and A. Ng. Self-taught learning: Transfer learning from unlabeled data. In Proceedings of the 24th international conference on Machine learning, pages 759-766. ACM New York, NY, USA, 2007.
33. A. Schwaighofer, V. Tresp, and K. Yu. Learning Gaussian process kernels via hierarchical Bayes. Advances in Neural Information Processing Systems, 17:1209-1216, 2005.
34. G. Schweikert, C. Widmer, B. Schölkopf, and G. Rätsch. An empirical analysis of domain adaptation algorithms for genomic sequence analysis. In NIPS, pages 1433-1440, 2008.
35. H. Shimodaira. Improving predictive inference under covariate shift by weighting the log-likelihood function. Journal of Statistical Planning and Inference, 90(2):227-244, 2000.
36. M. Sugiyama, S. Nakajima, H. Kashima, P. von Bunau, and M. Kawanabe. Direct importance estimation with model selection and its application to covariate shift adaptation. Advances in Neural Information Processing Systems, 20, 2008.
37. Z. Zheng, K. Chen, G. Sun, and H. Zha. A regression framework for learning ranking functions using relative relevance judgments. In SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 287-294, New York, NY, USA, 2007. ACM.
38. X. Zhu. Semi-supervised learning literature survey. Computer Science, University of Wisconsin-Madison, 2006.