Relevant knowledge helps in choosing right teacher: Active query selection for ranking adaptation

SIGIR'11 - Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2011, Pages 115-124

  Cai, Peng ^a   Gao, Wei ^b   Zhou, Aoying ^a   Wong, Kam Fai ^b,c  

^a EAST CHINA NORMAL UNIVERSITY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

Author keywords

Active learning; Query by committee; Ranking adaptation

Indexed keywords

ARTIFICIAL INTELLIGENCE; BUDGET CONTROL; COST EFFECTIVENESS; TEACHING;

ACTIVE LEARNING; AUTOMATIC RANKING; DOMAIN ADAPTATION; LEARNING TO RANK; PRIOR KNOWLEDGE; QUERY BY COMMITTEES; QUERY SELECTION; RANKING ADAPTATION;

PERSONNEL TRAINING;

EID: 80052127267     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2009916.2009935     Document Type: Conference Paper

References (46)

1. N. Abe and H. Mamitsuka. Query learning strategies using boosting and bagging. In Proceedings of ICML, pages 1-9, 1998.
2. M. Amini, N. Usunier, F. Laviolette, A. Lacasse, and P. Gallinari. A selective sampling strategy for label ranking. In Proceedings of ECML, pages 18-29. 2006. (Pubitemid 44618818)
3. J. Blitzer, R. Mcdonald, and F. Pereira. Domain adaptation with structural correspondence learning. In Proceedings of EMNLP, pages 120-128, 2006.
4. L. Breiman. Bagging predictors. Machine Learning, 24:123-140, August 1996. (Pubitemid 126724382)
5. B. Carterette, J. Allan, and R. Sitaraman. Minimal test collections for retrieval evaluation. In Proceedin gs of SIGIR, pages 268-275, 2006.
6. Y. S. Chan and H. T. Ng. Domain adaptation with active learning for word sense disambiguation. In Proceedings of ACL, pages 49-56, 2007.
7. O. Chapelle, D. Metzler, Y. Zhang, and P. Grinspan. Expected reciprocal rank for graded relevance. In Proceedings of CIKM, pages 621-630, 2009.
8. O. Chapelle, P. K. Shivaswamy, S. Vadrevu, K. Q. Weinberger, Y. Zhang, and B. L. Tseng. Multi-task learning for boosting with application to web search ranking. In Proceedings of SIGKDD, pages 1189-1198, 2010.
9. D. Chen, Y. Xiong, J. Yan, G.-R. Xue, G. Wang, and Z. Chen. Knowledge transfer for cross domain learning to rank. Information Retrieval, 13(3):236-253, 2009.
10. D. Chen, J. Yan, G. Wang, Y. Xiong, W. Fan, and Z. Chen. Transrank: A novel algorithm for transfer of rank learning. In IEEE International Conference on Data Mining Workshops, pages 106-115, 2008.
11. K. Chen, R. Lu, C. Wong, G. Sun, L. Heck, and B. Tseng. Trada: Tree based ranking function adaptation. In Proceedings of CIKM, pages 1143-1152, 2008.
12. I. Dagan and S. P. Engelson. Committee-based sampling for training probabilistic classifiers. In Proceedings of ICML, pages 150-157, 1995.
13. H. Daumé III. Frustratingly easy domain adaptation. In Proceedings of ACL, pages 256-263, 2007.
14. H. Daumé III and D. Marcu. Domain adaptation for statistical classifiers. Journal of Artificial Intelligence Research, 26(1):101-126, 2006. (Pubitemid 44452208)
15. P. Donmez and J. G. Carbonell. Optimizing estimated loss reduction for active sampling in rank learning. In Proceedings of ICML, pages 248-255, 2008.
16. P. Donmez and J. G. Carbonell. Active sampling for rank learning via optimizing the area under the roc curve. In Proceedings of ECIR, pages 78-89, 2009.
17. J. Gao, Q. Wu, C. Burges, K. Svore, Y. Su, N. Khan, S. Shah, and H. Zhou. Model adaptation via model interpolation and boosting for web search ranking. In Proceedings of EMNLP, pages 505-513, 2009.
18. W. Gao, P. Cai, K.-F. Wong, and A. Zhou. Learning to rank only using training data from related domain. In Proceedings of SIGIR, pages 162-169, 2010.
19. B. Geng, L. Yang, C. Xu, and X.-S. Hua. Ranking model adaptation for domain-specific search. In Proceedings of CIKM, pages 197-206, 2009.
20. R. Herbrich, T. Graepel, and K. Obermayer. Large Margin Rank Boundaries for Ordinal Regression. MIT Press, Cambridge, 2000.
21. K. Jarvelin and J. Kekalainen. IR evaluation methods for retrieving highly relevant documents. In Proceedings of SIGIR, pages 41-48, 2000.
22. J. Jiang and C. Zhai. Instance weighting for domain adaptation in nlp. In Proceedings of ACL, pages 264-271, 2007.
23. X. Jiang, Y. Hu, and H. Li. A ranking approach to keyphrase extraction. In Proceedings of SIGIR, pages 756-757, 2009.
24. D. D. Lewis and W. A. Gale. A sequential algorithm for training text classifiers. In Proceedings of SIGIR, pages 3-12, 1994.
25. H. Li, Y. Shi, M.-Y. Chen, A. G. Hauptmann, and Z. Xiong. Hybrid active learning for cross-domain video concept detection. In Proceedings of the International Conference on Multimedia, pages 1003-1006, 2010.
26. N. Liu, J. Yan, D. Shen, D. Chen, Z. Chen, and Y. Li. Learning to rank audience for behavioral targeting. In Proceedings of SIGIR, pages 719-720, 2010.
27. T.-Y. Liu. Learning to rank for information retrieval. Foundations and Trends in Information Retrieval, 3(3):225-331, 2009.
28. B. Long, O. Chapelle, Y. Zhang, Y. Chang, Z. Zheng, and B. L. Tseng. Active learning for ranking through expected loss optimization. In Proceedings of SIGIR, pages 267-274, 2010.
29. A. McCallum and K. Nigam. Employing EM in pool-based active learning for text classification. In Proceedings of ICML, pages 350-358, 1998.
30. T. Qin, T.-Y. Liu, J. Xu, and H. Li. LETOR: A benchmark collection for research on learning to rank for information retrieval. Information Retrieval, 2010.
31. J. Quiñonero-Candela, M. Sugiyama, A. Schwaighofer, and N. Lawrence. Dataset Shift in Machine Learning. MIT Press, Cambridge, 2009.
32. P. Rai, A. Saha, H. Daumé III, and S. Venkatasubramanian. Domain adaptation meets active learning. In Proceedings of the NAACL HLT 2010 Workshop on Active Learning for Natural Language Processing, 2010.
33. B. Settles. Active learning literature survey. Technical report, Technical Report, Computer Sciences 1648, University of Wisconsin, Madison, 2010.
34. H. S. Seung, M. Opper, and H. Sompolinsky. Query by committee. In Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pages 287-294, 1992. (Pubitemid 23615454)
35. X. Shen and C. Zhai. Active feedback in ad hoc information retrieval. In Proceedings of SIGIR, pages 59-66, 2005.
36. X. Shi, W. Fan, and J. Ren. Actively transfer domain knowledge. In Proceedings of ECML and KDD, pages 342-357, 2008.
37. M. Surdeanu, M. Ciaramita, and H. Zaragoza. Learning to rank answers on large online QA collections. In Proceedings of ACL, pages 719-727, 2008.
38. E. M. Voorhees. Overview of TREC 2003. In Proceedings of TREC 2003, pages 1-13, 2003.
39. E. M. Voorhees. Overview of TREC 2004. In Proceedings of TREC 2004, pages 1-12, 2004.
40. B. Wang, J. Tang, W. Fan, S. Chen, Z. Yang, and Y. Liu. Heterogeneous cross domain ranking in latent space. In Proceedings of CIKM, pages 987-996, 2009.
41. Z. Wang, J. Feng, C. Zhang, and S. Yan. Learning to rank tags. In Proceedings of the ACM International Conference on Image and Video Retrieval, pages 42-49, 2010.
42. Z. Xu and R. Akella. A bayesian logistic regression model for active relevance feedback. In Proceedings of SIGIR, pages 227-234, 2008.
43. L. Yang, L. Wang, B. Geng, and X.-S. Hua. Query sampling for ranking learning in web serach. In Proceedings of SIGIR, pages 754-755, 2009.
44. E. Yilmaz and S. Robertson. Deep versus shallow judgments in learning to rank. In Proceedings of SIGIR, pages 662-663, 2009.
45. H. Yu. Svm selective sampling for ranking with application to data retrieval. In Proceedings of SIGKDD, pages 354-363, 2005. (Pubitemid 43218297)
46. B. Zadrozny. Learning and evaluating classifiers under sample selection bias. In Proceedings of ICML, pages 114-121, 2004.