Active Sampling for rank learning via Optimizing the area under the ROC Curve

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5478 LNCS, Issue , 2009, Pages 78-89

  Donmez, Pinar ^a   Carbonell, Jaime G ^a  

^a Carnegie Mellon University   (United States)

Author keywords

Active learning; AUC; Document retrieval; Hinge loss; Performance optimization; Rank learning

Indexed keywords

ACTIVE LEARNING; AUC; DOCUMENT RETRIEVAL; PERFORMANCE OPTIMIZATION; RANK LEARNING;

INFORMATION RETRIEVAL; INFORMATION SERVICES; OPTIMIZATION;

EDUCATION;

EID: 67650696919     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-00958-7_10     Document Type: Conference Paper

References (30)

1. Amini, M., Usunier, N., Laviolette, F., Lacasse, A., Gallinari, P.: A selective sampling strategy for label ranking. In: Fürnkranz, J., Scheffer, T., Spiliopoulou, M. (eds.) ECML 2006. LNCS, vol.4212, pp. 18-29. Springer, Heidelberg (2006)
2. Brefeld, U., Scheffer, T.: AUC maximizing support vector learning. In: ICMLWorkshop on ROC Analysis in Machine Learning (2005)
3. Brinker, K.: Active Learning of Label Ranking Functions. In: ICML 2004, pp. 17-24 (2004)
4. Cao, Y., Xu, J., Liu, T.-Y., Li, H., Huang, Y., Hon, H.-W.: Adapting ranking svm to document retrieval. In: Proceedings of the international ACM SIGIR Conference on Research and Development in information retrieval (SIGIR 2006), pp. 186-193 (2006)
5. Chu, W., Ghahramani, Z.: Extensions of Gaussian Processes for Ranking: Semisupervised and Active Learning. In: Proceedings of the NIPS 2005 Workshop on Learning to Rank, pp. 29-34 (2005)
6. Craswell, N., Hawking, D., Wilkinson, R., Wu, M.: Overview of the trec 2003 web track. In: Text Retrieval Conference (TREC 2003) (2003)
7. Craswell, N., Hawking, D.: Overview of the trec 2004 web track. In: Text Retrieval Conference (TREC 2004) (2004)
8. Freund, Y., Iyer, R., Schapire, R.E., Singer, Y.: An efficient boosting algorithm for combining preferences. Journal of Machine Learning Research 4, 933-969 (2003)
9. Donmez, P., Carbonell, J.G., Bennett, P.N.: Dual strategy active learning. In: Kok, J.N., Koronacki, J., Lopez de Mantaras, R., Matwin, S., Mladeni?c, D., Skowron, A. (eds.) ECML 2007. LNCS, vol.4701, pp. 116-127. Springer, Heidelberg (2007)
10. Hand, D.J., Till, R.J.: A simple generalization of the area under the ROC curve for multiple class classification problems. Machine Learning, 171-186 (2001) (Pubitemid 33635984)
11. Gao, J., Qi, H., Xia, X., Nie, J.-Y.: Linear discriminant model for information retrieval. In: Proceedings of the international ACM SIGIR Conference on Research and Development in information retrieval (SIGIR 2005), pp. 290-297 (2005)
12. Lewis, D., Gale, W.: A sequential algorithm for training text classifiers. In: SIGIR 1994, pp. 3-12 (1994)
13. Liu, T.Y., Xu, J., Qin, T., Xiong, W., Wang, T., Li, H.: http://research.microsoft.com/users/tyliu/LETOR
14. Järvelin, K., Kek̈aläinen, J.: Cumulated gain-based evaluation of IR techniques. ACM Transaction on Information Systems 20(4), 422-446 (2002) (Pubitemid 44642296)
15. Joachims, T.: http://svmlight.joachims.org
16. Joachims, T.: Optimizing search engines using clickthrough data. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2002) (2002)
17. Joachims, T.: A support vector method for multivariate performance measures. In: Proceedings of the International Conference on Machine Learning (ICML 2005), pp. 377-384 (2005) (Pubitemid 43183356)
18. Mann, H.B., Whitney, D.R.: On a test whether one of two random variables is stochastically larger than the other. Annals of Mathematical Statistics, 50-60 (1947)
19. McCallum, A., Nigam, K.: Employing EM and pool-based active learning for text classification. In: ICML 1998, pp. 359-367 (1998)
20. Nguyen, H.T., Smeulders, A.: Active learning with pre-clustering. In: ICML 2004, pp. 623-630 (2004)
21. Radlinski, F., Joachims, T.: Active Exploration for Learning Rankings from Clickthrough Data. In: KDD 2007, pp. 570-579 (2007) (Pubitemid 350229242)
22. Rajaram, S., Dagli, C.K., Petrovic, N., Huang, T.S.: Diverse Active Ranking for Multimedia Search. In: Computer Vision and Pattern Recognition (CVPR 2007) (2007)
23. Rakotomamonjy, A.: Optimizing the area under ROC curve with SVMs. In: ECAI Workshop on ROC Analysis in AI (2004)
24. Roy, N., McCallum, A.: Toward optimal active learning through sampling estimation of error reduction. In: ICML 2001, pp. 441-448 (2001)
25. Seung, H.S., Opper, M., Sompolinsky, H.: Query by committee. In: Proceedings of the Fifth Annual ACMWorkshop on Computational Learning Theory, pp. 287-294 (1992) (Pubitemid 23615454)
26. Steck, H.: Hinge rank loss and the area under the ROC curve. In: Kok, J.N., Koronacki, J., Lopez de Mantaras, R., Matwin, S., Mladeni?c, D., Skowron, A. (eds.) ECML 2007. LNCS, vol.4701, pp. 347-358. Springer, Heidelberg (2007)
27. Tong, S., Koller, D.: Support vector machine active learning with applications to text classification. In: Proceedings of International Conference on Machine Learning, pp. 999-1006 (2000)
28. Wilcoxon, F.: Individual comparisons by ranking methods. Biometrics 1, 80-83 (1945)
29. Xu, Z., Yu, K., Tresp, V., Xu, X., Wang, J.: Representative sampling for text classification using support vector machines. In: Sebastiani, F. (ed.) ECIR 2003. LNCS, vol.2633, pp. 393-407. Springer, Heidelberg (2003)
30. Yu, H.: SVM selective sampling for ranking with application to data retrieval. In: SIGKDD 2005, pp. 354-363 (2005) (Pubitemid 43218297)