Ranking measures and loss functions in learning to rank

Advances in Neural Information Processing Systems 22 - Proceedings of the 2009 Conference

Volumn , Issue , 2009, Pages 315-323

  Chen, Wei ^a   Liu, Tie Yan ^b   Lan, Yanyan ^a   Ma, Zhiming ^a   Li, Hang ^b  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); INFORMATION RETRIEVAL; LEARNING SYSTEMS;

LEARN+; LOSS FUNCTIONS; MACHINE-LEARNING; MEASURE FUNCTION; PERFORMANCE; RANKING FUNCTIONS; RANKING MEASURES; RANKING SVM; RESEARCH TOPICS; UPPER BOUND;

ERRORS;

EID: 84863035221     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. R. Baeza-Yates and B. Ribeiro-Neto. Modern Information Retrieval. Addison Wesley, May 1999.
2. C. Burges, T. Shaked, E. Renshaw, A. Lazier, M. Deeds, N. Hamilton, and G. Hullender. Learning to rank using gradient descent. In ICML '05: Proceedings of the 22nd International Conference on Machine learning, pages 89-96, New York, NY, USA, 2005. ACM.
3. Z. Cao, T. Qin, T.-Y. Liu, M.-F. Tsai, and H. Li. Learning to rank: from pairwise approach to listwise approach. In ICML '07: Proceedings of the 24th International Conference on Machine learning, pages 129-136, New York, NY, USA, 2007. ACM.
4. W. Chen, T.-Y. Liu, Y. Lan, Z. Ma, and H. Li. Essential loss: Bridge the gap between ranking measures and loss functions in learning to rank. Technical report, Microsoft Research, MSR-TR-2009-141, 2009.
5. D. Cossock and T. Zhang. Statistical analysis of bayes optimal subset ranking. Information Theory, 54:5140-5154, 2008.
6. Y. Freund, R. Iyer, R. E. Schapire, and Y. Singer. An efficient boosting algorithm for combining preferences. Journal of Machine Learning Research, 4:933-969, 2003.
7. R. Herbrich, K. Obermayer, and T. Graepel. Large margin rank boundaries for ordinal regression. In Advances in Large Margin Classifiers, pages 115-132, Cambridge, MA, 1999. MIT.
8. K. Järvelin and J. Kekäläinen. Cumulated gain-based evaluation of ir techniques. ACM Transactions on Information Systems, 20(4):422-446, 2002.
9. T. Joachims. Optimizing search engines using clickthrough data. In KDD '02: Proceedings of the 8th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 133-142, New York, NY, USA, 2002. ACM.
10. P. Li, C. Burges, and Q. Wu. Mcrank: Learning to rank using multiple classification and gradient boosting. In NIPS '07: Advances in Neural Information Processing Systems 20, pages 897-904, Cambridge, MA, 2008. MIT.
11. T.-Y. Liu, J. Xu, T. Qin, W.-Y. Xiong, and H. Li. Letor: Benchmark dataset for research on learning to rank for information retrieval. In SIGIR '07 Workshop, San Francisco, 2007. Morgan Kaufmann.
12. Q. L. Olivier Chapelle and A. Smola. Large margin optimization of ranking measures. In NIPS workshop on Machine Learning for Web Search 2007, 2007.
13. T. Qin, X.-D. Zhang, M.-F. Tsai, D.-S. Wang, T.-Y. Liu, and H. Li. Query-level loss functions for information retrieval. Information Processing and Management, 44(2):838-855, 2008.
14. M. Taylor, J. Guiver, S. Robertson, and T. Minka. Softrank: optimizing non-smooth rank metrics. In Proceedings of the International Conference on Web search and web data mining, pages 77-86, Palo Alto, California, USA, 2008. ACM.
15. M.-F. Tsai, T.-Y. Liu, T. Qin, H.-H. Chen, and W.-Y. Ma. Frank: a ranking method with fidelity loss. In SIGIR '07: Proceedings of the 30th annual ACM SIGIR conference, pages 383-390, Amsterdam, The Netherlands, 2007. ACM.
16. F. Xia, T.-Y. Liu, J. Wang, W. Zhang, and H. Li. Listwise approach to learning to rank - theory and algorithm. In ICML '08: Proceedings of the 25th International Conference on Machine learning, pages 1192-1199. Omnipress, 2008.
17. J. Xu and H. Li. Adarank: a boosting algorithm for information retrieval. In SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 391-398, 2007.
18. Y. Yue, T. Finley, F. Radlinski, and T. Joachims. A support vector method for optimizing average precision. In SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 271-278, New York, NY, USA, 2007. ACM.
19. Z. Zheng, H. Zha, T. Zhang, O. Chapelle, K. Chen, and G. Sun. A general boosting method and its application to learning ranking functions for web search. In NIPS '07: Advances in Neural Information Processing Systems 20, pages 1697-1704. MIT, Cambridge, MA, 2008.