Post-rank reordering: Resolving preference misalignments between search engines and end users

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2009, Pages 641-649

  Liu, Chao ^a   Li, Mei ^b   Wang, Yi Min ^a  

^a MICROSOFT RESEARCH   (United States)

^b MICROSOFT   (United States)

Author keywords

Preference models; Result reordering; Web search

Indexed keywords

APPROXIMATION SCHEME; CHAIN MODELS; CLICKTHROUGH DATA; END USERS; NO SEARCH; ONLINE COMPUTATIONS; PREFERENCE MODELS; REAL WORLD DATA; WEB SEARCHES; WEB USERS;

ALIGNMENT; ENGINES; INFORMATION RETRIEVAL; KNOWLEDGE MANAGEMENT; PROBABILITY; SEARCH ENGINES;

WORLD WIDE WEB;

EID: 74549128582     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1645953.1646035     Document Type: Conference Paper

References (28)

1. E. Agichtein, E. Brill, and S. Dumais. Improving web search ranking by incorporating user behavior information. In SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, pages 19-26, 2006.
2. E. Agichtein, E. Brill, S. Dumais, and R. Ragno. Learning user interaction models for predicting web search result preferences. In SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, pages 3-10, 2006.
3. R. Baeza-Yates, A. Gionis, F. Junqueira, V. Murdock, V. Plachouras, and F. Silvestri. The impact of caching on search engines. In SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 183-190, 2007.
4. R. Bradley and M. Terry. The rank analysis of incomplete block designs. 1. the method of paired comparisons. Biometrika, 39, 1952.
5. C. Burges, T. Shaked, E. Renshaw, A. Lazier, M. Deeds, N. Hamilton, and G. Hullender. Learning to rank using gradient descent. In ICML '05: Proceedings of the 22nd international conference on Machine learning, pages 89-96, 2005.
6. N. Craswell, O. Zoeter, M. Taylor, and B. Ramsey. An experimental comparison of click position-bias models. In WSDM '08: Proceedings of the First International Conference on Web Search and Data Mining, pages 87-94, 2008.
7. H. A. David. The Method of Paired Comparisons. Oxford University Press, second edition, 1988.
8. G. E. Dupret, V. Murdock, and B. Piwowarski. Web search engine evaluation using click-through data and a user model. In Proceeding of the Workshop on Query Log Analysis: Social and Technological Challenges (WWW '07), 2007.
9. G. E. Dupret and B. Piwowarski. A user browsing model to predict search engine click data from past observations. In SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, pages 331-338, 2008.
10. G. E. Dupret, B. Piwowarski, C. A. Hurtado, and M. Mendoza. A statistical model of query log generation. In String Processing and Information Retrieval, 13th International Conference, SPIRE 2006, pages 217-228, 2006.
11. T. Fagni, R. Perego, F. Silvestri, and S. Orlando. Boosting the performance of web search engines: Caching and prefetching query results by exploiting historical usage data. ACM Transaction on Information System, 24(1):51-78, 2006.
12. F. Guo, C. Liu, T. Minka, Y.-M. Wang, and C. Faloutsos. Click chain model in web search. In WWW'09: Proceedings of the 20th International World Wide Web Conference, 2009.
13. F. Guo, C. Liu, and Y.-M. Wang. Efficient multiple-click models in web search. In WSDM '09: Proceedings of the Second International Conference on Web Search and Data Mining, 2009.
14. T.-K. Huang, R. C. Weng, and C.-J. Lin. Generalized bradley-terry models and multi-class probability estimates. J. Mach. Learn. Res., 7:85-115, 2006.
15. K. Järvelin and J. Kekäläinen. Cumulated gain-based evaluation of ir techniques. ACM Trans. Inf. Syst., 20(4):422-446, 2002.
16. G. Jeh and J. Widom. Scaling personalized web search. In WWW '03: Proceedings of the 12th international conference on World Wide Web, pages 271-279, 2003.
17. T. Joachims. Optimizing search engines using clickthrough data. In KDD '02: Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 133-142, 2002.
18. T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay. Accurately interpreting clickthrough data as implicit feedback. In SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pages 154-161, 2005.
19. T. Joachims, L. Granka, B. Pan, H. Hembrooke, F. Radlinski, and G. Gay. Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search. ACM Transaction on Information System, 25(2):7, 2007.
20. E. Lehmann and J. P. Romano. Testing Statistical Hypotheses. Springer, third edition, 2008.
21. J. Pitkow, H. Schütze, T. Cass, R. Cooley, D. Turnbull, A. Edmonds, E. Adar, and T. Breuel. Personalized search. Commun. ACM, 45(9):50-55, 2002.
22. F. Radlinski and T. Joachims. Query chains: learning to rank from implicit feedback. In KDD '05: Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining, pages 239-248, 2005.
23. F. Radlinski and T. Joachims. Active exploration for learning rankings from clickthrough data. In KDD '07: Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 570-579, 2007.
24. G. Salton and C. Buckley. Improving retrieval performance by relevance feedback. pages 355-364, 1997.
25. M. Shokouhi1, F. Scholer, and A. Turpin. Investigating the effectiveness of clickthrough data for document reordering. In ECIR'08: Proceedings of the The 30th European Conference on Information Retrieval, pages 591-595, 2008.
26. J. Teevan, S. T. Dumais, and E. Horvitz. Personalizing search via automated analysis of interests and activities. In SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pages 449-456, 2005.
27. A. Trotman. Learning to rank. Information Retrieval, 8(3):359-381, 2005.
28. K. Zhou, G.-R. Xue, H. Zha, and Y. Yu. Learning to rank with ties. In SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, pages 275-282, 2008.