Summary of the NTCIR-10 INTENT-2 Task: Subtopic mining and search result diversification

SIGIR 2013 - Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2013, Pages 761-764

  Sakai, Tetsuya ^a   Dou, Zhicheng ^a   Yamamoto, Takehiro ^b   Liu, Yiqun ^c   Zhang, Min ^c   Kato, Makoto P ^b  

^a MICROSOFT RESEARCH ASIA   (China)

^b KYOTO UNIVERSITY   (Japan)

^c TSINGHUA UNIVERSITY   (China)

Author keywords

Diversity; Evaluation; Intents; Subtopics; Test collections

Indexed keywords

DIVERSITY; EVALUATION; INTENTS; SUBTOPICS; TEST COLLECTION;

SEARCH ENGINES;

INFORMATION RETRIEVAL;

EID: 84883063122     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2484028.2484104     Document Type: Conference Paper

References (17)

1. R. Agrawal, G. Sreenivas, A. Halverson, and S. Leong. Diversifying search results. In Proceedings of ACM WSDM 2009, pages 5-14, 2009.
2. O. Chapelle, S. Ji, C. Liao, E. Velipasaoglu, L. Lai, and S.-L. Wu. Intent-based diversification of web search results: Metrics and algorithms. Information Retrieval, 14(6):572-592, 2011.
3. C. L. A. Clarke, N. Craswell, I. Soboroff, and A. Ashkan. A comparative analysis of cascade measures for novelty and diversity. In Proceedings of ACM WSDM 2011, pages 75-84, 2011.
4. C. L. A. Clarke, N. Craswell, and E. M. Voorhees. Overview of the TREC 2012 web track. In Proceedings of TREC 2012, 2013.
5. K. Järvelin and J. Kekäläinen. Cumulated gain-based evaluation of IR techniques. ACM TOIS, 20(4):422-446, 2002.
6. T. Sakai. Evaluating evaluation metrics based on the bootstrap. In Proceedings of ACM SIGIR 2006, pages 525-532, 2006.
7. T. Sakai. A note on progress in document retrieval technology based on the official ntcir results (in japanese). In Proceedings of FIT 2006, pages 67-70, 2006.
8. T. Sakai. Evaluation with informational and navigational intents. In Proceedings of ACM WWW 2012, pages 499-508, 2012.
9. T. Sakai. The unreusability of diversified search test collections. In Proceedings of EVIA 2013, 2013.
10. T. Sakai, Z. Dou, and C. L. Clarke. The impact of intent selection on diversified search evaluation. In Proceedings of ACM SIGIR 2013, 2013.
11. T. Sakai, Z. Dou, R. Song, and N. Kando. The reusability of a diversified search test collection. In Proceedings of AIRS 2012, pages 26-38, 2012.
12. T. Sakai, Z. Dou, T. Yamamoto, Y. Liu, M. Zhang, M. P. Kato, R. Song, and M. Iwata. Overview of the NTCIR-10 INTENT-2 task. In Proceedings of NTCIR-10, 2013.
13. T. Sakai and R. Song. Evaluating diversified search results using per-intent graded relevance. In Proceedings of ACM SIGIR 2011, pages 1043-1042, 2011.
14. T. Sakai and R. Song. Diversified search evaluation: Lessons from the NTCIR-9 INTENT task. Information Retrieval, 2013.
15. R. L. Santos, C. Macdonald, and I. Ounis. Selectively diversifying web search results. In Proceedings of CIKM 2010, pages 1179-1188, 2010.
16. R. Song, M. Zhang, T. Sakai, M. P. Kato, Y. Liu, M. Sugimoto, Q. Wang, and N. Orii. Overview of the NTCIR-9 INTENT task. In Proceedings of NTCIR-9, pages 82-105, 2011.
17. C. Zhai, W. W. Cohen, and J. Lafferty. Beyond independent relevance: Methods and evaluation metrics for subtopic retrieval. In Proceedings of ACM SIGIR 2003, pages 10-17, 2003.