Building a Filtering Test Collection for TREC 2002

SIGIR Forum (ACM Special Interest Group on Information Retrieval)

Volumn , Issue SPEC. ISS., 2003, Pages 243-250

  Soboroff, Ian ^a   Robertson, Stephen ^b  

^a NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

^b MICROSOFT RESEARCH   (United Kingdom)

Author keywords

Experimentation; Measurement

Indexed keywords

ADAPTIVE SYSTEMS; DATA ACQUISITION; DATA REDUCTION; FEEDBACK CONTROL; INFORMATION SCIENCE; PROBLEM SOLVING; ROUTERS;

EXPERIMENTATION; FILTERING TRACKS;

INFORMATION RETRIEVAL SYSTEMS;

EID: 1542347779     PISSN: 01635840     EISSN: None     Source Type: Journal    
DOI: 10.1145/860480.860481     Document Type: Conference Paper

References (22)

1. Edward A. Fox and Joseph A. Shaw. Combination of Multiple Searches. In D. K. Harman, editor, Proc. of the Second Text REtrieval Conference (TREC-2), NIST SP 500-215, pp. 243-252. National Institute of Standards and Technology, Gaithersburg, MD, Nov 1993.
2. Donna Harman. Overview of the Third Text REtrieval Conference (TREC-3). In Donna K. Harman, editor, Proc. of the Third Text REtrieval Conference (TREC-3), NIST SP 500-225, pp. 1-20. Gaithersburg, MD, Nov 1994.
3. William Hersh, Chris Buckley, T. J. Leone, and David Hickam. OHSUMED: an Interactive Retrieval Evaluation and new Large Test Collection for Research. In Proc. of the Seventeenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 192-201. Dublin, Ireland, Jul 1994.
4. David A. Hull. The TREC-6 Filtering Track: Description and Analysis. In E. M. Voorhees and D. K. Harman, editors, Proc. of the Sixth Text REtrieval Conference (TREC-6), NIST SP 500-240. National Institute of Standards and Technology, Gaithersburg, MD, Nov 1998.
5. David A. Hull. The TREC-7 Filtering Track: Description and Analysis. In Voorhees and Harman [18], pp. 33-56.
6. David A. Hull and Stephen Robertson. The TREC-8 Filtering Track Final Report. In Voorhees and Harman [19], pp. 35-56.
7. Victor Lavrenko and W. Bruce Croft. Relevance-Based Language Models. In W. Bruce Croft, David J. Harper, Donald H. Kraft, and Justin Zobel, editors, Proc. of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2001), pp. 120-127. ACM Press, New Orleans, LA, Sep 2001.
8. David D. Lewis. The TREC-4 Filtering Track. In Donna K. Harman, editor, Proc. of the Fourth Text REtrieval Conference (TREC-4), NIST SP 500-236, pp. 165-180. Gaithersburg, MD, Nov 1995.
9. David D. Lewis. The TREC-5 Filtering Track. In Voorhees and Harman [17], pp. 75-96.
10. David D. Lewis, Yiming Yang, Tony Rose, and Fan Li. RCV1: A New Benchmark Collection for Text Categorization Research. Journal of Machine Learning Research, 2002. To appear.
11. Andrew K. McCallum. Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering, 1996. http://www.cs.cmu.edu/~mccallum/bow.
12. Stephen Robertson and David A. Hull. The TREC-9 Filtering Track Final Report. In E. M. Voorhees and D. K. Harman, editors, Proc. of the Ninth Text REtrieval Conference (TREC-9), NIST SP 500-249, pp. 29-40. National Institute of Standards and Technology. Gaithersburg, MD, Nov 2000.
13. Stephen Robertson and Ian Soboroff. The TREC 2001 Filtering Track Final Report. In E. M. Voorhees and D. K. Harman, editors, Proc. of the Tenth Text REtrieval Conference (TREC 2001), NIST SP 500-250, pp. 26-37. Gaithersburg, MD, Nov 2001.
14. Stephen Robertson and Ian Soboroff. The TREC 2002 Filtering Track Final Report. In E. M. Voorhees and D. K. Harman, editors, Proc. of the Eleventh Text REtrieval Conference (TREC 2002), NIST SP 500-xxx. Gaithersburg, MD, Nov 2002. To appear.
15. T. G. Rose, M. Stevenson, and M. Whitehead. The Reuters Corpus Volume 1 - from Yesterday's News to Tomorrow's Language Resources. In In Proc. of the Third International Conference on Language Resources and Evaluation. Las Palmas de Gran Canaria. May 2002.
16. C. J. van Rijsbergen. Information Retrieval. Butterworths, 1979.
17. E. M. Voorhees and D. K. Harman, editors. Proc. of the Fifth Text REtrieval Conference (TREC-5), NIST SP 500-238. Gaithersburg, MD, Nov 1996.
18. E. M. Voorhees and D. K. Harman, editors. Proc. of the Seventh Text REtrieval Conference (TREC-7), NIST SP 500-242. National Institute of Standards and Technology, Gaithersburg, MD, Nov 1998.
19. E. M. Voorhees and D. K. Harman, editors. Proc. of the Eighth Text REtrieval Conference (TREC-8), NIST SP 500-246. National Institute of Standards and Technology, Gaithersburg, MD, Nov 1999.
20. Ellen M. Voorhees and Donna Harman. Overview of the Fifth Text RErieval Conference (TREC-5). In Voorhees and Harman [17], pp. 1-28.
21. Ellen M. Voorhees and Donna Harman. Overview of the Eighth Text REtrieval Conference (TREC-8). In Voorhees and Harman [19], pp. 1-24.
22. Justin Zobel. How Reliable are the Results of Large-Scale Retrieval Experiments? In W. Bruce Croft, Alistair Moffat, C. J. van Rijsbergen, Ross Wilkinson, and Justin Zobel, editors, Proc. of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98), pp. 307-314. ACM Press, Melbourne, Australia, Aug 1998.