Using controlled query generation to evaluate blind relevance feedback algorithms

Proceedings of the ACM/IEEE Joint Conference on Digital Libraries

Volumn 2006, Issue , 2006, Pages 286-295

  Jordan, Chris ^a   Watters, Carolyn ^a   Gao, Qigang ^a  

^a DALHOUSIE UNIVERSITY   (Canada)

Author keywords

Algorithm evaluation; Blind relevance feedback; Control environment; Controlled query generation

Indexed keywords

COMPUTER SIMULATION; FEEDBACK; INFORMATION RETRIEVAL; QUERY LANGUAGES; USER INTERFACES;

ALGORITHM EVALUATION; BLIND RELEVANCE FEEDBACK; CONTROL ENVIRONMENT; CONTROLLED QUERY GENERATION;

ALGORITHMS;

EID: 34247194212     PISSN: 15525996     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1141753.1141818     Document Type: Conference Paper

References (27)

1. Baeza-Yates R. and Ribeiro-Neto B.: Modern Information Retrieval. Addison-Wesley (1999)
2. Belkin, N. J., Kelly, D., Kim, G., Kim, J., Lee, H., Muresan, G., Tang, M., Yuan, X., and Cool, C.: Query length in interactive information retrieval. Proc. of the 26th Int. ACM SIGIR Conf. on Research and Development in Information Retrieval (2003) 205-212
3. Buckley C., Salton G., Allan J., and Singhal A.: Automatic Query Expansion Using SMART: TREC 3. Proc. of the 3rd Annual Text REtrieval Conf. (1994) 69-80
4. Cai D., van Rijsbergen C.J., and Jose J.M.: Automatic query expansion based on divergence. Proc. of the 10th Int. Conf. on Information and Knowledge Management (2001) 419-426
5. Cover T.M. and Thomas J.A.: Elements of Information Theory. John Wiley & sons. (1991)
6. Cronen-Townsend S., Zhou Y., and Croft W.B.: Predicting Query Performance. Proc. of the 25th Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval (2002) 299-306
7. Evans D. and Lefferts R.: Design and Evaluation of the CLARIT-TREC-2 System. Proc. of the 2nd Annual Text R.Etrieval Conf. (1993) 137-150
8. Fox E.A.: Characterization of Two New Experimental Collections in Computer and Information Science Containing Textual and Bibliographic Concepts. Technical Report, 83-561. Cornell University (1983) [9] Gu Z. and Luo M.: Comparison of Using Passages and Documents for Blind Relevance Feedback in Information Retrieval. Proc. of the 27th Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval (2004) 482-483
9. Jordan C. and Watters C.: Extending the Rocchio Relevance Feedback Algorithm to Provide Contextual Retrieval. Proc. of the 2nd Int. Atlantic Web Intelligence Conf. (2004) 135-144
10. Kelly, D., Dollu, V. D., and Fu, X. 2005. The loquacious user: a document-independent source of terms for query expansion. Proc. of the 28th Int. ACM SIGIR. Conf. on Research and Development in Information Retrieval (2005) 457-464
11. Lafferty J. and Zhai C.: Document Language Models, Query Models, and Risk Minimization for Information Retrieval. Proc. of the 24th Annual Int. ACM SIGIR. Conf. on Research and Development in Information Retrieval (2001) 111-119
12. Lancaster, F.W. and Mills, J.: Testing Indexes and Index Language Devices - ASLIB Cranfield Prbject. American Documentation, 15 (1), (1964) 4-13
13. Lavrenko V. and Croft W.B.: Relevance Based Language Models. Proc. of the 24th Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval (2001) 120-127
14. Mitra M., Singhal A., and Buckley C.: Improving automatic query expansion. Proc. of the 21st Annual Int. ACM SIGIR. Conf. on Research and Development in Information Retrieval (1998) 206-214
15. Montgomery J., Si L., Callan J., and Evans D.A.: Effect of Vary Number of Documents in Blind Feedback: Analysis of the 2003 NRRC RIA Workshop "bf_numdocs" Experiment Suite. Proc. of the 27st Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval (2004) 476-477
16. Rocchio J.J.: Relevance Feedback in Information Retrieval. The SMART Retrieval System: Experiments in Automatic Document Processing (1971) 313-323
17. Sakai T. and Robertson S.E.: Flexible Pseudo-Relevance Feedback Using Optimization Tables. Proc. of the 24th Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval (2001) 396-397
18. Silverstein C., Henzinger M., Marais H., and Moricz M.: Analysis of a Very Large AltaVista Query Log. Technical Report, 1998-014. Digital SRC. (1998)
19. Song F. and Croft W.B.: A General Language Model for Information Retrieval. Proc. of the 8th Int. Conf. on Information and Knowledge Management (1999) 316-321
20. Sparck Jones, K.: The Cranfield tests. In Sparck Jones, K. editor, Information Retrieval Experiment, Chapter 13, 256-284. Butterworths, London (1981)
21. Text REtrieval Conference (TREC). http://trec.nist.gov/ (2005)
22. UCI KDD Archive. Reuters-21578 Text Catergorization Collection. http://kdd.ics.uci.edu/databases/reuters21578/reuters21578.html (2005)
23. Voorhees, E. M.: The Philosophy of Information Retrieval Evaluation. In Revised Papers From the Second Workshop of the Cross-Language Evaluation Forum on Evaluation of Cross-Language information Retrieval Systems (September 03-04, 2001). C. Peters, M. Braschler, J. Gonzalo, and M. Kluck, Eds. Lecture Notes In Computer Science, vol. 2406. Springer-Verlag, London, (2002) 355-370.
24. Winer B.J., Brown D.R., and Michels K.M.: Statistical Principles in Experimental Design. McGraw-Hill. 3rd edition (1991)
25. Yu S., Cai D., Wen J., and Ma W.: Improving Pseudo-Relevance Feedback in Web Information Retrieval Using Web Page Segmentation. Technical Report, MSR-TR-2002-124. Microsoft Research. (2002)
26. Zhai C. and Lafferty J.: A Study of Smoothing Methods for Language Models Applied to Ad Hoc Information Retrieval. Proc. of the 24th Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval (2001) 334-342
27. Zhai C. and Lafferty J.: Model-Based Feedback in the Language Modeling Approach to Information Retrieval. Proc. of the 10th Int. Conf. on Information and Knowledge Management (2001) 403-410