Subjective and objective evaluation of interactive and automatic query expansion

Online Information Review

Volumn 29, Issue 4, 2005, Pages 374-390

  Shapira, Bracha ^a   Taieb Maimon, Meirav ^a   Nemeth, Yael ^a  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

Information retrieval; Project evaluation; User studies

Indexed keywords

COMPUTER SIMULATION; ONLINE SYSTEMS; QUERY LANGUAGES;

PROJECT EVALUATION; QUERY EXPANSION; SUBJECTIVE ANALYSIS; USER STUDIES;

INFORMATION RETRIEVAL;

EID: 24144439367     PISSN: 14684527     EISSN: None     Source Type: Journal    
DOI: 10.1108/14684520510617820     Document Type: Article

References (37)

1. Allan, J. (1995), "Relevance feedback with too much data", Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 9-13 July, 1995, Seattle, Washington, ACM, New York, NY, pp. 337-43.
2. Attar, L. and Fraenkel, A.S. (1977), "Local feedback in full-text retrieval systems", Journal of the Association for Computing Machinery, Vol. 24, pp. 397-417.
3. Beaulieu, M. (1997), "Experiments with interfaces to support query expansion", Journal of Documentation, Vol. 53 No. 1, pp. 8-19.
4. Belkin, N.J., Cool, C., Head, J., Jeng, J., Kelly, D., Lin, S., Lobash, L., Park, S.Y., Savage-Knepshield, P. and Sikora, C. (2000), "Relevance feedback versus local context analysis as term suggestion devices; Rutgers TREC-8 interactive track experience", in Vorhees, E.M. and Harman, D.K. (Eds), Proceedings of the 8th Text Retrieval Conference (TREC-8) 2000, National Institute of Standards and Technology, Gaithersburg, MD, p. 565.
5. Billerbeck, B. and Zobel, J. (2003), "When query expansion fails", Proceedings of the 26th InternationalACM SIGIR Conference on Research and Development in Information Retrieval, July 28-August 1, 2003, Toronto, Canada, ACM, New York, NY, pp. 387-8.
6. Billerbeck, B. and Zobel, J. (2004) "Questioning query expansion: an examination of behaviour and parameters", Proceedings of the Fifteenth Australasian Database Conference (ADC), Dunedin, New Zealand, January 2004, pp. 69-76.
7. Buckley, C., Salton, G., Allan, J. and Singhal, A. (1994), "Automatic query expansion using SMART: TREC 3", Proceedings of the Third Text REtrieval Conference (TREC-3), Held in Gaithersburg, MD, 2-4 November, 1994, National Institute of Standards and Technology, Gaithersburg, MD.
8. Caid, W.R., Dumais, S.T. and Gallant, S.I. (1995), "Learned vector space models for information retrieval", Information Processing & Management, Vol. 31 No. 3, pp. 419-29.
9. Carpineto, C., De Mori, R., Romano, G. and Bigi, B. (2001), "An information-theoretic approach to automatic query expansion", ACM Transactions on Information Systems, Vol. 19 No. 1, pp. 1-27.
10. Efthimiadis, E.N. (1996), "Query expansion", in Williams, M.E. (Ed.), Annual Review of Information Science and Technology 31, Information Toda, Medford, NJ, pp. 121-87.
11. Harman, D. (1988), "Towards interactive query expansion", Proceedings of the 11th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Grenoble France, 13-15 June 1988, ACM, New York, NY, pp. 321-31.
12. Harman, D. (1992), "Relevance feedback revisited", Proceedings of the 15th Annual International ACM SIGIR Conference in Research and Development in Information Retrieval, Copenhagen, Denmark, 21-24 June 1992, ACM, New York, NY, pp. 1-10.
13. Hersh, W., Turpin, A., Price, S., Kraemer, D., Chan, B., Sacherek, L. and Olson, D. (2000), "Do batch and user evaluations give the same results? An analysis from the TREC-8 Interactive Track", in Information Technology: Eighth Text REtrieval Conference (TREC-8), National Institute of Standards and Technology, Gaithersburg, MD, p. 531.
14. Hoashi, K., Matsumoto, K., Inoue, N. and Hashimoto, K. (2001), "Query expansion based on predictive algorithms for collaborative filtering", Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 9-13 September, 2001, New Orleans, LA, ACM, New York, NY, pp. 414-5.
15. Hölscher, C. and Strube, G. (2000), "Web search behavior of Internet experts and newbies", The International Journal of Computer and Telecommunications Networking, Vol. 33 Nos 1-6, pp. 337-46.
16. Hsieh-Yee, I. (1993), "Effects of search experience and subject knowledge on the search tactic of novice and experienced searchers", Journal of the American Society for Information Science, Vol. 45 No. 3, pp. 161-74.
17. Jansen, B.J., Spink, A., Bateman, T. and Saracevic, T. (2000), "Real life information retrieval: a study of user queries on the web", Information Processing & Management, Vol. 36 No. 2, pp. 207-27.
18. Jing, Y. and Croft, W.B. (1994), "An association thesaurus for information retrieval", in Conference Proceedings of RIAO '94:Intelligent Multimedia Information Retrieval Systems and Management, New York, 11-13 October, 1994, pp. 146-60.
19. Joho, H., Sanderson, M. and Beaulieu, M. (2004), "A study of user interaction with a concept-based query expansion support tool", Advances in Information Retrieval, 26th European Conference on IR Research, ECIR 2004, Sunderland, UK, 5-7 April, 2004, Proceedings, Springer Verlag, New York, NY, pp. 42-56.
20. Koenemann, J. and Belkin, N.J. (1996) pp. 205-12, "A case for interaction: a study of interactive information retrieval behavior and effectiveness", in Proceedings of the Human Factors in Computing Systems Conference (CHI'96), Zurich, Switzerland, 1996.
21. Lucas, W. and Topi, H. (2002), "Form and function: the impact of query term and operator usage on Web search results", Journal of the American Society for Information Science, Vol. 43 No. 2, pp. 95-108.
22. Magennis, M. and van Rijsbergen, C.J. (1997), "The potential and actual effectiveness of interactive query expansion", in Proceedings of the 20th International ACM SIGIR Conference on Research and Development in Information Retrieval, Philadelphia, 1997, pp. 324-32.
23. Mitra, M., Singhal, A. and Buckley, C. (1998), "Improving automatic query expansion", in Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia, August 1998, pp. 206-14.
24. Nemeth, Y., Shapira, B. and Taieb-Maimon, M. (2004), "Evaluation of the real and perceived value of automatic and interactive query expansion", in Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Sheffield, UK, 25-29 July, 2004, pp. 526-7.
25. Peat, H.J. and Willett, P. (1991), "The limitations of term co-occurrence data for query expansion in document retrieval systems", Journal of the American Society for Information Science, Vol. 42 No. 5, pp. 378-83.
26. Robertson, S.E., Thompson, C.L., Macaskill, M.J. and Bovey, J.D. (1986), "Weighting, ranking and relevance feedback in a front-end system", Journal of Information Science, Vol. 12 Nos 1-2, pp. 71-5.
27. Robertson, S.E. and Walker, S. (2000) "Microsoft Cambridge at TREC-9: Filtering Track", in Proceedings of the Ninth Text REtrieval Conference (TREC-9), National Institute of Standards and Technology, Gaithersburg, MD, pp. 361-8.
28. Rocchio, J.J. (1971), "Relevance feedback in information retrieval", in Salton, G. (Ed.), The SMART Retrieval System: Experiments in Automatic Document Processing, Prentice Hall, Englewood Cliffs, NJ, pp. 313-23.
29. Ruthven, I. (2003), "Re-examing the potential effectiveness of interactive query expansion", Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 28 July-1 August, 2003, Toronto, Canada, ACM, New York, NY, pp. 213-20.
30. Sakai, T. and Robertson, S.E. (2001), "Flexible pseudo-relevance feedback using optimization tables", Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 9-11 September, 2001, New Orleans, LA, ACM, New York, NY, pp. 396-7.
31. Salton, G. and Buckley, C. (1990), "Improving retrieval performance by relevance feedback", Journal of the American Society for Information Science, Vol. 41 No. 4, pp. 288-97.
32. Salton, G. and McGill, J. (1983), Introduction to Modern Information Retrieval, McGraw Hill, New York, NY.
33. Silverstein, C., Henzinger, M., Marais, H. and Moricz, M. (1999), "Analysis of a very large web search engine query log", SIGIR Forum, Vol. 33 No. 3, pp. 6-12 (originally published as DEC Systems Research Center Technical Note, 1998).
34. Smeaton, A.F. and van Rijsbergen, C.J. (1983), "The retrieval effects of query expansion on a feedback document retrieval system", The Computer Journal, Vol. 23 No. 3, pp. 239-46.
35. Sparck-Jones, K. and Jackson, D.M. (1970), "The use of automatically obtained keyword classifications for information retrieval", Information Storage and Retrieval, Vol. 5 No. 4, pp. 175-201.
36. Spink, A., Wolfram, D., Jansen, M.B.J. and Saracevic, T. (2002), "From e-sex to e-commerce: web search changes", IEEE Computer, Vol. 35 No. 3, pp. 107-9.
37. Xu, J. and Croft, B. (1996), "Query expansion using local and global document analysis", Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 18-22 August, 1996, Zurich, Switzerland, ACM, New York, NY, pp. 4-11.