Using query logs to establish vocabularies in distributed information retrieval

Information Processing and Management

Volumn 43, Issue 1, 2007, Pages 169-180

  Shokouhi, Milad ^a   Zobel, Justin ^a   Tahaghoghi, Saied ^a   Scholer, Falk ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

Distributed information retrieval; Indexing; Query logs; Uncooperative environments

Indexed keywords

BENCHMARKING; DISTRIBUTED COMPUTER SYSTEMS; INDEXING (OF INFORMATION); INFORMATION RETRIEVAL; SEARCH ENGINES; VOCABULARY CONTROL;

DISTRIBUTED INFORMATION RETRIEVAL; QUERY LOGS; UNCOOPERATIVE ENVIRONMENTS;

QUERY LANGUAGES;

EID: 33748304081     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2006.04.003     Document Type: Article

References (41)

1. Bailey P., Craswell N., and Hawking D. Engineering a multi-purpose test collection for Web retrieval experiments. Information Processing and Management 39 6 (2003) 853-871
2. Beitzel S.M., Jensen E.C., Chowdhury A., Grossman D., and Frieder O. Hourly analysis of a very large topically categorized Web query log. Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval (2004), ACM Press, Sheffield, United Kingdom 321-328
3. Billerbeck, B., Scholer, F., Williams, H. E., & Zobel, J. (2003). Query expansion using associated queries. In O. Frieder, J. Hammer, S. Quershi, L. Seligman (Eds.), Proceedings of the CIKM international conference on information and knowledge management (pp. 2-9). New Orleans.
4. Callan J., and Connell M. Query-based sampling of text databases. ACM Transactions on Information Systems 19 2 (2001) 97-130
5. Callan J., Connell M., and Du A. Automatic discovery of language models for text databases. Proceedings of the 1999 ACM SIGMOD international conference on management of data (1999), ACM Press, Philadelphia, Pennsylvania 479-490
6. Callan, J., Croft, W. B., & Harding, S. M. (1992). The INQUERY retrieval system. In Proceedings of third international conference on database and expert systems applications (pp. 78-83). Valencia, Spain.
7. Callan J., Lu Z., and Croft W.B. Searching distributed collections with inference networks. Proceedings of the 18th annual international ACM SIGIR conference on research and development in information retrieval (1995), ACM Press, Seattle, Washington 21-28
8. Carmel D., Cohen D., Fagin R., Farchi E., Herscovici M., Maarek Y.S., and Soffer A. Static index pruning for information retrieval systems. Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval (2001), ACM Press, New Orleans, Louisiana 43-50
9. Craswell, N., & Hawking, D. (2002). Overview of the TREC-2002 Web Track. In Proceedings of TREC-2002. Gaithersburg, Maryland.
10. Craswell N., Bailey P., and Hawking D. Server selection on the World Wide Web. Proceedings of the fifth ACM Conference on digital libraries (2000), ACM Press, San Antonio, Texas 37-46
11. Craswell, N., Hawking, D., Wilkinson, R., & Wu, M. (2003). Overview of the TREC-2003 Web Track. In Proceedings of TREC-2003. Gaithersburg, Maryland.
12. Craswell N., Hawking D., and Thistlewaite P. Merging results from isolated search engines. Proceedings of the 10th Australasian database conference (1999), Springer-Verlag, Auckland, NZ 189-200
13. Cui H., Wen J., Nie J., and Ma W. Probabilistic query expansion using query logs. Proceedings of the 11th international conference on World Wide Web (2002), ACM Press, Honolulu, Hawaii 325-332
14. de Moura E., dos Santos C.F., Fernandes D.R., Silva A.S., Calado P., and Nascimento M.A. Improving Web search efficiency via a locality based static pruning method. Proceedings of the 14th international conference on World Wide Web (2005), ACM Press, Chiba, Japan 235-244
15. D'Souza D., Thorn J., and Zobel J. Collection selection for managed distributed document databases. Information Processing and Management 40 3 (2004) 527-546
16. Fagni T., Perego R., Silvestri F., and Orlando S. Boosting the performance of Web search engines: Caching and prefetching query results by exploiting historical usage data. ACM Transactions on Information Systems 24 1 (2006) 51-78
17. Fuhr N. A decision-theoretic approach to database selection in networked IR. ACM Transactions on Information Systems 17 3 (1999) 229-249
18. Gravano L., Chang C.K., Garcia-Molina H., and Paepcke A. STARTS: Stanford proposal for Internet meta-searching. Proceedings of the 1997 ACM SIGMOD international conference on management of data (1997), ACM Press, Tucson, Arizona 207-218
19. Gravano L., Garcia-Molina H., and Tomasic A. GlOSS: Text-source discovery over the Internet. ACM Transactions on Database Systems 24 2 (1999) 229-264
20. Gravano L., Ipeirotis P.G., and Sahami M. Qprober: A system for automatic classification of Hidden-Web databases. ACM Transactions on Information Systems 21 1 (2003) 1-41
21. Hoi C., and Lyu M.R. A novel log-based relevance feedback technique in content-based image retrieval. Proceedings of the 12th annual ACM international conference on multimedia (2004), ACM Press, New York, NY 24-31
22. Ipeirotis, P. G., & Gravano, L. (2002). Distributed search over the Hidden Web: Hierarchical database sampling and selection. In Proceedings of 28th international conference on very large data bases (pp. 394-405). Hong Kong, China.
23. Jansen B.J., and Spink A. An analysis of Web searching by European AlltheWeb.com users. Information Processing and Management 41 2 (2005) 361-381
24. Jansen B.J., Spink A., and Pedersen J. A temporal comparison of AltaVista Web searching: Research articles. Journal of the American Society for Information Science and Technology 56 6 (2005) 559-570
25. Jones K.S., and Rijsbergen C.V. Progress in documentation. Journal of Documentation 32 1 (1976) 59-75
26. Lafferty J., and Zhai C. Document language models, query models, and risk minimization for information retrieval. Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval (2001), ACM Press, New Orleans, Louisiana 111-119
27. Lu J., and Callan J. Pruning long documents for distributed information retrieval. Proceedings of the eleventh international conference on information and knowledge management (2002), ACM Press, McLean, Virginia 332-339
28. Nottelmann H., and Fuhr N. Evaluating different methods of estimating retrieval quality for resource selection. Proceedings of the 26th annual international ACM SIGIR conference on research and development in information retrieval (2003), ACM Press, Toronto, Canada 290-297
29. Persin M., Zobel J., and Sacks-Davis R. Filtered document retrieval with frequency-sorted indexes. Journal of the American Society of Information Science 47 10 (1996) 749-764
30. Powell A.L., and French J. Comparing the performance of collection selection algorithms. ACM Transactions on Information Systems 21 4 (2003) 412-456
31. Robertson, S. E., Walker, S., Hancock-Beaulieu, M., Gull, A., & Lau, M. (1992). Okapi at TREC. In Proceedings of TREC-1992 (pp. 21-30). Gaithersburg, Maryland.
32. Salton G., and McGill M. Introduction to modern information retrieval (1986), McGraw-Hill, Inc., New York, NY, USA
33. Sanderson M., and Zobel J. Information retrieval system evaluation: Effort, sensitivity, and reliability. Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval (2005), ACM Press, Salvador, Brazil 162-169
34. Shokouhi M., Scholer F., and Zobel J. Sample sizes for query probing in uncooperative distributed information retrieval. In: Zhou X., Li J., Shen H.T., Kitsuregawa M., and Zhang Y. (Eds). APWeb. Lecture Notes in Computer Science vol. 3841 (2006), Springer 63-75
35. Si L., and Callan J. Relevant document distribution estimation method for resource selection. Proceedings of the 26th annual international ACM SIGIR conference on research and development in information retrieval (2003), ACM Press, Toronto, Canada 298-305
36. Silverstein C., Marais H., Henzinger M., and Moricz M. Analysis of a very large Web search engine query log. SIGIR Forum 33 1 (1999) 6-12
37. Spink A., Wolfram D., Jansen B., and Saracevic T. Searching the Web: The public and their queries. Journal of the American Society for Information Science and Technology 53 2 (2001) 226-234
38. Voorhees E.M., and Harman D. Overview of the sixth Text REtrieval Conference (TREC-6). Information Processing and Management 36 1 (2000) 3-35
39. Wen J., Lao N., and Ma W. Probabilistic model for contextual retrieval. Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval (2004), ACM Press, Sheffield, United Kingdom 57-63
40. Xu J., and Callan J. Effective retrieval with distributed collections. Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval (1998), ACM Press, Melbourne, Australia 112-120
41. Yuwono B., and Lee D.L. Server ranking for distributed text retrieval systems on the Internet. Proceedings of the fifth international conference on database systems for advanced applications (1997), World Scientific Press, Melbourne, Australia 41-50