Coverage, relevance, and ranking: The impact of query operators on Web search engine results

ACM Transactions on Information Systems

Volumn 21, Issue 4, 2003, Pages 383-411

  Eastman, Caroline M ^a,c   Jansen, Bernard J ^b  

^a UNIVERSITY OF SOUTH CAROLINA   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

^c University of South Carolina   (United States)

Author keywords

Boolean operators; Coverage; Query operators; Ranking; Relative precision; Search engines; Web results

Indexed keywords

BOOLEAN OPERATORS; COVERAGE; QUERY OPERATORS; RELATIVE PRECISION; WEB RESULTS;

BOOLEAN ALGEBRA; DATABASE SYSTEMS; DIGITAL LIBRARIES; INFORMATION RETRIEVAL; WORLD WIDE WEB;

SEARCH ENGINES;

EID: 2442457056     PISSN: 10468188     EISSN: None     Source Type: Journal    
DOI: 10.1145/944012.944015     Document Type: Review

References (60)

1. AOL. 2003. Getting started. Accessed on: 23 April 2003 at: http://search.aol.com/aolcom/help.jsp.
2. BORGMAN, C. 1996. Why are online catalogs still hard to use? J. ASIS 47, 1, 493-503.
3. BRIN, S. 1998. Extracting patterns and relations from the world wide web. In Proceedings of the World Wide Web and Databases (Valencia, Spain). 172-183.
4. CHANG, C.-C. K., GARCIA-MOLINA, H., AND PAEPCKE, A. 1999. Predicate rewriting for translating Boolean queries in a heterogeneous information system. ACM Trans. Inf. Syst. 17, 1, 1-39.
5. CHOWDHURY, A., BEITZEL, S., AND JENSEN, E. 2002. Analysis of combining multiple query representations with varying lengths in a single engine. In Proceedings of the IEEE 3rd International Conference on Information Technology Coding and Computing (Las Vegas, Nev.). IEEE Computer Society Press, Los Alamitos, Calif., 8-15.
6. CLARK, P. 2001. Solving Internet overload. Net Econ. 2, 3, 1.
7. CLARKE, C. L. A. AND CORMACK, G. V. 2000. Shortest-substring retrieval and ranking. ACM Trans. Inf. Syst. 18, 1, 44-78.
8. COOPER, W. S. 1968. Expected search length: A single measure of retrieval effectiveness based on weak ordering action of retrieval systems. J. ASIS 19, 1, 30-41.
9. CRASWELL, N., HAWKING, D., AND ROBERTSON, S. 2001. Effective site finding using link anchor information. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (New Orleans, La). ACM New York, 250-257.
10. GRONEN-TOWNSEND, S., ZHOU, Y., AND CROFT, W. B. 2002. Predicting query performance. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Tampere, Finland). ACM New York, 299-306.
11. CYBER ATLAS. 2002. U.S. Top 50 Internet properties July 2002 at home and work combined. Accessed on: 1 November 2002 at: http://cyberatlas.internet.com.
12. DEERWESTEB, S., DUMAIS, S. T., FURNAS, G. W., LANDAUER, T. K., AND HARSHMAN, R. 1990. Indexing by latent semantic analysis. J. ASIS 41, 6, 391-407.
13. DING, W. AND MARCHIONINI, G. 1996. A comparative study of Web search service performance. In Proceedings of the 59th Annual Meeting of the American Society for Information Science (Medford, N.J.). 136-142.
14. DUMAIS, S., CUTRELL, E., and CHEN, H. 2001. Optimizing search by showing results in context. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Seattle, Wash.). 277-284.
15. DUMAIS, S. T 2002. Web experiments and test collections. Presented at the 11th International World Wide Web Conference (Honolulu, Hi., May 7-11). Presentation available at http://www2002.org/presentations/dumais.pdf.
16. EASTMAN, C. M. 2002. 30,000 hits may be better than 300: Precision anomalies in Internet searches. J. ASIST 63, 11, 879-882.
17. FORD, N., MILLER, D., AND MOSS, N. 2003. Web search strategies and approaches to studying. J. ASIST 54, 6, 473-489.
18. FRANTS, V. I., SHAPIRO, J., TAKSA, I., AND VOISKUNSKII, V. G. 1999. Boolean search: Current state and perspectives. J. ASIS 50, 1, 86-95.
19. GLOVER, E. J., LAWRENCE, S., GORDON, M. D., BIRMINGHAM, W. P., AND GILES, C. L. 2001. Web search-Your way: Improving Web searching with user preferences. Commun. ACM 44, 12, 97-102.
20. GOGGLE. 2003. Advanced search. Accessed on: 23 April 2003 at: http://www.google.com/help/refinesearch.html.
21. GUDIVADA, V. N., RAGHAVAN, V. V., GROSKY, W. I., AND KASANAGOTTU, R. 1997. Information retrieval on the World Wide Web. IEEE Internet Comput. Sept.-Oct. 58-68.
22. HAWKING, D. 2000. Overview of the TREC-9 Web track. In Proceedings of the 9th Text Retrieval Conference (Gaithersburg, Md.). 87-103.
23. HAWKING, D., CRASWELL, N., BAILEY, P., AND GRIFFIHS, K. 2001. Measuring search engine quality. Inf. Ret. 4,1, 33-59.
24. HAWKING, D. AND ROBERTSON, S. 2003. On collection size and retrieval effectiveness. Inf. Ret. 6, 1, 99-105.
25. HIEMSTRA, D. AND ROBERTSON, S. E. 2001. Relevance feedback for best match term weighting algorithms in information retrieval. In Proceedings of Joint 2nd DELOS-NSF Workshop on Personalisation and Recommender Systems in Digital Libraries (Dublin City University, Ireland). 37-42.
26. HIEMSTRA, D. AND VRIES, A. D. 2000. CTIT Technical Report TR-CTIT-00-09: Relating the new language models of information retrieval to the traditional retrieval models. Accessed on: 30 March 2003 at: http://wwwhome.cs.utwente.nl/ ~hiemstra/papers/.
27. HÖLSCHER, C. AND STRUBE, G. 2000. Web search behavior of Internet experts and newbies. Int. J. Comput. Telecommun. Netw. 33, 1-6, 337-346.
28. INKTOMI. 2002. Refocused Inktomi seeks to monetize search. Accessed on: 20 December 2002 at: http://www.inktomi.com/company/news/.
29. JANSEN, B. J. 2000. An investigation into the use of simple queries on Web IR systems. Inf. Res.: An Elect. J. 6, 1, 1-10.
30. JANSEN, B. J. AND KRONER, G. 2003. The impact of automated assistance on the information retrieval process. In Proceedings of the ACM CHI 2003 Conference on Human Factors in Computing Systems (Fort Lauderdale, Fla.). ACM New York, 1004-1006.
31. JANSEN, B. J. AND POOCH, U. 2001. Web user studies: A review and framework for future work. J. ASIST 52, 3, 235-246.
32. JANSEN, B. J., SPINK, A., BATEMAN, J., AND SARACEVIC, T. 1998. Real life information retrieval: A study of user queries on the Web. SIGIR Forum. 32, 1, 5-17.
33. JANSEN, B. J., SPINK, A., PFAFF, A., AND GOODRUM, A. 2000a. Web query structure: Implications for IR system design. In Proceedings of the 4th World Multiconference on Systemics, Cybernetics and Informatics (SCI'2000), (Orlando, Fla.). 169-176.
34. JANSEN, B. J., SPINK, A., AND SARACEVIC, T. 2000b. Real life, real users, and real needs: A study and analysis of user queries on the Web. Inf. Proc. Manage. 36, 2, 207-227.
35. KIRSCH, S. 1998. The future of Internet search (keynote address). Accessed on: 16 August 1999 at: http://www.skirsch.com/stk.html/presentations/ sigir.ppt.
36. KORFHAGE, R. 1997. Information Storage and Retrieval. Wiley, New York.
37. LAWRENCE, S. AND GILES, C. L. 1999. Accessibility of information on the Web. Nature. 400, 107-109.
38. LEXISNEXIS. 2003. Terms and connectors - introduction to traditional Boolean searching. Accessed on: 5 April 2003 at: http://support.lexis-nexis.com/ online/record.asp?ArticleID=GS_ Boolean.
39. LOOKSMART. 2003. Looksmart search: About us. Accessed on: 1 February 2002 at: http://aboutus. looksmart.com/about. jhtml;$sessionid$MFR0PZYAAACADLAQQBTSOJQ?dir = profile&page = about.
40. LUCAS, W. AND TOPI, H. 2002. Form and function: The impact of query term and operator usage on Web search results. J. ASIST 53, 2, 95-108.
41. MSN. 2003. Tips for an advanced search. Accessed on: 23 April 2003 at: http://search.msn.com.
42. NIELSEN NETRATING. 2002. Top Web properties march 2002. Accessed on: 27 September 2002 at: http://www.nielsen-netratings.com.
43. NIELSENMEDIA. 1997. Search engines most popular method of surfing the Web. Accessed on: 30 August 2000 at: http://www.commerce.net/news/press/0416. html.
44. NOTESS, G. R. 2003. Search engine features chart. Accessed on: 13 April 2003 at: http://www. searchengineshowdown.com/features/.
45. PETERSEN, R. E. 1997. Eight Internet search engines compared. First Monday. 2, 2
46. SALTON, G. AND MCGILL, M. J. 1983. Introduction to Modern Information Retrieval. McGraw-Hill, New York.
47. SELBERG, E. AND ETZIONI, O. 2000. On the instability of Web search services. In Proceedings of RIAO 2000: Computer-Assisted Information Retrieval (Paris, France). 223-236.
48. SILVERSTEIN, C., HENZINGER, M., MARAIS, H., AND MORICZ, M. 1999. Analysis of a very large Web search engine query log. SIGIR Forum. 33, 1, 6-12.
49. SORMUNEN, E. 2000. A novel method for the evaluation of Boolean query effectiveness across a wide operational range. In Proceedings of 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Athens, Greece). ACM New York, 2532.
50. SPINK, A. 1995. Term relevance feedback and mediated database searching: Implications for information retrieval practice and design. Inf. Proc. Manage. 31, 6, 161-171.
51. SPINK, A., BATEMAN, J. AND JANSEN, B. J. 1998a. Searching heterogeneous collections on the Web: Behavior of Excite users. Inf. Res. 4, 2, 317-328.
52. SPINK, A., BATEMAN, J. AND JANSEN, B. J. 1999. Searching the Web: A survey of Excite users. J. Internet Res. Electron. Netw. Appl. Policy 9, 2, 117-128.
53. SPINK, A., GREISDORF, H. AND BATEMAN, J. 1998b. From highly relevant to not relevant: Examining different regions of relevance. J. ASIS 34, 5, 599-621.
54. SPINK, A., JANSEN, B. J., WOLFRAM, D., AND SARACEVIC, T. 2002. From e-sex to e-commerce: Web search changes. IEEE Comput. 35, 3, 107-111.
55. SULLIVAN, D. 2000. Search watch. Accessed on: 1 June 2000 at: http://searchenginewatch.com/.
56. SULLIVAN, D. 2002. Search engine math. Accessed on: 11 April 2003 at: http://www. searchenginewatch.com/facts/article.php/2156021.
57. SULLIVAN, D. 2003. Coping with GDS, the Google dance syndrome. Accessed on: 14 July 2033 at: http://www.searchenginewatch.com/sereport/article.php/ 2216081.
58. WITTEN, I., MOFFAT, A. AND BELL, T. C. 1994. Managing Gigabytes: Compressing and Indexing Documents and Images. Van Nostrand Reinhold, New York, NY.
59. WOLFRAM, D. 1999. Term co-occurrence in Internet search engine queries: An analysis of the Excite data set. Canad. J. Inf. Library Sci. 24, 2/3, 12-33.
60. ZAPUR, K. AND ZHANG, J. 2000. Searching the Web using synonyms and senses. WebNet J.: Internet Tech. Appl. Issues. 2, 3, 54-61.