Measuring Search Engine Quality

Information Retrieval

Volumn 4, Issue 1, 2001, Pages 33-59

  Hawking, David ^a   Craswell, Nick ^a   Bailey, Peter ^b   Griffihs, Kathleen ^b  

^a CSIRO   (Australia)

^b AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Evaluation; Search engines; Web search

Indexed keywords

EID: 0003015330     PISSN: 13864564     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1011468107287     Document Type: Article

References (21)

1. Alta Vista Company. Alta Vista web page. http://www.altavista.com/.
2. Blair DC and Maron ME (1985) An evaluation of retrieval effectiveness for a full-text document-retrieval system. Communications of the ACM, 28(3):289-299.
3. Buckley C and Voorhees E (2000) Evaluating evaluation measure stability. In: Proceedings of SIGIR'00, New York, 2000, pp. 33-40. ACM Press.
4. Cleverdon C (1997) The Cranfield tests on index language devices. In: Jones KS and Willett P, Eds. Readings in Information Retrieval, Morgan Kauffman, San Francisco, pp. 47-59. (Reprinted from Aslib Proceedings, 19, 173-192).
5. Ding W and Marchionini G (1996) Comparative study of web search service performance. In: Proceedings of the ASIS 1996 Annual Conference, Oct. 1996, pp. 136-142.
6. Eisenberg M and Barry C (1998) Order effects: A study of the possible influence of presentation order on user judgments of document relevance. Journal of the American Society for Information Science, 39(5):293-300.
7. Electric Knowledge LLC. Electric Monk home page. http://electricmonk.com/.
8. Gordon M and Pathak P (1999) Finding information on the world wide web: The retrieval effectiveness of search engines. Information Processing and Management, 35(2):141-180.
9. Hawking D and Thistlewaite P (1997) Overview of TREC-6 very large collection track. In: Voorhees EM and Harman DK, Eds. Proceedings of TREC-6. Gaithersburg, MD, Nov. 1997, pp. 93-106. NIST special publication 500-240, http://trec.nist.gov.
10. Hawking D, Thistlewaite P and Harman D (1999) Scaling up the TREC collection. Information Retrieval, 1(1):115-137.
11. Hawking D, Voorhees E, Bailey P and Craswell N (1999) Overview of TREC-8 Web Track. In: Proceedings of TREC-8. Gaithersburg, MD. Nov. 1999, pp. 131-150. NIST special publication 500-246, http://tree.nist.gov.
12. Koster M The web robots pages. http://info.webcrawler.com/mak/projects/robots/robots.html.
13. Lawrence S and Lee Giles C (1999) Accessibility of information on the web. Nature, 400:107-109.
14. Leighton HV and Srivastava J (1999) First 20 precision among world wide web search services (search engines). Journal of the American Society for Information Science, 50(10):882-889.
15. Lynx. Lynx browser home page. http://lynx.browser.org.
16. Salton G and Lesk ME (1997) Computer evaluation of indexing and text processing. In: Jones KS and Willett P, Eds. Readings in Information Retrieval, Morgan Kauffman, San Francisco, pp. 60-84. (Reprinted from Journal of the ACM, 15, 8-36).
17. Silverstein C, Henzinger M, Marais H and Moricz M (1999) Analysis of a very large web search engine query log. SIGIR Forum, 33(1):6-12. Previously available as Digital Systems Research Center TR 1998-014 at http://www.research.digital.com/SRC.
18. Voorhees EM and Harman DK (1998) Eds. Proceedings of TREC-7, Gaithersburg, MD, Nov. 1998. NIST special publication 500-242, http://tree.nist.gov.
19. Voorhees EM and Harman DK (1999) Eds. Proceedings of TREC-8, Gaithersburg, MD, Nov. 1999. NIST special publication 500-246, cm http://trec.nist.gov.
20. Voorhees EM and Harman DK (1996) Overview of the fifth Text Retrieval Conference (TREC-5). In: Voorhees EM and Harman DK, Eds. Proceedings of TREC-5, Gaithersburg, MD, Nov. 1996. pp. 1-28. NIST special publication 500-238, http://tree.nist.gov.
21. Voorhees EM (1998) Variations in relevance judgments and the measurement of retrieval effectiveness. In: Croft WB, Moffat A, van Rijsbergen CJ, Wilkinson R and Zobel J, Eds. Proceedings of SIGIR'98, Melbourne, Australia, August 1998, pp. 315-323.