Precision Evaluation of Search Engines

World Wide Web

Volumn 5, Issue 2, 2002, Pages 159-173

  Shang, Yi ^a   Li, Longzhuang ^a  

^a UNIVERSITY OF MISSOURI   (United States)

Author keywords

relevance score; search engine precision; statistical comparison

Indexed keywords

VECTOR SPACES;

DATA ENGINEERING; EVALUATING PRECISION; GOOGLE+; INDEX TERMS; PHRASE SEARCHES; PRECISION EVALUATION; RELEVANCE SCORE; SCORING ALGORITHMS; SEARCH ENGINE PRECISION; STATISTICAL COMPARISONS;

SEARCH ENGINES;

EID: 4644307157     PISSN: 1386145X     EISSN: 15731413     Source Type: Journal    
DOI: 10.1023/A:1019679624079     Document Type: Article

References (23)

1. S. Brin and L. Page, “The anatomy of a large-scale hypertextual web search engine,” in Proc. 7th International World Wide Web Conference, 1998, http://www7.scu.edu.au/programme/fullpapers/1921/com1921.htm
2. H. Chu and M. Rosenthal, “Search engines for the World Wide Web: A comparative study and evaluation methodology,” in ASIS'96: Proc. 59th ASIS Annual Meeting, Medford, NJ, Information Today, Inc., 1996, pp. 127–135.
3. C. L. A. Clark, G. V. Cormack, and F. J. Burkowski, “Shortest substring ranking,” in Fourth Text Retrieval Conference (TREC-4), Gaithersburg, MD, 1995, pp. 295–304.
4. C. L. A. Clarke, G. V. Cormack, and E. A. Tudhope, “Relevance ranking for one to three term queries,” Information Processing & Management36, 2000, 291–311.
5. A. Cohen, “Web portal and search sites,” PC Magazine10, 1999, 120–156.
6. G. V. Cormack, C. L. A. Clarke, C. R. Palmer, and D. I. E. Kisman, “Fast automatic passage ranking (multitext experiments for TREC-8),” in Proceedings of the TREC-8, 2000.
7. X. Dong and L. T. Su, “Search engines on the World Wide Web and information retrieval from the Internet: A review and evaluation,” Online and CDROM Review21(2), 1997, 67–81.
8. D. Hawking, P. Bailey, and N. Craswell, “ACSYS TREC-8 experiments,” in Proceedings of the TREC-8, 2000.
9. D. Hawking, N. Craswell, P. Thistlewaite, D. Harman, “Results and challenges in web search evaluation,” in Proceedings of the 8th International World Wide Web Conference, Toronto, Canada, May 11–14, 1999.
10. D. Hawking, E. Voorhees, N. Craswell, and P. Bailey, “Overview of the TREC-8 Web track,” in Proceedings of the TREC-8, 2000.
11. A. Ieumwananonthachai and B. W. Wah, “Statistical generalization of performance-related heuristics for knowledge-lean applications,” International Journal of Artificial Intelligence Tools5(1–2), June 1996, 61–79.
12. B. J. Jansen, A. Spink, J. Bateman, and T. Saracevic, “Real life information retrieval: A study of user queries on the Web,” SIGIR Forum32(1), 1998, 5–17.
13. A. Lebedev, “Best search engines for finding scientific information in the Web,” 1999, http://www.chem.msu.su/eng/comparison.html
14. H. V. Leighton and J. Srivastava, “First 20 precision among World Wide Web search services (search engines),” Journal of the American Society for Information Science50(10), 1999, 870–881.
15. L. Li and Y. Shang, “A new statistical method for evaluating search engines,” in Proc. IEEE 12th Internat. Conf. on Tools with Artificial Intelligence, Vancouver, British Columbia, Canada, 2000, pp. 208–215.
16. G. R. Notess, “Search engine statistics: Database total size estimates,” July 2000, http://www.notess.com/search/stats/sizeest.shtml
17. S. E. Robertson and S. Walker, “Okapi/keenbow at TREC-8,” in Proceedings of the TREC-8, 2000.
18. G. Salton, Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer, Addison-Wesley Series in Computer Science, Addison-Wesley Longman, Reading, MA, 1989.
19. Y. Shang and L. Li, “A new method for automatic performance comparison of search engines,” World Wide Web3(4), December 2000.
20. D. Sullivan, “Search engine sizes,” July 2000, http://searchenginewatch.com/reports/sizes.html
21. T. Takakuwa, “Search engines worldwide,” 2000, http://www.twics.com/takakuwa/search/search.html
22. N. G. Tomaiuolo and J. G. Packer, “An analysis of Internet search engines: Assessment of over 200 search queries,” Vomputers in Libraries16(6), 1996, 58–63.
23. L. Wishard, “Precison among Internet search engines: An earth sciences case study,” Issues in Science and Technology Librarianship18, 1998.