A new method for automatic performance comparison of search engines

World Wide Web

Volumn 3, Issue 4, 2000, Pages 241-247

  Li, Longzhuang ^a   Shang, Yi ^a  

^a UNIVERSITY OF MISSOURI   (United States)

Author keywords

Friedman statistic; performance comparison; probability of win; relevance evaluation; search engine

Indexed keywords

PROBABILITY; STATISTICS; VECTOR SPACES;

FRIEDMAN STATISTIC; GOOGLE+; PERFORMANCE; PERFORMANCE COMPARISON; PROBABILITY OF WIN; RELEVANCE EVALUATION; SEARCH ENGINES - ALTAVISTA; STATISTICS MEASURES; TARGET SEARCH; VECTOR SPACE MODELS;

SEARCH ENGINES;

EID: 85105254140     PISSN: 1386145X     EISSN: 15731413     Source Type: Journal    
DOI: 10.1023/A:1018790907285     Document Type: Article

References (22)

1. Brin, S. and L. Page (1998), “The Anatomy of a Large-Scale Hypertextual Web Search Engine,” In Proc. of the 7th International World Wide Web Conference, http://www7.scu.edu.au/programme/fullpapers/1921/com1921.htm.
2. Chu, H. and M. Rosenthal (1996), “Search Engines for the World Wide Web: A Comparative Study and Evaluation Methodology,” In ASIS'96: Proc. of the 59th ASIS Annual Meeting, Medford, NJ, Information Today, Inc., pp. 127–135.
3. Clarke, S.J. and P. Willett (1997), “Estimating the Recall Performance of Web Search Engines,” Aslib Proceedings, 184–189.
4. Cohen, A. (1999), “Web Portal and Search Sites,” PC Magazine 10, 120–156.
5. Conover, W.J. (1971), Practical Nonparametric Statistics, Wiley, New York.
6. Devore, J.L. (1982), Probability and Statistics for Engineering and the Sciences, Brooks/Cole Pub. Co., Monterey, CA.
7. Ding, W. and G. Marchionini (1996), “A Comparative Study ofWeb Search Service Performance,” In ASIS'96: Proc. of the 59th ASIS Annual Meeting, Medford, NJ, Information Today, Inc., pp. 136–141.
8. Dong, X. and L.T. Su (1997), “Search Engines on the World Wide Web and Information Retrieval from the Internet: A Review and Evaluation,” Online and CDROM Review 21, 2, 67–81.
9. Gauch, S. and G. Wang (1996), “Information Fusion with Profusion,” In Webnet 96 Conference [online].
10. Gravano, L., H. Garcia-Molina, and A. Tomasic (1999), “GlOSS: Text-Source Discovery over the Internet,” ACM Transactions on Database Systems 24, 2, 229–264.
11. Grossman, D., O. Frieder, D. Holmes, and D. Roberts (1997), “Integrating Structured Data and Text: A Relational Approach,” Journal of the American Society for Information Science 48, 2.
12. Ieumwananonthachai, A. and B.W. Wah (1996), “Statistical Generalization of Performance-Related Heuristics for Knowledge-Lean Applications,” International Journal of Artificial Intelligence Tools 5, 1/2, 61–79.
13. Lebedev, A. (1999), “Best Search Engines for Finding Scientific Information in the Web,” http://www.chem.msu.su/eng/comparison.html.
14. Leighton, H.V. and J. Srivastava (1999), “First 20 Precision among World Wide Web Search Services (Search Engines),” Journal of the American Society for Information Science 50, 10, 870–881.
15. MacCall, S.L. (1998), “Relevance Reliability in Cyberspace: Toward Measurement Theory for Internet Information Retrieval,” In Proceedings of the American Society for Information Science 1998 Annual Meeting, pp. 13–22.
16. MacCall, S.L. and A.D. Cleveland (1999), “A Relevance-based Quantitative Measure for Internet Information Retrieval Evaluation,” In Proceedings of the American Society for Information Science 1999 Annual Meeting, pp. 763–768.
17. Salton, G. (1989), Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer, Addison-Wesley Series in Computer Science, Addison-Wesley/Longman, Reading, MA.
18. Siegel, S. and J.N. John Castellan (1988), Nonparametric Statistics for the Behavioral Sciences, McGraw-Hill, New York.
19. Takakuwa, T. (2000), “Search Engines WorldWide,” http://www.twics.com/takakuwa/search/search.html.
20. Tomaiuolo, N. and J. Packer (1996), “An Analysis of Internet Search Engines: Assessment of over 200 Search Queries,” Computers in Libraries 16, 6, 58–63.
21. Wah, B.W., A. Ieumwananonthachai, L.C. Chu, and A. Aizawa (1995), “Genetics-Based Learning of New Heuristics: Rational Scheduling of Experiments and Generalization,” IEEE Transactions on Knowledge and Data Engineering 7, 5, 763–785.
22. Wishard, L. (1998), “Precison among Internet Search Engines: An Earth Sciences Case Study,” Issues in Science and Technology Librarianship 18.