A new statistical method for performance evaluation of search engines

Proceedings - International Conference on Tools with Artificial Intelligence, ICTAI

Volumn 2000-January, Issue , 2000, Pages 208-215

  Li, Longzhuang ^a   Shang, Yi ^a  

^a UNIVERSITY OF MISSOURI   (United States)

Author keywords

Algorithm design and analysis; Computer science; Distributed processing; Information retrieval; Probability; Search engines; Statistical analysis; Testing; Time measurement; Web pages

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SCIENCE; DISTRIBUTED PARAMETER NETWORKS; INFORMATION RETRIEVAL; PROBABILITY; STATISTICAL METHODS; STATISTICS; TESTING; TIME MEASUREMENT; VECTOR SPACES; WEBSITES;

ALGORITHM DESIGN AND ANALYSIS; DISTRIBUTED PROCESSING; PARALLEL AND DISTRIBUTED PROCESSING; PERFORMANCE BASED; RELEVANCE EVALUATION; SCORING ALGORITHMS; STATISTICAL COMPARISONS; VECTOR SPACE MODELS;

SEARCH ENGINES;

EID: 84923105949     PISSN: 10823409     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/TAI.2000.889872     Document Type: Conference Paper

References (24)

1. K. Bharat and M. R. Henzinger. Improved algorithms for topic distillation in a hyperlinked environment. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 104-111, Melbourne, Australia, 1998.
2. S. Brin and L. Page. The anatomy of a largescale hypertextual web search engine. In Proc. 7th International World Wide Web Conference, http://www7.scu.edu.au/programme/fullpapers/1921/com1921.htm, 1998.
3. H. Chu and M. Rosenthal. Search engines for the world wide web: A comparative study and evaluation methodology. In ASIS'96: Proc. 59th ASIS Annual Meeting, pages 127-135, Medford, NJ: Information Today, Inc., 1996.
4. C. L. Clarke, G. V. Cormack, and E. A. Tudhope. Relevance ranking for one to three term queries. Information Processing & Management, (36):291-311, 2000.
5. S. J. Clarke and P. Willett. Estimating the recall performance of web search engines. Aslib Proceedings, pages 184-189, July/August 1997.
6. A. Cohen. Web portal and search sites. PC Magazine, pages 120-156, 10/1999.
7. W. Ding and G. Marchionini. a comparative study of web search service performance. In ASIS'96: Proc. 59th ASIS Annual Meeting, pages 136-141, Medford, NJ: Information Today, Inc., 1996.
8. X. Dong and L. T. Su. Search engines on the world wide web and information retrieval from the internet: A review and evaluation. Online and CDROM Review, 21(2):67-81, 1997.
9. S. Gauch and G. Wang. Information fusion with profusion. In Webnet 96 Conference [online], 1996.
10. L. Gravano, H. Garcia-Molina, and A. Tomasic. Gloss: Text-source discovery over the internet. ACM Transactions on Database Systems, 24(2):229-264, June 1999.
11. D. Grossman, O. Frieder, D. Holmes, and D. Roberts. Integrating structured data and text: A relational approach. Journal of the American Society for Information Science, 48(2), Feb. 1997.
12. A. Ieumwananonthachai and B. W. Wah. Statistical generalization of performance-related heuristics for knowledgelean applications. Int'l J. of Artificial Intelligence Tools, 5(12):61-79, June 1996.
13. B. J. Jansen, A. Spink, J. Bateman, and T. Saracevic. Real life information retrieval: a study of user queries on the web. SIGIR Forum, 32(1):5-17, 1998.
14. A. Lebedev. Best search engines for finding scientific information in the web. http://www.chem.msu.su/eng/comparison.html, 1999.
15. H. V. Leighton and J. Srivastava. First 20 precision among world wide web search services (search engines). Journal of the American Society for Information Science, 50(10):870-881, 1999.
16. S. L. MacCall. Relevance reliability in cyberspace: Toward measurement theory for internet information retrieval. In Proceedings of the American Society for Information Science 1998 Annual Meeting, pages 13-22, 1998.
17. S. L. MacCall and A. D. Cleveland. A relevance-based quantitative measure for internet information retrieval evaluation. In Proceedings of the American Society for Information Science 1999 Annual Meeting, pages 763-768, 1999.
18. D. E. Rose and C. Stevens. V-twin: A lightweight engine for interactive use. In Fifth Text Retrieval Conference (TREC-5), pages 279-290, Gaithersburg, MD, 1996.
19. G. Salton. Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer. Addison-Wesley Series in Computer Science. Addison-Wesley Longman Publ. Co., Inc., Reading, MA, 1989.
20. T. Takakuwa. Search engines worldwide. http://www.twics.com/takakuwa/search/search.html, 2000.
21. N. Tomaiuolo and J. Packer. An analysis of internet search engines: Assessment of over 200 search queries. computers in Libraries, 16(6):58-63, 1996.
22. B. W. Wah, A. Ieumwananonthachai, L. C. Chu, and A. Aizawa. Genetics-based learning of new heuristics: Rational scheduling of experiments and generalization. IEEE Trans. on Knowledge and Data Engineering, 7(5):763-785, Oct. 1995.
23. R. Wilkinson, J. Zobel, and R. Sacks-Davis. Similarity measures for short queries. In Fourth Text Retrieval Conference (TREC-4), pages 277-285, Gaithersburg, MD, 1995.
24. L. Wishard. Precison among internet search engines: an earth sciences case study. Issues in science and technology librarianship, 18, 1998.