Methods for evaluating dynamic changes in search engine rankings: A case study

Journal of Documentation

Volumn 62, Issue 6, 2006, Pages 708-729

  Bar Ilan, Judit ^a   Levene, Mark ^b   Mat Hassan, Mazlita ^b  

^a BAR ILAN UNIVERSITY   (Israel)

^b UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Data collection; Search engines; Worldwide web

Indexed keywords

EID: 33750701866     PISSN: 00220418     EISSN: None     Source Type: Journal    
DOI: 10.1108/00220410610714930     Document Type: Article

References (22)

1. AlltheWeb (2004), available at: www.alltheweb.com (accessed February 18, 2004).
2. Chowdhury, A. and Soboroff, I. (2002), "Automatic evaluation of worldwide web search services", Proceedings of the 25th Annual International ACM SIGIR Conference, pp. 421-2.
3. Diaconis, P. and Graham, R.L. (1977), "Spearman's footrule as a measure of disarray", Journal of the Royal Statistical Society, Vol. 39 No. 2, pp. 262-8 (Series B (Methodological)).
4. Dwork, C., Kumar, R., Naor, M. and Sivakumar, D. (2001), "Rank aggregation methods for the web", Proceedings of the 10th Worldwide Web Conference, May, Hong-Kong, pp. 613-22.
5. Fagin, R., Kumar, R. and Sivakumar, D. (2003), "Comparing top k lists", SIAM Journal on Discrete Mathematics, Vol. 17 No. 1, pp. 134-60.
6. Google (2003a), Google Information for Webmasters, available at: www.google.com/webmasters/seo.html (accessed February 18, 2004).
7. Google (2003b), Google Information for Webmasters, available at: www.google.com/webmasters/4.html (accessed February 18, 2004).
8. Google (2004), Google, available at: www.google.com (accessed February 18, 2004).
9. Hawking, D., Craswell, N., Bailey, P. and Griffiths, K. (2001), "Measuring search engine quality", Information Retrieval, Vol. 4, pp. 33-59.
10. Nielsen/NetRatings (2004), NetView Usage Metrics, available at: www.netratings.com/news.jsp?section=datto (accessed September 16, 2004).
11. Price, G. (2004), "Google ups total page count", Resourceshelf, available at: http://www.resourceshelf.com/archives/ 20040201resourceshelfarchive.html107702946623981034 (accessed February 18).
12. Silverstein, C., Henzinger, M., Marais, H. and Moricz, M. (1999), "Analysis of a very large web search engine query log", ACM SIGIR Forum, Vol. 33 No. 1, available at: www.acm.org/sigir/forum/F99/Silverstein.pdf (accessed February 18, 2004).
13. Singhal, A. and Kaszkiel, M. (2001), "A case study in web search using TREC algorithms", Proceedings of the 10th International Worldwide Web Conference, May, pp. 708-16, available at: www10.org/cdrom/papers/pdf/p317.pdf (accessed February 18, 2004).
14. Spink, A., Ozmutlu, S., Ozmutlu, H.C. and Jansen, B.J. (2002), "US versus European web searching trends", SIGIR Forum, Fall, available at: www.acm.org/sigir/forum/F2002/spink.pdf (accessed February 18, 2004).
15. Soboroff, I., Nicholas, C. and Cahan, P. (2001), "Ranking retrieval systems without relevance judgments", Proceedings of the 24th Annual International ACM SIGIR Conference, pp. 66-72.
16. Su, L.T., Chen, H.L. and Dong, X.Y. (1998), "Evaluation of web-based search engines from the end-user's perspective: a pilot study", Proceedings of the ASIS Annual Meeting, Vol. 35, pp. 348-61.
17. Sullivan, D. (2003a), Yahoo to Buy Overture, available at: http://searchenginewatch.com/searchday/article.php/2234821 (accessed October 4, 2004).
18. Sullivan, D. (2003b), Buying Your Way in: Search Engine Advertising Chart, available at: www.searchenginewatch.com/webmasters/article.php/2167941 (accessed February 18, 2004).
19. Sullivan, D. (2003c), Florida Google Dance Resources, available at: www.searchenginewatch.com/searchday/article.php/3285661 (accessed February 18, 2004).
20. Sullivan, D. and Sherman, C. (2004), The 4th Annual Search Engine Watch 2003 Awards, available at: www.searchenginewatch.com/awards/article.php/3309841 (accessed February 18, 2004).
21. Vaughan, L. (2004), "New measurements for search engine evaluation proposed and tested", Information Processing and Management, Vol. 40, pp. 677-91.
22. Voorhees, E.M. (2000), "Variations in relevance judgments and the measurement of retrieval effectiveness", Information Processing and Management, Vol. 36, pp. 697-716.