Relevance ranking on Google: Are top ranked results really considered more relevant by the users?

Online Information Review

Volumn 35, Issue 4, 2011, Pages 598-610

  Hariri, Nadjla ^a  

^a ISLAMIC AZAD UNIVERSITY   (Iran)

Author keywords

PageRank; Relevance ranking; Result pages; Search engines, Google; User interfaces

Indexed keywords

MACHINE DESIGN; SEARCH ENGINES;

DESIGN/METHODOLOGY/APPROACH; GOOGLE; PAGERANK; RELEVANCE RANKING; RELEVANT DOCUMENTS; RESULT PAGES; RETRIEVED DOCUMENTS; SEARCH SESSIONS;

USER INTERFACES;

EID: 84993077902     PISSN: 14684527     EISSN: None     Source Type: Journal    
DOI: 10.1108/14684521111161954     Document Type: Article

References (21)

1. Agrahri, A.K., Manickam, D.A.T. and Riedl, J. (2008), “Can people collaborate to improve the relevance of search results?”, Proceedings of the 2008 ACM Conference on Recommender Systems, Lausanne, ACM Press, New York, NY, pp. 283-6.
2. Bade, D. (2007), “Relevance ranking is not relevance ranking or, when the user is not the user, the search results are not search results”, Online Information Review, Vol. 31 No. 6, pp. 831-44.
3. Bar-Ilan, J., Mat-Hassan, M. and Levene, M. (2006a), “Methods for comparing rankings of search engine results”, Computer Networks, Vol. 50 No. 10, pp. 1448-63.
4. Bar-Ilan, J., Levene, M. and Mat-Hassan, M. (2006b), “Methods for evaluating dynamic changes in search engine rankings: a case study”, Journal of Documentation, Vol. 62 No. 6, pp. 708-29.
5. Bar-Ilan, J., Keenoy, K., Yaari, E. and Levene, M. (2007), “User rankings of search engine results”, Journal of the American Society for Information Science and Technology, Vol. 58 No. 9, pp. 1254-66.
6. Chowdhury, A. and Soboroff, I. (2002), “Automatic evaluation of world wide web search services”, Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Tampere, Finland, ACM Press, New York, NY, pp. 421-2.
7. comScore (2010), “comScore reports global search market growth of 46 per cent in 2009”, available at: www.comscore.com/Press_Events/Press_Releases/2010/1/Global_Search_Market_Grows_46_Per cent_in_2009 (accessed 19 April 2011).
8. Google (2010), “About Google, corporate information, technology overview”, available at: www.google.com/intl/en/corporate/tech.html (accessed 4 September 2010).
9. Hariri, N. (2008), “An investigation on effectiveness of the ‘similar pages’ feature of Google”, Online Information Review, Vol. 32 No. 3, pp. 370-8.
10. Hawking, D., Craswell, N., Thistlewaite, P. and Harman, D. (1999), “Results and challenges in web search evaluation”, Computer Networks, Vol. 31 Nos 11-16, pp. 1321-30.
11. Jansen, B.J. and Spink, A. (2005), “An analysis of web searching by European Allthe Web.com users”, Information Processing and Management, Vol. 41, pp. 361-81.
12. Jesdanun, A. (2008), “Google takes lead as most popular US site. Search giant edges past Yahoo! for having most unique visitors in April”, Associated Press, available at: www.msnbc.msn.com/id/24624874/ (accessed 19 April 2011).
13. Meadow, C.T., Boyce, B.R., Kraft, D.H. and Barry, C. (2007), Text Information Retrieval Systems, Academic Press, London.
14. Nowicki, S.A. (2002), “Students' success with worldwide web search engines: retrieving relevant results with respect to end-user relevance judgments”, PhD thesis, Nova Southeastern University, Fort Lauderdale, FL.
15. Patil, S., Alpert, S.R., Karat, J. and Wolf, C. (2005), in Costabile, M.F. and Paternò, F. (Eds), “THAT's what I was looking for: comparing user-rated relevance with search engine rankings”, Human-Computer Interaction, Proceedings of the INTERACT 2005 International Conference Proceedings, Lecture Notes in Computer Science, Vol. 3855, Springer, Berlin, pp. 117-29.
16. Sherman, C. (2005), “A new f-word for Google search results”, available at: http://searchenginewatch.com/3488076 (accessed 19 April 2011).
17. Silverstein, C., Henzinger, M., Marais, H. and Moricz, M. (1999), “Analysis of a very large web search engine query log”, ACM SIGIR Forum, available at: www.acm.org/sigir/forum/F99/Silverstein.pdf (accessed 20 April 2011).
18. Singhal, A. and Kaszkiel, M. (2001), “A case study in web search using TREC algorithms”, Proceedings of the 10th International Worldwide Web Conference, May, available at: www10.org/cdrom/papers/pdf/p317.pdf (accessed 20 April 2011).
19. Spink, A., Ozmutlu, S., Ozmutlu, H.C. and Jansen, B.J. (2002), “US versus European web searching trends”, SIGIR Forum, Vol. 36 No. 2, pp. 32-8, available at: www.acm.org/sigir/forum/F2002/spink.pdf (accessed 3 November 2008).
20. Vaughan, L. (2004), “New measurements for search engine evaluation proposed and tested”, Information Processing and Management, Vol. 40 No. 4, pp. 677-91.
21. Veronis, J. (2006), “A comparative study of six search engines”, available at: www.up.univ-mrs.fr/veronis/pdf/2006-comparative-study.pdf (accessed 20 April 2011).