Expectations versus reality - Search engine features needed for Web research at mid 2005

Cybermetrics

Volumn 9, Issue 1, 2005, Pages

  Bar Ilan, Judit ^a  

^a BAR ILAN UNIVERSITY   (Israel)

Author keywords

Google; MSN search; Search engines; Webometrics; Yahoo Search

Indexed keywords

EID: 28244488229     PISSN: 11375019     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (85)

1. Albert, R., Jeong, H., & Barabasi, A. L. (1999). The diameter of the World Wide Web. Nature, 401, 130-131.
2. AlltheWeb (2003). Query language. 〈http://web.archive.org/web/ 20031002014314/http:// www.alltheweb.com/help/fags/query_language〉 (archived October 2, 2003, accessed September 2, 2005)
3. AltaVista (2002). Searching Web elements. 〈http://web.archive.org/ web/20010413160155/ doc.altavista.com/help/search/search_web_elements.html〉 (archived October 4, 2001, accessed September 2, 2002)
4. Ambrogi, R. J. (1995). Legal research on the Internet. A primer. 〈http://www.legal.com/column10.htm〉 (accessed September 1, 2005)
5. Bar-Ilan, J. (2000). Evaluating the stability of the search tools HotBot and Snap: A case study. Online Information Review, 24(6), 439-449.
6. Bar-Ilan, J. (2002). How Much Information Search Engines Disclose on the Links to a Web Page? - A Longitudinal Case Study of the 'Cybermetrics' Home Page. Journal of Information Science, 28(6).
7. Bar-Ilan, J. (no date). Web links and search engine ranking - The case of Google and the query "Jew". To appear in the Journal of the American Society for Information Science and Technology.
8. Bar-Ilan, J. (2002a). Methods for Measuring Search Engine Performance over Time. Journal of the American Society for Information Science and Technology., 54(3), 308-319, 2002.
9. Bar-Ilan, J. (2002b). How Much Information Search Engines Disclose on the Links to a Web Page? - A Longitudinal Case Study of the 'Cybermetrics' Home Page. Journal of Information Science, 28(6) 455-466.
10. Bar-Ilan, J. (2005). What do we know about links and linking? A framework for studying links in academic environments. Information Processing and Management, 41(4), 973-986.
11. Bar-Ilan, J. (2005b). Expectations versus reality - Web search engines at the beginning of 2005. In Proceedings of the 10th International Conference of the International Society for Scientometrics and Informetrics, 87-96.
12. Bar-Ilan, J., & Gutman, T. (2005). How do search engines respond to some non-English queries. Journal of Information Science, 31(1), 13-28.
13. Bar-Ilan, J., Levene, M., & Mat-Hassan, M. (2004). Dynamics of search engine rankings - A case study. In Proceedings of the 3rd International Workshop on Web Dynamics, New-York, May 2004. 〈http://www.dcs.bbk.ac.uk/ webDyn3/webdyn3_proceedings.pdf〉 (accessed August 31, 2005)
14. Bar-Ilan, J., Mat-Hassan, M., & Levene, M. (no date). Methods for comparing rankings of search engine results. To appear in Communication Networks. Preliminary version 〈http://arxiv.org/abs/cs.IR/0505039〉 (accessed September 1, 2005)
15. Bharat, K., & Broder, A. (1998). A technique for measuring the relative size and overlap of public Web search engines. In Proceedings of the 7th International World Wide Web Conference, April 1998, 〈http://www.ra. ethz.ch/CDstore/www7/1937/com1937.htm〉 (accessed September 1, 2005)
16. Brewington, B. E., & Cybenko, G. (2000). Keeping up with the changing Web. Computer, 33(5), 52-58.
17. Brin, S., & Page, L. (1998). The anatomy of a large-scale hypertextual Web search engine. In Proceedings of the 7th International World Wide Web Conference, April 1998. 〈http://www-db.stanford.edu/pub/papers/ google.pdf〉 (accessed September 1, 2005)
18. Broder, A., Kumar, R., Maghoul, F., Raghavan, P., Rajagopalan, S., Stata, R., Tomlins, A. & Wiener, J. (2000). Graph structure in the Web. In Proceedings of the 9th International World Wide Web Conference, May 2000. 〈http:www9.org/w9cdrom/160.html〉 (accessed September 1, 2005)
19. Callishain, T. (2004). Yahoo's groovy linkdomain syntax. ResearchBuzz. 〈http://www.researchbuzz.org/yahoos_groovy_linkdomain syntax.shtml〉 (updated May 26, 2004, accessed September 2, 2005)
20. Cheney, M. & Perry, M. (2005a). A comparison of the Yahoo and Google indices. 〈http://vburton.ncsa.uiuc.edu/oldstudy.html〉 (updated 16 August, 2005, accessed 29 August, 2005)
21. Cheney, M. & Perry, M. (2005b). A comparison of the Yahoo and Google indices. 〈http://vburton.ncsa.uiuc.edu/indexsizepage.html〉 (accessed 29 August, 2005)
22. com Score (2005). comScore reports July 2005 search engine rankings. 〈http://www.comscore.com/press/release.asp?press=622〉 (updated on 19 August 2005, accessed on 27 August, 2005).
23. Cyber Atlas (2000). Web pages by language. 〈http://www.clickz.com/ stats/sectors/demographics/ article.php/408521〉 (updated on 5 July, 2000, accessed on 27 August, 2005)
24. Dogpile (2005). Different engines, different results. 〈http://comparesearchengines.dogpile.com/ OverlapAnalysis.pdf〉 (accessed September 1, 2005)
25. Duffez, O. (2005). Google indexes more than 101 K per document. Search Engine News. 〈http://www.prweaver.com/blog/2005/04/07/170-google -indexes-more-than-101k-per-document〉 (updated April 7, 2005, accessed August 29, 2005)
26. Faba-Perez, C., Guerrero-Bote, V. P., & De Moya-Anegon, F. (2003). Data mining in a closed Web environment. Scientometrics, 58(3), 623-640.
27. Fagin, R., Kumar, R. and Sivakumar, D. (2003). Comparing top k lists. SIAM Journal on Discrete Mathematics, 17(1), 134-160.
28. Fetterly, D., Manasse, M., Najork, M., & Wiener, J. (2004). A large-scale study of the evolution of Web pages. Software: Practice and Experience, 34(2), 213-237.
29. French, G. (2004). Tool compares Google and Yahoo algorithms. 〈http://www.webpronews.com/insiderreports/searchinsider/ wpn-49-20040312ToolCompareGoogleAndYahooAlgorithms.html〉 (updated March 12, 2004, accessed August 30, 2005)
30. Global Reach. (2004). Global Internet statistics (by language). 〈http://www.global-reach.biz/globstats/〉 (updated on 30 March, 2004, accessed on 27 August, 2005)
31. Google (2004). Google help: Cheat sheet. 〈http://web.archive.org/ web/20041128004753/http://www. google.com/help/cheatsheet.html〉 (archived November 28, 2004, accessed September 1, 2005)
32. Google (2005a). Information for Webmasters. 〈http://www.google.com/ webmasters/4.html〉 (accessed August 29, 2005)
33. Google (2005b). The basics of Google search. 〈http://www.google.com/ intl/en/help/basics.html〉 (accessed August 29, 2005)
34. Google (2005c). Google Help: Cheat sheet. 〈http://www.google.com/ help/cheatsheet.html〉 (accessed September 1, 2005)
35. Google (2005d). Advanced search made easy. 〈http://www.google.com/ intl/en/help/refinesearch.html〉 (accessed September 1, 2005)
36. Google (2005e). Google Web APIs (beta). 〈http://www.google.com/apis/ reference.html〉 (accessed Spetember 1, 2005)
37. Guggenheim, E., & Bar-Ilan, J. (2005). Tauglichkeit von Suchmaschinen für deutschesprachige Abfragen. Information, Wissenschaft und Praxis, 56(1), 35-40.
38. Huberman, B. A., & Adamic, L. A., (1999). Growth dynamics of the World Wide Web. Nature, 401, 131.
39. Ingwersen, P. (1998). The calculation of Web Impact Factors. Journal of Documentation, 54(2), 236-243.
40. Introna, L. D., & Nissenbaum, H. (2000). Shaping the Web: Why the politics of search engines matters. The Information Society, 16, 169-180.
41. Janes, J. W. (2004). LIS 598. Google. 〈http://www.ischool. washington.edu/jwj/google/〉 (accessed September 1, 2005)
42. Jansen, B. J., Spink, A., & Saracevic, T. (2000). Real life, real users and real needs: A study and analysis of user queries on the Web. Information Processing and Management, 36, 207-227.
43. Kleinberg, J. M. (1998). Authoritative sources in a hyperlinked environment. Journal of the ACM, 46(5), 604-632, 1999.
44. Kumar, R., Novak, J., Raghavan, P., & Tomkins, A. (2003). On the bursty evolution of Blogspace, In Proceedings of the 12th International World Wide Web Conference, (pp. 568-576). 〈http://www2003.org/cdrom/papers/ refereed/p477/ 477-kumar/p477-kumar.htm〉 (accessed September 1, 2005)
45. Kumar, S. R., Raghavan, P., Rajagopalan, S., & Tomkins, A. (1999). Trawling emerging cyber-communities automatically. In Proceedings of the 8th International World Wide Web Conference, May 1999. 〈http://www8.org/w8- papers/4a-search-mining/trawling/trawling.html〉 (accessed September 1, 2005)
46. Lawrence, S., & Giles, C. L. (1998). Searching the World Wide Web. Science, 280 (5360), 98-100.
47. Lawrence, S., & Giles, C. L. (1999). Accessibility of information on the Web. Nature, 400, 107-109.
48. Mettrop, W., & Nieuwenhuysen, P. (2001). Internet search engines - fluctuations in document accessibility. Journal of Documentation, 57(5), 623-651.
49. MSN (2005). Search builder and advanced search options. 〈http://search.msn.com/docs/help.aspx? =SEARCH_REF_AdvSrchOperators. htm〉 (accessed September 1, 2005)
50. MSN (2005b). New operators explained. MSN Search's Weblog. 〈http://blogs.msdn.com/msnsearch/archive/2005/ 06/24/432439_aspx〉 (updated June 24, 2005, accessed September 2, 2005)
51. Notess, G. (2000). Search engine inconsistencies, online (March 2000). 〈http://www.onlinemag.net/OL2000/net3.html〉 (accessed September 1, 2005)
52. Notess, G. (2005). Yahoo! Review on Search Engine Showdown. Search Engine Showdown. 〈http://www.searchengineshowdown.com/features/ yahoo/review.html〉 (updated April 25, 2005, accessed August 29, 2005).
53. Notess, G. (2005b). Long word showdown. Search Engine Showdown. 〈http://www.searchengineshowdown.com/stats/ longwords.shtml〉 (updated March 5, 2005, accessed September 2, 2005).
54. Olsen, S. (2001). AltaVista serving up out-of-date listings. 〈http://news.com.com/2100-1023-274839.html?legacy=cnet〉 (accessed September 1, 2005)
55. Oxford Dictionary (1989). Reliability. 〈http://disciplinary.oed.com/ cgi/entry/50202002?query_type= word&queryword=reliability&first= 1&max_to_show=10&single= 1&sort_type=alpha〉 (accessible through subscription, accessed January 15, 2005).
56. Price, G. (2005). More on the total database size battle and Googlewhacking with Yahoo. Searchenginewatch. 〈http://blog. searchenginewatch.com/blog/050811-231448〉 (updated 11 August, 2005, accessed 28 August, 2005).
57. Rousseau, R. (1999). Daily time series of common single word searches in AltaVista and NorthernLight. Cybermetrics, 2/3(1), paper 2. 〈http://www. cindoc.csic.es/cybermatics/articles/v2i1p2.html〉 (accessed September 1, 2005)
58. Shim, R., & Kanellos, M. (2004). Google downed by latest MyDoom. Retrieved January 13, 2005, from 〈http://news.zdnet.co.uk/internet/0. 39020369.39161678.00.htm〉 (accessed September 1, 2005)
59. Searchenginewatch Forum (2004). Google say not reporting all backlinks. 〈http://forums.searchenginewatch.com/showthread.php? t=2423&page= 2&pp=20〉 (updated November 18, 2005, accessed August 29, 2005)
60. Searchenginewatch Forum (2005). Ridiculous increase in Yahoo backlink counts & is bigger index real? 〈http://forums.searchenginewatch.com/ showthread.php? threadid=7195〉 (updated August 4, 2005, accessed August 29, 2005)
61. SEMPO (2004). Summary report: The state of search engine marketing 2004. 〈http://www.sempo.org/research/SEMPO-Market-Sizing-200-SUMMARY-v1. pdf〉 (accessed September 1, 2005)
62. Smith, Alastair (1999). ANZAC webometrics: exploring Australasian Web structures. In Proceedings of Information Online and On Disc 99: Strategies for the next millennium. Sydney, Australia, 19-21 January 1999 [Sydney]:ALIA, 1999. Pp 159-181. 〈http://www.csu.edu.au/special/online99/proceedings99/ 203b.htm〉 (accessed August 30, 2005).
63. Snyder, H. & Rosenbaum , H. (1999). Can search engines be used as tools for web-link analysis? A critical view. Journal of Documentation, 55, 375-384.
64. Spink, A., & Jansen, B. J. (2004). Web search: Public searching the Web. London: Springer.
65. Statistical Cybermetrics Research Group (2004 a). SocSciBot3. 〈http://cybermetrics.wlv.ac.uk/database〉 (accessed September 1,2005)
66. Statistical Cybermetrics Research Group (2004b). The academic weblink database project. 〈http://cybermetrics.wlv.ac.uk/database/〉 (accessed September 1, 2005)
67. Sullivan, D. (1998). Northern Light add search functions, freshens index. 〈http://searchenginewatch.com/sereport/article.php/2166471〉 (accessed September 1, 2005)
68. Sullivan, D. (2004a). Major search engines and directories. 〈http://searchenginewatch.com.links/article.php/2156221〉 (accessed September 1, 2005)
69. Sullivan, D. (2005). Search engine sizes. Searchenginewatch. 〈http://searchenginewatch.com/reports/article.php/2156481〉 (updated 28 January, 2005 , accessed August 28, 2005).
70. Sullivan, D. (2004c). Yahoo reawakens the paid inclusion debate. Searchenginewatch. 〈http:searchenginewatch.com/searchday/article.php/ 3355221〉 (accessed September 1, 2005)
71. Sullivan, D. (2004d). Search engine size wars V erupts. Searchenginewatch. 〈http://blog.searchenginewatch.com/blog/041111- 084221〉 (updated November 11, 2004, accessed August 29, 2005)
72. Thelwall, M. (2000a). Web impact factors and search engine coverage. Journal of Documentation, 56, 185-189.
73. Thelwall, M. (2001). A web crawler design for data mining, Journal of Information Science 27(5), 319-325.
74. Thelwall, M. (2001 b). The responsiveness of search engine indexes. Cybermetrics, 5(1), paper 1. 〈http://www.cindoc.csic.es/cybermetrics/ articles/v5i1p1.html〉 (accessed September 1, 2005)
75. Thelwall, M. (2003). What is this link doing here? Beginning a fine-grained process of identifying reasons for academic hyperlink creation. Information Research, 8(3). 〈http://informationr.net/ir/8-3/paper151. html〉 (accessed September 1, 2005)
76. Thelwall, M. (2005). Link analysis: An information science approach. San Diego: Academic Press.
77. Vaughan, L. (2004). New measurements for search engine evaluation proposed and tested. Information Processing and Management, 40 (4), 677-691.
78. Van Couvering, E. (2004). New media? The political economy of Internet search engines. Paper presented at the Annual Conference of the International Association of Media & Communications Researchers, Porto Alegre, Brazil. 〈http://personal.lse.ac.uk/vancouve/IAMCR-CTP SearchEnginePolitical_Economy_EVC_2004-07-4.pdfhttp://personal.lse.ac.uk/ vancouve/IAMCR-CTP SearchEnginePoliticalEconomy_EVC_2004-07-14.pdf〉 (accessed September 3, 2005)
79. Veronis, J. (2005a). Google's missing pages. Mystery solved? Technologies du Langage. 〈http://aixtal.blogspot.com/2005/02 web-googles-missing-pages- mystery.html〉 (updated February 8, 2005, accessed October 17, 2005)
80. Veronis, J. (2005b). Google: A snapshot of the update. Technologies du Langage. 〈http://aixtal.blogspot.com/2005/03/google-snapshot of-update.html〉 (updated March 25, 2005, accessed October 17, 2005)
81. Whatis.com (2002). Googling. 〈http://searchwebservices.techtarget. com/sDefinition/ sid26_gci799367.00.html〉 (updated March 9, 2002, accessed September 1, 2005)
82. Wikipedia (2005). Google bomb. 〈http://en.wikipedia.org/wiki/ Googlebomb〉 (updated August 29, 2005, accessed September 1, 2005)
83. Wouters, J. J. (2004). Searching for disclosure: How search engines alert consumers to the presence of advertising in search results. 〈http://www.consumerwebwatch.org/news/paidsearch finalreport.pdf〉 (accessed September 1, 2005)
84. WWW10 Panel (2001). Search: Beyond the keyword interface. At The 10th International World Wide Web Conference, Hong-Kong, May 2000. Outline. 〈http://www10.org/program/w10-panel.shtml〉 (accessed September 1, 2005)
85. Yahoo (2005). Help: Using meta search words to find specific URLs, sub-pages, link popularity and more. 〈http://help.yahoo.com/help/us/ ysearch/tips/tips-08.html〉 (accessed 29 August, 2005).