A comparison of methods for collecting web citation data for academic organizations

Journal of the American Society for Information Science and Technology

Volumn 62, Issue 8, 2011, Pages 1488-1497

  Thelwall, Mike ^a   Sud, Pardeep ^a  

^a UNIVERSITY OF WOLVERHAMPTON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALTERNATIVE METHODS; COMPARISON OF METHODS; HIT COUNT; LIBRARY AND INFORMATION SCIENCE; LINK COUNT; WEB CITATIONS;

SEARCH ENGINES; USER INTERFACES;

INFORMATION RETRIEVAL;

EID: 79960307044     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.21571     Document Type: Article

References (72)

1. Aguillo, I.F., (2009). Measuring the institution's footprint in the web. Library Hi Tech, 27 (4), 540-556.
2. Aguillo, I.F., Granadino, B., Ortega, J.L., &, Prieto, J.A., (2006). Scientific research activity and communication measured with cybermetrics indicators. Journal of the American Society for Information Science and Technology, 57 (10), 1296-1302. (Pubitemid 44187269)
3. An, L., &, Qiu, J.P., (2004). Research on the relationships between Chinese journal impact factors and external web link counts and web impact factors. Journal of Academic Librarianship, 30 (3), 199-204. (Pubitemid 38726448)
4. Bar-Ilan, J., (1999). Search engine results over time-a case study on search engine stability. Cybermetrics. Retrieved from
5. Bar-Ilan, J., (2001). Data collection methods on the web for informetric purposes-A review and analysis. Scientometrics, 50 (1), 7-32. (Pubitemid 33594952)
6. Bar-Ilan, J., (2005). What do we know about links and linking? A framework for studying links in academic environments. Information Processing & Management, 41 (4), 973-986. (Pubitemid 40049188)
7. Bar-Ilan, J., &, Peritz, B.C., (2008). The lifespan of 'informetrics' on the web: An eight year study (1998-2006). Scientometrics, 79 (1), 7-25.
8. Bar-Ilan, J., &, Peritz, B.C., (2009). A method for measuring the evolution of a topic on the web: The case of "Informetrics." Journal of the American Society for Information Science and Technology, 60 (9), 1730-1740.
9. Barjak, F., Li, X., &, Thelwall, M., (2007). Which factors explain the web impact of scientists' personal home pages ? Journal of the American Society for Information Science and Technology, 58 (2), 200-211. (Pubitemid 46134071)
10. Barjak, F., &, Thelwall, M., (2008). A statistical analysis of the web presences of European life sciences research teams. Journal of the American Society for Information Science and Technology, 59 (4), 628-643. (Pubitemid 351310583)
11. BBC. (2009). Profiles: Yahoo!, Google and Microsoft. BBC News, Retrieved from
12. Björneborn, L., &, Ingwersen, P., (2004). Toward a basic framework for webometrics. Journal of the American Society for Information Science and Technology, 55 (14), 1216-1227.
13. Bornmann, L., &, Daniel, H.-D., (2006). Selecting scientific excellence through committee peer review-A citation analysis of publications previously published to approval or rejection of post-doctoral research fellowship applicants. Scientometrics, 68 (3), 427-440. (Pubitemid 44127033)
14. Bornmann, L., &, Daniel, H.-D., (2008). What do citation counts measure? A review of studies on citing behavior. Journal of Documentation, 64 (1), 45-80.
15. Brin, S., &, Page, L., (1998). The anatomy of a large scale hypertextual web search engine. Computer Networks and ISDN Systems, 30 (1-7), 107-117.
16. Chen, C., Newman, J., Newman, R., &, Rada, R., (1998). How did university departments interweave the web: A study of connectivity and underlying factors. Interacting With Computers, 10 (4), 353-373. (Pubitemid 128638284)
17. Cothey, V., (2004). Web-crawling reliability. Journal of the American Society for Information Science and Technology, 55 (14), 1228-1238.
18. Cronin, B., (2001). Bibliometrics and beyond: Some thoughts on web-based citation analysis. Journal of Information Science, 27 (1), 1-7. (Pubitemid 32251890)
19. Cronin, B., &, Shaw, D., (2002). Banking (on) different forms of symbolic capital. Journal of the American Society for the Information Science, 53 (13), 1267-1270.
20. Cronin, B., Snyder, H.W., Rosenbaum, H., Martinson, A., &, Callahan, E., (1998). Invoked on the web. Journal of the American Society for Information Science, 49 (14), 1319-1328. (Pubitemid 128702685)
21. Garfield, E., (2005). The agony and the ecstasy: The history and the meaning of the journal impact factor. Fifth International Congress on Peer Review in Biomedical Publication, in Chicago, IL, USA, Retrieved from
22. Gingras, Y., &, Wallace, M.L., (2010). Why it has become more difficult to predict Nobel Prize winners: A bibliometric analysis of nominees and winners of the chemistry and physics prizes (1901-2007) Scientometrics, 82 (2), 401-412.
23. Gomes, B., &, Smith, B.T., (2003). Detecting query-specific duplicate documents. United States Patent 6,615,209, Retrieved from
24. Google (2011). JSON/Atom Custom Search API, Retrieved from
25. Ingwersen, P., (1998). The calculation of web Impact Factors. Journal of Documentation, 54 (2), 236-243.
26. Kousha, K., &, Thelwall, M., (2006). Motivations for URL citations to open access library and information science articles Scientometrics, 68 (3), 501-517.
27. Kousha, K., &, Thelwall, M., (2007a). Google Scholar citations and Google Web/URL citations: A multi-discipline exploratory analysis. Journal of the American Society for Information Science and Technology, 58 (7), 1055-1065. (Pubitemid 46826219)
28. Kousha, K., &, Thelwall, M., (2007b). How is science cited on the web? A classification of Google unique web citations. Journal of the American Society for Information Science and Technology, 58 (11), 1631-1644. (Pubitemid 47397665)
29. Kousha, K., &, Thelwall, M., (2008). Assessing the impact of disciplinary research on teaching: An automatic analysis of online syllabuses. Journal of the American Society for Information Science and Technology, 59 (13), 2060-2069.
30. Kousha, K., &, Thelwall, M., (2009). Google Book Search: Citation analysis for social science and the humanities. Journal of the American Society for Information Science and Technology, 60 (8), 1537-1549.
31. Kousha, K., Thelwall, M., &, Rezaie, S., (2010). Using the web for research evaluation: The Integrated Online Impact indicator. Journal of Informetrics, 4 (1), 124-135.
32. Lawrence, S., &, Giles, C.L., (1999). Accessibility of information on the web. Nature, 400 (6740), 107-109. (Pubitemid 29327520)
33. Lewandowski, D., Wahlig, H., &, Meyer-Bautor, G., (2006). The freshness of web search engine databases. Journal of Information Science, 32 (2), 131-148. (Pubitemid 43384492)
34. Li, X., Thelwall, M., Wilkinson, D., &, Musgrove, P.B., (2005a). National and international university departmental web site interlinking. Part 1: Validation of departmental link analysis. Scientometrics, 64 (2), 151-185. (Pubitemid 40936934)
35. Li, X., Thelwall, M., Wilkinson, D., &, Musgrove, P.B., (2005b). National and international university departmental web site interlinking. Part 2: Link patterns. Scientometrics, 64 (2), 187-208. (Pubitemid 40936935)
36. MacRoberts, M.H., &, MacRoberts, B.R., (1996). Problems of citation analysis. Scientometrics, 36 (3), 435-444. (Pubitemid 126449893)
37. McCowan, F., &, Nelson, M.L., (2007). Agreeing to disagree: Search engines and their public interfaces. Joint Conference on Digital Libraries, Retrieved from
38. Meho, L.I., &, Sonnenwald, D.H., (2000). Citation ranking versus peer evaluation of senior faculty research performance: A case study of Kurdish scholarship. Journal of American Society for Information Science, 51 (2), 123-138. (Pubitemid 30527158)
39. Merton, R.K., (1973). The sociology of science. Theoretical and empirical investigations. Chicago: University of Chicago Press.
40. Mettrop, W., &, Nieuwenhuysen, P., (2001). Internet search engines-fluctuations in document accessibility. Journal of Documentation, 57 (5), 623-651.
41. Moed, H.F., (2005). Citation analysis in research evaluation. New York: Springer.
42. Oppenheim, C., (1995). The correlation between citation counts and the 1992 Research Assessment Exercise ratings for British library and information science universtiy departments. Journal of Documentation, 51, 18-27.
43. Oppenheim, C., (1997). The correlation between citation counts and the 1992 Research Assessment Exercise ratings for British research in Genetics, Antomy and Archaeology. Journal of Documentation, 53, 477-487.
44. Qiu, J.P., Chen, J.Q., &, Wang, Z., (2004). An analysis of backlink counts and web Impact Factors for Chinese university websites. Scientometrics, 60 (3), 463-473. (Pubitemid 38926353)
45. Rousseau, R., (1999). Daily time series of common single word searches in AltaVista and NorthernLight. Cybermetrics, 2 / 3, Retrieved from
46. Seglen, P.O., (1998). Citation rates and journal impact factors are not suitable for evaluation of research. ACTA Orthopaedica Scandinavica, 69 (3), 224-229. (Pubitemid 28369466)
47. Seidman, E., (2007). We are flattered, but... Bing Community, Retrieved from
48. Smith, A.G., (1999). A tale of two web spaces; comparing sites using web Impact Factors. Journal of Documentation, 55 (5), 577-592.
49. Smith, A., &, Eysenck, M., (2002). The correlation between RAE ratings and citation counts in psychology. Retrieved from
50. Stuart, D., &, Thelwall, M., (2006). Investigating triple helix relationships using URL citations: A case study of the UK West Midlands automobile industry. Research Evaluation, 15 (2), 97-106. (Pubitemid 44671372)
51. Thelwall, M., (2002a). Conceptualizing documentation on the web: An evaluation of different heuristic-based models for counting links between university web sites. Journal of American Society for Information Science and Technology, 53 (12), 995-1005.
52. Thelwall, M., (2002b). The top 100 linked pages on UK university web sites: high inlink counts are not usually directly associated with quality scholarly content. Journal of Information Science, 28 (6), 485-493.
53. Thelwall, M., (2004). Methods for reporting on the targets of links from national systems of university web sites. Information Processing & Management, 40 (1), 125-144.
54. Thelwall, M., (2008a). Extracting accurate and complete results from search engines: Case study Windows Live. Journal of the American Society for Information Science and Technology, 59 (1), 38-50.
55. Thelwall, M., (2008b). Quantitative comparisons of search engine results. Journal of the American Society for Information Science and Technology, 59 (11), 1702-1710.
56. Thelwall, M., (2011, in press). A comparison of link and URL citation counting. ASLIB Proceedings, Retrieved from
57. Thelwall, M., &, Harries, G., (2004). Do the web sites of higher rated scholars have significantly more online impact ? Journal of the American Society for Information Science and Technology, 55 (2), 149-159.
58. Thelwall, M., &, Kousha, K., (2008). Online presentations as a source of scientific impact?: An analysis of PowerPoint files citing academic journals. Journal of the American Society for Information Science and Technology, 59 (5), 805-815. (Pubitemid 351456559)
59. Thelwall, M., &, Zuccala, A., (2008). A university-centred European Union link analysis. Scientometrics, 75 (3), 407-420.
60. Uyar, A., (2009a). Google stemming mechanisms. Journal of Information Science, 35 (5), 499-514.
61. Uyar, A., (2009b). Investigation of the accuracy of search engine hit counts. Journal of Information Science, 35 (4), 469-480.
62. van Raan, A.F.J., (2000). The Pandora's box of citation analysis: Measuring scientific excellence-The last evil? In, B. Cronin, &, H.B. Atkins, (Eds.), The Web of knowledge: A festschrift in honor of Eugene Garfield (pp. 301-319). Medford, NJ: Information Today, ASIS Monograph Series.
63. Vaughan, L., (2005). Exploring website features for business information. Scientometrics, 61 (3), 467-477.
64. Vaughan, L., &, Hysen, K., (2002). Relationship between links to journal web sites and impact factors. ASLIB Proceedings, 54 (6), 356-361.
65. Vaughan, L., &, Shaw, D., (2003). Bibliographic and web citations: What is the difference ? Journal of the American Society for Information Science and Technology, 54 (14), 1313-1322.
66. Vaughan, L., &, Shaw, D., (2005). Web citation data for impact assessment: A comparison of four science disciplines. Journal of the American Society for Information Science & Technology, 56 (10), 1075-1087. (Pubitemid 41205800)
67. Vaughan, L., &, Wu, G., (2004). Links to commercial websites as a source of business information. Scientometrics, 60 (3), 487-496. (Pubitemid 38926355)
68. Vaughan, L., &, You, J., (2010). Word co-occurrences on webpages as a measure of the relatedness of organizations: A new webometrics concept. Journal of Informetrics, 4 (4), 483-491.
69. Wilkinson, D., Harries, G., Thelwall, M., &, Price, E., (2003). Motivations for academic web site interlinking: Evidence for the web as a novel source of information on informal scholarly communication. Journal of Information Science, 29 (1), 49-56.
70. Yahoo! (2011a). When will the change happen? How long will the transition take? Retrieved from
71. Yahoo! (2011b). Web Search APIs from Yahoo! Search. Retrieved from
72. Zuccala, A., Thelwall, M., Oppenheim, C., &, Dhiensa, R., (2007). Web intelligence analyses of digital libraries: A case study of the National electronic Library for Health (NeLH). Journal of Documentation, 64 (3), 558-589.