Web indicators - A new generation of S&T indicators?

Cybermetrics

Volumn 10, Issue 1, 2006, Pages

  Scharnhorst, Andrea ^a   Wouters, Paul ^a  

^a ROYAL NETHERLANDS ACADEMY OF ARTS AND SCIENCES   (Netherlands)

Author keywords

Complex networks; Cybermetrics; e science; Self organization; Semiotics; STI indicators; Web indicators

Indexed keywords

EID: 33750571394     PISSN: 11375019     EISSN: 11375019     Source Type: Journal    
DOI: None     Document Type: Review

References (99)

1. (2003) European Report on Science & Technology Indicators : Towards a Knowledge-Based Economy 2003 〈http://cordis.europa.eu/indicators/ third_report.htm〉 (accessed 31 July 2006).
2. (2001) Future research domains at the frontiers of science and technology: on the road to the 6th FP, FP6 Strategic Planning Workshop, Brussels, 26-27 April 2001, REPORT on discussions held in PANEL 4: COMPUTING, 〈http://cordis.europa.eu/ist/fet/6fp-7.htm〉 (last modified 21 December 2004, accessed 29 July 2006).
3. (2004) Key Figures : Towards a European Research Area ; Science, Technology and Innovation 2003-2004 〈ftp://ftp.cordis.europa.eu/pub/ indicators/docs/ind_kf0304.pdf〉 (accessed 31 July 2006).
4. (2005) OECD Factbook : economic, environmental and social statistics/ Organisation for Economic Co-operation and Development 2005.
5. (2000) Science and Engineering Indicators 2000, 〈http://www.nsf.gov/ statistics/seind00/〉.
6. (2004) Science and Engineering Indicators 2004, 〈http://www.nsf.gov/ statistics/seind04/〉.
7. (1998) Science, Technology and Industry Outlook / Organisation for Economic Co-operation and Development 1998, Chapter 7: The Global Research Village: How Information and Communication Technologies affect the Science System, p. 189-238. 〈http://www.oecd.org/dataoecd/9/30/2754574.pdf〉 (accessed 31 July 2006).
8. Adamic, L. A. (1999), The Small World Web, in: S. Abiteboul, A.-M. Vercoustre (eds.), Research and Advanced Technology for Digital Libraries: Third European Conference, ECDL'99, Paris, France, September 1999. Proceedings LNCS 1696, Springer, Berlin/Heidelberg, 443-452.
9. Adamic, L. (2000), Zipf, Power-laws, and Pareto - a ranking tutorial. 〈 http://www.hpl.hp.com/research/idl/papers/ranking/〉 (last modified 10 April 2000, accessed 29 July 2006).
10. Almind, T. and P. Ingwersen (1997), Informetric Analyses on the World Wide Web: Methodological Approaches to "Webometrics", Journal of Documentation 53: 404-426.
11. Arzberger, P., P. Schröder, A. Beaulieu, G. Bowker, K. Casey, L. Laaksonen, D. Moorman, P. Uhlir, P. Wouters (2004), Science and Government: An International Framework to Promote Access to Data. Science 303(5665): 1777-1778.
12. Bak, P. (1996), How Nature Works: The Science of Self-Organised Criticality, Copernicus Press, New York.
13. Barabasi, A. L., H. Jeong, Z. Neda, E. Ravasz, A. Schubert, T. Vicsek (2002), Evolution of the social network of scientific collaborations., Physica A 311 (3-4): 590-614.
14. Bar-Ilan, J. and B. C. Peritz (2002), Informetric Theories and Methods for Exploring the Internet: An Analytical Survey of Recent Research Literature, Library Trends 50(3): 371-392.
15. Barjak, F. and N. Harabi (2003), Internet for R&D. Final Report of the SIBIS Project. 〈http://www.fhso.ch/pdf/unternehmer/sibis_final. pdf〉 (access 31 July 2006).
16. Bentley, R. A. and H. D. G. Maschner (2000), A Growing Network of Ideas, Fractals-Complex Geometry Patterns and Scaling in Nature and Society 8(3): 227-237.
17. Björneborn, L. (2004), Small-World Link Structures Across an Academic Web Space: a Library and Information Science Approach, PhD Thesis, Department of Information Studies, Copenhagen, Royal School of Library and Information Science, 〈http://www.db.dk/lb/#phd〉 (access 31 July 2006).
18. Björneborn, L. and P. Ingwersen (2001), Perspectives of Webometrics, Scientometrics 50(1): 65-82.
19. Bollen, K. A. (2001), Indicator: Methodology, in: N.J. Smelser and P.B. Baltes (eds.), International Encyclopedia of the Social and Behavioral Sciences, Elsevier Academic Press, Amsterdam, 7282-7287.
20. Bornholdt, S. and H.-G. Schuster (2002), Handbook of Graphs and Networks: From the Genome to the Internet, Wiley-VCH, Wein heim.
21. Boudourides, M. A., B. Sigrist, et al. (1999). Webometrics and the Self-Organization of the European Information Society 〈 http://hyperion.math.upatras.gr/webometrics/〉 (last accessed 29 July 2006)
22. Bray, T. (1996), Measuring the Web, Computer Networks and ISDN Systems, 28(7-11): 993-1005.
23. Broder, A., R. Kumar, F. Maghoul, P. Raghavan, S. Rajagopalan, R. Stata, A. Tomkins, J. Wiener (2000), Graph Structure in the Web, Journal of Computer Networks 33(1-6): 309-320.
24. Brunn, S. D. and M. Dodge (2001). "Mapping the 'Worlds' of the World Wide Web: (Re)Structuring Global Commerce Through Hyperlinks." American Behavioral Scientist 44(10): 1717-1739.
25. Callaway, D. S., M. E. J. Newman, S.H. Strogatz, D.J. Watts (2000), Network Robustness and Fragility: Percolation on Random Graphs, Physical Review Letters 85(25): 5468-5471.
26. Cothey, V. (2004), Web-Crawling Reliability, Journal of the American Society for Information Science and Technology 55(14): 1228-1238.
27. Cothey, V., I. Aguillo, N. Arroyo (2006), Operationalising "Websites": lexically, semantically or topologically?, Cybermetrics 10(1) 〈http://www.cindoc.csic.es/cybermetrics/articles/v10i1p4.pdf〉
28. Cozzens, S. E., P. Healey, A. Rip, J. Ziman (1990), The Research System in Transition, Kluwer, Dordrecht.
29. Cronin, B. (2001), Bibliometrics and Beyond: Some Thoughts on Web-Based Citation Analysis, Journal of Information Science 27(1): 1-7.
30. Day, M. (2005), Institutional Repositories and Research Assessment, 〈http://www.rdn.ac.uk/projects/eprints-uk/docs/studies/rae/raestudy. pdf〉 (access 31 July 2006).
31. Dobrov, G. M. (1970), Aktuelle Probleme der Wissenschaftsw issenschaft (in German). Akademie Verlag, Berlin.
32. Eco, U. (1976) A Theory of Semiotics, Indiana University Press, Bloomington.
33. Egghe, L. (2000), New Informetric Aspects of the Internet: Some Reflections -Many Problems, Journal of Information Science 26(5): 329-335.
34. Faloutsos, M., P. Faloutsos, C. Faloutsos (1999), On Power-Law Relationships of the Internet Topology, Comput. Commun. Rev. 29: 251.
35. Fetterly, D., M. Manasse, M. Najork, J. Wiener (2004), A large-scale study of the evolution of Web pages, Software Practise and Experience 34(2): 213-237.
36. Godin, B. (2004), The Who, What, Why and How of S&T Measurement, Project on the History and Sociology of S&T Statistics, Working Paper no. 26, 16 page, 〈http://www.csiic.ca/PDF/Godin_26_a.pdf〉
37. (Published also under the title: Pour une sociologie de la statistique sur la science et l'innovation, Le Banquet: revue politique 19(1): 159-170).
38. Goldstein, M. L., S. A. Morris, G.G. Yen (2004), A Group-Based Yule Model for Bipartite Author-Paper Networks, 〈http://arxiv.org/abs/condmat/ 0409205〉 (access 31 July 2006)
39. Goodrum, A. A., K. W. McCain, S. Lawrence, C.L. Giles (2001), Scholarly Publishing in the Internet Age: a Citation Analysis of Computer Science Literature, Information Processing & Management 37(5): 661-676.
40. Grupp, H. and U. Schmoch (1999), Patent Statistics in the Age of Globalisation: New Legal Procedures, New Analytical Methods, New Economic Interpretation, Research Policy 28: 377-396.
41. Harnad, S. (2001), The Self-Archiving Initiative, Nature 410(26 April): 1024-1025.
42. Harter, S. P. (1997), Scholarly Communication and the Digital Library: Problems and Issues, Journal of Digital Information 1(1): 〈http://jodi.ecs. soton.ac.uk/Articles/v01/101/Harter/〉.
43. Heimeriks, G. (2002), Development of Web-Indicators. Report. 〈http://www.eicstes.org/ElCSTES_PDF/Deliverables/ Development%20of%20Web%20Indicators.PDF〉
44. Heimeriks, G. and P. van den Besselaar (2006), Analyzing Hyperlinks Networks. The Meaning of Hyperlink Based Indicators of Knowledge Production, Cybermetrics 10(1), 〈http://www.cindoc.csic.es/cybermetrics/articles/ v10i1p1.pdf〉
45. Heimeriks, G., (2005), Knowledge Production and Communication in the Information Society: Mapping Communications in Heterogeneous Research Networks, PhD Thesis, University of Amsterdam.
46. Heimeriks, G., M. Hörlesberger, P. van den Besselaar (2003), Mapping Communication and Collaboration in Heterogeneous Research Networks, Scientometrics 58(2): 391-413.
47. Hellsten, I., L. Leydesdorff, and P. Wouters (2006), Multiple Presents: How Search Engines Re-write the Past, New Media and Society 8(6) (in print)
48. Hey, T. and A. E. Trefethen (2002), The UK e-Science Core Programme and the Grid, Future Generation Computer Systems 18(8): 1017-1031.
49. Huberman, B. A. (2001), The Laws of the Web: Patterns in the Ecology of Information. The MIT Press, Cambridge Mass.
50. Ingwersen, P. (1998), The Calculation of Web Impact Factors, Journal of Documentation 54(2): 236-243.
51. Ingwersen, P. and L. Björneborn (2004), Methodological Issues of Webometric Studies, in: H.F. Moed, W. Glänzel, U. Schmoch (eds.), Handbook of Quantitative Science and Technology Research : The Use of Publication and Patent Statistics in Studies of S&T Systems. Kluwer Academic Publishers, Dordrecht/Boston/London, 339-370.
52. Katz, J. S. (1999), The Self-Similar Science System, Research Policy 28: 501-517.
53. Katz, J. S. (2000), Scale Independent Indicators and Research Evaluation, Science and Public Policy 27(1): 23-36.
54. Katz, J. S. (2004), Co-link indicators of the European Research Area, WISER report, 〈http://www.sussex.ac.uk/Users/sylvank/pubs/Co-Link.pdf〉 (access 31 July 2006).
55. Katz, J. S. (2005). "Scale independent bibliometric indicators." Measurement 3(1): 24-28.
56. Katz, J. S. (2006), Indicators for complex innovation systems, Research Policy (in print) 〈http://www.sussex.ac.uk/Users/sylvank/pubs/ICIS-RP. pdf〉.
57. Kleinberg, J. M., R. Kumar, P. Raghavan, S. Rajagopalan, A. S. Tomkins (1999), The Web as a Graph: Measurements, Models, and Methods, in: T. Asano, H. Imai, D.T. Lee, S. Nakano, S. Tokuyama (eds.), Computing and Combinatorics: 5th Annual International Conference, COCOON'99, Tokyo, Japan, July 1999. Proceedings. Lecture Notes in Computer Science, Vol. 1627, Springer, Berlin, 1-17.
58. Kleinknecht, A., K. v. Montford, E. Brouwer. (2002), The Non-Trivial Choice Between Innovation Indicators, Economics of Innovation and New Technology 11(2): 109-121.
59. Kling, R. (2000), Learning about Information Technologies and Social Change: The Contribution of Social Informatics, The Information Society 16(3): 217-232.
60. Koehler, W. (1999), Digital Libraries and World Wide Web sites and Page Persistence, Information Research 4(4), 〈http://InformationR.net/ir/44/ paper60.html〉.
61. Koehler, W. (2002), Web Page Change and Persistence - A Four-Year Longitudinal Study, Journal of the American Society for Information Science and Technology 53(2): 162-171.
62. Koehler, W. (2004), A Longitudinal Study of Web pages Continued: a Consideration of Document Persistence, Information Research 9(2), 〈http://informationr.net/ir/9-2/paper174.html〉.
63. Larson, R. R. (1996), Bibliometrics of the World Wide Web: an Exploratory Analysis of the Intellectual Structure of Cyberspace, in: S. Hardin (ed.), Global Complexity: Information Chaos and Control, Proceedings of the ASIS&T 59th annual meeting, Available at 〈http://sherlock.berkeley.edu/asis96/ asis96.html〉
64. Lawrence, S. and C. L. Giles (1999), Accessibility of Information on the Web, Nature 400(6740): 107-109.
65. Leland, W. E., M. S. Taqqu, W. Willinger, D.V. Wilson (1994), On the Self-Similar Nature of Ethernet Traffic, I EEE ACM transactions on networking 2 (1):1-15.
66. Leydesdorff, L. and A. Scharnhorst (2002), Measuring the Knowledge Base: A Program of Innovation Studies, Report to the Bundesministerium für Bildung und Forschung. Berlin-Brandenburgische Akademie der Wissenschaften. Amsterdam, NIWI-KNAW, 〈http://www.sciencepolicystudies.de/dok/expertise- leydesdorffscharnhorst.pdf〉 (access 31 July 2006)
67. Li, M., J. Wu, D. Wang, T. Zhou, Z. Di, Y. Fan (2005), Evolving Model of Weighted Networks Inspired by Scientific Collaboration Networks, 〈http://arxiv.org/abs/cond-mat/0501655〉.
68. Liang, L. (2005), R-Sequences: Relative Indicators for the Rhythm of Science, Journal of the American Society for Information Science and Technology 56(10):1045-1049.
69. Mandelbrot, B. B. (1983), The Fractal Geometry of Nature, W. H. Freeman, New York.
70. Marsh, J. B. T. (2001), Cultural Diversity and the Information Society- Policy Options and Technological Issues, Final study, 〈http://www. euresearch.ch/media/IST_STOA_Cult_Divers_en_2000.pdf〉 (access 31 July 2006)
71. Maurer, S. M. and B. A. Huberman (2001), Restart Strategies and Internet Congestions, Journal of Economic Dynamics & Control 25: 641-654.
72. Meyer, M. (2000a), Does Science Push Technology? Patents Citing Scientific Literature, Research Policy 29: 409-434.
73. Meyer, M. (2000b), What is Special about Patent Citations? Differences Between Scientific and Patent Citations, Scientometrics 49 : 93-123.
74. Moed, H. F., W. Glänzel, U. Schmoch (eds.) (2004), Handbook of Quantitative Science and Technology Research : The Use of Publication and Patent Statistics in Studies of S&T Systems. Kluwer Academic Publishers, Dordrecht/Boston/London.
75. Moed, H. F. and T. Van Leeuwen (1995), Improving the Accuracy of Institute for Scientific Information's Journal Impact Factors, Journal of the American Society for Information Science 46(6): 461-467.
76. Nalimov, V. V. and B. M. Mulchenko (1969), Naukometria (in Russian). Nauka, Moscow.
77. Nentwich, M. (2003), Cyberscience. Research in the Age of the Internet, Austrian Academy of Sciences Press, Vienna.
78. Pastor-Satorras, R. and A. Vespignani (2004), Evolution and Structure on the Internet. A Statistical Physics Approach.Cambridge University Press, Cambridge.
79. Rousseau, R. (1997), Sitations: an Exploratory Study, Cybermetrics 1(1), 〈http://www.cindoc.csic.es/cybermetrics/articles/v1i1p1.html〉.
80. Rousseau, R. (1999), Daily Time Series of Common Single Word Searches in AltaVista and NorthernLight, Cybermetrics 2/3(1), 〈http://www.cindoc.csic. es/cybermetrics/articles/v2i1p2.html〉.
81. Scharnhorst, A. (2003), Complex Networks and the Web: Insights from Nonlinear Physics, Journal of Computer-Mediated Communication 8(4) 〈http://jcmc.indiana.edu/vol8/issue4/scharnhorst.html〉.
82. Schmoch, U. (1997), Indicators and the Relations between Science and Technology, Scientometrics 38(1): 103-116.
83. Schubert, A. and W. Glänzel (1983), Statistical Reliability of Comparisions Based on the Citation Impact of Scientific Publications, Scientometrics 5: 59-74.
84. Sen, P. (2004), Directed Accelerated Growth: Application in Citation Network, 〈http://arxiv.org/abs/cond-mat/0409154〉.
85. Snyder, H. and H. Rosenbaum (1999), Can Search Engines be Used for Web-Link Analysis? A Critical Review, Journal of Documentation 55(4):375-384.
86. Tadic, B. (2001), Dynamics of directed graphs, Physica A 293(1-2): 273-284.
87. Thelwall, M. (2004a), Link Analysis: an Information Science Approach. Elsevier Academic Press., Amsterdam et al.
88. Thelwall, M. (2004b), Weak Benchmarking Indicators for Formative and Semi-Evaluative Assessment of Research, Research Evaluation 13(1): 63-68.
89. Thelwall, M., L. Vaughan, L. Björneborn (2005), Webometrics, Annual Review of Information Science and Technology 39:81-135.
90. Thomas, N., A. King, E.H.G. Jones (2000), Linguistic Diversity on the Internet: Assessment of the Contribution of Machine Translation, STOA Study PE 289 622/Fin. ST., European Parliament, 〈http://www.servinf.deusto.es/ ABAITUA/konzeptu/ta/EuroParlament.html〉 (access 31 July 2006).
91. Thomas, O. and P. Willet (2000), Webometric Analysis of Departments of Librarianship and Information Science, Journal of Information Science 26 (6): 421-428.
92. Vaughan, L. and D. Shaw (2005), Web Citation Data for Impact Assessment: A Comparison of Four Science Disciplines, Journal of the American Society for Information Science and Technology 56(10): 1075-1087.
93. Weingart, P. and M. Winterhager (1984). Die Vermessung der Forschung (in German), Campus Verlag, Frankfurt am Main.
94. Wilde, E. (1999), World Wide Web: Technische Grundlagen (in German), Springer, Berlin.
95. Wouters, P. (1999), Beyond the Holy Grail: From Citation Theory to Indicator Theories, Scientometrics 44(3): 561-580.
96. Wouters, P. (2000), Garfield as Alchemist, in: B. Cronin and H. B. Atkins (eds.), Web of Knowledge, Information Today, Inc, Medford, New Jersey, 65-71.
97. Wouters, P. and R. De Vries (2004), Formally Citing the Web, Journal of the Am erican Society for Information Seience and Technology 55(14): 1250-1260.
98. Wouters, P., Hellsten I, and Leydesdorff, L (2004), Internet Time and the Reliability of Search Engines, First Monday 9(10), 〈http://www. firstmonday.org/issues/issue9_10/wouters/index.html〉
99. Wouters, P., K. Vann, A. Scharnhorst, M. Ratio, J. Fry, A. Beaulieu, I. Hellsten (The Virtual Knowledge Studio) (2007), Messy Shapes of Knowledge - STS Explores Informatization, New Media and Academic Work, in: E. Hackett, O. Amsterdamska, M. Lynch, J. Wajcman (eds.), New Handbook of Science, Technololgy and Society, MIT Press (under review).