Evaluation of research and evolution of science indicators

Current Science

Volumn 89, Issue 9, 2005, Pages 1510-1517

  Leydesdorff, Loet ^a  

^a UNIVERSITY OF LAUSANNE   (Switzerland)

Author keywords

Evaluation; Policy decision; Research evolution; Science indicators

Indexed keywords

EID: 31744442333     PISSN: 00113891     EISSN: 00113891     Source Type: Journal    
DOI: None     Document Type: Review

References (75)

1. OECD, The Measurement of Scientific and Technical Activities: 'Frascati Manual', OECD, Paris, 1963.
2. Bush, V., The Endless Frontier: A Report to the President, 1945; Reprinted, Arno Press, New York, 1980.
3. Steelman, J. R., Science and Public Policy, Government Printing Office, Washington, DC, 1947. Reprinted by the Arno Press, New York, 1980.
4. York, H. F., Race to Oblivion: A Participant's View of the Arms Race, Simon and Schuster, New York, 1970.
5. Edwards, P., The Closed World, Computers and the Politics of Discourses in Cold War America, MIT Press, Cambridge, MA, 1996.
6. Abramowitz, M., Resource and output trends in the United States since 1870. Am. Econ. Rev., 1956, 46, 5-23.
7. OECD, The Residual Factor and Economic Growth, OECD, Paris, 1964.
8. Rosenberg, N., Perspectives on Technology, Cambridge University Press, Cambridge, 1976.
9. Mulkay, M. J., The mediating role of the scientific elite. Social Stud. Sci., 1976, 6, 445-470.
10. Price, D. d. S., Little Science, Big Science, Columbia University Press, New York, 1963.
11. Elkana, Y., Lederberg, J., Merton, R. K., Thackray, A. and Zuckerman, H., Toward a Metric of Science: The Advent of Science Indicators, Wiley, New York, 1978.
12. Narin, F., Evaluative Bibliometrics: The Use of Publication and Citation Analysis in the Evaluation of Scientific Activity, National Science Foundation, Washington, DC, 1976.
13. Small, H., Co-citation in the scientific literature: A new measure of the relationship between two documents. J. Am. Soc. Inf. Sci., 1973, 24, 265-269.
14. Carpenter, M. P. and Narin, F., Clustering of scientific journals. J. Am. Soc. Inf. Sci., 1973, 24, 425-436.
15. Pinski, G. and Narin, F., Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics. Inf. Proc. Manage., 1976, 12(5), 297-312.
16. Braun, T., Glänzel, W. and Schubert, A., Scientometric Indicators. A 32-Country Comparative Evaluation of Publishing Performance and Citation Impact, World Scientific Publications, Singapore/Philadelphia, 1985.
17. Schubert, A. and Braun, T., Standards for citation based assessments. Scientometrics, 1993, 26, 21-35.
18. Martin, B. and Irvine, J., Assessing basic research: Some partial indicators of scientific progress in radio astronomy. Res. Policy, 1983, 12, 61-90.
19. Moed, H. F., Burger, W. J. M., Frankfort, J. G. and van Raan, A. F. J., The use of bibliometric data for the measurement of university research performance. Res. Policy, 1985, 14, 131-149.
20. Hicks, D. and Katz, J. S., Science policy for a highly collaborative science system. Sci. Public Policy, 1996, 23, 39-44.
21. Weingart, P. (ed.), Die Wissenschaft in osteuropäischen Ländern im Internationalen Vergleich - Eine Quantitative Analyse auf der Grundlage wissenschaftsmetrischer Indikatoren, Kleine Verlag, Bielefeld, 1991.
22. Collins, H. M., The possibilities of science policy. Soc. Stud. Sci., 1985, 15, 554-558.
23. Whitley, R. D., The Intellectual and Social Organization of the Sciences, Oxford University Press, Oxford, 1984.
24. Leydesdorff, L. and Besselaar, P. v. d., Scientometrics and communication theory: Towards theoretically informed indicators. Scientometrics, 1997, 38, 155-174.
25. Leydesdorff, L., The Challenge of Scientometrics: The Development, Measurement, and Self-Organization of Scientific Communications, DSWO Press, Leiden University, Leiden, 1995.
26. Irvine, J., Martin, B., Peacock, T. and Turner, R., Charting the decline of British science. Nature, 1985, 316, 587-590.
27. Leydesdorff, L., Problems with the 'measurement' of national scientific performance. Sci. Public Policy, 1988, 15, 149-152.
28. Braun, T., Gl,,nzel, W. and Schubert, A., Assessing assessments of British science. Some facts and figures to accept or decline. Scientometrics, 1989, 15, 165-170.
29. Martin, B. R., The bibliometric assessment of UK scientific performance - a reply to Braun, Glänzel and Schubert. Scientometrics, 1991, 20, 333-357.
30. Burt, R. S., Toward a Structural Theory of Action, Academic Press, New York, 1982.
31. Leydesdorff, L., Can scientific journals be classified in terms of aggregated journal-journal citation relations using the journal citation reports?. J. Am. Soc. Inf. Sci. Technol., forthcoming.
32. Callon, M., Courtial, J.-P., Turner, W. A. and Bauin, S., From translations to problematic networks: An introduction to co-word analysis. Soc. Sci. Inf., 1983, 22, 191-235.
33. Callon, M., Law, J. and Rip, A. (eds), Mapping the Dynamics of Science and Technology, Macmillan, London, 1986.
34. Latour, B., Science in Action. Open University Press, Milton Keynes, 1987.
35. Small, H. and Sweeney, E., Clustering the science citation index using co-citations I. A comparison of methods. Scientometrics, 1985, 7, 391-409.
36. Small, H., Sweeney, E. and Greenlee, E., Clustering the science citation index using co-citations II. Mapping science. Scientometrics, 1985, 8, 321-340.
37. Leydesdorff, L., Various methods for the mapping of science. Scientometrics, 1987, 11, 291-320.
38. Leydesdorff, L., A validation study of 'Leximappe'. Scientometrics, 1992, 25, 295-312.
39. Lazarsfeld, P. F. and Henry, N. W., Latent Structure Analysis, Houghton Mifflin, New York, 1968.
40. Luhmann, N., Soziale Systeme. Grundriß einer allgemeinen Theorie, Suhrkamp, Frankfurt a. M, 1984.
41. Luhmann, N., Die Wissenschaft der Gesellschaft, Suhrkamp, Frankfurt a.M, 1990.
42. Nederhof, A. J., Changes in publication patterns of biotechnologists: An evaluation of the impact of government stimulation programs in six industrial nations. Scientometrics, 1988, 14, 475-485.
43. Giddens, A., New Rules of Sociological Method, Hutchinson, London, 1976.
44. Giddens, A., The Constitution of Society, Polity Press, Cambridge, 1984.
45. Leydesdorff, L., Why words and co-words cannot map the development of the sciences. J. Am. Soc. Inf. Sci., 1997, 48(5), 418-427.
46. Price, D. de Solla, Editorial statement. Scientometrics, 1978, 1(1), 7-8.
47. Wouters, P. and Leydesdorff, L., Has Price's dream come true: Is scientometrics a hard science?. Scientometrics, 1994, 31, 193-222.
48. Price, D. d. S., Citation measures of hard science, soft science, technology, and nonscience. In Communication among Scientists and Engineers (eds Nelson, C. E. and Pollock, D. K.), Lexington, MA, Heath, 1970, pp. 3-22.
49. Glänzel, W. and Schöpflin, U., Little scientometrics, big scientometrics.... and beyond. Scientometrics, 1994, 30(2-3), 375-384.
50. Narin, F. and Noma, E., Is technology becoming science?. Scientometrics, 1985, 7, 369-381.
51. Etzkowitz, H. and Leydesdorff, L., The dynamics of innovation: From national systems and 'mode 2' to a triple helix of University-Industry- Government relations. Res. Policy, 2000, 29(2), 109-123.
52. Gibbons, M., Limoges, C., Nowotny, H., Schwartzman, S., Scott, P. and Trow, M., The New Production of Knowledge: The Dynamics of Science and Research in Contemporary Societies, Sage, London, 1994.
53. Lundvall, B.-Å. (ed.), National Systems of Innovation, Pinter, London, 1992.
54. Nelson, R. R. (ed.), National Innovation Systems: A Comparative Analysis, Oxford University Press, New York, 1993.
55. Van den Daele, W., Krohn, W. and Weingart, P. (eds), Geplante Forschung: Vergleichende Studien über den Einfluss politischer Programme auf die Wissenschaftsentwicklung, Suhrkamp, Frankfurt a.M., 1979.
56. Studer, K. E. and Chubin, D. E., The Cancer Mission. Social Contexts of Biomedical Research, Sage, Beverly Hills, 1980.
57. Lewison, G. and Cunningham, P., Bibliometric studies for the evaluation of trans-national research. Scientometrics, 1991, 21, 223-244.
58. Kobayashi, S.-I., Applying audition systems from the performing arts to R&D funding mechanisms: Quality control in collaboration among the academic, public, and private sectors in Japan. Res. Policy, 2000, 29(2), 181-192.
59. Nowotny, H., Scott, P. and Gibbons, M., Re-Thinking Science: Knowledge and the Public in an Age of Uncertainty, Polity, Cambridge, 2001.
60. Leydesdorff, L. and Etzkowitz, H., The triple helix as a model for innovation studies. Sci. Public Policy, 1998, 25(3), 195-203.
61. Skolnikoff, E. B., The Elusive Transformation: Science, Technology and the Evolution of International Politics, Princeton University Press, Princeton, NJ, 1993.
62. Pavitt, K., Sectoral patterns of technical change: Towards a theory and a taxonomy. Res. Policy, 1984, 13, 343-373.
63. Freeman, C., Continental, national and sub-national innovation systems - Complementarity and economic growth. Res. Policy, 2002, 31, 191-211.
64. Carlsson, B. (ed.), New Technological Systems in the Bio Industries - An International Study, Kluwer Academic Publishers, Boston/Dordrecht/London, 2002.
65. Callon, M. and Latour, B., Unscrewing the big leviathan: How actors macro-structure reality and how sociologists help them to do so. In Advances in Social Theory and Methodology. Toward an Integration of Micro- and Macro-Sociologies (eds Knorr-Cetina, K. D. and Cicourel, A. V.), Routledge & Kegan Paul, London, 1981, pp. 277-303.
66. Wouters, P., The citation culture. Unpublished Ph D thesis, University of Amsterdam, 1999.
67. Rip, A., Qualitative conditions for scientometrics: The new challenges. Scientometrics, 1997, 38(1), 7-26.
68. Leydesdorff, L., Indicators of innovation in a knowledge-based economy. Cybermetrics, 2001, 5(1), Paper 2, at http://www.cindoc.csic.es/cybermetrics/ articles/v5i1p2.html (Accessed on 30 July 2005).
69. Marx, K., The Communist Manifesto, Paris, Translated by Samuel Moore in 1888. Penguin, Harmondsworth, 1967, 1848.
70. Leydesdorff, L., A Sociological Theory of Communication: The Self-Organization of the Knowledge-Based Society, Universal Publishers, Parkland, FL, 2001; at 〈http://www.upublish.com/books/leydesdorff. htm〉; (Accessed on 30 July 2005).
71. Casti, J., Alternate Realities. Wiley, New York, 1989.
72. Van Raan, A. F. J. (ed.), Handbook of Quantitative Studies of Science and Technology, Elsevier, Amsterdam, 1988.
73. Persson, O., Glänzel, W. and Danell, R., Inflationary bibliometric values: The role of scientific collaboration and the need for relative indicators in evaluative studies. Scientometrics, 2004, 60(3), 421-432.
74. Wagner, C. S. and Leydesdorff, L., Mapping the network of global science: Comparing international co-authorships from 1990 to 2000. Int. J. Technol. Globalization, 2005, 1(2), 185-208.
75. Wagner, C. S. and Leydesdorff, L., (forthcoming). Network structure, self-organization and the growth of international collaboration in science. Res. Policy, 2005 (in print).