Indicators for national science and technology policy: How robust are composite indicators?

Research Policy

Volumn 33, Issue 9, 2004, Pages 1373-1384

  Grupp, Hariolf ^a,b   Mogee, Mary Ellen ^c  

^a UNIVERSITY OF KARLSRUHE   (Germany)

^b FRAUNHOFER INSTITUTE FOR SYSTEMS AND INNOVATION RESEARCH ISI   (Germany)

^c Mogee Research and Analysis   (United States)

Author keywords

Benchmarking; National innovation policy; Science and technology indicators; Scoreboards

Indexed keywords

BENCHMARKING; INDUSTRIAL ECONOMICS; INDUSTRIAL RESEARCH; MANAGEMENT SCIENCE; PATENTS AND INVENTIONS; RESEARCH AND DEVELOPMENT MANAGEMENT;

COMPOSITE INDICATORS; ECONOMIC GROWTH; NATIONAL INNOVATION POLICY; SCIENCE AND TECHNOLOGY INDICATORS; SCOREBOARDS;

PUBLIC POLICY;

EID: 20344383758     PISSN: 00487333     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.respol.2004.09.007     Document Type: Article

References (51)

1. Acs, Z.J., 1989. Patents as a measure of innovative activity. Kyklos 42 (2), 171-180.
2. BMBF (Ed.), various years. Bundesbericht Forschung, Bonn, Berlin.
3. Breitzman, A.F., Mogee, M.E., 2002. The many applications of patent analysis. Journal of Information Science 28 (3), 187-205.
4. R.C. Camp Benchmarking: The Search for Industry Best Practices that Lead to Superior Performance 1989 ASQC Quality Press Milwaukee
5. Campbell, R.S., Nieves, A.L., 1979. Technology Indicators Based on Patent Data: the Case of Catalytic Converters - Phase 1 Report: Design and Demonstration. Pacific Northwest Laboratories, Battelle.
6. Carpenter, M.P., Narin, F., 1983. Validation study: patent citations as indicators of science and foreign dependence. World Patent Information 5 (3), 180-185.
7. A. Charnes, W.W. Cooper, and E. Rhodes Measuring the efficiency of decision making units European Journal of Operations Research 2 6 1978 429 444
8. CSRS (Ed.), 1998. Technological Innovation in Russia. Centre for Science Research and Statistics, Moscow.
9. DTI (Ed.), 2003. Competing in the Global Economy - the Innovation Challenge. DTI, London.
10. J. Edler S. Kuhlmann M. Behrens Changing Governance of Research and Technology Policy 2003 Edward Elgar Publishing The European Research Area, Cheltenham, UK and Northhampton, USA
11. European Commission (Ed.), 1994. The European Report on Science & Technology Indicators 1994. EUR 15897 EN, Brussels.
12. European Commission (Ed.), 2001. European Innovation Scoreboard 2001. SEC, Luxemburg, p. 1414.
13. European Commission (Ed.), 2002. Benchmarking National Research Policies. EUR 20494 EN, Brussels.
14. European Commission (Ed.), 2003. Third European Report on Science & Technology Indicators 2003. EUR 20025 EN, Brussels.
15. European Commission (Ed.), 2003a. Biotechnology Innovation Scoreboard 2003. Innovation/SMEs Programme, Brussels.
16. European Commission (Ed.), 2003b. Towards a European Research Area Science, Technology and Innovation - Key Figures 2003-2004. EUR 20735 EN, Brussels.
17. R. Evenson International invention: implications for technology market analysis Griliches 1984 89 123
18. E. Geisler The Metrics of Science and Technology 2000 Quorum Books Westport, CT
19. Gellman Research Associates Indicators of International Trends in Technological Innovation 1976 National Science Foundation Washington, DC
20. B. Godin The emergence of S&T indicators: why did governments supplement statistics with indicators? Research Policy 32 4 2003 679 691
21. Gokhberg, L., Gorodnikova, N, Wuttke, J., 1999. Volkswirtschaft im Übergang - Ein Vergleich der FuE-Indikatoren in Russland und Deutschland, Moscow and Essen: CSRS and Stifterverband.
22. Griliches, Z., 1984. R&D, Patents and Productivity. University of Chicago Press, Chicago.
23. Z. Griliches R&D and productivity: econometric results and measurement issues P. Stoneman Handbook of the Economics of Innovation and Technological Change 1995 Blackwell Oxford and Cambridge, MA 52 89
24. H. Grupp, H. Legler, B. Gehrke, and B. Breitschopf Zur Technologischen Leistungsfähigkeit Deutschlands 2002 2003 BMBF Berlin
25. H. Grupp Foundations of the Economics of Innovation - Theory Measurement and Practice 1998 Edward Elgar Publishing Cheltenham, UK and Northhampton, US
26. H. Grupp, and S. Maital Managing New Product Development - A Microeconomic Toolbox 2001 Edward Elgar Publishing Cheltenham, UK and Northhampton, USA
27. Hill, C.T., Hansen, J.A., Stein, J.I., 1983. New Indicators of Industrial Innovation, Cambridge. Massachusetts Institute of Technology, Center for Policy Alternatives (CPA-83-14), MA.
28. D.T. Kearnes Quality improvement begins at the top World 20 5 1986 21
29. F. Kodama A system approach to science indicators H. Grupp Problems of Measuring Technological Change 1987 Verlag TÜV Rheinland Köln 65 87
30. Management and Coordination Agency (Ed.), various years. Report on the Survey of Research and Development, Tokyo.
31. Mogee, M., 1994. International Comparisons of Technological Performance Using the Derwent World Patents Index: methodological issues, workshop on innovation, patents and technological strategies. Organisation for Economic Cooperation and Development, Paris.
32. Mogee, M., 1996. Benchmarking U.S. competitive technological position in implantable prostheses with data on new products, patent families and patent citations. In: Mason, Lefebvre, Khalil (Eds.), Management of Technology V: Technology Management in a Changing World. Elsevier Advanced Technology, Oxford.
33. R.R. Nelson National Innovation Systems: A Comparative Analysis 1999 Oxford University Press New York
34. Narin, F., Noma, E., Perry, R., 1987. Patents as Indicators of Corporate Technological Strength. Research Policy 16 (2), 143-155.
35. National Science Board, various years. Science (& Engineering) Indicators. Washington, DC.
36. F. Niwa, and H. Tomizawa Integrated indicators: international comparisons of overall strengths in science and technology NISTEP Science and Technology Indicators 1994 1995 Science and Technology Agency Tokyo 345 365
37. OECD (Ed.), 2003. OECD Science Technology and Industry Scoreboard. Organisation for Economic Co-operation and Development, Paris.
38. OST (Ed.), various years. Science & Technologie - Indicateurs. Economica, Paris.
39. Pakes, A., Simpson, M., 1989. Patent Renewal Data, Brookings Papers on Economic Activity: Microeconomics, pp. 331-410.
40. P. Patel, and K. Pavitt Patterns of technological activity: their measurement and interpretation P. Stoneman Handbook of the Economics of Innovation and Technological Change 1995 Blackwell Oxford and Cambridge, MA 15 51
41. Pavitt, K., 1988. Uses and abuses of patent statistics. In: van Raan, A.F. (Ed.), Handbook of Quantitative Studies of Science and Technology. North-Holland, Amsterdam, pp. 509-536.
42. Pavitt, K., 1985. Patent statistics as indicators of innovative activities: possibilities and problems. Scientometrics 7 (1-2), 77-99.
43. S. Pohn-Weidinger, H. Gassler, M. Gruber, W. Polt, A. Schibany, and H. Leo Innovationsbericht 2001 Bundesministerium für Wirtschaft und Arbeit Wien
44. Porter, A.L., Roessner, J.D., 1991. Indicators of national competitiveness in high technology industries, two-volume final report to the Science Indicators Studies Group, National Science Foundation. National Science Foundation, Washington, DC.
45. M.E. Porter, and S. Stern The New Challenge to America's Prosperity: Findings from the Innovation Index 1999 Council on Competitiveness Washington, DC
46. Republik Österreich Österreichischer Forschungs- und Technologie bericht 2003 Bericht der Bundesregierung an den Nationalrat Wien
47. R. Solow Technical progress and the aggregate production function Review of Economics and Statistics 39 1957 312 320
48. R.J.W. Tijssen Scoreboards of research excellence Research Evaluation 12 2 2003 91 103
49. M. Trajtenberg A penny for your quotes: patent citations and the value of innovations Rand Journal of Economic 21 1 1990 172 187
50. US Congress, Office of Technology Assessment, 1986. Research funding as an investment: can we measure the returns? Report prepared by the Office of Technology Assessment for the Task Force on Science Policy, Committee on Science and Technology, US House of Representatives, April 1986 (reprinted as Science Policy Study Background Report No. 12 by the Task Force on Science Policy, Committee on Science and Technology, US House of Representatives, 99th Congress, Second session, December 1986).
51. M. Zitt, R. Barre, A. Sigogneau, and F. Laville Territorial concentration and evolution of science and technology activities in the European Union: a descriptive analysis Research Policy 28 5 1999 545 562