The unintended consequences of metrics in technology evaluation

Journal of Informetrics

Volumn 1, Issue 2, 2007, Pages 103-114

  Kostoff, Ronald N ^a   Geisler, Elie ^b  

^a OFFICE OF NAVAL RESEARCH   (United States)

^b ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Metrics; Research documentation; Research evaluation; Research policy; Science and technology; Scientometrics; Strategic management; Unintended consequences

Indexed keywords

EID: 34247517404     PISSN: 17511577     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.joi.2007.02.002     Document Type: Article

References (27)

1. Council on Competitiveness (2004). National Innovation Initiative Report: Innovate America. Washington, DC.
2. Couzzarin B., and Percival J. Complementarities between organizational strategies and innovation. Economies of Innovation & New Technology 15 3 (2006) 195-217
3. Das S., and Van de Ven A. Competing with new product technologies: A process model of strategy. Management Science 46 10 (2000) 1300-1316
4. Egghe L., and Rousseau R. Introduction to informetrics: Quantitative methods in library, documentation, and information science (1990), Elsevier Publishing Company, New York
5. Ethiraj S., and Levinthal D. Bounded rationality and the search for organizational architecture: An evolutionary perspective on the design of organizations and their evolvability. Administrative Science Quarterly 49 3 (2004) 404-437
6. Galbraith J. The anatomy of power (1985), Houghton-Mifflin Company, New York
7. Geisler E. When whales are cast ashore: The conversion to relevancy of US basic research and universities. IEEE Transactions on Engineering Management 41 1 (1995) 3-8
8. Geisler E. The metrics of science and technology (2000), Greenwood, Westport, CT
9. Godener A., and Soderquist K. Use and impact of performance measurement results in R&D and NPD: An exploratory study. R&D Management 34 2 (2004) 191-213
10. Kaplan R., and Norton D. The balanced scorecard (1996), Harvard Business School Press, Cambridge, MA
11. Kaplan R., and Norton D. Alignment: Using the balanced scorecard to create corporate synergies (2006), Harvard Business School Press, Cambridge, MA
12. Katz S., and Cothey V. Web indicators for complex innovation systems. Research Evaluation 15 2 (2006) 85-95
13. Kerssens-Van Drongelen, and Bilderbeek J. R&D performance measurement: More than choosing a set of metrics. R&D Management 29 1 (1999) 35-46
14. Klavans R., and Boyack K. Identifying a better measure of relatedness for mapping science. Journal of the American Society for Information Science and Technology 57 2 (2006) 251-263
15. Kostoff R.N. Overcoming Specialization. BioScience 52 10 (2002) 937-941
16. Kostoff R.N. Systematic acceleration of radical discovery and innovation in science and technology. Technological Forecasting and Social Change 73 8 (2006) 923-936
17. Lessenius G., Missinen M., Raujiaven K., and Sulonen R. The interactive goal panel: A methodology for assigning R&D activities with corporate strategy. Proceedings of the International Conference of IEMC. San Juan, Puerto Rico, October (1998)
18. Loch C., and Staffan-Tapper U. Implementing a strategy-driven performance measurement system for an applied research group. Journal of Product Innovation Management 19 3 (2002) 185-198
19. Mann, G., Mimno, D., & McCallum, A. (2006). Bibliometric impact measures leveraging topic analysis. JCDL, June 11-15.
20. Pun K., and White A. A Performance measurement paradigm for integrating strategy formulation: A review of systems and frameworks. International Journal of Management Reviews 7 1 (2005) 49-71
21. Rubenstein A., and Geisler E. The use of indicators and measures of the R&D process in evaluating science and technology programs. In: Roessner D. (Ed). Government innovation policy (1988), St. Martin's Press, New York 185-204
22. Shupe C., and Behling R. Developing and implementing a strategy for technology deployment. Information Management Journal 40 4 (2006) 52-57
23. Siggelkow N., and Rivkin J. When exploration backfires: Unintended consequences of multilevel organizational search. Academy of Management Journal 49 4 (2006) 779-795
24. Souitaris V. Technological trajectories as moderators of firm-level determinants of innovation. Research Policy 31 6 (2002) 877-898
25. Weingart P. Impact of bibliometrics upon the science system: Inadvertent consequences. Scientometrics 62 1 (2005) 117-131
26. Weiss R. Our incredible shrinking curiosity. The Washington Post (2005) B-01
27. Werner B., and Souder W. Measuring R&D performance: State of the art. Research Technology Management 40 2 (1997) 34-42