Evaluating research and innovation policy: A systems world needs systems evaluations

Research Evaluation

Volumn 13, Issue 1, 2004, Pages 3-17

  Arnold, Erik ^a,b  

^a UNIVERSITY OF BRIGHTON   (United Kingdom)

^b Technopolis Group Austria   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 2442436840     PISSN: 09582029     EISSN: None     Source Type: Journal    
DOI: 10.3152/147154404781776509     Document Type: Article

References (44)

1. E Arnold (1997), 'Uses and Limits of Cost-Benefit Analysis in Evaluating Industrial Modernisation Programs: The Irish Technology Transfer Programme', paper presented at the American Evaluation Association conference, San Diego.
2. E Arnold and M Bell (2001), 'Some new ideas about research and development', in Partnership at the Leading Edge: A Danish Vision for Knowledge, Research and Development (Danish Ministry of Foreign Affairs: Copenhagen).
3. E Arnold, P Boekholt and P Keen (1996), Good Ideas in Programme Management for Research and Technical Development Programmes, report to D-G XIII (Technopolis: Brighton).
4. E Arnold and P Boekholt with E Deiaco, S McKibbin, J de la Mothe, P Simmonds and J Stroyan (2003), Research and Innovation Governance in Eight Countries: A Meta-Analysis of Work Funded by EZ (Netherlands) and RCN (Norway) (Technopolis: Brighton).
5. E Arnold, J Cheshire, E Deiaco, J Stroyan, S Whitehouse and R Zaman with M Kara, G Marsh, R McGill and W Turkenburg (2003), Evaluation of the Swedish Long Range Energy Research Programme 1998-2004, report to the LångEn Enquiry (Technopolis: Brighton).
6. E Arnold and K Guy (1991) 'Diffusion policies for IT: the way forward', OECD/ICCP Expert Group on the Economic Implications of Information Technologies (OECD, Paris).
7. E Arnold and S Kuhlman (2001), RCN in the Norwegian Research and Innovation System, Background Report No 12 in the Evaluation of the Research Council of Norway (Royal Norwegian Ministry for Education, Research and Church Affairs: Oslo). Also available at www.technopolis-group.com
8. E Arnold, S Kuhlman and B van der Meulen (2001), A Singular Council: Evaluation of the Research Council of Norway (Royal Norwegian Ministry of Research, Education and Church Affairs: Oslo).
9. E Arnold and B Thuriaux (1997) Developing Firms' Technological Capabilities, report to OECD (Technopolis, Brighton), which may be downloaded from www.technopolis-group.com
10. K Arrow (1962), 'Economic welfare and the allocation of resources for invention', in Richard Nelson (editor), The Rate and Direction of Inventive Activity (Princeton University Press: Princeton, NJ).
11. P Boekholt, M Lankhuizen, E Arnold, J Clark, J Kuusisto, B de Laat, P Simmonds, S Cozzens, G Kingsley and R Johnston (2001), An International Review of Methods to Measure Relative Effectiveness of Technology Policy Instruments (Min EZ: The Hague).
12. B Bozeman and J D Rogers (2002), 'A churn model of scientific knowledge: Internet researchers as a knowledge value collective,' Research Policy, 31, pages 769-794.
13. B Carlsson and S Jacobsson (1997), 'In search of useful public policies: Key lessons and issues for policy makers,' in Bo Carlsson (editor), Technological Systems and Industrial Dynamics (Kluwer Academic Publishers: New York).
14. T Christensen and P Lægreid (1998), Den moderne forvaltning (Aschehoug: Oslo).
15. W Cohen and D Levinthal (1990), 'Absorptive capacity: a new perspective on learning and innovation', Administrative Science Quarterly, 35, pages 128-152.
16. H Etzkowitz and L Leydesdorff (2000),'The dynamics of innovation: from National Systems and "Mode 2" to a Triple Helix of university-industry-government relations', Research Policy, 29(2).
17. P Feyerabend (1975), Against Method (NLB: London).
18. Forskning 2000 Committee to Review Swedish Research Policy (1998), Slutbetänkande av Kommittén för översyn av den svenska forskningspolitiken (Forskning 2000) (1998), Final report of the Committee to Review Swedish Research Policy (Research 2000) (Stockholm).
19. C Freeman (1987), Technology Policy and Economic Performance: Lessons from Japan (Frances Pinter: London).
20. C Freeman, J Clark and L Soete (1982), Unemployment and Technical Innovation: A Study of Long Waves and Economic Development (Frances Pinter: London).
21. L Georghiou and D Roessner (2000), 'Evaluating technology programmes: tools and methods,' Research Policy, 29, pages 657-678.
22. M Gibbons, C Limoges, H Nowotny, S Schwartzman, P Scott and M Trow (1994), The New Production of Knowledge: The Dynamics of Science and Research in Contemporary Societies (Sage: London).
23. J Hauknes and L Norgren (1999), Economic Rationales of Government Intervention in Innovation and the Supply of Innovation-Related services, STEP Report 08 1999 (STEP Group: Oslo) downloadable from 〈www.step.no〉
24. J Irvine and B Martin (1984), Foresight in Science: Picking the Winners (Frances Pinter: London).
25. R Jungk (1958), Brighter than a Thousand Suns (Gollancz: London).
26. E Kallerud (1998), 'Basic research: in a state of crisis?', in E Kallerud (editor), Basic Research in Innovation and Science Policy (NIFU: Oslo).
27. T S Kuhn (1970), The Structure of Scientific Revolutions, 2nd edition (University of Chicago Press).
28. I Lakatos and A Musgrave (1970), Criticism and the Growth of Knowledge (Cambridge University Press).
29. B A Lundvall (editor) (1992), National Systems of Innovation: Towards a Theory of Innovation and Interactive Learning (Frances Pinter: London).
30. F Malerba (1997), 'Public policy and industrial dynamics: An evolutionary perspective', in C Edqvist (editor), Systems of Innovation: Technologies, Institutions and Organisations (Cassell, London).
31. B Martin (1996), 'The use of multiple indicators in the assessment of basic research', Scientometrics, 36(3), pages 343-362.
32. B Martin, A Salter et al (1996), The Relationship between Publicly Funded Basic Research and Economic Performance, report to HM Treasury (Science Policy Research Unit: Brighton).
33. J S Metcalfe (2000), 'Co-evolution of systems of innovation', paper presented at the Volkswagen Foundation Conference, Prospects and Challenges for Research and Innovation, Berlin, 8-9 June 2000 (CRIC: Manchester University).
34. R R Nelson (1959), 'The simple economics of basic scientific research,' Journal of Political Economy, 67, pages 297-306.
35. R R Nelson (1993), National Innovation Systems (Oxford University Press, New York).
36. R R Nelson and S Winter (1982), An Evolutionary Theory of Economic Change (Harvard University Press).
37. D C North (1990), Institutions, Institutional Change and Economic Performance (Cambridge University Press).
38. R Pawson and N Tilley (1997) Realistic Evaluation (Sage: London).
39. K R Popper (1951), The Open Society and Its Enemies, 2nd edition (RKP: London - 1st edition originally published 1945).
40. A Rip (2001), 'Aggregation machines: a political science of science approach to the future of the Peer Review System', in M Hisschemoller et al (editors), Knowledge, Power, and Participation in Environmental Policy Analysis, Policy Studies Review Annual, Vol. 12, (Transaction Books: New Brunswick, NJ).
41. N Rosenberg (1976), Perspectives on Technology (Cambridge University Press).
42. R Rothwell, C Freeman, A Horsley, V T P Jervis, A B Robertson and J Townsend (1972), 'SAPPHO updated', Research Policy, 3(3), pages 158-176.
43. H Simon (1976), Administrative Behaviour, 3rd edition (Free Press: New York).
44. K Smith (1997), 'Economic infrastructures and innovation systems,' in C Edqvist (editor), Systems of Innovation: Technologies, Institutions and Organisations (Cassell: London).