The practice of evaluation in innovation policy in Europe

Research Evaluation

Volumn 21, Issue 3, 2012, Pages 167-182

  Edler, Jakob ^a   Berger, Martin ^b   Dinges, Michael ^b   Gök, Abdullah ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

^b JOANNEUM RESEARCH   (Austria)

Author keywords

evaluation; evaluation practice; evaluation typology; innovation policy

Indexed keywords

EID: 84867016375     PISSN: 09582029     EISSN: 14715449     Source Type: Journal    
DOI: 10.1093/reseval/rvs014     Document Type: Article

References (37)

1. Amanatidou, E. and Garefi, I. (2011) Evaluation in the Context of Structural Funds: Impact on Evaluation Culture and Institutional Build up, EUNIP International Workshop on Evaluating Innovation Policy: Methods and Applications, 5-6 May 2011, Florence.
2. Arnold, E. (2004) 'Evaluation Research and Innovation Policy: A Systems World Needs Systems Evaluations', Research Evaluation, 13/1: 3-17. (Pubitemid 38613437)
3. Arnold, E. and Guy, K. (1997) 'Technology Diffusion Programmes and the Challenge for Evaluation', In: OECD (ed.) Policy Evaluation in Innovation and Technology. Paris: OECD Proceedings.
4. Bergs, S. (1981) Optimalita? t bei Cluster-Analysen: Experimente zur Bewertung numerischer Klassifikationsverfahren. PhD Thesis. Muenster.
5. Buisseret, T. J., Cameron, H. M. and Georghiou, L. (1995) 'What Difference Does It Make-Additionality in The Public Support Of R&D In Large Firms', International Journal of Technology Management, 10: 587-600.
6. Buhrer, S. and Daimer, S. (2011) The Role of Impact Assessment in Evaluation, EUNIP International Workshop on Evaluating Innovation Policy: Methods and Applications, 5-6 May 2011, Florence.
7. Chen, H. T. (1996) 'A Comprehensive Typology for Program Evaluation', Evaluation Practice, 17/2: 121-130.
8. Corder, G. W. and Foreman, D. I. (2009) Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach. Hoboken: Wiley.
9. Edler, J., Ebersberger, B. and Lo, V. (2008) 'Improving Policy Understanding by means of Secondary Evaluation', R&D Evaluation, 17/3: 175-186.
10. Edler, J., Blind, K., Georghiou, L. and Uyarra, E. (2009) Monitoring and Evaluation Methodology for the EU Lead Market Initiative: A Concept Development, Report for the Innogrips/Lead Market Initiative, DG Enterprise, European Commission, Brussels.
11. Edler, J. et al. (2010) INNO-Appraisal. Understanding Evaluation of Innovation Policy in Europe, Brussels/Manchester.
12. Edler, J., Georghiou, L., Blind, K. and Elvira, U. (2012) 'Evaluating the Demand Side. New Challenges for Evaluation', Research Evaluation, 21: 33-47.
13. Everitt, B. S., Landau, S. and Leese, M. (2001) Cluster Analysis, 4th edn. London: Arnold.
14. Fahrenkrog, G. et al. (2002) 'RTD Evaluation Toolbox-Assessing the Socio-economic Impact of RTD Policies (EUR 20382 EN)'. Seville: IPTS.www.jrc.es/home/publications/publication.cfm?pub=1045 .
15. Finch, H. (2005) 'Comparison of Distance Measures in Cluster Analysis with Dichotomous Data', Journal of Data Science, 3/1: 85-100.
16. Flanagan, K., Uyarra, E. and Laranja, M. (2011) 'Reconceptualising the 'Policy Mix' for Innovation', Research Policy, 40: 702-713.
17. Georghiou, L. (1999a) 'Meta Evaluation. Evaluation of Evaluations', Scientometrics, 4/3: 523-530.
18. -. (1999b) 'Issues in the Evaluation of Innovation and Technology Policy', In: OECD (ed.) Policy Evaluation in in Innovation and Technology Policy: Towards Best Practice, pp. 19-33. Paris: OECD.
19. Gok, A. (2010) An Evolutionary Approach to Innovation Policy Evaluation: Behavioural Additionality and Organisational Routines, PhD Thesis. Manchester Institute of Innovation Research, University of Manchester, Manchester.https:// www.escholar.manchester.ac.uk/jrul/item/?pid=uk-ac-manscw: 98600 .
20. Gok, A. and Edler, J. (2011) The Use of Behavioural Additionality in Innovation Policy-Making, EUNIP International Workshop on Evaluating Innovation Policy: Methods and Applications, 5-6 May 2011, Florence.
21. Hands, S. and Everitt, B. (1987) 'A Monte Carlo Study of the Recovery of Cluster Structure in Binary Data by Hierarchical Clustering Techniques', Multivariate Behavioral Research, 22/2: 235-243.
22. ImpLore. (2009) Benchmarking Strategies and Methodologies of National, European and International R&D Programmes, to Assess and Increase their Impact on Innovation, Report to Lot 2 of European Commission Tender ENTR/04/96. April 2009, Brussels.
23. Kaufman, L. and Rousseeuw, P. J. (1990) Finding Groups in Data: An Introduction to Cluster Analysis. New York: Wiley.
24. Mark, M. M., Hentry, G. T. and Julnes, G. (2000) Evaluation: An Integrated Framework for Understanding Guiding, and Improving Policies and Programs. San Francisco: Jossey-Bass.
25. Miles, I. et al. (2005) SMART Innovation: A Practical Guide to Evaluating Innovation Programmes, A Study for DG Enterprise and Industry, Brussels.
26. OECD. (1998) Best Practice Guidelines for Evaluation, PUMA Policy Brief No. 5, May 1998 http://www.oecd.org/dataoecd/11/56/1902965.pdf .
27. OECD (ed.) (1999) Policy Evaluation in Innovation and Technology Policy: Towards Best Practice, Paris.
28. OECD. (2009) Enhancing Public Research Performance Through Evaluation, Impact Assessment and Priority Setting, OECD DSTI/STPTIP(2009)5, Paris.
29. Papaconstantinou, G. and Polt, W. (1999) 'Policy Evaluation in Innovation and Technology Policy. An Overview', In: OECD (ed.) Policy Evaluation in Innovation and Technology Policy: Towards Best Practice, pp. 9-14. Paris: OECD.
30. Patton, M. Q. (1996) 'A World Larger than Formative and Summative', Evaluation Practice, 17/2: 131-144.
31. Pichler, R. (2010) Usefulness of Evaluations, Presentations at the CIA4OPM OMC-Net Meeting, Brussels, December 2010.
32. Rezankova, H. and Everitt, B. (2009) 'Cluster analysis and categorical data', Statistika, 216-232.
33. Ruegg, R. and Feller, I. (2003) A Toolkit for Evaluating Public R&D Investment, Models, Methods, and Findings, from ATP's First Decade. Gaithersburg: NST.
34. Scriven, M. (1991) 'Beyond Formative and Summative Evaluation'. In: McLaughlin, G. W. and Phillips, D. C. (eds) Evaluation and Education: A Quarter Century, pp. 19-64. Chicago, IL: University of Chicago Press.
35. Shapira, P. and Kuhlmann, S., eds, (2003) Learning from Science and Technology Policy Evaluation. Northampton, MA and Cheltenham, UK: Edward Elgar Publishers.
36. STATA. (2007) Multivariate Statistics. College Station: Stata Press.
37. Tsipouiri, L., Reid, A. and Miedzinski, M. (2008) European Innovation Progress Report 2008. Brussels: EU DG Enterprise.