Performance-based research funding in EU Member States - A comparative assessment

Science and Public Policy

Volumn 46, Issue 1, 2019, Pages 105-115

  Zacharewicz, Thomas ^a   Lepori, Benedetto ^b   Reale, Emanuela ^c   Jonkers, Koen ^a  

^a JOINT RESEARCH CENTRE   (Italy)

^b UNIVERSITY OF LUGANO   (Switzerland)

^c CNR   (Italy)

Author keywords

funding allocation; institutional funding; performance based funding; project funding; research assessment; research funding

Indexed keywords

COMPARATIVE STUDY; EUROPEAN UNION; GOVERNMENT; HETEROGENEITY; INSTITUTIONAL FRAMEWORK; PERFORMANCE ASSESSMENT; RESEARCH AND DEVELOPMENT;

EID: 85058686011     PISSN: 03023427     EISSN: None     Source Type: Journal    
DOI: 10.1093/scipol/scy041     Document Type: Article

References (59)

1. Alexander, S. (2015) RIO Country Report 2014: Luxembourg, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
2. Bitard, P. (2015) RIO Country Report 2014: France, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
3. Braun, D. (2003) 'Lasting Tensions in Research Policy-Making-A Delegation Problem', Science and Public Policy, 30: 309-21.
4. Bornmann, L. (2012) 'What is Societal Impact of Research and How Can It Be Assessed? A Literature Survey', Journal of the Association for Information Science and Technology, 64/2: 217-33.
5. Butler, (2003) 'Explaining Australia's Increased Share of ISI Publications-the Effects of a Funding Formula Based on Publication Counts', Research Policy, 32/2003: 143-55.
6. CRDI (2013b) Methodology of Evaluation of Research Organizations and Evaluation of Finished Programmes (valid for years 2013-2015) http://www. vyzkum.cz/FrontClanek.aspx? idsekce695512 accessed 27 July 2017.
7. Cruz-Castro, L., Bleda, M., Derrick, G. E. et al. (2011). Issue Brief: Public Sector Research Funding. https://www.innovationpolicyplatform.org/ sites/default/files/Public%20Sector%20Research%20Funding-0-0.pdf accessed 27 July 2017.
8. Cunningham, P. (2015) RIO Country Report 2014: UK, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
9. Cuntz, A. (2015) RIO Country Report 2014: Austria, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
10. Debackere, K., and Glänzel, W. (2004) 'Using a Bibliometric Approach to Support Research Policy Making: The Case of the Flemish BOF-Key', Scientometrics, 59/2: 253-76.
11. DeBackere, K. and Veugelers, R., (eds) (2015) Vlaams indicatorenboek 2013, https://www.ecoom.be/sites/ecoom.be/files/downloads/indicatorenboek 2013.pdf accessed 27 July 2017
12. Debackere, K., Arnold, E., Sivertsen, G. et al. (2018) Performance-Based Funding of University Research MLE on Performance-based Research Funding Systems (PRFS), Horizon 2020 Policy Support Facility, European Commission, DG Research and Innovation.
13. De Boer, H. F., Jongbloed, B., Benneworth, P. et al. (2015). Performance-based funding and performance agreements in fourteen higher education systems-Report for the Ministry of Education, Culture and Science, Enschede: CHEPS, University of Twente.
14. Derrick, G. E. (2017) The Evaluators' Eye: Impact Assessment and Academic Peer Review. London: Palgrave Macmillan
15. Pavone, V. (2013) 'Democratising Research Evaluation: Achieving Greater Public Engagement with Bibliometrics-Informed Peer Review', Science and Public Policy, 40/5: 563-75.
16. DORA, (2012) San Francisco Declaration on Research Assessment. http:// www.ascb.org/dora/ accessed January 2018.
17. Döry, T. (2015) RIO Country Report 2014: Hungary, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
18. EC (2011) Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions. Supporting Growth and Jobs-An Agenda for the Modernisation of Europe's Higher Education Systems.
19. COM (2011) 567 final. http://ec.europa.eu/dgs/education-culture/repository/education/ library/policy/modernisation-en.pdf accessed 27 July 2017.
20. European Commission (2012) Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions a Reinforced European Research Area Partnership for Excellence and Growth. Com/2012/0392 final, http://eur-lex.europa.eu/legal-content/EN/TXT/?uriCELEX: 520 12DC0392 accessed 27 July 2017.
21. EC (2017). ERA Progress Report. http://ec.europa.eu/research/era/pdf/era-pro gress-report2016/era-progress-report-2016-com.pdf accessed 27 July 2017.
22. Edquist, C., and Johnson, B. (1997) 'Institutions and Organisations in Systems of Innovation'. In: C. Edquist (ed.) Systems of Innovation, Technologies, institutions and organisations, pp. 41-60. Cheltenham: Edward Elgar. ERAC Peer Review of the Spanish Research and innovation System (2014).
23. Fernández Zubieta, A. (2015) RIO Country Report 2014: Spain, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
24. Geuna, A. (2001) 'The Changing Rationale for European University Research Funding: Are There Negative Unintended Consequences?', Journal of Economic Issues, 35/3: 607-32.
25. Piolatto, M. (2016) 'Research Assessment in the UK and Italy: Costly and Difficult, but Probably Worth It (at least for a while)', Research Policy, 45/1: 260-71.
26. Good, B., Vermeulen, N., Tiefenthaler, B et al. (2015), Counting Quality? The Czech Performance-Based Research Funding System', Research Evaluation, 24/2: 91-105.
27. Grimpe, C. (2015) RIO Country Report 2014: Denmark, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
28. HEFCE, (2015) Review of the UK's interdisciplinary research http://www. hefce.ac.uk/pubs/rereports/Year/2015/interdisc/Title, 104883, en.html accessed 8 October 2015.
29. Hicks, D. (2012) 'Performance-based university research funding systems', Research Policy, 41/2: 251-61.
30. Wang, J. (2009) 'Towards a Bibliometric Database for the Social Sciences and Humanities' http://works.bepress.com/diana-hicks/18/ accessed 27 July 2017.
31. Wouters, P., Waltman, L., De Rijcke, S. and Rafols, I. (2015) 'Bibliometrics: The Leiden Manifesto for Research Metrics', Nature, 520: 429-31.
32. Jacob, M. (2015) RIO Country Report 2014: Sweden, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
33. Jonkers, K., Tijssen, R. J. W., Karvounaraki, A et al. (2018) A Regional Innovation Impact Assessment Framework for Universities; 28927 EN; doi: 10.2760/623825.
34. Zacharewicz, T. (2016) Research Performance Based Funding Systems: a Comparative Assessment; EUR 27837 EN; doi: 10.2791/659483
35. Kalpazidou Schmidt, E. (2012) University Reform in the Nordic Countries http://www.zam.go.jp/n00/pdf/nf010007.pdf accessed 27 July 2017.
36. Klincewicz, K. (2015) RIO Country Report 2014: Poland, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
37. Kottmann, A. (2012) Higher Education in Germany: Country Report. (International Higher Education Monitor). Universiteit Twente, Enschede: Center for Higher Education Policy Studies (CHEPS).
38. Lepori, B. (2017) Analysis of National Public Research Funding PREF. Handbook for Data Collection and Indicators Production.
39. Malek, J., Hudeckova, V., andMatejka,M. (2014) 'System of Evaluation of Research Institutions in the Czech Republic', Procedia Computer Science, 33: 315-20.
40. MINECO, (2015), Apoyo y acreditación de Centros de Excelencia 'Severo Ochoa' y a Unidades de Excelencia 'Mar?a de Maeztu', http://www.idi. mineco.gob.es/portal/site/MICINN/menuitem.7eeac5cd345b4f34f09dfd10 01432ea0/?vgnextoidcba733a6368c2310VgnVCM1000001d04140 aRCRD accessed 8 October 2015
41. North, D. (1990) Institutions, Institutional Change and Economic Performance. Cambridge (UK): Cambridge University Press.
42. Paliokaite, A. (2015) RIO Country Report 2014: Lithuania. Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
43. Rafols, I., Leydesdorff, L., O'Hare, A., et al. (2012) 'How Journal Rankings can Suppress Interdisciplinarity. A Comparison between Innovation Studies and Business & Management', Research Policy, 41/7: 1262-82.
44. Reale, E. (2017) Analysis of National Public Research Funding-PREF. Final Report, doi: 10.2760/19140
45. Rinia, E. J., Van Leeuwen, T. N., Van Buren, T. N. et al. (2001) 'Influence of Interdisciplinarity on Peer-Review and Bibliometric Evaluations in Physics Research', Research Policy, 30/3: 357-61.
46. Saarnivaara, V.-P. (2015) RIO Country Report 2014: Finland, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
47. Schneider, J. W., Aagaard, J., and Bloch, C. W. (2016) 'What Happens When National Research Funding is Linked to Differentiated Publication Counts? A Comparison of the Australian and Norwegian Publication-Based Funding Models', Research Evaluation, 25/3: 244-56.
48. Sivertsen, G. (2016) 'Data Integration in Scandinavia', Scientometrics, 106/2: 849-55.
49. (2017) 'Unique, But Still Best Practice? The Research Excellence Framework (REF) from an International Perspective', Palgrave Communications, 3: 17078. http://dx.doi.org/10.1057/palcomms. 2017.78
50. Solberg, E. (2016) RIO Country Report 2015: Norway; EUR 27858 ENdoi: 10.2791/662065
51. Srholec, M., and Szkuta, K. (2016) RIO Country Report 2015: Czech Republic; EUR 27868; doi: 10.2791/161713
52. Steen, J. V. (2012) 'Modes of Public Funding of Research and Development: Towards Internationally Comparable Indicators', OECD Science, Technology and Industry Working Papers, 2012/04, OECD Publishing. doi: 10.1787/5k98ssns1gzs-en.
53. Stern N. (2016) Research Excellence Framework (REF) Review: Building on Success and Learning from Experience. Ref: IND/16/9. Department for Business, Energy& Industrial Strategy.
54. Todorova, A., and Pérez, S. E. (2015) Stairways to Excellence Country Report Bulgaria. Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
55. Slavcheva, M. (2016) RIO Country Report 2015: Bulgaria; EUR 27878 EN; doi: 10.2791/116438.
56. Tsipouri, L. (2015) RIO Country Report 2014: Greece, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.
57. Van Daalen, R., Mehmood, S., Verstraten, P. et al. (2014) Public Funding of Science: An International Comparison', CPB Background Document, Netherlands Bureau for Economic Policy Development, The Hague.
58. Van den Besselaar, P., Heyman, U., and Sandström, U. (2017) 'Perverse Effects of Output-based Research Funding? Butler's Australian Case Revisited', Journal of Informetrics, 11: 905-18.
59. Warrington, B. (2015) RIO Country Report 2014: Malta, Editor: European Commission, Joint Research Centre, Institute for Prospective Technological Studies, Publications Office of the European Union.