What happens when national research funding is linked to differentiated publication counts? A comparison of the Australian and Norwegian publication-based funding models

Research Evaluation

Volumn 25, Issue 3, 2016, Pages 244-256

  Schneider, Jesper W ^a   Aagaard, Kaare ^a   Bloch, Carter W ^a  

^a AARHUS UNIVERSITY   (Denmark)

Author keywords

Performance based funding; Perverse incentives; Publication behaviour; Publication model

Indexed keywords

EID: 84984683777     PISSN: 09582029     EISSN: 14715449     Source Type: Journal    
DOI: 10.1093/reseval/rvv036     Document Type: Article

References (24)

1. Aagaard, K. (2015) 'How Incentives Trickle Down: Local Use of a National Bibliometric Indicator System', Science and Public Policy, (2015) 42/5: 725-737.
2. Aagaard, K., Bloch, C. W., Schneider, J. W., Henriksen, D., Lauridsen, P. S. and Ryan, T. K. (2014) Evaluation of the Norwegian Publication Indicator (in Danish). Oslo: Norwegian Association of Higher Education Institutions.
3. Aagaard, K., Bloch, C., and Schneider, J. W. (2015) 'Impacts of Performancebased Research Funding Systems: The Case of the Norwegian Publication Indicator', Research Evaluation, 24/2: 106-17.
4. Berk, R. A. (2004) Regression Analysis: A Constructive Critique. Newbury Park: Sage Publications.
5. Berk, R. (2010) 'What You Can and Can't Properly Do with Regression', Journal of Quantitative Criminology, 26/4: 481-7.
6. Bloch, C. W., Sørensen, M. P., Graversen, E., Schneider, J. W., Kalpazidou Schmidt, E., Aagaard, K., and Mejlgaard, N. (2014) 'Developing a Methodology to Assess the Impact of Research Grant Funding-A Mixed Methods Approach', Evaluation and Program Planning, 43: 105-117.
7. Butler, L. (2002) 'A List of Published Papers is no Measure of Value-The Present System Rewards Quantity, Not Quality - But Hasty Changes Could be as Bad', Nature, 419/6910: 877.
8. Butler, L. (2003a) 'Explaining Australia's Increased Share of ISI Publications-The Effects of a Funding Formula Based on Publication Counts', Research Policy, 32/1: 143-55.
9. Butler, L. (2003b) 'Modifying Publication Practices in Response to Funding Formulas', Research Evaluation, 12/1: 39-46.
10. Butler, L. (2004) 'What happens when funding is linked to publication counts?' In: Moed H. et al. (eds) Handbook of Quantitative Science and Technology Research, pp. 389-405. Netherlands: Kluwer Academic Publishers.
11. Butler, L. (2010) 'Impacts of Performance-based Research Funding Systems: A Review of the Concerns and the Evidence', in Performance-based Funding for Public Research in Tertiary Education Institutions, pp. 127-65. Workshop Proceedings. Paris: OECD.
12. Freedman, D. A. (1991) 'Statistical Models and Shoe Leather', Sociological Methodology, 21/1: 201-313.
13. Hicks, D. (2012) 'Performance-based University Research Funding Systems', Research Policy, 41/2: 251-61.
14. Jiménez-Contreras, E., Moya Anegó n, F. D., and Lopez-Cozar, E. D. (2003) 'The Evolution of Research Activity in Spain-The Impact of the National Commission for the Evaluation of Research Activity (CNEAI)', Research Policy, 32/1: 123-42.
15. Leamer, E. E. (1983) Let's Take the Con of Econometrics', American Economic Review, 73: 31-43.
16. Lieberson, S. (1985) Making it Count: The Improvement of Social Research and Theory. University of California Press, Berkeley.
17. Nordforsk (2010) Bibliometric Research Performance Indicators for the Nordic Countries. Schneider J. W. (ed.). Nordforsk report.
18. Norwegian Association of Higher Education Institutions (UHR) (2004) A Bibliometric Model for Performance-based Budgeting of Research Institutions. Oslo.
19. Osuna, C., Cruz-Castro, L., and Sanz-Menendez, L. (2011) 'Overturning Some Assumptions about the Effects of Evaluation Systems on Publication Performance', Scientometrics, 86/3: 575-92.
20. Schneider, J. W. (2009) 'An Outline of the Bibliometric Indicator Used for Performance-based Funding of Research Institutions in Norway', European Political Science, 8/3: 364-78.
21. Sivertsen, G. (2010) 'A Performance Indicator Based on Complete Data for the Scientific Publication Output at Research Institutions', ISSI Newsletter (International Society for Scientometrics and Informetrics), 6/1: 22-8.
22. Testa, J. (2011) The Globalization of Web of Science: 2005-2010. Thomson Reuters. accessed 16 Feb 2015.
23. Waltman, L., Calero-Medina, C., Noyons, E. C. M, Tijssen, R. J. W., van Eck, N. J., van Leeuwen, T. N., van Raan, A. F. J., Visser, M, and Wouters, P. (2012) The Leiden Ranking 2011/2012: Data Collection, Indicators, and Interpretation', Journal of the American Society for Information Science and Technology, 63/12: 2419-32.
24. Wendt, K., Aksnes, D. W., Sivertsen, G., and Karlsson, S. (2012) 'Challenges in Cross-National Comparisons of R&D Expenditure and Publication Output', in Archambault É ., Gingras Y. and Larivière V. (eds) Proceedings of the 17th International Conference on Science and Technology Indicators, pp. 826-34. Montréal: Science-Metrix and OST.