Evaluation as a travelling idea: Assessing the consequences of research assessment exercises

Research Evaluation

Volumn 26, Issue 2, 2017, Pages 55-65

  Karlsson, Sara ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

Evaluation; Publication patterns; Research assessment exercise; Research management; Travelling ideas

Indexed keywords

EID: 85020255774     PISSN: 09582029     EISSN: 14715449     Source Type: Journal    
DOI: 10.1093/reseval/rvx001     Document Type: Article

References (65)

1. Aagaard, K. (2015) 'How Incentives Trickle Down: Local use of a National Bibliometric Indicator System', Science and Public Policy, 42/5: 725-37.
2. Aagaard, K., Bloch, C., and Schneider, J. W. (2015) 'Impacts of Performance-Based Research Funding Systems: The Case of the Norwegian Publication Indicator', Research Evaluation, 24/2: 106-17.
3. Becher, T., and Trowler, P. R. (2001) Academic Tribes and Territories - Intellectual Inquiry and the Culture of Disciplines, 2nd edn. Buckingham & Philadelphia, PA: The Society for Research into Higher Education & the Open University Press.
4. Borrego, M., Douglas, E. P., and Amelink, C. T. (2009) 'Quantitative, Qualitative, and Mixed Research Methods in Engineering Education', Journal of Engineering Education, 98/1: 53-66.
5. Boxenbaum, E., and Jonsson, S. (2008) 'Isomorphism, Diffusion and Decoupling', in Greenwood R., Oliver C., Suddaby R., and Sahlin K. (eds) The SAGE Handbook of Organizational Institutionalism. London: Sage.
6. Butler, L. (2003) 'Academic Reactions: Modifying Research Practices in Response to Funding Formulas', Research Evaluation, 12/1: 39-46.
7. Christensen, T., and Laegreid, P. (2011) 'Introduction', in Christensen T. and Laegreid P. (eds) The Ashgate Research Companion to New Public Management, pp. 1-13. Farnham: Ashgate Publishing.
8. Cohen, L., Manion, L., and Morrison, K. (2011) Research Methods in Education. 7th ed. London & New York: Routledge.
9. Cozzens, S. E. (2007) 'Death By Peer Review? The Impact of Results-Oriented Management in U.S. Research', in The Changing Governance of the Sciences, pp. 225-42. Dordrecht: Springer.
10. Cupples, J., and Pawson, E. (2012) 'Giving an Account of Oneself: The PBRF and the Neoliberal University', New Zealand Geographer, 68/1: 14-23.
11. Czarniawska, B., and Joerges, B. (1996) 'Travels of Ideas', in Czarniawska B. and Sevón G. (eds) Translating Organizational Change. Berlin: de Gruyter.
12. Dahler-Larsen, P. (1998) Den rituelle reflektion: om evaluering i organisationer. Odense: Odense Universitetsforlag.
13. Dahler-Larsen, P. (2012) The Evaluation Society. Stanford, CA.: Stanford Business Books.
14. de Rijcke, S., and Rushforth, A. (2015) 'To Intervene or Not to Intervene: Is That the Question? On the Role of Scientometrics in Research Evaluation', Journal of the Association for Information Science and Technology, 66/9: 1954-8.
15. Deem, R., Hilliyard, S., and Reed, M. (2010) Knowledge, Higher Education, and the New Managerialism. Oxford: Oxford University Press.
16. DiMaggio, P. J., and Powell, W. W. (1983) 'The Iron Cage revisited: Institutional Isomorphism and Collective Rationality in Organizational Fields', American Sociological Review, 48/2: 147-60.
17. Engwall, L. (2008) 'The University: A Multinational Corporation?', in Engwall L. and Weaire D. (eds) The University in the Market, pp. 9-21. London: Portland Press.
18. Engwall, L., and Nybom, T. (2007) 'The Visible Hand versus the Invisible Hand - The Allocation of Research Resources in Swedish Universities', in Whitley R. and Gläser J. (eds) The Changing Governance of the Sciences, pp. 31-49. Dordrecht: Springer.
19. Ferlie, E., Musselin, C., and Andresani, G. (2008) 'The Steering of Higher Education Systems: A Public Management Perspective', Higher Education, 56/3: 325-48.
20. Geuna, A., and Martin, B. E. N. R. (2003) 'University Research Evaluation and Funding: An International Comparison', Minerva, 41: 277-304.
21. Gibbons, M. et al. (1994) The New Production of Knowledge - The Dynamics of Science and Research in Contemporary Societies. London: Sage.
22. Gläser, J., and Laudel, G. (2007) 'Evaluation without Evaluators: The Impact of Funding Formulae on Australian University Research', in Whitley R. and Gläser J. (eds) The Changing Governance of the Sciences, pp. 127-51. Dordrecht: Springer.
23. Hammarfelt, B., and de Rijcke, S. (2014) 'Accountability in Context: Effects of Research Evaluation Systems on Publication Practices, Disciplinary Norms, and Individual Working Routines in the Faculty of Arts at Uppsala University', Research Evaluation, 24/1: 63-77.
24. Henkel, M. (2000) Academic Identities and Policy Change in Higher Education. London: Jessica Kingsley.
25. Huisman, J., and Currie, J. (2004) 'Accountability in Higher Education: Bridge over Troubled Water?', Higher Education, 48/4: 529-51.
26. Ingwersen, P., and Larsen, B. (2014) 'Influence of a Performance Indicator on Danish Research Production and Citation Impact 2000-12', Scientometrics, 101/2: 1325-44.
27. Jiménez-Contreras, E., de Moya Anegón, F., and Delgado López-Cozar, E. (2003) 'The Evolution of Research Activity in Spain. The Impact of the National Commission for the Evaluation of Research Activity (CNEAI)', Research Policy, 32/1: 123-42.
28. Karlsson, S. et al. (2014) 'Not Just Another Evaluation: A Comparative Study of Four Educational Quality Projects at Swedish Universities', Tertiary Education and Management, 20/3: 239-51.
29. Karlsson, S., and Geschwind, L. (2013) Metautv ärdering av Research Assessment Exercise (RAE). Stockholm: KTH.
30. Krücken, G., and Meier, F. (2006) 'Turning the University into an Organizational Actor', in Drori G. S., Meyer J. W., and Hwang H. (eds) Globalization and Organization: World Society and Organizational Change, pp. 241-57. Oxford: Oxford University Press.
31. KTH. (2008) Focusing on Quality - International Research Assessment Exercise Project Report. Stockholm: KTH.
32. KTH. (2012a) Vision 2027. Stockholm: KTH.
33. KTH. (2012b) KTH Research Assessment Exercise 2012. Stockholm: KTH.
34. KTH. (2013) Strategic Plan 2013-2016. Stockholm: KTH.
35. KTH. (2015) Management Report 2015. Stockholm: KTH.
36. Kvale, S., and Brinkmann, S. (2009) Inter Views: Learning the Craft of Qualitative Research Interviewing. Los Angeles, CA: Sage Publications.
37. Lawrence, P. A. (2008) 'Lost in Publication: How Measurement Harms Science', Ethics in Science and Environmental Politics, 8/1: 9-11.
38. Leathwood, C., and Read, B. (2013) 'Research Policy and Academic Performativity: Compliance, Contestation and Complicity', Studies in Higher Education, 38/8: 1162-74.
39. Leisyte, L. (2007) University Governance and Academic Research: Case Studies of Research Units in Dutch and English Universities. Twente: University of Twente.
40. Leisyte, L., Enders, J., and Boer, H. (2009) 'The Balance Between Teaching and Research in Dutch and English Universities in the Context of University Governance Reforms', Higher Education, 58/5: 619-35.
41. Lucas, L. (2006) The Research Game in Academic Life. Maidenhead: Open University Press.
42. Lucas, L. (2014) 'Academic Resistance to Quality Assurance Processes in Higher Education in the UK', Policy and Society, 33/3: 215-24. Policy and Society Associates Ltd Partnership.
43. McNay, I. (2007) 'Research Assessment: Researcher Autonomy', in Kayrooz C., Åkerlind G. S., and Tight M. (eds) Autonomy in Social Science Research: The View from United Kingdom and Australian Universities: International Perspectives on Higher Education Research Vol. 4, pp. 183-216. Bingley: Emerald.
44. McNay, I. (2014) 'Debate: Does Research Quality Assessment Increase Output and Give Value for Money?', Public Money & Management, 35/1: 67-8.
45. Meyer, J. W., and Rowan, B. (1977) 'Institutionalized Organizations: Formal Structure as Myth and Ceremony', American Journal of Sociology, 83/2: 340-63.
46. Morris, N. (2002) 'The Developing Role of Departments', Research Policy, 31/5: 817-33.
47. Nowotny, H., Scott, P., and Gibbons, M. (2001) Re-Thinking Science: Knowledge and the Public in an Age of Uncertainty. Cambridge: Polity Press.
48. Osuna, C., Cruz-Castro, L., and Sanz-Menéndez, L. (2011) 'Overturning some Assumptions about the Effects of Evaluation Systems on Publication Performance', Scientometrics, 86/3: 575-92.
49. Owens, B. (2013) 'Judgement Day', Nature: News Feature, 502: 288-90.
50. Power, M. (1999) The Audit Society: Rituals of Verification. Oxford: Oxford University Press.
51. Reale, E., and Seeber, M. (2010) 'Organisation Response to Institutional Pressures in Higher Education: The Important Role of the Disciplines', Higher Education, 61/1: 1-22.
52. Sahlin, K., and Wedlin, L. (2008) 'Circulating Ideas: Imitation, Translation and Editing', in Greenwood R., Oliver C., Sahlin K., and Suddaby R. (eds) The SAGE Handbook of Organizational Institutionalism. London: SAGE.
53. Salmi, J. (2009) The Challenge of Establishing World-Class Universities. Washington, DC: The World Bank.
54. Schiene, C., and Schimank, U. (2007) 'Research Evaluation as Organisational Development'. in The Changing Governance of the Sciences, pp. 171-90. Dordrecht: Springer.
55. Sikes, P. (2006)'Working in a 'New' University: In the Shadow of the Research Assessment Exercise?', Studies in Higher Education, 31/5: 555-68.
56. Stensaker, B. (2007) 'Quality as Fashion: Exploring the Translation of a Management Idea into Higher Education'. in Westerheijden D. F., Stensaker B., and Rosa M. J. (eds) Quality Assurance in Higher Education: Trends in Regulation, Translation and Transformation, pp. 99-118. Dordrecht: Springer.
57. Stensaker, B., and Harvey, L. (2011) In Stensaker B. and Harvey L. (eds), Accountability in Higher Education: Global Perspectives on Trust and Power. New York: Taylor & Francis.
58. Täljedal, I. B. (2013) 'Publish and Perish: A Note on a Collapsing Academic Authorship', in Transformations in Research, Higher Education and the Academic Market: The Breakdown of Scientific Thought, pp. 145-53. Dordrecht: Springer.
59. Universitetskanslersämbetet. (2015) Forskningsresurser baserade påprestation. Stockholm: Universitetskanslersämbetet.
60. Vetenskapsrådet. (2014) Forskningskvalitetsutv ärdering i Sverige - FOKUS. Stockholm: Vetenskapsrådet.
61. Whitley, R. (2007) 'Changing Governance of the Public Sciences - The Consequences of Establishing Research Evaluation Systems for Knowledge Production in Different Countries and Scientific Fields', in Whitley R. and Gläser J. (eds) The Changing Governance of the Sciences, pp. 3-27. Dordrecht: Springer.
62. Whitley, R., and Gläser, J. (2007) in Whitley R. and Gläser J. (eds) The Changing Governance of the Sciences - The Advent of Research Evaluation Systems. Dordrecht: Springer.
63. Williams, B. (1991) University Responses to Research Selectivity. London: University of London, Centre for Higher Education Studies.
64. van Vught, F. (2008) 'Mission Diversity and Reputation in Higher Education', Higher Education Policy, 21/2: 151-74.
65. Yin, R. K. (2009) Case Study Research: Design and Methods. London: Sage.