The UK and Italian research assessment exercises face to face

Research Policy

Volumn 42, Issue 9, 2013, Pages 1657-1666

  Rebora, Gianfranco ^a   Turri, Matteo ^b  

^a CREMS Centre for Research on Health Economics Social and Health Care Management Carlo Cattaneo University LIUC   (Italy)

^b UNIVERSITY OF MILAN   (Italy)

Author keywords

RAE; Reactivity; REF; Research assessment; VQR

Indexed keywords

CONTROL SYSTEMS; REACTIVITY (NUCLEAR);

NEW PUBLIC MANAGEMENT; ORGANISATIONAL; RAE; REF; RESEARCH ASSESSMENT EXERCISE; RESEARCH EVALUATION; THEORETICAL FRAMEWORK; VQR;

RESEARCH;

EID: 84885590737     PISSN: 00487333     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.respol.2013.06.009     Document Type: Article

References (96)

1. ANVUR Valutazione della Qualità della ricerca 2004-2010. Bando di partecipazione [WWW Document]. 2011 URL http://www.anvur.org (accessed 1.05.12).
2. ANVUR La valutazione della qualità della ricerca [WWW Document] 2012 URL http://www.anvur.org (accessed 29.05.12)
3. R.N. Anthony Planning and Control Systems: A Framework for Analysis 1965 Harvard Business School Boston
4. K. Barker The UK Research Assessment Exercise: the evolution of a national research evaluation system Research Evaluation 16 2007 3 12
5. M. Bauer, and M. Kogan Evaluation systems in the UK and Sweden: successes and difficulties European Journal of Education 32 1997 129 143
6. I. Bleiklie, and M. Kogan Organization and governance of universities Higher Education Policy 20 2007 477 493
7. L. Boltanski, and L. Thévenot De la justification. Les economies de la grandeur 1991 Gallimard Paris
8. M. Bressan, S. Miscia, R. Palumbo, E. Reale, P. Sacchetta, M. Seeber, and M. Impicciatore Caratteristiche e Dimensioni del VTR E. Reale, La Valutazione Della Ricerca Pubblica. Una Analisi della Valutazione Triennale della Ricerca 2008 Franco Angeli Milano 17 37
9. A. Brew, and D. Boud Understanding academics' engagement with research A. Brew, L. Lucas, Academic Research and Researchers 2009 Open University Press Maidenhead 189 203
10. T. Brinn, M.J. Jones, and M. Pendlebury The impact of Research Assessment Exercises on UK accounting and finance faculty The British Accounting Review 33 2001 333 355
11. J. Broadbent The UK Research Assessment Exercise: performance measurement and resource Allocation Australian Accounting Review 20 2010 14 23
12. J. Broadbent, and R. Laughlin Performance management systems: a conceptual model Management Accounting Research 20 2009 283 295
13. N. Brunsson, and K. Sahlin-Andersson Constructing organizations: the example of public sector reform Organization Studies 21 2000 721 746
14. L. Butler Impacts of performance-based research funding systems: a review of the concerns and the evidence Performance-Based Funding for Public Research in Tertiary Education Institutions 2010 OECD Publishing Paris 127 165 10.1787/9789264094611-en (accessed 6.05.12)
15. CIVR Relazione finale 2006 http://vtr2006.cineca.it/php5/vtr-rel-civr- index.php?info= (accessed 18.06.12).
16. G. Capano Looking for serendipity: the problematical reform of government within Italy's universities Higher Education 55 2008 481 504
17. G. Capano A Sisyphean Task: evaluation and institutional accountability in Italian higher education Higher Education Policy 23 2010 39 62
18. G. Capano Government continues to do its job. A comparative study of governance shifts in the higher education sector Public Administration 89 2011 1622 1642
19. L.B. Cardinal Technological innovation in the pharmaceutical industry: the use of organizational control in managing research and development Organization Science 12 2001 19 36
20. C. Charle L'évaluation des enseignants-chercheurs Critiques et propositions Vingtième Siècle. Revue d'histoire 102 2009 159 170
21. A.M. Chiesi La valutazione della produzione sociologica Quaderni di Sociologia 52 2008 123 134
22. R. Deem, S. Hillyard, and M. Reed Knowledge, Higher Education, and the New Managerialism: The Changing Management of UK Universities 2007 Oxford University Press Oxford, UK
23. P.J. DiMaggio, and W.W. Powell The iron cage revisited: institutional isomorphism and collective rationality in organizational fields American Sociological Review 48 1983 147 160
24. T. Diefenbach New public management in public sector organisations - the dark sides of managerialistic "enlightenment" Public Administration 87 2009 892 899
25. R.L.M. Dunbar, and M. Statler A historical perspective of organizational control S.B. Sitkin, L.B. Cardinal, K. Bijlsma-Frankema, Organisational Control 2010 Cambridge University Press Cambridge
26. K.M. Eisenhardt Control: organizational and economic approaches Management Science 31 1985 134 149
27. L. Elton The Research Assessment Exercise: unintended consequences Higher Education Quarterly 54 2000 274 283
28. W.N. Espeland, and M. Sauder Rankings and reactivity: how public measures recreate social worlds American Journal of Sociology 113 2007 1 40
29. J. Fagerberg, H. Landström, and B.R. Martin Exploring the emerging knowledge base of "the knowledge society" Research Policy 41 2012 1121 1131
30. E. Ferlie, and G. Andresani United Kingdom from Bureau Professionalism to New Public Management C. Paradeise, E. Reale, I. Bleiklie, E. Ferlie, University Governance. Western European Comparative Perspectives 2008 Springer Dordrecht 177 196
31. A. Ferreira, and D. Otley The design and use of performance management systems: an extended framework for analysis Management Accounting Research 20 2009 263 282
32. S. Fiori Laurea DOC La Repubblica 49 2012
33. E.G. Flamholtz, T.K. Das, and A.S. Tsui Toward an integrative framework of organizational control Accounting, Organizations and Society 10 1985 35 50
34. M. Franceschet, and A. Costantini The first Italian research assessment exercise: a bibliometric perspective Journal of Informetrics 5 2011 275 291
35. P. Garegnani Sulla valutazione della ricerca economica Rivista Italiana degli Economisti 2007 177 190
36. A. Geuna, and B.E.N.R. Martin University research evaluation and funding: an international comparison Minerva 41 2003 277 304
37. J. Gläser, G. Laudel, S. Hinze, and L. Butler Impact of evaluation-based funding on the production of scientific knowledge: What to worry about, and how to find out. Expertise for the German Ministry for Education and Research, Research Program 'Knowledge for decision-making processes - research on the relationship between science politics and society' 2002 http://www.sciencepolicystudies.de/publikation/expertise.htm (accessed 15.05.12)
38. HEFCE Identification and dissemination of lessons learned by institutions participating in the Research Excellence Framework (REF) bibliometrics pilot [WWW Document] 2009 http://www.ref.ac.uk/ (accessed 1.05.12)
39. HEFCE Assessment framework and guidance on submissions. Contents 2011 http://www.ref.ac.uk (accessed 1.05.12)
40. H.F. Hansen Performance indicators used performance-based research funding system OECD Publishing Performance-Based Funding for Public Research in Tertiary Education Institutions. Workshop Proceedings 2010 53 84 10.1787/9789264094611-en (accessed 6.05.12)
41. M. Henkel The modernisation of research evaluation: the case of the UK Higher Education 1999 105 122
42. D. Hicks Evolving regimes of multi-university research evaluation Higher Education 57 2009 393 404
43. D. Hicks Overview of models of performance-based research funding systems OECD Performance-Based Funding for Public Research in Tertiary Education Institutions 2010 23 52 10.1787/9789264094611-en (accessed 6.05.12)
44. D. Hicks Performance-based university research funding systems Research Policy 41 2012 251 261
45. Hm Treasury Science & innovation investment framework 2004-2014 2004 http://www.bis.gov.uk/ (accessed 29.05.12).
46. A.G. Hopwood Changing pressures on the research process: on trying to research in an age when curiosity is not enough European Accounting Review 17 2008 87 96
47. J. Huisman, G. Rebora, and M. Turri The Effects of Quality Assurance in Universities Empirical Evidence from Three Case Studies BT - EUA Bologna Handbook 2007 European University Association (EUA) Brussels
48. W.H.A. Johnson Managing university technology development using organizational control theory Research Policy 40 2011 842 852
49. L. Karpik L'économie des singularités 2007 Gallimard Paris
50. S. Kerr On the folly of rewarding a, while hoping for B Academy of Management Journal 18 1975 769 783
51. K. Langfield-Smith Management control systems and strategy: a critical review Accounting, Organizations and Society 22 1997 207 232
52. R. Lewis Excellence Without a Soul. Does Liberal Education Have Future? 2006 Public Affairs New York
53. S. Louvel, and S. Lange L'évaluation de la recherche: l'exemple de trois pays européens Sciences de la Société 79 2010 11 26
54. L. Lucas The Research Game in Academic Life 2006 Open University Press Maidenhead
55. J.G. March, and J.P. Olsen The logic of appropriateness M. Moran, M. Rein, R. Goodin, The Oxford Handbook of Public Policy 2006 Oxford University Press Oxford 687 798
56. B.R. Martin The Research Excellence Framework and the "impact agenda": are we creating a Frankenstein monster? Research Evaluation 20 2011 247 254
57. B.R. Martin, and R. Whitley The UK Research Assessment Exercise: a case of regulatory capture? R. Whitley, J. Gläser, L. Engwall, Reconfiguring Knowledge Production: Changing Authority Relationships in the Sciences and Their Consequences for Intellectual Innovation 2010 Oxford University Press Oxford, UK 51 80
58. I. McNay The Research Assessment Exercise (RAE) and after: "you never know how it will all turn out" Perspectives Policy and Practice in Higher Education 2 1998 19 22
59. I. McNay The paradoxes of research assessment and funding M. Henkel, B. Little, Changing Relationship Between Higher Education and the State 1999 Jessica Kingley publisher London 191 203
60. I. McNay Research assessment: researcher autonomy C. Kayrooz, G. Akerlind, M. Tight, Autonomy in Social Science Research: The View from United Kingdom and Australian Universities 2007 Elsevier New York
61. A. Merchant Control in business organization. Accounting Organizations and Society 32 1987 471 472
62. J.W. Meyer, and B. Rowan Institutionalized organizations: formal structure as myth and ceremony American Journal of Sociology 83 1977 340 363
63. J.W. Meyer, W.R. Scott, and T.E. Deal Institutional and technical sources of organizational structure: explaining the structure of educational organizations Paper Prepared for a Conference on Human Service Organizations at the Center for Advanced Study in the Behavioral Sciences Stanford, March 2-3, 1979 1980
64. M. Meyer, and V. Gupta The performance paradox Research in Organizational Behavior 15 1994 309 369
65. E. Minelli, G. Rebora, and M. Turri How can evaluation fail? The case of Italian universities Quality in Higher Education 14 2008 157 173
66. E. Minelli, G. Rebora, and M. Turri The Structure and Significance of the Italian Research Assessment Exercise (VTR). BT - European Universities in Transition 2008 Edward Elgar Cheltenham (UK)
67. E. Minelli, G. Rebora, and M. Turri The risk of failure of controls and levers of change: an examination of two Italian sectors Journal of Accounting and Organizational Change 4 2008 5 26
68. H.F. Moed UK Research Assessment Exercises: informed judgments on research quality or quantity? Scientometrics 74 2008 153 161
69. C.C. Morphew Conceptualizing change in the institutional diversity of U.S. Colleges and Universities The Journal of Higher Education 80 2009 243 269
70. C. Musselin European academic labor markets in transition Higher Education 49 2005 135 154
71. OECD Performance-based Funding for Public Research in Tertiary Education Institutions: Workshop Proceedings 2010 OECD Publishing 10.1787/9789264094611-en (accessed 6.05.12)
72. M. Osterloh, and B.S. Frey Creativity and conformity: alternatives to the present peer review system 2008 http://www.ncbi.nlm.nih.gov/pmc/articles/ PMC2850525/ (accessed 29.05.12)
73. D. Otley Research assessment in the UK: an overview of 1992-2008 Australian Accounting Review 20 2010 3 13
74. J. Parker Comparing research and teaching in university promotion criteria Higher Education Quarterly 62 2008 237 251
75. L. Parker Critical perspectives on accounting university corporatisation: driving redefinition Critical Perspectives on Accounting 22 2011 434 450
76. C. Pollitt Bureaucracies remember, post-bureaucratic organizations forget? Public Administration 87 2009 198 218
77. C. Pollitt, and G. Bouckaert Public Management Reform: A Comparative Analysis 2004 Oxford University Press Oxford, UK
78. M. Power The Audit Society: Rituals of Verification 1997 Oxford University Press Oxford
79. I. Rafols, L. Leydesdorff, A. O'Hare, P. Nightingale, and A. Stirling How journal rankings can suppress interdisciplinary research: a comparison between Innovation Studies and Business & Management Research Policy 41 2012 1262 1282
80. E. Reale La Valutazione della Ricerca Pubblica 2008 Franco Ang. ed. Milano
81. E. Reale, A. Barbara, and A. Costantini Peer review for the evaluation of academic research: lessons from the Italian experience Research Evaluation 16 2007 216 228
82. G. Rebora L'università tra inferno e paradiso. Gli atenei italiani alla prova della valutazione 2010 ScriptaWeb Napoli
83. G. Rebora, and M. Turri Critical factors in the use of evaluation in Italian universities Higher Education 61 2011 531 544
84. G. Rebora, and M. Turri Frameworks, effects and significance of research assessment in the Italian university system M. Vukasović, P. Maassen, M. Nerland, R. Pinheiro, B. Stensaker, V. Agnete, Effects of Higher Education Reforms: Change Dynamics 2012 Sense Rotterdam 203 215
85. M. Reed New managerialism, professional power and organisational governance in UK universities: a review and assessment A. Amaral, G.A. Jones, B. Karseth, Governing Higher Education: National Perspectives on Institutional Governance 2002 Kluwer Academic Publishers Dordrecht 163 186
86. S.B. Sitkin Sense-making in organizational control Research in the Sociology of Organizations 28 2010 409 418
87. S.B. Sitkin, L.B. Cardinal, and K.M. Bijlsma-Frankema Control is fundamental S.B. Sitkin, L.B. Cardinal, K. Bijlsma-Frankema, Organisational Control 2010 Cambridge University Press Cambridge
88. P. Smith On the unintended consequences of publishing performance data in the public sector International Journal of Public Administration 18 1995 277 310
89. S. Smith, V. Ward, and A. House "Impact" in the proposals for the UK's Research Excellence Framework: shifting the boundaries of academic autonomy Research Policy 40 2011 1369 1379
90. D. Talib Institutional behaviour impact of the 1996 RAE Higher Education Review 36 2003 57 77
91. D. Talib, and A. Steele The Research Assessment Exercise: strategies and trade-offs Higher Education Quarterly 54 2000 68 87
92. T. Tapper, and B. Salter Interpreting the process of change in higher education: the case of the Research Assessment Higher Education Quarterly 57 2003 4 23
93. T. Tapper, and B. Salter Governance of Higher Education in Britain: the significance of the research assessment exercises for the funding council model Higher Education Quarterly 58 2004 4 30
94. S.V. Thiel, and F.L. Leeuw The performance paradox in the public sector Public Performance Management Review 25 2002 267 281
95. M. Turri L'università in transizione: governance, struttura economica e valutazione 2011 Guerini Milano
96. K. Yokoyama The effect of the research assessment exercise on organisational culture in English universities: collegiality versus managerialism Tertiary Education and Management 12 2006 311 322