Evaluating the performance of academic departments: An analysis of research-related output efficiency

Research Evaluation

Volumn 21, Issue 1, 2012, Pages 2-14

  Agasisti, Tommaso ^a   Catalano, Giuseppe ^a   Landoni, Paolo ^a   Verganti, Roberto ^a  

^a Department of Management Economics and Industrial Engineering ^*  (Italy)

Author keywords

Academic research; Data envelopment analysis; Efficiency; Quality quantity trade off

Indexed keywords

EID: 84863835585     PISSN: 09582029     EISSN: 14715449     Source Type: Journal    
DOI: 10.1093/reseval/rvr001     Document Type: Article

References (52)

1. Agasisti, T. and Dal Bianco, A. (2006) 'Data Envelopment Analysis of the Italian University System: Theoretical Issues and Policy Implications', International Journal of Business Performance Management, 8/4: 344-367.
2. Agasisti, T. and Salerno, C. (2007) 'Assessing the Cost Efficiency of Italian Universities', Education Economics, 15/4: 455-471.
3. Aksnes, D.W. and Rip, A. (2009) 'Researchers' Perceptions of Citations', Research Policy, 38: 895-905.
4. Arvanitis, S., Kubli, U. and Woerter, M. (2003) 'University-Industry Knowledge and Technology Transfer in Switzerland: What University Scientists Think about Co-operation with Private Enterprises', Research Policy, 37/10: 1865-1883.
5. Azoulay, P., Ding, W. and Stuart, T. (2006) 'The Impact of Academic Patenting on the Rate, Quality and Direction of (public) Research', The Journal of Industrial Economics, 52/4: 637-676.
6. Azoulay, P., Ding, W. and Stuart, T. (2007) 'The Determinants of Faculty Patenting Behavior: Demographics or Opportunities', Journal of Economic Behavior and Organization, 63/4: 599-623.
7. Banker, R. D., Charnes, A. and Cooper, W. (1984) 'Models for Estimation of Technical and Scale Inefficiencies in Data Envelopment Analysis', Management Science, 30: 1078-1092.
8. Barker, K. (2007) 'The UK Research Assessment Exercise: the Evolution of a National Research Evaluation System', Research Evaluation, 16/1: 3-12.
9. Beath, J., Owen, R.F., Poyago-Theotoky, J. and Ulph, D. (2003) 'Optimal Incentives for Income-Generation in Universities: the Rule of Thumb for the Compton tax', Internal Journal of Industrial Organization, 21/9: 1301-1322.
10. Bonaccorsi, A., Daraio, C. and Simar, L. (2006) 'Advanced Indicators of Productivity of Universities. An Application of Robust Nonparametric Methods to Italian data', Scientometrics, 66/2: 389-410.
11. Brennan, J. and Teichler, U. (2008) 'The Future of Higher Education and of Higher Education Research', Higher Education, 56: 259-264.
12. Breschi, S., Lissoni, F. and Montobbio, F. (2005) 'From Publishing to Patenting: Do Productive Scientists Turn into Academic Inventors?', Revue d'Economie Industrielle, 110: 75-102.
13. Breschi, S., Lissoni, F. and Montobbio, F. (2008) 'University Patenting and Scientific Productivity. A Quantitative Study of Italian Academic Inventors, European Management Review', The Journal of the European Academy of Management, 5/2: 91-109.
14. Buccola, S., Ervin, D. and Yang, H. (2009) 'Research Choice and Finance in University Bioscience', Southern Economic Journal, 75/4: 1238-1255.
15. Chang, Y., Chen, M., Hua, M. and Yang, P.Y. (2006) 'Managing Academic Innovation in Taiwan: Towards a 'Scientific-Economic' Framework', Technological Forecasting & Social Change, 73/2: 199-213.
16. Charnes, A., Cooper, W.W. and Rhodes, E. (1978) 'Measuring the Efficiency of Decision Making Units', European Journal of Operational Research, 2: 429-444.
17. Coccia, M. and Rolfo, S. (2008) 'Strategic Change of Public Research Units in their Scientific Activity', Technovation, 28/8: 485-494.
18. Cooper, W.W., Seiford, L.M. and Tone, K. (2006) Introduction to Data Envelopment Analysis and its Uses. New York: Springer.
19. Czarnitzki, D., Glä nzel, W. and Hussinger, K. (2007) 'Patent and Publication Activities of German Professors: An Empirical Assessment of their Co-Activity', Research Evaluation, 16/4: 311-319.
20. Dai, Y., Popp, D. and Bretschneider, S. (2005) 'Institutions and Intellectual Property: The Influence of Institutional Forces on University Patenting', Journal of Policy Analysis and Management, 24/3: 579-598.
21. Daraio, C. and Simar, L. (2007) Advanced Robust and Nonparametric Methods in Efficiency Analysis: Methodology and Applications. New York: Springer.
22. Dewett, D. and Denisi, A.S. (2004) 'Exploring Scholarly Reputation: It's More than Just Productivity', Scientometrics, 60/2: 249-272.
23. Etzkowitz, H., Webster, A. and Healy, P. (1998) Capitalizing Knowledge: New Intersections of Industry and Academia. New York: State University of New York Press.
24. Fabrizio, K.R. and Di Minin, A. (2008) 'Commercializing the laboratory: Faculty patenting and the open science environment', Research Policy, 37: 914-931.
25. Gimenez, V.M. and Martinez, J.L. (2006) 'Cost Efficiency in the University: a Departmental Evaluation Model', Economics of Education Review, 25: 543-553.
26. Goldfarb, B. (2008) 'The Effect of Government Contracting on Academic Research: Does the Source of Funding Affect Scientific Output?', Research Policy, 37/1: 41-58.
27. Gulbrandsen, M. and Smeby, J.C. (2005) 'Industry Funding and University Professors' Research Performance', ResearchPolicy, 34/4: 932-950.
28. Haddow, G. and Genoni, P. (2010) 'Citation Analysis and Peer Ranking of Australian Social Science Journals', Scientometrics, article in Press.
29. Harnad, S. (2008) 'Validating Research Performance Metrics against Peer Rankings', Ethics in Science and Environmental Politics, 8: 103-107.
30. Hayati, Z. and Ebrahimy, S. (2009) 'Correlation between Quality and Quantity in Scientific Production: A Case Study of Iranian Organizations from 1997 to 2006', Scientometrics, 80/3: 627-638.
31. Hicks, D. (2009) 'Evolving Regimes of Multi-University Research Evaluation', Higher Education, 57: 393-404.
32. Johnes, G. and Johnes, J. (1993) 'Measuring the Research Performance of UK Economics Departments: an Application of Data Envelopment Analysis', Oxford Economic Papers, 45: 332-347.
33. Johnes, G. and Johnes, J. (1995) 'Research Funding and Performance in UK University Departments of Economics: A Frontier Analysis', Economics of Education Review, 14/3: 301-314.
34. Johnes, J. (2006) 'Data Envelopment Analysis and its Application to the Measurement of Efficiency in Higher Education', Economics of Education Review, 25: 273-288.
35. Koksal, G. and Nalcaci, B. (2006) 'The Relative Efficiency of Departments at a Turkish Engineering College: a Data Envelopment Analysis', Higher Education, 51/1: 173-289.
36. Kroll, H. and Schiller, D. (2010) 'Establishing an Interface between Public Sector Applied Research and the Chinese Enterprise Sector: Preparing for 2020', Technovation, 30/2: 117-119.
37. Lissoni, F., Mairesse, J., Montobbio, F. and Pezzoni, M. (2009) 'Scientific Productivity and Academic Promotion: A Study on French and Italian Physicists, Industrial and Corporate Change', Forthcoming (Working paper n. 27/2009, Knowledge, Internationalization and Technology Studies -Università commerciale Luigi Bocconi, Milan, Italy).
38. Madden, G., Savage, S. and Kemp, S. (1997) 'Measuring Public Sector Efficiency: a Study of Economics Departments at Australian Universities', Education Economics, 5/2: 153-167.
39. Manjarres-Henriquez, L., Gutierrez-Gracia, A., Carrion-Garcia, A. and Vega-Jurado, J. (2009) 'The Effects of University- Industry Relationships and Academic Research On Scientific Performance: Synergy or Substitution?', Research in Higher Education, 50/8: 795-811.
40. Meyer, M. (2006) 'Knowledge Integrators or Weak Links? An Exploratory Comparison of Patenting Researchers with their Non-Inventing Peers in Nano-Science and Technology', Scientometrics, 68/3: 545-560.
41. Moed, H.F. (2007) 'The Future of Research Evaluation Rests with an Intelligent Combination of Advanced Metrics and Transparent Peer Review', Science and Public Policy, 34/8: 575-583.
42. Moed, H.F. (2008) 'UK Research Assessment Exercises: Informed Judgments on Research Quality or Quantity?', Scientometrics, 74/1: 153-161.
43. Moreno, A.A. and Tadepali, R. (2002) 'Assessing Academic Department Efficiency at a Public University', Managerial and Decision Economics, 23: 385-397.
44. Pesenti, R. and Ukovich, W. (1996) 'Evaluating Academic Activities Using DEA', Internal Report, DEEI, Universita di Trieste.
45. Rizzi, D. (1999) L'efficienza dei dipartimenti dell'Università Cà Foscari di Venezia via DEA e DFA (The efficiency of departments at University CàFoscari through DEA and DFA) Working Paper, Università Cà Foscari di Venezia, Dipartimento di Scienze Economiche.
46. Roessner, D. (2000) 'Quantitative and Qualitative Methods and Measures in the Evaluation of Research', Research Evaluation, 8/2: 125-132.
47. Sala, A., Landoni, P. and Verganti, R. (2011) 'R&D networks: an evaluation framework', International Journal of Technology Management, 53/1: 19-43.
48. Stephan, P.E., Gurmu, S., Sumell, A.J. and Black, G. (2007) 'Who's Patenting in the University? Evidence from the Survey of Doctorate Recipients', Economics of Innovation and New Technology, 16/2: 71-99.
49. Thursby, J.G. (2000) 'What Do We Say about Ourselves and What Does It Mean? Yet Another Look at Economics Department Research', Journal of Economic Literature, 38: 383-404.
50. Van Looy, B., Callaert, J. and Debackere, K. (2006) 'Publication and Patent Behavior of Academic Researchers: Conflicting, Reinforcing or Merely Co-Existing?', Research Policy, 35/3: 596-608.
51. Van Looy, B., Landoni, P., Callaert, J., Van Pottelsberghe, B., Sapsalis, E. and Debackere, K. (2011) 'Entrepreneurial Effectiveness of European Universities: An Empirical Assessment of Antecedents and Trade-Offs', Research Policy, 40: 553-564.
52. Zhu, J. (2003) Quantitative Models for Performance Evaluation and Benchmarking. Boston, MA: Kluwer Academic Publisher.