Rankings and university performance: A conditional multidimensional approach

European Journal of Operational Research

Volumn 244, Issue 3, 2015, Pages 918-930

  Daraio, Cinzia ^a   Bonaccorsi, Andrea ^b,c   Simar, Léopold ^a,d  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

^b UNIVERSITY OF PISA   (Italy)

^c Responsable for National Scientific Habilitation   (United Kingdom)

^d UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

Bootstrap; Conditional directional distances; European universities; Rankings; Robust frontiers

Indexed keywords

DECISION MAKING; OPEN DATA;

BOOTSTRAP; DIRECTIONAL DISTANCES; EUROPEAN UNIVERSITIES; RANKINGS; ROBUST FRONTIERS;

DATA INTEGRATION;

EID: 84926408843     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2015.02.005     Document Type: Article

References (59)

1. Abbott M., and Doucouliagos H. The efficiency of Australian universities: A data envelopment analysis Economics of Education Review 22 2003 89 97
2. Badin L., Daraio C., and Simar L. How to measure the impact of environmental factors in a nonparametric production model European Journal of Operational Research 223 2012 818 833
3. Bastedo M.N., and Bowman N.A. The U.S. news and world report college rankings: Modeling institutional effects on organizational reputation American Journal of Education 116 2010 163 184
4. Bonaccorsi A. Knowledge, diversity and performance in European higher education 2014 Edward Elgar. Cheltenham
5. Bonaccorsi A., and Daraio C. Universities and strategic knowledge creation. Specialization and performance in Europe 2007 Edward Elgar Publisher Cheltenham, UK
6. Bonaccorsi A., and Daraio C. The differentiation of the strategic profile of higher education institutions. New positioning indicators based on microdata Scientometrics 74 1 2008 15 37
7. Bornmann L., Lutz R., and Daniel H.D. Multilevel-statistical reformulation of citation-based university rankings: The Leiden ranking 2011/2012 Journal of the American Society for Information Science and Technology 64 8 2013 1649 1658
8. Bornmann L., de Moya Anegon F., and Mutz R. Do universities or research institutions with a specific subject profile have an advantage or a disadvantage in institutional rankings? A latent class analysis with data from the Scimago ranking Journal of the American Society of Information Science and Technology 64 11 2013 2310 2316
9. Bowden R. Fantasy higher education: University and college league tables Quality in Higher Education 6 1 2000 41 60
10. Buela-Casal G., Gutierrez-Martinez O., Bermudez-Sanchez M., and Vadillo-Mugnoz O. Comparative study of international academic rankings of universities Scientometrics 71 3 2007 349 365
11. Chambers R.G., Chung Y., and Färe R. Benefit and distance functions Journal of Economic Theory 70 1996 407 419
12. Cremonini L., Westerheijden D.F., and Enders J. Disseminating the right information to the right audience: Cultural determinants in the use (and misuse) of rankings Higher Education 55 2008 373 385
13. Daghbashyan Z., Deiaco E., and McKelvey M. How and why does cost efficiency of universities differ across European countries? An explorative attempt using new microdata Bonaccorsi A. Knowledge, diversity and performance in European higher education 2014 Edward Elgar Cheltenham
14. Daouia A., Simar L., and Wilson P.W. Measuring firm performance using nonparametric quantile-type distances Econometric Review 2014 (forthcoming)
15. Daraio C., and Bonaccorsi A. The European university landscape: A micro characterization based on evidence from the Aquameth project Research Policy 40 2011 148 164
16. Daraio, C., Bonaccorsi, A. Simar, L. (2015). Efficiency and economies of scale and specialization in European universities: A directional distance approach (under review for the Journal of Informetrics).
17. Daraio C., and Simar L. Advanced robust and nonparametric methods in efficiency analysis. Methodology and applications 2007 Springer New York
18. Daraio C., and Simar L. Directional distances and their robust versions: Computational and testing issues European Journal of Operational Research 237 2014 358 369
19. Deprins D., Simar L., and Tulkens H. Measuring labor inefficiency in post offices M. Marchand, P. Pestieau, H. Tulkens, The performance of public enterprises: Concepts and measurements 1984 Amsterdam North-Holland 243 267
20. Docampo D. Adjusted sum of institutional scores as an indicator of the presence of university systems in the ARWU ranking Scientometrics 90 2012 701 713
21. Efron B., and Tibshirani R.J. An introduction to the bootstrap 1993 Chapman and Hall London
22. Färe R., Grosskopf S., and Margaritis D. Efficiency and productivity: Malmquist and More. H. Fried, C.A. Knox Lovell, S. Schmidt, The measurement of productive efficiency 2nd 2008 Oxford University Press
23. Färe R., Grosskopf S., and Primont D. Aggregation, Efficiency and Measurement 2007 Springer Science and Business Media LCC, New York
24. Farrell M.J. The measurement of productive efficiency Journal of the Royal Statistical Society A 120 1957 253 281
25. Flegg T., Allen D., Field K., and Thurlow T.W. Measuring the efficiency of British universities: A multi-period data envelopment analysis Education Economics 12 3 2004 231 249
26. Florian R.V. Irreproducibility of the results of the shanghai academic ranking of world universities Scientometrics 72 1 2007 25 32
27. Goldstein H., and Spiegelhalter D.J. League tables and their limitations. Statistical issues in comparisons of institutional performance Journal of the Royal Statistical Society. Series A 159 3 1996 385 443
28. Grosskopf S., Hayes K., and Taylor L.L. Applied efficiency analysis in education Economics and Business Letters 3 1 2014 19 26
29. Grosskopf S., Hayes K., Taylor L.L., and Weber W. Centralized or decentralized control of school resources? A network model Journal of Productivity Analysis 2012 1 12 10.1007/s11123-013-0379-2
30. Hazelkorn E. The impact of league tables and ranking systems on higher education decision making Higher Education Management and Policy 19 2 2007 89 112
31. Hazelkorn E. Rankings and the battle for world-class excellence: Institutional strategies and policy choices Higher Education Management and Policy 21 1 2009 1 22
32. Hemlin S. Research on research evaluations Social Epistemology 10 2 1996 209 250
33. Johnes J. Measuring teaching efficiency in higher education: An application of data envelopment analysis to economics graduates from UK universities 1993 European Journal of Operational Research 174 1 2006 443 456
34. Johnes J. Efficiency and productivity change in the English higher education sector from 1996/97 to 2004/05 The Manchester School 76 6 2008 653 674
35. Johnes J. Efficiency and mergers in english higher education 1996/97 to 2008/9: Parametric and non-parametric estimation of the multi-input multi-output distance function The Manchester School 82 4 2013 465 487
36. Leibenstein H. Allocative efficiency vs. "x-efficiency" American Economic Review 56 1966 392 415
37. Liu N.C. The story of academic ranking of world universities International Higher Education 54 2009 2 3
38. Liu N.C., Cheng Y., and Lin L. Academic ranking of world universities using scientometrics. A comment to the fatal attraction Scientometrics 64 1 2005 101 109
39. Lubrano M. A statistical approach to rankings: Some figures and explanations for European universities Dehon C. Jacobs D. Vermandele C. Ranking universities 2009 Editions de l'Université de Bruxelles Brussels
40. Marginson S. Global position and position-taking: The case of Australia Journal of Studies in International Education 11 1 2007 5 32
41. Marginson S., and van der Wende M. To rank or to be ranked: The impact of global rankings in higher education Journal of Studies in International Education 11 3-4 2007 306 329
42. Moed H.F., Burger W.J., Frankfort J.G., and van Raan A.F.J. The use of bibliometric data for the measurement of university research performance Research Policy 14 1985 131 149
43. Porter S.R., and Toutkoushian R.K. Institutional research productivity and the connection to average student quality and overall reputation Economics of Education Review 25 6 2006 605 617
44. Provan D., and Abercromby K. University league tables and rankings Research in Higher Education 45 5 2000 443 461
45. Safon V. What do global university rankings really measure? The search for the x factor and the x entity Scientometrics 97 2013 223 244
46. Saisana M., D'Hombres B., and Saltelli A. Rickety numbers: Volatility of university rankings and policy implications Research Policy 40 2011 165 177
47. Salmi J., and Saroyan A. League tables as policy instruments: Uses and misuses Higher Education Management and Policy 19 2 2007 33 70
48. Sarrico C.S., and Dyson R.G. Using DEA for planning in UK universities: An institutional perspective Journal of the Operational Research Society 51 7 2000 789 800
49. Sarrico C.S., Teixeira P.N., Rosa M.J., and Cardoso M.F. Subject mix and productivity in Portuguese universities European Journal of Operational Research 197 1 2009 287 295
50. Simar L., and Wilson P. Statistical inference in nonparametric frontier models: The state of the art Journal of Productivity Analysis 13 2000 49 78
51. Simar L., and Wilson P.W. Estimation and inference in two-stage, semi-parametric models of production processes Journal of Econometrics 136 1 2007 31 64
52. Simar L., and Wilson P.W. Inference from cross-sectional stochastic frontier models Econometric Review 29 1 2010 62 98
53. Simar, L. Wilson, P. W. (2014). Statistical approaches for non-parametric frontier models: A guided tour. International Statistical Review, 1-34doi:10.1111/ insr.12056.
54. Stake J.E. The interplay between law school rankings, reputations, and resource allocations: Ways rankings mislead Indiana Law Journal 82 2006 229 270
55. Toutkoushian R.K., and Webber K. Measuring the research performance of postsecondary institutions J.C. Shin, R.K. Toutkoushian, U. Teichler, University rankings. Theoretical basis, methodology and impacts on global higher education 2011 Springer Science Dordrecht
56. Van Dyke N. Twenty years of university report cards Higher Education in Europe 30 2 2005 103 125
57. Van Leeuwen T., Visser M., Moed H., Nederhof T., and van Raan A. The holy grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence Scientometrics 57 2003 257 280
58. Van Raan A.F.J. Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods Scientometrics 62 1 2005 133 143
59. Worthington A.C., and Lee B.L. Efficiency, technology and productivity change in Australian universities 1998-2003 Economics of Education Review 27 3 2008 285 298