Measuring efficiency: A comparison of multilevel modelling and data envelopment analysis in the context of higher education

Bulletin of Economic Research

Volumn 58, Issue 2, 2006, Pages 75-104

  Johnes, Jill ^a  

^a LANCASTER UNIVERSITY   (United Kingdom)

Author keywords

Data envelopment analysis; Efficiency measurement; Higher education; Multilevel modelling

Indexed keywords

DATA ENVELOPMENT ANALYSIS; HIGHER EDUCATION; MODELING; UNIVERSITY SECTOR;

EURASIA; EUROPE; UNITED KINGDOM; WESTERN EUROPE;

EID: 33745937527     PISSN: 03073378     EISSN: 14678586     Source Type: Journal    
DOI: 10.1111/j.0307-3378.2006.00238.x     Document Type: Article

References (79)

1. Abbott, M. and Doucouliagos, C. (2003). 'The efficiency of Australian universities: A data envelopment analysis', Economics of Education Review, 22(1), pp. 89-97.
2. Ahn, T. and Seiford, L. M. (1993). 'Sensitivity of data envelopment analysis to models and variable sets in a hypothesis test setting: The efficiency of university operations', in Ijiri, Y. (ed.), Creative and Innovative Approaches to the Science of Management, Westport, CT: Quorum Books.
3. Ahn, T., Arnold, V., Charnes, A. and Cooper, W. W. (1989). 'DEA and ratio efficiency analyses for public institutions of higher learning in Texas', Research in Governmental and Nonprofit Accounting, 5, pp. 165-85.
4. Aigner, D. J., Lovell, C. A. K. and Schmidt, P. (1977). 'Formulation and estimation of stochastic frontier production function models', Journal of Econometrics, 6(1), pp. 21-37.
5. Athanassopoulos, A. D. and Shale, E. (1997). 'Assessing the comparative efficiency of higher education institutions in the UK by means of data envelopment analysis', Education Economics, 5(2), pp. 117-34.
6. Avkiran, N. K. (2001). 'Investigating technical and scale efficiencies of Australian universities through data envelopment analysis', Socio-Economic Planning Sciences, 35(1), pp. 57-80.
7. Barnett, V. D. and Lewis, T. (1963). 'A study of the relation between GCE and degree results', Journal of the Royal Statistical Society, Series A, 126, pp. 187-216.
8. Barnett, V. D., Holder, R. L. and Lewis, T. (1968). 'Some new results on the association between students'ages and their degree results', Journal of the Royal Statistical Society, Series A, 131, pp. 410-33.
9. Barrow, M. (1991). 'Measuring the local education authority performance: a frontier approach', Economics of Education Review, 10(1), pp. 19-27.
10. Beasley, J. E. (1990). 'Comparing university departments', Omega, 18, pp. 171-83.
11. Beasley, J. E. (1995). 'Determining teaching and research efficiencies', Journal of the Operational Research Society, 46(4), pp. 441-52.
12. Bee, M. and Dolton, P. (1985). 'Degree class and pass rates: An inter-university comparison', Higher Education Review, 17, pp. 45-52.
13. Bratti, M. (2002). 'Does the choice of university matter?A study of the differences across UK universities in life sciences students'degree performance', Economics of Education Review, 21, pp. 431-43.
14. Bratti, M., McKnight, A., Naylor, R. and Smith, J. (2003). 'Higher education outcomes, graduate employment and university performance indicators', Department of Economics, University of Warwick.
15. Chalos, P. (1997). 'An examination of budgetary inefficiency in education using data envelopment analysis', Financial Accountability and Management, 13(1), pp. 55-69.
16. Chapman, K. (1994). 'Variability of degree results in geography in UK universities, 1973-1990: Preliminary results and policy implications', Studies in Higher Education, 19(1), pp. 89-102.
17. Coelli, T., Rao, D. S. P. and Battese, G. E. (1998). An Introduction to Efficiency and Productivity Analysis, Norwell, MA: Kluwer Academic.
18. Connolly, K. J. and Smith, P. (1986). 'What makes a "good" degree: Variations between different departments', Bulletin of the British Psychological Society, 39, pp. 48-51.
19. Crum, R. and Parikh, A. (1983), 'Headmasters'reports, admissions and academic performance in social sciences', Educational Studies, 9, pp. 169-84.
20. Cuesta, R. A. and Orea, L. (2002). 'Mergers and technical efficiency in Spanish saving banks: A stochastic distance function approach', Journal of Banking and Finance, 26, pp. 2231-47.
21. Deller, S. C. and Rudnicki, E. (1993). 'Production efficiency in elementary education: The case of Maine public schools', Economics of Education Review, 12(1), pp. 45-57.
22. Eaton, E. G. and West, H. T. (1980). 'Academic performance of mature age students: Recent research in Australia', in Hore, T. and West, H. T. (eds.), Mature Age Students in Australian Higher Education, Victoria: Acacia Press.
23. El-Mahgary, S. and Lahdelma, R. (1995). 'Data envelopment analysis: visualizing the results', European Journal of Operational Research, 85, pp. 700-10.
24. Entwistle, N. J. and Wilson, J. D. (1977). Degrees of Excellence: The Academic Achievement Game, London: Hodder and Stoughton.
25. Førsund, F. R., Lovell, C. A. K. and Schmidt, P. (1980), 'A survey of frontier production functions and of their relationship to efficiency measurement', Journal of Econometrics, 13, pp. 5-25.
26. Freeman, P. R. (1970). 'A multivariate study of students'performance in university examinations', Journal of the Royal Statistical Society Series A, 133, pp. 38-55.
27. Goldstein, H. (1999). Multilevel Statistical Models, London: Institute of Education, available at http://www.soziologie.uni-halle.de/langer/multilevel/books/goldstein.pdf
28. Goldstein, H. and Spiegelhalter, D. J. (1996). 'League tables and their limitations: Statistical issues in comparisons of institutional performance', Journal of the Royal Statistical Society, Series A, 159(3), pp. 385-443.
29. Goldstein, H. and Thomas, S. (1996). 'Using examination results as indicators of school and college performance', Journal of the Royal Statistical Society, Series A, 159(1), pp. 149-63.
30. Hill, P. and Rowe, K. (1996). 'Multilevel modelling in school effectiveness research', School Effectiveness and School Improvement, 7, pp. 1-34.
31. Izadi, H., Johnes, G., Oskrochi, R. and Crouchley, R. (2002). 'Stochastic frontier estimation of a CES cost function: The case of higher education in Britain', Economics of Education Review, 21, pp. 63-71.
32. Johnes, G. (1998). 'The costs of multiproduct organizations and the heuristic evaluation of industrial structure', Socio-Economic Planning Sciences, 32(3), pp. 199-209.
33. Johnes, G. (1999). 'The management of universities: Scottish Economic Society/Royal Bank of Scotland Annual Lecture', Scottish Journal of Political Economy, 46, pp. 505-22.
34. Johnes, G. (2004). 'CIDEA: Software for evaluating confidence intervals in DEA problems', mimeo, Lancaster University Management School, available at http://www.lancs.ac/people/ecagj/cidea.html
35. Johnes, G. and Johnes, J. (1992). 'Apples and oranges: The aggregation problem in publications analysis', Scientometrics, 25(2), pp. 353-65.
36. Johnes, G. and Johnes, J. (1993). 'Measuring the research performance of UK economics departments: An application of data envelopment analysis', Oxford Economic Papers, 45, pp. 332-47.
37. Johnes, G., Johnes, J., Thanassoulis, E., Lenton, P. and Emrouznejad, A. (2005). An Exploratory Analysis of the Cost Structure of Higher Education in England, DFES Research Report 641, London.
38. Johnes, J. (1992). 'The potential effects of wider access to higher education on degree quality', Higher Education Quarterly, 46(1), pp. 88-107.
39. Johnes, J. (1996). 'Performance assessment in higher education in Britain', European Journal of Operational Research, 89, pp. 18-33.
40. Johnes, J. (1997). 'Inter-university variations in undergraduate non-completion rates: A statistical analysis by subject of study', Journal of Applied Statistics, 24(3), pp. 343-61.
41. Johnes, J. (2006a). 'Measuring teaching efficiency in higher education: an application of data envelopment analysis to graduates from UK universities 1993', European Journal of Operational Research, forthcoming.
42. Johnes, J. (2006b). 'DEA and its application to the measurement of efficiency in higher education', Economics of Education Review, forthcoming.
43. Johnes, J. and Taylor, J. (1987). 'Degree quality: An investigation into differences between universities', Higher Education, 16, pp. 581-602.
44. Johnes, J. and Taylor, J. (1989a). 'The first destination of new graduates: Comparisons between universities', Applied Economics, 21(3), pp. 357-74.
45. Johnes, J. and Taylor, J. (1989b). 'Undergraduate non-completion rates: differences between UK universities', Higher Education, 18, pp. 209-25.
46. Johnes, J. and Taylor, J. (1990). Performance Indicators in Higher Education: UK Universities, Milton Keynes: Open University Press and the Society for Research into Higher Education.
47. Johnes, J. and Taylor, J. (1991). 'Non-completion of a degree course and its effect on the subsequent experience of non-completers in the labour market', Studies in Higher Education, 16(1), pp. 73-81.
48. Johnes, J. and Taylor, J. (1992). 'The 1989 research selectivity exercise: A statistical analysis of differences in research rating between universities at the cost centre level', Higher Education Quarterly, 46(1), pp. 67-87.
49. Kang, B.-G. and Greene, K. V. (2002). 'The effects of monitoring and competition on public education outputs: A stochastic frontier approach', Public Finance Review, 30(1), pp. 3-26.
50. Kapur, R. L. (1972). 'Student wastage at Edinburgh University I: Factors related to failure and dropout', Universities Quarterly, 26, pp. 353-77.
51. Korhonen, P., Tainio, R. and Wallenius, J. (2001). 'Value efficiency analysis of academic research', European Journal of Operational Research, 130, pp. 121-32.
52. Lovell, C. A. K. (1993). 'Production frontiers and productive efficiency', in Fried, H. O., Lovell, C. A. K. and Schmidt, S. S. (eds.), The Measurement of Productive Efficiency, Oxford: Oxford University Press.
53. Madden, G., Savage, S. and Kemp, S. (1997). 'Measuring public sector efficiency: A study of economics departments at Australian universities', Education Economics, pp. 153-67.
54. Mallier, T. and Rodgers, T. (1995). 'Measuring value added in higher education: A proposal', Education Economics, 3(2), pp. 119-32.
55. Montague, W. and Odds, F. C. (1990). 'Academic selection criteria and subsequent performance', Medical Education, 24, pp. 151-7.
56. Naylor, R., Smith, J. and McKnight, A. (2000). 'Occupational earnings of graduates: Evidence for the 1993 UK university population', Department of Economics, University of Warwick.
57. Nisbett, J. and Welsh, J. (1972). 'The mature student', Educational Research, 14, pp. 204-7.
58. Portela, M. C. S. and Thanassoulis, E. (2001). 'Decomposing school and school-type efficiency', European Journal of Operational Research, 132(2), pp. 357-73.
59. Rabash, J., Steele, F., Browne, W. and Prosser, B. (2004). A User's Guide to MLwiN, Centre for Multilevel Modelling, Institute of Education, University of London.
60. Rodgers, T. and Ghosh, D. (2001). 'Measuring the determinants of quality in UK higher education: A multinomial logit approach', Quality Assurance in Education, 9(3), pp. 121-6.
61. Rudd, E. (1984). 'A comparison between the results achieved by women and men studying for first degrees in British universities', Studies in Higher Education, 9, pp. 47-57.
62. Sarrico, C. S. and Dyson, R. G. (2000). 'Using data envelopment analysis for planning in UK universities - an institutional perspective', Journal of the Operational Research Society, 51, pp. 789-800.
63. Sarrico, C. S., Hogan, S. M., Dyson, R. G. and Athanassopoulos, A. D. (1997). 'Data envelopment analysis and university selection', Journal of the Operational Research Society, 48, pp. 1163-77.
64. Sear, K. (1983) 'The correlation between A level grades and degree results in England and Wales', Higher Education, 12, pp. 609-19.
65. Simar, L. and Wilson, P. W. (2004). 'Performance of the bootstrap for DEA estimation and iterating the principle', in Cooper, W. W., Seiford, L. M. and Zhu, J. (eds.), Handbook on Data Envelopment Analysis, Boston: Kluwer.
66. Smith, J. and Naylor, R. (2001a). 'Determinants of degree performance in UK universities: A statistical analysis of the 1993 student cohort', Oxford Bulletin of Economics and Statistics, 63, pp. 29-60.
67. Smith, J. and Naylor, R. (2001b). 'Dropping out of university: A statistical analysis of the probability of withdrawal for UK university students', Journal of the Royal Statistical Society, Series A, 164(2), pp. 389-405.
68. Smith, J., McKnight, A. and Naylor, R. (2000). 'Graduate employability: policy and performance in higher education in the UK', The Economic Journal, 110, pp. F382-F411.
69. Smith, P. K. (1990). 'The distribution of psychology degree classes in the UK', Bulletin of the British Psychological Society, 4, pp. 147-52.
70. Snijders, T. A. B. and Bosker, R. J. (1999). Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modelling, London: Sage.
71. Stevens, P. A. (2005). 'Stochastic frontier analysis of English and Welsh universities', Education Economics, 13(4), pp. 355-74.
72. Tarsh, J. (1982). 'The correlation between A levels and degree performance', Unit for Manpower Studies, mimeo.
73. Thanassoulis, E. (1999). 'Setting achievement targets for school children', Education Economics, 7(2), pp. 101-19.
74. Thanassoulis, E. and Portela, M. C. S. (2002). 'School outcomes: Sharing the responsibility between pupil and school', Education Economics, 10(2), pp. 183-207.
75. Thanassoulis, E., Simpson, G., Battisti, G. and Charlesworth-May, A. (2003). 'DEA and multilevel modelling as alternative methods for assessing pupil and school performance', Discussion Paper, Aston Business School.
76. Tomkins, C. and Green, R. (1988). 'An experiment in the use of data envelopment analysis for evaluating the efficiency of UK university departments of accounting', Financial Accountability and Management, 4(2), pp. 147-64.
77. Walker, P. (1975). 'The university performance of mature students', Research in Education, 14, pp. 1-13.
78. Woodhouse, G. and Goldstein, H. (1988). 'Educational performance indicators and LEA league tables', Oxford Review of Education, 14, pp. 301-19.
79. Yang, M. and Woodhouse, G. (2001). 'Progress from GCSE to A and AS level: Institutional and gender differences, and trends over time', British Educational Research Journal, 27(3), pp. 24-46.