Accounting for exogenous influences in performance evaluations of teachers

Economics of Education Review

Volumn 30, Issue 4, 2011, Pages 641-653

  De Witte, Kristof ^a,b   Rogge, Nicky ^a,c  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b MAASTRICHT UNIVERSITY   (Netherlands)

^c HOGESCHOOL UNIVERSITEIT BRUSSEL   (Belgium)

Author keywords

Conditional efficiency; Data envelopment analysis; Education; Teacher performance

Indexed keywords

ACADEMIC RESEARCH; CURRICULUM; DATA ENVELOPMENT ANALYSIS; EFFICIENCY MEASUREMENT; PERFORMANCE ASSESSMENT; STUDENT; TEACHING; UNIVERSITY SECTOR;

EID: 79955465661     PISSN: 02727757     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.econedurev.2011.02.002     Document Type: Article

References (67)

1. Abrami P.C., d'Apollonia S. Current concerns are past concerns. American Psychologist 1999, 54(7):519-520.
2. Aigner D.J., Thum F.D. On student evaluations of university teaching. The Journal of Economic Education 1986, 17(4):243-265.
3. Badri M.A., Abdulla M., Kamali M.A., Dodeen H. Identifying potential biasing variables in student evaluation of teaching in a newly accredited business program in the UAE. International Journal of Educational Management 2006, 20(1):43-59.
4. Baek S.-G., Shin H.-J. Multilevel analysis of the effects of student and course characteristics on satisfaction in undergraduate liberal arts courses. Asian Pacific Education Review 2008, 9(4):475-486.
5. Baldwin T., Blattner N. Guarding against potential bias in student evaluations: What every faculty member needs to know. College Teaching 2003, 51(1):27-32.
6. Basow S.A. Best and worst professors: Gender patterns in students' choices. Sex Roles: A Journal of Research 2000, 43(5/6):407-417.
7. Bettinger, E. P., & Long, B. T. Does cheaper mean better? The impact of using adjunct instructors on student outcomes. The Review of Economics and Statistics, in press.
8. Bifulco R., Bretschneider S. Estimating school efficiency: A comparison of methods using simulated data. Economics of Education Review 2001, 20:417-429.
9. Cazals C., Florens J.P., Simar L. Nonparametric frontier estimation: A robust approach. Journal of Econometrics 2002, 106(1):1-25.
10. Centra J.A., Gaubatz N.B. Is there gender bias in student evaluations of teaching. Journal of Higher Education 2000, 71(1):17-33.
11. Charnes A., Cooper W.W., Rhodes E. Measuring the efficiency of decision making units. European Journal of Operational Research 1978, 2:429-444.
12. Cherchye L., Moesen W., Rogge N., Van Puyenbroeck T. An introduction to 'benefit of the doubt' composite indicators. Social Indicators Research 2007, 82:111-145.
13. Cochran H.H., Hodgin G.L., Zietz J. Student evaluations of teaching: Does pedagogy matter?. Journal for Economic Educators 2003, 4(1):6-18.
14. Cook W.D. Qualitive data in DEA. Handbook on data envelopment analysis 2004, 75-97. Kluwer Academic Publishers, Dordrecht. W.W. Cooper, L. Seiford, J. Zhu (Eds.).
15. Cranton P., Smith R. A new look at the effect of course characteristics on student ratings of instruction. American Educational Research Journal 1986, 23(1):117-128.
16. Daraio C., Simar L. Introducing environmental variables in nonparametric frontier models: A probabilistic approach. Journal of Productivity Analysis 2005, 24(1):93-121.
17. Daraio C., Simar L. Advanced robust and nonparametric methods in efficiency analysis: Methodology and applications. Studies in productivity and efficiency 2007, Springer.
18. Daraio C., Simar L. Conditional nonparametric frontier models for convex and nonconvex technologies: A unifying approach. Journal of Productivity Analysis 2007, 28:13-32.
19. Davies M., Hirschberg J.G., Lye J.N., Johnston C., McDonald I.M. Systematic influences on teaching evaluations: The case for caution. Australian Economic Papers 2007, 46(1):18-38.
20. De Witte, K., & Kortelainen, M. (2008). Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete environmental variables. CES discussion paper series DPS 08.33; MPRA paper 14034.
21. DeBerg C.L., Wilson J.R. An empirical investigation of the potential confounding variables in student evaluation of teaching. Journal of Accounting Education 1990, 8(1):37-62.
22. DeCanio S.J. Student evaluations of teaching - A multinomial logit approach. The Journal of Economic Education 1986, 17:165-176.
23. Dreeben R., Barr R. Classroom composition and the design of instruction. Sociology of Education 1988, 61:129-142.
24. Dundar H., Lewis D.R. Departmental productivity in American universities: Economies of scale and scope. Economics of Education Review 1995, 14(2):119-144.
25. Ehrenberg R.G., Zhang L. Do tenured and tenure-track faculty matter?. The Journal of Human Resources 2005, 40(3):647-659.
26. Ellis L., Burke D.M., Lomire P., McCormack D.R. Student grades and average ratings of instructional quality: The need for adjustment. The Journal of Educational Research 2003, 97(1):35-40.
27. Emery C.R., Kramer T.R., Tian R.G. Return to academic standards: A critique of student evaluations of teaching effectiveness. Quality Assurance in Education 2003, 11(1):37-46.
28. Farrell M.J. The measurement of productive efficiency. Journal of the Royal Statistical Society, Series A 1957, CXX(Part 3):253-290.
29. Feldman K.A. Consistency and variability among college students in rating their teachers and courses: A review and analysis. Research in Higher Education 1977, 6:223-274.
30. Feldman K.A. College students' views of male and female college teachers: Part 1 - Evidence from the social laboratory and experiments. Research in Higher Education 1992, 3:317-375.
31. Feldman K.A. Identifying exemplary teaching: Evidence from student ratings. Effective teaching in higher education: Research and practice 1997, Agathon Press, New York. R.P. Perry, J.C. Smart (Eds.).
32. Feldman K.A. Reflections on the study of effective college teaching and student ratings: One continuing quest and two unresolved issues. Higher education: Handbook of theory and research 1998, vol. 13. Agathon Press, New York.
33. Greenwald A.G., Gilmore G.M. Grading leniency is a removable contaminant of student ratings. American Psychologist 1997, 52(11):1209-1217.
34. Hobson S.M., Talbot D.M. Understanding student evaluations. College Teaching 2001, 49(1):26-32.
35. Hoffmann F., Oreopoulos P. Professor quality and student achievement. The Review of Economics and Statistics 2009, 91(1):83-92.
36. Isely P., Singh H. Do higher grades lead to favorable student evaluations. Journal of Economic Education 2005, 29-42.
37. Jacob B.A., Lefgren L. Can principals identify effective teachers? Evidence on subjective performance evaluation in education. Journal of Labor Economics 2008, 26:101-136.
38. Jeong S., Park B., Simar L. Nonparametric conditional efficiency measures: Asymptotic properties. Annals of Operations Research 2010, 173(1):105-122.
39. Kaschak E. Another look at sex bias in students' evaluations of professors. Psychology of Women Quarterly 1981, 5:767-772.
40. Kirjavainen T., Loikkanen H.A. Efficiency differences of Finnish senior secondary schools: An application of DEA and Tobit analysis. Economics of Education Review 1998, 17(4):377-394.
41. Koh H.C., Tan T.M. Empirical investigation of the factors affecting SET results. International Journal of Educational Management 1997, 11(4):170-178.
42. Krautmann A.C., Sander W. Grades and student evaluations of teachers. Economics of Education Review 1999, 18:59-63.
43. Langbein L. The validity of student evaluations of teaching. Political Science and Politics 1994, 27(3):545-553.
44. Li Q., Racine J. Nonparametric econometrics: Theory and practice 2007, Princeton University Press.
45. Liaw S.-H., Goh K.-L. Evidence and control of biases in student evaluations of teaching. The International Journal of Educational Management 2003, 17(1):37-43.
46. Marsh H.W. SEEQ: A reliable, valid, and useful instrument for collecting students' evaluations of university teaching. British Journal of Educational Psychology 1982, 52:77-95.
47. Marsh H.W. Students' evaluations of university teaching: Research findings, methodological issues, and directions for further research. International Journal of Educational Research 1987, 11:253-288.
48. Marsh H.W. Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness. The scholarship of teaching and learning in higher education: An evidence-based perspective 2007, 319-383. Springer. R.P. Perry, J.C. Smart (Eds.).
49. Marsh H.W., Dunkin M.J. Students' evaluations of university teaching: A multidimensional perspective. Higher education: Handbook of theory and research 1992, vol. 8:143-233. Agathon Press, New York.
50. Marsh H.W., Roche L. The use of students' evaluations of university teaching to improve teaching effectiveness 1994, Australian Department of Employment, Education, and Training, Canberra, ACT.
51. Marsh H.W., Roche L. Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. American Psychologist 1997, 52(11):1187-1197.
52. Marsh H.W., Roche L. Effects of grading leniency and low workload on students' evaluations of teaching, popular myth, bias, validity, or innocent bystanders?. Journal of Educational Psychology 2000, 92(1):202-228.
53. McPherson M.A. Determinants of how students evaluate teachers. Journal of Economic Education 2006, 37:3-20.
54. Melyn, W., & Moesen, W. (1991). Towards a synthetic indicator of macroeconomic performance: Unequal weighting when limited information is available. Public economics research paper, 17, CES, KULeuven.
55. Nasser F., Hagtvet K.A. Multilevel analysis of the effects of student and instructor/course characteristics on student ratings. Research in Higher Education 2006, 47(5):559-590.
56. Perry R.P. Teaching effectively: Which students? What methods?. Higher education: Handbook of theory and research 1997, 154-168. Agathon, New York. J. Smart (Ed.).
57. Pritchard R.D., Watson M.D., Kelly K., Paquin A.R. Helping teachers teach well: A new system for measuring and improving teaching effectiveness in higher education 1998, The New Lexington Press, San Francisco.
58. Rivkin S.G., Hanushek E.A., Kain J.F. Teachers, schools, and academic achievement. Econometrica 2005, 73(2):417-458.
59. Rockoff J.E. The impact of individual teachers on student achievement: Evidence from panel data. The American Economic Review 2003, 92(4):247-252.
60. Rogge, N. Granting teachers the 'benefit of the doubt' in performance evaluations. International Journal of Educational Management, in press.
61. Ryan J.M., Harrison P.D. The relationship between individual characteristics and overall assessment of teaching effectiveness across different instructional contexts. Research in Higher Education 1995, 36:577-594.
62. Streiner D.L., Goldberg J.O., Miller H.R. MCMI-II weights: Their lack of effectiveness. Journal of Personality Assessment 1993, 60:471-476.
63. Wagenaar T.C. Student evaluation of teaching: Some cautions and suggestions. Teaching Sociology 1995, 23(1):64-68.
64. Waldo S. On the use of student data in efficiency analysis - Technical efficiency in Swedish upper secondary school. Economics of Education Review 2007, 26:173-185.
65. Wang M.W., Stanley J.C. Differential weighting: A review of methods and empirical studies. Review of Educational Research 1970, 40:663-705.
66. Wong Y.H.B., Beasly J.E. Restricting weight flexibility in data envelopment analysis. Journal of the Operational Research Society 1990, 41:829-835.
67. Zhou P., Ang B.W., Poh K.L. A mathematical programming approach to constructing composite indicators. Ecological Economics 2007, 62:291-297.