Counseling University Instructors Based on Student Evaluations of Their Teaching Effectiveness: A Multilevel Test of its Effectiveness Under Consideration of Bias and Unfairness Variables

Research in Higher Education

Volumn 52, Issue 7, 2011, Pages 717-737

  Dresel, Markus ^a   Rindermann, Heiner ^b  

^a UNIVERSITY OF AUGSBURG   (Germany)

^b CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Bias and unfairness variables; Counseling of instructors; Multi level analysis; Students' evaluations of teaching quality

Indexed keywords

EID: 80053051179     PISSN: 03610365     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11162-011-9214-7     Document Type: Article

References (44)

1. Abrami, P. C., d'Apollonia, S., & Rosenfield, S. (2007). The dimensionality of student ratings of instruction: What we know and what we do not. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 385-456). Dordrecht: Springer.
2. Bray, J. H., & Howard, G. S. (1980). Methodological considerations in the evaluation of a teacher-training program. Journal of Educational Psychology, 72, 62-70.
3. Brinko, K. T. (1990). Instructional consultation with feedback in higher education. Journal of Higher Education, 67, 65-83.
4. Brinko, K. T., & Menges, R. J. (Eds.). (1997). Practically speaking: A sourcebook for instructional consultants in higher education. Stillwater, OK: New Forum.
5. Centra, J. A. (2003). Will teachers receive higher student evaluations by giving higher grades and less course work? Research in Higher Education, 44, 495-518.
6. Cohen, P. A. (1991). Effectiveness of student ratings feedback and consultation for improving instruction in dental school. Journal of Dental Education, 55, 145-150.
7. Cranton, P., & Smith, R. A. (1990). Reconsidering the unit of analysis: A model of student ratings of instruction. Journal of Educational Psychology, 82, 207-212.
8. Erickson, G. R., & Erickson, B. L. (1979). Improving college teaching. An evaluation of a teaching consultation procedure. Journal of Higher Education, 50, 670-683.
9. Feldman, K. A. (2007). Identifying exemplary teachers and teaching: Evidence from student ratings. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 93-143). Dordrecht: Springer.
10. Foersterling, F. (1985). Attributional retraining: A review. Psychological Bulletin, 98, 495-512.
11. Greenwald, A. G. (1997). Validity concerns and usefulness of student ratings of instruction. American Psychologist, 52, 1182-1186.
12. Hampton, S. E., & Reiser, R. A. (2004). Effects of a theory-based feedback and consultation process on instruction and learning in college classrooms. Research in Higher Education, 45, 497-527.
13. Knapper, C., & Piccinin, S. (Eds.). (1999). Using consultants to improve teaching. San Francisco: Jossey-Bass.
14. l'Hommedieu, R. L., Menges, R. J., & Brinko, K. T. (1990). Methodological explanations for the modest effects of feedback from student ratings. Journal of Educational Psychology, 82, 232-241.
15. Marsh, H. W. (1982). SEEQ: A reliable, valid and useful instrument for collecting students' evaluations of university teaching. British Journal of Educational Psychology, 52, 77-95.
16. Marsh, H. W. (2007a). Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 319-383). Dordrecht: Springer.
17. Marsh, H. W. (2007b). Do university teachers become more effective with experience? A multilevel growth model of students' evaluations of teaching over 13 years. Journal of Educational Psychology, 99, 775-790.
18. Marsh, H. W., & Hocevar, D. (1991). Students' evaluations of teaching effectiveness: The stability of mean ratings of the same teacher over a 13-year period. Teaching and Teacher Education, 7, 303-341.
19. Marsh, H. W., & Roche, L. A. (1993). Effects of grading leniency and low workload on students' evaluations of teaching. Journal of Educational Psychology, 92, 202-228.
20. Marsh, H. W., & Roche, L. A. (1997). Making students' evaluations of teaching effectiveness effective. American Psychologist, 52, 1187-1197.
21. McKeachie, W. J. (2007). Good teaching makes a difference-and we know what it is. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 457-474). Dordrecht: Springer.
22. McKeachie, W. J., Lin, Y., Daugherty, M., Moffett, M., Neigler, C., Nork, J., et al. (1980). Using student ratings and consultation to improve instruction. British Journal of Educational Psychology, 50, 168-174.
23. Menges, R. J., & Brinko, K. T. (1986). Effects of student evaluation feedback: A meta-analysis of higher education research. Paper presented at the meeting of the American Educational Research Association, San Francisco.
24. Murray, H. G. (1997). Effective teaching behaviors in the college classroom. In R. P. Perry & J. C. Smart (Eds.), Effective teaching in higher education: Research and practice (pp. 171-204). New York: Agathon Press.
25. Murray, H. G., & Lawrence, C. (1980). Speech and drama training for lecturers as a means of improving university teaching. Research in Higher Education, 13, 73-90.
26. Penny, A. R., & Coe, R. (2004). Effectiveness of consultation on student ratings feedback: A meta-analysis. Review of Educational Research, 74, 215-253.
27. Perry, R. P., & Smart, J. C. (Eds.). (2007). The scholarship of teaching and learning in higher education: An evidence-based perspective. Dordrecht: Springer.
28. Piccinin, S., Cristi, C., & McCoy, M. (1999). The impact of individual consultation on student ratings of teaching. International Journal for Academic Development, 4, 75-88.
29. Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., & Congdon, R. T. (2001). HLM 5 (Version 5. 04). Chicago: Scientific Software International.
30. Richardson, J. T. E. (2005). Instruments for obtaining student feedback: A review of literature. Assessment & Evaluation in Higher Education, 30, 387-415.
31. Rindermann, H. (1996). Zur Qualität studentischer Lehrveranstaltungsevaluationen [On the quality of student evaluations of college courses]. German Journal of Educational Psychology, 10, 129-145.
32. Rindermann, H. (2009). Lehrevaluation - Einführung und Überblick zur Forschung und Praxis der Lehrveranstaltungsevaluation an Hochschulen [Evaluation of teaching-an introduction and overview of research and practice] (2nd ed.). Landau, Germany: VEP.
33. Rindermann, H., & Heller, K. A. (2005). The benefit of gifted classes and talent schools for developing students' competences and enhancing academic self-concept. German Journal of Educational Psychology, 19, 133-136.
34. Rindermann, H., & Kohler, J. (2003). Lässt sich die Lehrqualität durch Evaluation und Beratung verbessern? Überprüfung eines Evaluations-Beratungs-Modells [Does evaluation and consulting improve quality of instruction? Test of an evaluation-consulting-model]. Psychologie in Erziehung und Unterricht, 50, 71-85.
35. Rindermann, H., Kohler, J., & Meisenberg, G. (2007). Quality of instruction improved by evaluation and consultation of instructors. International Journal for Academic Development, 12, 73-85.
36. Rindermann, H., & Schofield, N. (2001). Generalizability of multidimensional student ratings of university instruction across courses and teachers. Research in Higher Education, 42, 377-399.
37. Rotem, A. (1978). The effects of feedback from students to university instructors: An experimental study. Research in Higher Education, 9, 303-318.
38. Snijders, T. A. B., & Bosker, R. J. (2002). Multilevel analysis. An introduction to basic and advanced multilevel modeling. London: Sage.
39. Spiel, C., & Gössler, P. M. (2000). Zum Einfluss von Biasvariablen auf die Bewertung universitärer Lehre durch Studierende [On the influence of bias variables on assessments of university teaching by students]. German Journal of Educational Psychology, 14, 38-47.
40. Ting, K.-F. (2000). Cross-level effects of class characteristics on students' perceptions of teaching quality. Journal of Educational Psychology, 92, 818-825.
41. Webler, W.-D. (1996). Qualitätssicherung in Lehre und Studium an deutschen Hochschulen [Quality Assurance in Teaching and Academic Studies at German Universities]. Zeitschrift für Sozialisationsforschung und Erziehungssoziologie, 16, 119-148.
42. Wendorf, C. A., & Alexander, S. (2005). The influence of individual- and class-level fairness-related perceptions on student satisfaction. Contemporary Educational Psychology, 30, 190-206.
43. Will, H., & Blickhan, C. (1987). Evaluation als Intervention [Evaluation as an intervention]. In H. Will, A. Winteler, & A. Krapp (Eds.), Evaluation in der beruflichen Aus- und Weiterbildung [Evaluation in Vocational Training] (pp. 43-59). Heidelberg: Sauer.
44. Wilson, R. C. (1986). Improving faculty teaching. Effective use of student evaluations and consultants. Journal of Higher Education, 57, 196-211.