Do University Teachers Become More Effective With Experience? A Multilevel Growth Model of Students' Evaluations of Teaching Over 13 Years

Journal of Educational Psychology

Volumn 99, Issue 4, 2007, Pages 775-790

  Marsh, Herbert W ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

long term stability and change; multilevel growth modeling; students' evaluations of teaching effectiveness

Indexed keywords

EID: 38049028595     PISSN: 00220663     EISSN: None     Source Type: Journal    
DOI: 10.1037/0022-0663.99.4.775     Document Type: Article

References (52)

1. Aiken L.S., and West S.G. Multiple regression: Testing and interpreting interactions (1991), Sage, Newbury Park, CA
2. Barnes J. Experience and student achievement/teacher effectiveness. In: Husen T., and Postlethwaite T.N. (Eds). International encyclopedia of education: Research and studies (1985), Pergamon Press, Oxford, England 5125-5128
3. Bausell R.B., and Bausell C.R. Student ratings and various instructional variables from a within-instructor perspective. Research in Higher Education 11 (1979) 167-177
4. Blackburn R.T., and Lawrence J.H. Aging and the quality of faculty job-performance. Review of Educational Research 56 3 (1986) 265-290
5. Cohen P.A. Effectiveness of student-rating feedback for improving college instruction: A meta-analysis. Research in Higher Education 13 (1980) 321-341
6. Collins L.M., and Sayer A.G. New methods for the analysis of change (2001), American Psychological Association, Washington, DC
7. Duncan T.E., Duncan S.C., and Stryker L.A. An introduction to latent variable growth curve modeling: Concepts, issues, and applications. 2nd ed. (2006), Erlbaum, London
8. Feldman K.A. Consistency and variability among college students in rating their teachers and courses. Research in Higher Education 6 (1977) 223-274
9. Feldman K.A. The seniority and instructional experience of college teachers as related to the evaluations they receive from their students. Research in Higher Education 18 (1983) 3-124
10. Feldman K.A. Identifying exemplary teachers and teaching: Evidence from student ratings. In: Perry R.P., and Smart J.C. (Eds). Effective teaching in higher education: Research and practice (1997), Agathon, New York 368-395
11. Gilmore G.M., Kane M.T., and Naccarato R.W. The generalizability of student ratings of instruction: Estimates of teacher and course components. Journal of Educational Measurement 15 (1978) 1-13
12. Goldstein H. Multilevel statistical models. 3rd ed. (2003), Hodder Arnold, London
13. Horner K.L., Murray H.G., and Rushton J.P. Relation between aging and rated teaching effectiveness of academic psychologists. Psychology and Aging 4 (1989) 226-229
14. Kane M.T., Gillmore G.M., and Crooks T.J. Student evaluations of teaching: The generalizability of class means. Journal of Educational Measurement 13 (1976) 171-184
15. Kulik J.A., and McKeachie W.J. The evaluation of teachers in higher education. Review of Research in Higher Education 3 (1975) 210-240
16. L'Hommedieu R., Menges R.J., and Brinko K.T. Methodological explanations for the modest effects of feedback. Journal of Educational Psychology 82 (1990) 232-241
17. Marsh H.W. The influence of student, course and instructor characteristics on evaluations of university teaching. American Educational Research Journal 17 (1980) 219-237
18. Marsh H.W. The use of path analysis to estimate teacher and course effects in student ratings of instructional effectiveness. Applied Psychological Measurement 6 (1981) 47-60
19. Marsh H.W. SEEQ: A reliable, valid, and useful instrument for collecting students' evaluations of university teaching. British Journal of Educational Psychology 52 (1982) 77-95
20. Marsh H.W. Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and utility. Journal of Educational Psychology 76 (1984) 707-754
21. Marsh H.W. Students' evaluations of university teaching: Research findings, methodological issues, and directions for future research. International Journal of Educational Research 11 (1987) 253-388
22. Marsh H.W. Distinguishing between good (useful) and bad workload on students' evaluations of teaching. American Educational Research Journal 38 1 (2001) 183-212
23. Marsh H.W. Students' evaluations of university teaching: A multidimensional perspective. In: Perry R.P., and Smart J.C. (Eds). The scholarship of teaching and learning in higher education: An evidence-based perspective (2007), Springer, New York 319-384
24. Marsh H.W., and Bailey M. Multidimensionality of students' evaluations of teaching effectiveness: A profile analysis. Journal of Higher Education 64 (1993) 1-18
25. Marsh H.W., and Dunkin M.J. Students' evaluations of university teaching: A multidimensional perspective. In: Perry R.P., and Smart J.C. (Eds). Effective teaching in higher education: Research and practice (1997), Agathon, New York 241-320
26. Marsh H.W., and Hocevar D. The multidimensionality of students' evaluations of teaching effectiveness: The generality of factor structures across academic discipline, instructor level, and course level. Teaching and Teacher Education 7 (1991) 9-18
27. Marsh H.W., and Hocevar D. Students' evaluations of teaching effectiveness: The stability of mean ratings of the same teachers over a 13-year period. Teaching and Teacher Education 7 (1991) 303-314
28. Marsh H.W., and Overall J.U. Long-term stability of students' evaluations. Research in Higher Education 10 (1979) 139-147
29. Marsh H.W., and Roche L.A. The use of students' evaluations and an individually structured intervention to enhance university teaching effectiveness. American Educational Research Journal 30 (1993) 217-251
30. Marsh H.W., and Roche L.A. The use of students' evaluations of university teaching to improve teaching effectiveness (1994), Australian Department of Employment, Education, and Training, Canberra, Australia
31. Marsh H.W., and Roche L.A. Making students' evaluations of teaching effectiveness effective. American Psychologist 52 (1997) 1187-1197
32. Marsh H.W., and Roche L.A. Effects of grading leniency and low workloads on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?. Journal of Educational Psychology 92 (2000) 202-228
33. Marsh H.W., and Rowe K.J. The negative effects of school-average ability on academic self-concept-an application of multilevel modelling. Australian Journal of Education 40 1 (1996) 65-87
34. McKeachie W.J. Do we need norms of student ratings to evaluate faculty?. Instructional Evaluation and Faculty Development 14 (1996) 14-17
35. Menges R.J. The real world of teaching improvement. In: Theall M., and Franklin J. (Eds). New directions for teaching and learning: No. 48. Effective practices for improving teaching (1991), Jossey-Bass, San Francisco 21-37
36. Murray, H. G. (1990, June). Does evaluation of teaching lead to improvement of teaching? Paper presented at the annual meeting of the Society for Teaching and Learning in Higher Education, Montreal, Canada.
37. Murray H.G. Does evaluation of teaching lead to improvement of teaching?. International Journal for Academic Development 2 1 (1997) 8-23
38. Nesselroade R., and Baltes P.M. Longitudinal research in the study of behavior and development (1979), Academic Press, New York
39. Overall J.U., and Marsh H.W. Midterm feedback from students: Its relationship to instructional improvement and students' cognitive and affective outcomes. Journal of Educational Psychology 71 (1979) 856-865
40. Overall J.U., and Marsh H.W. Students' evaluations of instruction: A longitudinal study of their stability. Journal of Educational Psychology 72 (1980) 321-325
41. Plewis I. Analyzing change: Measurement and explanation using longitudinal data (1985), Wiley, New York
42. Rasbash J., Steele F., Browne W., and Prosser B. A user's guide to MLwiN (Version 2) [Computer software manual] (2005), University of Bristol, Centre for Multilevel Modelling, Bristol, United Kingdom. http://www.cmm.bristol.ac.uk/MLwiN/download/manuals.shtml Available from http://www.cmm.bristol.ac.uk/MLwiN/download/manuals.shtml
43. Raudenbush S.W., and Bryk A.S. Hierarchical linear models: Applications and data analysis methods. 2nd ed. (2002), Sage, Thousand Oaks, CA
44. Renaud R.D., and Murray H.G. Aging, personality, and teaching effectiveness in academic psychologists. Research in Higher Education 37 (1996) 323-340
45. Rindermann H., and Schofield N. Generalizability of multidimensional student ratings of university instruction across courses and teachers. Research in Higher Education 42 4 (2001) 377-399
46. Rogosa D., Brandt D., and Zimowski M.A. Growth curve approach to the measurement of change. Psychological Bulletin 92 3 (1982) 726-748
47. Rogosa D.R., Floden R., and Willett J.B. Assessing the stability of teacher behavior. Journal of Educational Psychology 76 (1984) 1000-1027
48. Ryans D.G. Prediction of teacher effectiveness. In: Harris C.W. (Ed). Encyclopedia of educational research (1960), Macmillan, New York 1486-1491
49. Snijders T.A.B., and Bosker R.J. Multilevel analysis: An introduction to basic and advanced multilevel modeling (1999), Sage, London
50. Wen Z., Marsh H.W., and Hau K.-T. Interaction effects in growth modeling: A full model. Structural Equation Modeling 9 1 (2002) 20-39
51. Willett J.B. Questions and answers in the measurement of change. In: Rothkopf E. (Ed). Review of research in education 15 (1988), American Education Research Association, Washington, DC 345-422
52. Willett J.B., and Sayer A.G. Using covariance structure-analysis to detect correlates and predictors of individual change over time. Psychological Bulletin 116 (1994) 363-381