Effects of course and instructor characteristics on student evaluation of teaching across a college of engineering

Journal of Engineering Education

Volumn 102, Issue 2, 2013, Pages 289-318

  Johnson, Michael D ^a   Narayanan, Arunachalam ^b   Sawaya, William J ^c  

^a TEXAS A AND M UNIVERSITY   (United States)

^b UNIVERSITY OF HOUSTON   (United States)

^c BOWLING GREEN STATE UNIVERSITY   (United States)

Author keywords

Academic administration; Engineering; Student evaluations of teaching (SETs)

Indexed keywords

ACADEMIC PERFORMANCE; DEMOGRAPHIC DATA; ENGINEERING COLLEGES; ENGINEERING INSTRUCTORS; FACULTY MEMBERS; PUBLIC UNIVERSITIES; STUDENT EVALUATION; TEACHING EFFECTIVENESS;

ENGINEERING; POPULATION STATISTICS; STUDENTS;

TEACHING;

EID: 84880644406     PISSN: 10694730     EISSN: None     Source Type: Journal    
DOI: 10.1002/jee.20013     Document Type: Article

References (82)

1. Adams, J. B. (2005). What makes the grade? Faculty and student perceptions. Teaching of Psychology, 32(1), 21-24.
2. Aleamoni, L. M., & Hexner, P. Z. (1980). A review of the research on student evaluation and a report on the effect of different sets of instructions on student course and instructor evaluation. Instructional Science, 9(1), 67-84.
3. Aleamoni, L. M., & Thomas, G. S. (1980). Differential relationships of student, instructor, and course characteristics to general and specific items on a course evaluation questionnaire. Teaching of Psychology, 7(4), 233.
4. Arreola, R. A. (2007). Developing a comprehensive faculty evaluation system: A guide to designing, building, and operating large-scale faculty evaluation systems. Bolton, MA: Anker.
5. Bailey, C. D., Gupta, S., & Schrader, R. W. (2000). Do students' judgment models of instructor effectiveness differ by course level, course content, or individual instructor? Journal of Accounting Education, 18(1), 15-34.
6. Bennett, S. K. (1982). Student perceptions of and expectations for male and female instructors: Evidence relating to the question of gender bias in teaching evaluation. Journal of Educational Psychology, 74(2), 170-179.
7. Blackhart, G. C., Peruche, B. M., Dewall, C. N., & Joiner Jr, T. E. (2006). Factors influencing teaching evaluations in higher education. Teaching of Psychology, 33(1), 37-39.
8. Blunt, A. (1991). The effects of anonymity and manipulated grades on student ratings of instructors. Community College Review, 18(4), 48.
9. Boyer, E. L. (1990). Scholarship reconsidered: Priorities of the professoriate. Princeton, NJ: Carnegie Foundation for the Advancement of Teaching.
10. Boysen, G. A. (2008). Revenge and student evaluations of teaching. Teaching of Psychology, 35(3), 218-222.
11. Braskamp, L. A., & Ory, J. C. (1994). Assessing faculty work: Enhancing individual and institutional performance. San Francisco, CA: Jossey-Bass.
12. Brightman, H. J. (2005). Mentoring faculty to improve teaching and student learning. Decision Sciences Journal of Innovative Education, 3(2), 191-203.
13. Bunker, M. P., & Clayson, D. E. (2008). Good grades or fair grades: The impact of expected and deserved grades on the student evaluation of instruction. In L. Robinson (Ed.), Proceedings of the Annual Conference of the Academy of Marketing Science, Vancouver, BC, Canada.
14. Burns, S. M., & Ludlow, L. H. (2005). Understanding student evaluations of teaching quality: The contributions of class attendance. Journal of Personnel Evaluation in Education, 18(2), 127-138.
15. Cashin, W. E. (1990). Student ratings of teaching: Recommendations for use. Manhattan, KS: Center for Faculty Evaluation & Development, Kansas State University.
16. Cattell, Raymond B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245-276.
17. Centra, J. A. (1982). Determining faculty effectiveness (2nd ed.). San Francisco, CA: Jossey-Bass.
18. Centra, J. A. (1983). Research productivity and teaching effectiveness. Research in Higher Education, 18(4), 379-389.
19. Centra, J. A., & Gaubatz, N. B. (2000). Is there gender bias in student evaluations of teaching? Journal of Higher Education, 71(1), 17-33.
20. Chapman, L., & Ludlow, L. (2010). Can downsizing college class sizes augment student outcomes? An investigation of the effects of class size on student learning. Journal of General Education, 59(2), 105-123.
21. Clayson, D. E. (2009). Student evaluations of teaching: Are they related to what students learn? Journal of Marketing Education, 31(1), 16-30.
22. Clayson, D. E., Frost, T. F., & Sheffet, M. J. (2006). Grades and the student evaluation of instruction: A test of the reciprocity effect. Academy of Management Learning & Education, 5(1), 52-65.
23. Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155-159.
24. Cohen, P. A. (1981). Student ratings of instruction and student achievement: A meta-analysis of multisection validity studies. Review of Educational Research, 51(3), 281-309.
25. Cohen, P. A. (1989). Do grades influence students' evaluations of clinical courses? Journal of Dental Education, 53(4), 238-240.
26. Divoky, J. J., & Rothermel, M. A. (1988). Student perceptions of the relative importance of dimensions of teaching performance across a type of class. Educational Research Quarterly, 12(3), 40-45.
27. Donaldson, J. F., Flannery, D., & Ross-Gordon, J. (1993). A triangulated study comparing adult college students' perceptions of effective teaching with those of traditional students. Continuing Higher Education Review, 57(3), 147-165.
28. Dresel, M., & Rindermann, H. (2011). Counseling university instructors based on student evaluations of their teaching effectiveness: A multilevel test of its effectiveness under consideration of bias and unfairness variables. Research in Higher Education, 52, 717-737.
29. DuCette, J., & Kenney, J. (1982). Do grading standards affect student evaluations of teaching? Some new evidence on an old question. Journal of Educational Psychology, 74(3), 308-314.
30. El Ansari, W., & Oskrochi, R. (2006). What matters most? Predictors of student satisfaction in public health educational courses. Public Health, 120(5), 462-473.
31. Ellis, L., Burke, D. M., Lomire, P., & Mccormack, D. R. (2003). Student grades and average ratings of instructional quality: The need for adjustment. Journal of Educational Research, 97(1), 35-40.
32. Elmore, P. B., & Lapointe, K. A. (1975). Effect of teacher sex, student sex, and teacher warmth on the evaluation of college instructors. Journal of Educational Psychology, 67(3), 368-374.
33. Feldman, K. A. (1987). Research productivity and scholarly accomplishment of college teachers as related to their instructional effectiveness: A review and exploration. Research in Higher Education, 26(3), 227-298.
34. Feldman, K. A. (1993). College students' views of male and female college teachers: Part II - Evidence from students' evaluations of their classroom teachers. Research in Higher Education, 34(2), 151-211.
35. Feldman, K. A. (2007). Identifying exemplary teachers and teaching: Evidence from student ratings. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 93-143). Dordrech, the Netherlands: Springer.
36. Franklin, J. L., Theall, M., & Ludlow, L. (1991). Grade inflation and student ratings: A closer look. Paper presented at the annual meeting of the American Educational Research Association, Chicago, IL.
37. Gage, N. L. (1961). The appraisal of college teaching: An analysis of ends and means. Journal of Higher Education, 32(1), 17-22.
38. Goldberg, G., & Callahan, J. (1991). Objectivity of student evaluations of instructors. Journal of Education for Business, 66(6), 377.
39. Hippensteel, S. P., & Martin, W. (2005). Increasing the significance of course evaluations in large-enrollment geoscience classes. Journal of Geoscience Education, 53(2), 158-165.
40. Holmes, D. S. (1972). Effects of grades and disconfirmed grade expectancies on students' evaluations of their instructor. Journal of Educational Psychology, 63(2), 130-133.
41. Howard, G. S., & Maxwell, S. E. (1980). Correlation between student satisfaction and grades: A case of mistaken causation? Journal of Educational Psychology, 72(6), 810-820.
42. Howard, G. S., & Maxwell, S. E. (1982). Do grades contaminate student evaluations of instruction? Research in Higher Education, 16(2), 175-188.
43. Isely, P., & Singh, H. (2005). Do higher grades lead to favorable student evaluations? Journal of Economic Education, 36(1), 29-42.
44. Johnson, V. E. (2003). Grade inflation: A crisis in college education. New York, NY: Springer.
45. Kaiser, Henry F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141-151.
46. Kapel, D. E. (1974). Assessment of a conceptually based instructor evaluation form. Research in Higher Education, 2(1), 1-24.
47. Kherfi, S. (2011). Whose opinion is it anyway? Determinants of participation in student evaluation of teaching. Journal of Economic Education, 42(1), 19-30.
48. Kidd, R. S., & Latif, D. A. (2004). Student evaluations: Are they valid measures of course effectiveness? American Journal of Pharmaceutical Education, 68(3), 1-5.
49. Langbein, L. (2008). Management by results: Student evaluation of faculty teaching and the mis-measurement of performance. Economics of Education Review, 27(4), 417-428.
50. Lin, W. Y. (1992). Is class size bias to student ratings of university faculty. Chinese University of Education Journal, 20(1), 49-53.
51. Lovell, G. D., & Haner, C. F. (1955). Forced-choice applied to college faculty rating. Educational and Psychological Measurement, 15(3), 291-304.
52. Marsh, H. W. (1984). Students' evaluations of university teaching: Dimensionality, reliability, validity, potential baises, and utility. Journal of Educational Psychology, 76(5), 707-754.
53. Marsh, H. W. (2007). Do university teachers become more effective with experience? A multilevel growth model of students' evaluations of teaching over 13 years. Journal of Educational Psychology, 99(4), 775-790.
54. Marsh, H. W., Overall, J. U., & Kesler, S. P. (1979). Class size, students' evaluations, and instructional effectiveness. American Educational Research Journal, 16(1), 57-70.
55. Marsh, H. W., & Roche, L. A. (1997). Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. American Psychologist, 52(11), 1187-1197.
56. Marsh, H. W., & Roche, L. A. (2000). Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? Journal of Educational Psychology, 92(1), 202-228.
57. Mateo, M. A., & Fernandez, J. (1996). Incidence of class size on the evaluation of university teaching quality. Educational and Psychological Measurement, 56(5), 771-778.
58. McPherson, M. A. (2006). Determinants of how students evaluate teachers. Journal of Economic Education, 37(1), 3-20.
59. McPherson, M. A., & Jewell, R. T. (2007). Leveling the playing field: Should student evaluation scores be adjusted? Social Science Quarterly, 88(3), 868-881.
60. McPherson, M. A., Jewell, T. R., & Kim, M. (2009). What determines student evaluation scores? A random effects analysis of undergraduate economics classes. Eastern Economic Journal, 35(1), 37-51.
61. Morgan, J., & Davies, T. (2006). Analysis of bias in student evaluations of faculty at an all female Arab university in the Middle East. Learning and Teaching in Higher Education: Gulf Perspectives, 3(2), 1-20.
62. Nimmer, J. G., & Stone, E. F. (1991). Effects of grading practices and time of rating on student rating of faculty performance and student learning. Research in Higher Education, 32(2), 195-215.
63. Patrick, C. L. (2011). Student evaluations of teaching: Effects of the big five personality traits, grades and the validity hypothesis. Assessment and Evaluation in Higher Education, 36(2), 239-249.
64. Petchers, M. K., & Chow, J. C. (1988). Sources of variation in students' evaluations of instruction in a graduate social work program. Journal of Social Work Education, 24(1), 35-42.
65. Peterson, R. L., Berenson, M. L., Misra, R. B., & Radosevich, D. J. (2008). An evaluation of factors regarding students' assessment of faculty in a business school. Decision Sciences Journal of Innovative Education, 6(2), 375-402.
66. Pohlmann, J. T. (1975). A multivariate analysis of selected class characteristic and student rating of instruction. Multivariate Behavioral Research, 10(1), 81.
67. Ragan, J., & Walia, B. (2010). Differences in student evaluations of principles and other economics courses and the allocation of faculty across courses. Journal of Economic Education, 41(4), 335-352.
68. Ratz, H. C. (1975). Factors in the evaluation of instructors by students. IEEE Transactions on Education, E-18(3), 122-127.
69. Remedios, R., & Lieberman, D. A. (2008). I liked your course because you taught me well: The influence of grades, workload, expectations and goals on students' evaluations of teaching. British Educational Research Journal, 34(1), 91-115.
70. Rodabaugh, R. C., & Kravitz, D. A. (1994). Effects of procedural fairness on student judgments of professors. Journal on Excellence in College Teaching, 5(2), 67-83.
71. Sailor, P., Worthen, B. R., & Shin, E.-H. (1997). Class level as a possible mediator of the relationship between grades and student ratings of teaching. Assessment & Evaluation in Higher Education, 22(3), 261-268.
72. Scherr, F. C., & Scherr, S. S. (1990). Bias in student evaluation of teacher effectiveness. Journal of Education for Business, 65(8), 356-358.
73. Schuckman, H. (1990). Students' perceptions of faculty and graduate students as classroom teachers. Teaching of Psychology, 17(3), 162.
74. Spooren, P. (2010). On the credibility of the judge: A cross-classified multilevel analysis on students' evaluation of teaching. Studies in Educational Evaluation, 36(4), 121-131.
75. Statham, A., Richardson, L., & Cook, J. A. (1991). Gender and university teaching: A negotiated difference. Albany, NY: State University of New York Press.
76. Trick, L. R., Lehmkuhle, S., Myers, R., Graham, J., & Davis, S. L. (1993). Do grades affect faculty teaching evaluations? Journal of Optometric Education, 18(3), 88-92.
77. Troy, M. E., Friedrich, K., & Troy, M. F. (1992). Teaching or research? The relationship between scholarly productivity and students' judgments of teaching. Paper presented at the annual meeting of the American Evaluation Association, Seattle, WA.
78. Watkins, D. (1990). Student ratings of tertiary courses for 'alternative calendar' purposes. Assessment & Evaluation in Higher Education, 15(1), 12-21.
79. Westerlund, J. (2008). Class size and student evaluations in Sweden. Education Economics, 16(1), 19-28.
80. Wood, K., Linsky, A. S., & Straus, M. A. (1974). Class size and student evaluations of faculty. Journal of Higher Education, 45(7), 524-534.
81. Yeo, I.-K., & Johnson, R. A. (2000). A new family of power transformations to improve normality or symmetry. Biometrika, 87(4), 954-959.
82. Zabaleta, F. (2007). The use and misuse of student evaluations of teaching. Teaching in Higher Education, 12(1), 55-76.