Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?

Journal of Educational Psychology

Volumn 92, Issue 1, 2000, Pages 202-228

  Marsh, Herbert W ^a   Roche, Lawrence A ^b  

^a UNIVERSITY OF WESTERN SYDNEY   (Australia)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0034144905     PISSN: 00220663     EISSN: None     Source Type: Journal    
DOI: 10.1037/0022-0663.92.1.202     Document Type: Review

References (59)

1. Abrami, P. C., d'Apollonia, S., & Cohen, P. A. (1990). Validity of student ratings of instruction: What we know and what we do not. Journal of Educational Psychology, 82, 219-231.
2. Abrami, P. C., Dickens, W. J., Perry, R. P., & Leventhal, L. (1980). Do teacher standards for assigning grades affect student evaluations of instruction? Journal of Educational Psychology, 72, 107-118.
3. Aiken, L. S., & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
4. Aleamoni, L. (1987). Student rating myths versus research facts. Journal of Personnel Evaluation in Education, 1, 111-119.
5. Cashin, W. E. (1988). Student ratings of teaching: A summary of research (IDEA Paper No. 20). Manhattan: Kansas State University, Division of Continuing Education. (ERIC Document Reproduction Service No. ED 302 567).
6. Cashin, W. E., & Downey, R. G. (1992). Using global student rating items for summative evaluation. Journal of Educational Psychology, 84, 563-572.
7. Centra, J. A. (1993). Reflective faculty evaluation. San Francisco: Jossey-Bass.
8. Centra, J. A., & Creech, F. R. (1976). The relationship between student, teacher, and course characteristics and student ratings of teacher effectiveness. Princeton, NJ: Educational Testing Service.
9. Cohen, J., & Cohen, P. (1983). Applied multiple regression/ correlation analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
10. Cohen, P. A. (1987, April). A Critical Analysis and Reanalysis of the Multisection Validity Meta-analysis. Paper presented at the annual meeting of the American Educational Research Association, Washington, DC. (ERIC Document Reproduction Service No. ED 283 876).
11. Covington, M. V. (1997). A motivational analysis of academic life in college. In R. P. Perry & J. C. Smart (Eds.), Effective teaching in higher education: Research and practice (pp. 61-100). New York: Agathon.
12. d'Apollonia, S., Lou, Y, & Abrami, P. C. (1998). Making the grade: A meta-analysis on the influence of grade inflation on student ratings. Manuscript submitted for publication.
13. Feldman, K. A. (1976). Grades and college students' evaluations of their courses and teachers. Research in Higher Education, 4, 69-111.
14. Feldman, K. A. (1989a). Association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies. Research in Higher Education, 30, 583-645.
15. Feldman, K. A. (1989b). Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers. Research in Higher Education, 30, 137-194.
16. Feldman, K. A. (1997). Identifying exemplary teachers and teaching: Evidence from student ratings. In R. P. Perry & J. C. Smart (Eds.), Effective teaching in higher education: Research and practice (pp. 368-395). New York: Agathon.
17. Feldman, K. A. (1998). Reflections on the study of effective college teaching and student ratings: One continuing quest and two unresolved issues. In J. C. Smart (Ed.), Higher education: Handbook of theory and research (Vol. 13, pp. 35-74). New York: Agathon.
18. Franklin, J., & Theall, M. (1996, April). Disciplinary difference in sources of systematic variation in student ratings of instructor effectiveness and students' perceptions of the value of class preparation time: A comparison of two universities'rating data. Paper presented at the annual meeting of the American Educational Research Association, New York.
19. Freedman, R. D., & Stumpf, S. A. (1978). Student evaluation of courses and faculty based on a perceived learning criterion: Scale construction, validation, and comparison of results. Applied Psychological Measurement, 2, 189-202.
20. Frey, P. W. (1978). A two dimensional analysis of student ratings of instruction. Research in Higher Education, 9, 69-91.
21. Gillmore, G. M., & Greenwald, A. G. (1994). The effects of course demands and grading leniency on student ratings of instruction (Report No. 94-4). Seattle: University of Washington, Office of Educational Assessment.
22. Greenwald, A. (1996). Applying social psychology to reveal a major (but correctable) flaw in student evaluations of teaching. Unpublished manuscript, University of Washington.
23. Greenwald, A. G. (1997). Validity concerns and usefulness of student ratings of instruction. American Psychologist, 52, 1182-1186.
24. Greenwald, A. G. (1998, April). The positive relationship between course grades and course ratings: What is the cause and what, if anything, should be done about it? Symposium conducted at the annual meeting of the American Educational Research Association, New York.
25. Greenwald, A. G., & Gillmore, G. M. (1997a). Grading leniency is a removable contaminant of student ratings. American Psychologist, 52, 1209-1217.
26. Greenwald, A. G., & Gillmore, G. M. (1997b). No pain, no gain? The importance of measuring course workload in student ratings of instruction. Journal of Educational Psychology, 89, 743-751.
27. Howard, G. S., & Maxwell, S. E. (1980). The correlation between student satisfaction and grades: A case of mistaken causation? Journal of Educational Psychology, 72, 810-820.
28. Howard, G. S., & Maxwell, S. E. (1982). Do grades contaminate student evaluations of instruction? Research in Higher Education, 16, 175-188.
29. Joreskog, K. G., & Sörbom, D. (1993). LISREL-8: Structural equation modeling with the SIMPLIS command language. Chicago: Scientific Software International.
30. Linn, R. L., Centra, J. A., & Tucker, L. R. (1974). Between, within, and total factor analyses of students' rating of instruction (Report No. RB-74-39). Princeton, NJ: Educational Testing Service.
31. Marsh, H. W. (1976). The relationship between background variables and students' evaluations of instructional quality. Los Angeles: University of Southern California, Office of Institutional Studies.
32. Marsh, H. W. (1980). The influence of student, course, and instructor characteristics on evaluations of university teaching. American Educational Research Journal, 17, 219-237.
33. Marsh, H. W. (1982). The use of path analysis to estimate teacher and course effects in student ratings of instructional effectiveness. Applied Psychological Measurement, 6, 47-59.
34. Marsh, H. W. (1983). Multidimensional ratings of teaching effectiveness by students from different academic settings and their relation to student/course/instructor characteristics. Journal of Educational Psychology, 75, 150-166.
35. Marsh, H. W. (1984). Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and utility. Journal of Educational Psychology, 76, 707-754.
36. Marsh, H. W. (1986a). Applicability paradigm: Students' evaluations of teaching effectiveness in different countries. Journal of Educational Psychology, 78, 465-473.
37. Marsh, H. W. (1986b). The self serving effect (bias?) in academic attributions: Its relation to academic achievement and self-concept. Journal of Educational Psychology, 78, 190-200.
38. Marsh, H. W. (1987). Students' evaluations of university teaching: Research findings, methodological issues, and directions for future research. International Journal of Educational Research, 11, 253-388.
39. Marsh, H. W. (1995). Still weighting for the right criteria to validate student evaluations of teaching in the IDEA system. Journal of Educational Psychology, 87, 666-679.
40. Marsh, H. W., Balla, J. R., & Hau, K. T. (1996). An evaluation of incremental fit indices: A clarification of mathematical and empirical processes. In G. A. Marcoulides & R. E. Schumacker (Eds.), Advanced structural equation modeling: Issues and techniques (pp. 315-353). Hillsdale, NJ: Erlbaum.
41. Marsh, H. W., & Dunkin, M. (1992). Students' evaluations of university teaching: A multidimensional perspective. Higher education: Handbook on theory and research (Vol. 8, pp. 143-234). New York: Agathon.
42. Marsh, H. W., & Hocevar, D. (1991). The multidimensionality of students' evaluations of teaching effectiveness: The generality of factor structures across academic discipline, instructor level, and course level. Teaching and Teacher Education, 7, 9-18.
43. Marsh, H. W., & Overall, J. U. (1979). Validity of students' evaluations of teaching: A comparison with instructor self-evaluations by teaching assistants, undergraduate faculty, and graduate faculty. (ERIC Document Reproduction Service No. ED177 205)
44. Marsh, H. W., & Röche, L. A. (1993). The use of students' evaluations and an individually structured intervention to enhance university teaching effectiveness. American Educational Research Journal, 30, 217-251.
45. Marsh, H. W., & Roche, L. A. (1994). The use of students' evaluations of university teaching to improve teaching effectiveness. Canberra: Australian Government Publishing Service.
46. Marsh, H. W., & Roche, L. A. (1997). Making students' evaluations of teaching effectiveness effective. American Psychologist, 52, 1187-1197.
47. Marsh, H. W., & Ware, J. E. (1982). Effects of expressiveness, content coverage, and incentive on multidimensional student rating scales: New interpretations of the Dr. Fox effect. Journal of Educational Psychology, 74, 126-134.
48. McKeachie, W. J. (1979). Student ratings of faculty: A reprise. Academe, 65, 384-397.
49. McKeachie, W. J. (1997a). Good teaching makes a difference - And we know what it is. In R. P. Perry & J. C. Smart (Eds.), Effective teaching in higher education: Research and practice (pp. 396-411). New York: Agathon.
50. McKeachie, W. J. (1997b). Student ratings: The validity of use. American Psychologist, 52, 1218-1225.
51. Michigan State University, Office of Evaluation Services. (1972). Student Instructional Rating System response and student characteristics (SIRS Research Report No. 4). East Lansing: Author.
52. Perry, R. P. (1997). Perceived control in college students: Implications for instruction in higher education. In R. P. Perry & J. C. Smart (Eds.), Effective teaching in higher education: Research and practice (pp. 11-60). New York: Agathon.
53. Pohlman, J. T. (1975). A multivariate analysis of selected class characteristics and student ratings of instruction. Multivariate Behavioral Research, 10, 81-91.
54. Schwab, D. P. (1976). Manual for the Course Evaluation Instrument. Madison: University of Wisconsin, School of Business.
55. Snyder, C. R., & Clair, M. (1976). Effects of expected and obtained grades on teacher evaluation and attribution of performance. Journal of Educational Psychology, 68, 75-82.
56. Theall, M., Franklin, J., & Ludlow, L. (1990). Attributions and retributions: Student ratings and the perceived causes of performance. Instructional Evaluation, 11, 12-17.
57. Watkins, D. (1994). Student evaluations of teaching effectiveness: A cross-cultural perspective. Research in Higher Education, 35, 251-266.
58. Weiner, B. (1980). Human motivation. New York: Holt, Rinehart & Winston.
59. Worthington, A. G., & Wong, P. T. P. (1979). Effects of earned and assigned grades on student evaluations of an instructor. Journal of Educational Psychology, 71, 764-775.