The role of scales in student ratings

Learning and Instruction

Volumn 16, Issue 5, 2006, Pages 401-415

  Sedlmeier, Peter ^a  

^a CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Bias; Course evaluation; Scales; Student ratings

Indexed keywords

EID: 33750514077     PISSN: 09594752     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.learninstruc.2006.09.002     Document Type: Article

References (36)

1. Abrami P.C., and d'Appolonia S. The dimensionality of ratings and their use in personnel decisions. In: Theall M., and Franklin J. (Eds). Student ratings of instruction: Issues of improving practice (1990), Jossey-Bass, San Francisco 97-111
2. d'Appolonia S., and Abrami P.C. Navigating student ratings of instruction. American Psychologist 52 (1997) 1198-1208
3. Attali Y., and Bar-Hillel M. Guess where: the position of correct answers in multiple-choice test items as a psychometric variable. Journal of Educational Measurement 40 (2003) 109-128
4. Bar-Hillel M., and Attali Y. Seek whence: answer sequences and their consequences in key-balanced multiple-choice tests. The American Statistician 56 (2002) 299-303
5. Basow S.A. Student evaluations of college professors: when gender matters. Journal of Educational Psychology 87 (1995) 656-665
6. Boehnke, K., Petri, K., Baier, D., & Goldschmidt, R. (2000). Evaluationsprojekt "Universitätsweite beleglesergestützte Lehrevaluation" - Ergebnisse der zweiten Befragungswelle. Available from http://www.tu-chemnitz.de/phil/soziologie/boehnke/.
7. Cashin W.E., and Downey R.G. Using global student rating items for summative evaluation. Journal of Educational Psychology 84 (1992) 563-572
8. Cohen J. A power primer. Psychological Bulletin 112 (1992) 155-159
9. Diehl J.M. Studentische Lehrevaluation in den Sozialwissenschaften: Fragebögen, Normen, Probleme. In: Keiner (Hrsg.) E. (Ed). Evaluation (in) der Erziehungswissenschaft (2001), Deutscher Studien Verlag, Weinheim, Germany
10. Diehl J.M. Normierung zweier Fragebögen zur studentischen Beurteilung von Vorlesungen und Seminaren. Psychologie in Erziehung und Unterricht 50 (2003) 27-42
11. Diehl J.M., and Kohr H.U. Entwicklung eines Fragebogens zur Beurteilung von Hochschulveranstaltungen im Fach Psychologie. Psychologie in Erziehung und Unterricht 24 (1977) 61-75
12. Grice H.P. Logic and conversation. In: Davidson D., and Harman G. (Eds). The logic of grammar (1975), Dickenson, Encino, CA 64-75
13. Greenwald A.G., and Gillmore G.M. No pain, no gain? The importance of measuring course workload in student ratings of instruction. Journal of Educational Psychology 89 (1997) 743-751
14. Greenwald A.G., and Gillmore G.M. Grading leniency is a removable contaminant of student ratings. American Psychologist 52 (1997) 1209-1217
15. Harris R.J., and Monaco G.E. Psychology of pragmatic implication: information processing between the lines. Journal of Experimental Psychology: General 107 (1978) 1-27
16. Lebherz C., Mohr C., Henning M., and Sedlmeier P. Wie brauchbar sind Hochschul-Rankings? Eine empirische Analyse. Zeitschrift für Pädagogik. Beiheft 50 (2005) 188-208
17. Loftus E.F. Leading questions and the eyewitness report. Cognitive Psychology 7 (1975) 560-572
18. Marsh H.W. SEEQ: a reliable, valid, and useful instrument for collecting student's evaluations of university teaching. British Journal of Educational Psychology 52 (1982) 77-95
19. Marsh H.W. Students' evaluations of university teaching: dimensionality, reliability, validity, potential biases, and utility. Journal of Educational Psychology 76 (1984) 707-754
20. Marsh H.W. Still weighting for the right criteria to validate student evaluations of teaching in the IDEA system. Journal of Educational Psychology 87 (1995) 666-679
21. Marsh H.W., and Roche L.A. Making students' evaluations of teaching effectiveness effective. The critical issues of validity, bias, and utility. American Psychologist 52 (1997) 1187-1197
22. Marsh H.W., and Roche L.A. Effects of grading leniency and low workload on students' evaluations of teaching: popular myth, bias, validity, or innocent bystanders?. Journal of Educational Psychology 92 (2000) 202-228
23. Murray H.G., Rushton J.P., and Paunonen S.V. Teacher personality traits and student instructional ratings in six types of university courses. Journal of Educational Psychology 82 (1990) 250-261
24. Rindermann H. Lehrevaluation an Hochschulen: Schlussfolgerungen aus Forschung und Anwendung für Hochschulunterricht und seine Evaluation. Zeitschrift für Evaluation 3 (2003) 233-256
25. Rindermann H., and Amelang M. Das Heidelberger Inventar zur Lehrveranstaltungs-Evaluation (HILVE). Handanweisung (1994), Asanger, Heidelberg, Germany
26. Rosenthal R. Parametric measures of effect size. In: Cooper H., and Hedges L.V. (Eds). The handbook of research synthesis (1994), Russel Sage Foundation, New York 231-244
27. Rosenthal R., Rosnow R.L., and Rubin D.B. Contrasts and effect sizes in behavioral research (2000), Cambridge University Press, New York
28. Schwarz N. Assessing frequency reports of mundane behaviours: Contributions of cognitive psychology to questionnaire construction. In: Hendrick C., and Clark M.S. (Eds). Research methods in personality and social psychology. Review of personality and social psychology Vol. 11 (1990), Sage, Beverly Hills, CA (pp. 98-119)
29. Schwarz N. Self-reports: how the questions shape the answers. American Psychologist 54 (1999) 93-105
30. Schwarz N., Hippler H.J., Deutsch B., and Strack F. Response categories: effects on behavioral reports and comparative judgments. Public Opinion Quarterly 49 (1985) 388-395
31. Schwarz N., Knäuper B., Hippler H.J., Noelle-Neumann E., and Clark F. Rating scales: numeric values may change the meaning of scale labels. Public Opinion Quarterly 55 (1991) 570-582
32. Sedlmeier P. Jenseits des Signifikanztest-Rituals: Ergänzungen und Alternativen. Methods of Psychological Research - Online, 1 (1996). http://www.mpr-online.de/
33. Sedlmeier P. Improving statistical reasoning: Theoretical models and practical implications (1999), Erlbaum, Mahwah
34. In: Sedlmeier P., and Betsch T. (Eds). Etc. Frequency processing and cognition (2002), Oxford University Press, Oxford
35. Spiel C., and Gössler P.M. Zum Einfluß von Biasvariablen auf die Bewertung universitärer Lehre durch Studierende. Zeitschrift für Pädagogische Psychologie 14 (2000) 38-47
36. Staufenbiel R. Fragebogen zur Evaluation von universitären Lehrveranstaltungen durch Studierende und Lehrende. Diagnostica 46 (2000) 169-181