Factorial validity of student ratings of instruction

Research in Higher Education

Volumn 46, Issue 8, 2005, Pages 929-953

  Renaud, Robert D ^a   Murray, Harry G ^b  

^a UNIVERSITY OF MANITOBA   (Canada)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Factorial validity; Illusory correlation; Student ratings; Systematic distortion hypothesis; Teacher effectiveness

Indexed keywords

EID: 29144435627     PISSN: 03610365     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11162-005-6934-6     Document Type: Article

References (48)

1. Albright, L., Kenny, D. A., and Malloy, T. R. (1988). Consensus in personality judgment at zero acquaintance. Journal of Personality and Social Psychology 55: 387-395.
2. Ambady, N., and Rosenthal, R. (1993). Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. Journal of Personality and Social Psychology 64: 431-441.
3. Berman, J. S., and Kenny, D. A. (1976). Correlational bias in observer ratings. Journal of Personality and Social Psychology 34: 263-273.
4. Block, J., Weiss, D. S., and Thorne, A. (1979). How relevant is a semantic similarity interpretation of personality ratings'?. Journal of Personality and Social Psychology 37: 1055-1074.
5. Borkenau, P., and Liebler, A. (1992). Trait inferences: Sources of validity at zero acquaintance. Journal of Personality and Social Psychology 62: 645-657.
6. Borkenau, P., and Ostendorf, F. (1987). Retrospective estimates of act frequencies: How accurately do they reflect reality?. Journal of Personality and Social Psychology 52: 626-638.
7. Byrne, B. M. (2001). Structural Equation Modeling with AMOS: Basic concepts. Applications, and programming, Lawrence Erlbaum Associates Inc., Mahwah, NJ.
8. Cadwell, J., and Jenkins, J. (1985). Effects of the semantic similarity of items on student ratings of instructors. Journal of Educational Psychology 77: 383-393.
9. Chadwick, P., and Taylor, G. (2000). Are deluded people unusually prone to illusory correlation? Behavior Modification 24: 130-141.
10. Chapman, L. J., and Chapman, J. P. (1967). Genesis of popular but erroneous psychodiagnostic observations. Journal of Abnormal Psychology 72: 193-204.
11. Chapman, L. J., and Chapman, J. P. (1969). Illusory correlation as an obstacle to the use of valid psychodiagnostic signs. Journal of Abnormal Psychology 74: 271-280.
12. Cohen, P. A. (1981). Student ratings of instruction and student achievement: A meta-analysis of multisection validity studies. Review of Educational Research 51: 281-309.
13. Cooper, W. H. (1981). Conceptual similarity as a source of illusory halo. Journal of Applied Psychology 66: 302-307.
14. Cranton, P. A., and Hilgartner, W. (1981). The relationship between student ratings and instructor behavior: Implications for improving teaching. Canadian Journal of Higher Education 11: 73-81.
15. Cronbach, L. J. (1955). Processes affecting scores on "understanding of others" and "assumed similarity". Psychological Bulletin 52: 177-193.
16. Cronbach, L. J. (1958). Proposals leading to analytic treatment of social perception scores. In R. Tagiuri and L. Petrullo (eds.), Person Perception and Interpersonal Behavior. Stanford University Press, pp. 351-379.
17. Dewhirst, J. R., and Herman, J. S. (1978). Social judgments of spurious and causal relations between attributes and outcomes. Journal of Experimental Social Psychology 14: 313-325.
18. Dollinger, S. J., Greening, L., and Radtke, R. C. (2001). Reading too much between the lines: Illusory correlation and the word association implications test. Personality and Individual Differences 30: 799-808.
19. Feldman, K. A. (1989a). Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers. Research in Higher Education 30: 137-194.
20. Feldman, K. A. (1989b). The association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies. Research in Higher Education 30: 583-645.
21. Hamilton, D. L., and Rose, T. L. (1980). Illusory correlation and the maintenance of stereotypic beliefs. Journal of Personality and Social Psychology 39: 832-845.
22. Hu, L.-T., and Bentler, P. M. (1995). Evaluating model fit. In: Hoyle, R. H. (ed), Structured Equation Modeling: Concepts, Issues and Applications, Sage, Thousand Oaks, CA, pp. 76-99.
23. Jackson, D. N., Chan, D. W., and Stricker, L. J. (1979). Implicit personality theory: Is it illusory?. Journal of Personality 47: 1-10.
24. Kenny, D. A., Horner, C., Kashy, D. A., and Chu, L. (1992). Consensus at zero acquaintance: Replication, behavioral cues, and stability. Journal of Personality and Social Psychology 62: 88-97.
25. King, R. N., and Koehler, D. J. (2000). Illusory correlations in graphical inference. Journal of Experimental Psychology: Applied 6: 336-348.
26. Kozlowski, S. W. J., and Kirsch, M. P. (1987). The systematic distortion hypothesis, halo, and accuracy: An individual-level analysis. Journal of Applied Psychology 72: 252-261.
27. Kozlowski, S. W. J., Kirsch, M. P., and Chao, G. T. (1986). Job knowledge, ratee familiarity, conceptual similarity, and halo error: An exploration. Journal of Applied Psychology 11: 45-49.
28. Lodzinski, A. (1991). The Systematic Distortion Hypothesis and Diagnostically Meaningful Student Ratings of University Instructor Teaching Effectiveness. Unpublished doctoral dissertation, University of Windsor, Windsor Ontario.
29. Lodzinski, A., Schneider, F., and Murray, H. G. (1991). The systematic distortion hypothesis and student ratings of low-inference teaching behaviors. Instructional Evaluation and Faculty Development 12: 8-15.
30. Marsh, H. W. (1982). SEEQ: A reliable, valid, and useful instrument for collecting students' evaluations of university teaching. British Journal of Educational Psychology 52: 77-95.
31. Marsh, H. W. (1984). Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and utility. Journal of Educational Psychology 76: 707-754.
32. Marsh, H. W., and Hau, K.-T. (1999). Confirmatory factor analysis: Strategies for small sample sizes. In: Hoyle, R. H. (eds.), Statistical Strategies for Small Sample Research, Sage, Thousand Oaks, CA, pp. 251-284.
33. Murray, H. G. (1980). Evaluating University Teaching: A Review of Research, Ontario Confederation of University Faculty Associations, Toronto.
34. Murray, H. G. (1983). Low-inference classroom teaching behaviors and student ratings of college teaching effectiveness. Journal of Educational Psychology 75: 138-149.
35. Passini, F. T., and Norman, W. T. (1966). A universal conception of personality structure?. Journal of Personality and Social Psychology 4: 44-49.
36. Paunonen, S. V. (1991). On the accuracy of ratings of personality by strangers. Journal of Personality and Social Psychology 61: 471-477.
37. Paunonen, S. V., and Jackson, D. N. (1979). Nonverbal trait inference. Journal of Personality and Social Psychology 37: 1645-1659.
38. Riemann, R., and Angleitner, A. (1993). Inferring interpersonal traits from behavior: Act prototypicality versus conceptual similarity of trait concepts. Journal of Personality and Social Psychology 64: 356-364.
39. Romer, D., and Revelle, W. (1984). Personality traits: Fact or fiction? A critique of the Shweder and D'ndrade systematic distortion hypothesis. Journal of Personality and Social Psychology 47: 1028-1042.
40. Shrout, P. E., and Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin 86: 420-428.
41. Shweder, R. A. (1975). How relevant is an individual difference theory of personality?. Journal of Personality 43: 455-485.
42. Shweder, R. A. (1977). Illusory correlation and the M.M.P.I. controversy. Journal of Consulting and Clinical Psychology 45: 917-924.
43. Shweder, R. A. (1982). Fact and artifact in trait perception: The systematic distortion hypothesis. Progress in Experimental Personality Research 11: 65-100.
44. Shweder, R. A., and D'Andrade, R. G. (1980). The systematic distortion hypothesis. In: Shweder, R. A. (eds.), Fallible Judgment in Behavioral Research; New directions for Methodology of Social and Behavioral Science, Jossey-Bass, San Francisco, pp. 37-58.
45. Vonk, R. (1998). The slime effect: suspicion and dislike of likeable behavior toward superiors. Journal of Personality and Social Psychology 74: 849-864.
46. Watson, D. (1989). Strangers' ratings of the five robust personality factors: Evidence of a surprising convergence with self-reports. Journal of Personality and Social Psychology 57: 120-128.
47. Weiss, D. S., and Mendelsohn, G. A. (1986). An empirical demonstration of the implausibility of the semantic similarity explanation of how trait ratings are made and what they mean. Journal of Personality and Social Psychology 50: 595-601.
48. Whitely, S. E., and Doyle, K. O. (1976). Implicit theories in student ratings. American Educational Research Journal 13: 241-253.