What does ratemyprofessors.com actually rate?

Assessment and Evaluation in Higher Education

Volumn 39, Issue 6, 2014, Pages 678-698

  Clayson, Dennis E ^a  

^a UNIVERSITY OF NORTHERN IOWA   (United States)

Author keywords

construct validation; online evaluations; student evaluation of teaching

Indexed keywords

EID: 84902515488     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602938.2013.861384     Document Type: Article

References (57)

1. Al-Issa, A., and H. Sulieman. 2007. "Student Evaluations of Teaching: Perceptions and Biasing Factors." Quality Assurance in Education 15 (3): 302-317.
2. Attiyeh, R., and K. G. Lumsden. 1972. "Some Modern Myths in Teaching Economics: The UK. Experience." American Economic Review 62: 429-433.
3. Bacon, D. R., and J. Novotny. 2002. "Exploring Achievement Striving as a Moderator of the Grading Leniency Effect." Journal of Marketing Education 24 (2): 4-14.
4. Baird, J. S. 1987. "Perceived Learning in Relation to Student Evaluation of University Instruction." Journal of Educational Psychology 79 (1): 90-91.
5. Blaske-Rechek, A., and M. Kelsey. 2010. Ratemyprofessor.com: Testing Assumptions about Student Use and Misuse. Practical Assessment, Research & Evaluation 15 (5): 1-12. Accessed August 2013. http://pareonline.net/pdf/v15n5.pdf
6. Carrell, S. E., and J. E. West. 2010. "Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors." Journal of Political Economy 118 (3): 409-432.
7. Cashin, W. E. 1995. Student Ratings of Teaching: The Research Revisited. IDEA Paper No. 32. Manhattan, KS: Publication of the Center for Faculty Evaluation & Development, Division of Continuing Education, Kansas State University.
8. Clayson, D. E. 1989. "Halo Effects in Student Evaluation of Teaching: A Question of Validity." Marketing: Positioning for the 1990's Proceedings of the Southern Marketing Association, 271-275, New Orleans.
9. Clayson, D. E. 2007. "Conceptual and Statistical Problems of Using between Class Data in Educational Research." Journal of Marketing Education 29 (1): 34-38.
10. Clayson, D. E. 2009. "Student Evaluation of Teaching: Are They Related to What Students Learn? A Meta Analysis and Review of the Literature." Journal of Marketing Education 31 (1): 16-30.
11. Clayson, D. E. 2013. "A Multi-disciplined Review of the Student Teacher Evaluation Process." Accessed March. http://business.uni.edu/clayson/set
12. Clayson, D. E., T. F. Frost, and M. J. Sheffet. 2006. "Grades and the Student Evaluation of Instruction: A Test of the Reciprocity Effect." Academy of Management Learning and Education 5 (5): 2-65.
13. Clayson, D. E., and D. A. Haley. 1990. "Student Evaluations in Marketing: What is Actually Being Measured?" Journal of Marketing Education 12 (3): 9-17.
14. Cohen, P. A. 1980. "Effectiveness of Student-Rating Feedback for Improving College Instruction: A Meta-Analysis." Research in Higher Education 13 (4): 321-341.
15. Cohen, P. A. 1981. "Student Ratings of Instruction and Student Achievement: A Meta-analysis of Multi -Section Validity Studies." Review of Educational Research 51: 281-309.
16. Coladarci, T., and I. Kornfield. 2007. "Ratemyprofessors.com versus Formal in-class Student Evaluations of Teaching." Practical Assessment, Research & Evaluation12 (6). Accessed March 2013. http://pareonline.net/pdf/v12n6.pdf
17. Davidson, E., and J. Price. 2009. "How Do We Rate? An Evaluation of Online Student Evaluations." Assessment & Evaluation in Higher Education 34 (1): 51-65.
18. Delucchi, M., and S. Pelowski. 2000. Liking or Learning? The Effect of Instructor Likeability and Student Perceptions of Learning on Overall Ratings of Teaching Ability. Radical Pedagogy 2(2). Accessed December 2012. http://radicalpedagogy.icaap.org/content/issue2_2/delpel.html
19. Dowell, D. B., and J. A. Neal. 1982. "A Selective Review of the Validity of Student Ratings of Teaching." Journal of Higher Education 53 (1): 51-62.
20. Feeley, T. H. 2002. "Evidence of Halo Effects in Student Evaluations of Communication Instruction." Communication Education 51 (3): 225-236.
21. Feldman, K. A. 1989. "The Association Between Student Ratings of Specific Instructional Dimensions and Student Achievement: Refining and Extending the Synthesis of Data from Multisection Validity Studies." Research in Higher Education 30 (6): 583-645.
22. Felton, J., P. T. Koper, J. Mitchell, and M. Stinson. 2008. "Attractiveness, Easiness and Other Issues: Student Evaluations of Professors on ratemyprofessors.com." Assessment & Evaluation in Higher Education 33 (1): 45-61.
23. Felton, J., J. Mitchell, and M. Stinson. 2004. "Web-Based Student Evaluation of Professors: What We Know and What We don't." Assessment & Evaluation in Higher Education 29 (1): 91-108.
24. Fliamengo, J.2013. "How Well Does 'Rate My Professors' Rate?" PJ Media, February 23. Accessed March. http://pjmedia.com/blog/how-well-does-rate-my-professors-rate
25. Flinn, R. E., and D. L. Crumbley. 2009. Measure Learning Rather than Satisfaction in Higher Education. Sarasota, FL: American Accounting Association.
26. Goldberg, G., and J. Callahan. 1991. "Objectivity of the Student Evaluation of Instructors." Journal of Education for Business 66 (6): 377-378.
27. Greenwald, A. G., and G. M. Gillmore. 1997. "Grading Leniency is a Removable Contaminant of Student Ratings." American Psychologist 52 (11): 1209-1217.
28. Guthrie, E. R. 1954. The Evaluation of Teaching: A Progress Report. Seattle: University of Washington.
29. Hake, R. R. 1998. "Interactive-Engagement versus Traditional Methods: A Six-thousand-student Survey of Mechanics Test Data for Introductory Physics Courses." American Journal of Physics 66 (1): 64-74.
30. Halloun, I. A., and D. Hestenes. 1985. "The Initial Knowledge State of College Physics Students." American Journal of Physics 53 (11): 1053-1055.
31. Howard, C. (2013). "Ranking America's Top Colleges 2013." Forbes, July 24. Accessed September. http://www.forbes.com/sites/carolinehoward/2013/07/24/ranking-americas-top-colleges-2013
32. Johnson, V. E. 2003. Grade Inflation: A Crisis in College Education. New York: Springer.
33. Kantor, D. 2007. Graphic Design and Religion: A Call for Renewal. Chicago, IL: GIA Publications.
34. Kennedy, E. J., L. Lawton, and E. L. Plumlee. 2002. "Bliss Ignorance: The Problem of Unrecognized Incompetence and Academic Performance." Journal of Marketing Education 24 (3): 243-252.
35. Kindred, R., and Mohammed, S. 2005. "He Will Crush You like an Academic Ninja! Exploring Teacher Ratings on ratemyprofessors.com." Journal of Computer-Mediated Communication 10 (3) article 9. Accessed March 2013. http://jcmc.indiana.edu/vol10/issue3/kindred.html
36. Kulik, J. A. 2001. "Student Ratings: Validity, Utility, and Controversy." New Directions for Institutional Research 109: 9-25.
37. Leuthesser, L., C. S. Kohli, and K. R. Hatich. 1995. "Brand Equity: The Halo Effect Measure." European Journal of Marketing 29 (4): 57-66.
38. Lundsten, N. L. 1986. "Student Evaluations in a Business Administration Curriculum: A Marketing Viewpoint." AMA Developments in Marketing Science 9: 169-173.
39. Lyness, J. N., and C. B. Moler. 1966. "Van Der Monde Systems and Numerical Differentiation." Numerische Mathematik 8: 458-464.
40. Marks, R. B. 2000. "Determinants of Student Evaluations of Global Measures of Instructor and Course Value." Journal of Marketing Education 22 (2): 108-119.
41. Marlin, J. W., and J. F. Niss. 1980. "End-of-course Evaluations as Indicators of Student Learning and Instructor Effectiveness." The Journal of Economic Education 11 (Spring): 16-27.
42. Marsh, H. W., and L. A. Roche. 2000. "Effects of Grading Leniency and Low Workload on students' Evaluations of Teaching: Popular Myth, Bias, Validity, or Innocent Bystanders?" Journal of Educational Psychology 92 (1): 202-228.
43. Orsini, J. L. 1988. "Halo Effects in Student Evaluations of Faculty: A Case Study." Journal of Marketing Education 10 (2): 38-45.
44. Otto, J., D. A. Sanford, and D. N. Ross. 2008. "Does ratemyprofessor.com Really Rate My Professor?" Assessment & Evaluation in Higher Education 33 (4): 355-368.
45. Porter, S. R. 2011. "Do College Student Surveys Have Any Validity?" The Review of Higher Education 35 (1): 45-76.
46. Rentfrow, P. J., S. D. Gosling, M. Jokela, D. J. Stillwell, M. Kosinski, and J. Potter. 2013. "Divided We Stand: Three Psychological Regions of the United States and Their Political, Economic, Social, and Health Correlates." Journal of Personality and Social Psychology. Advance online publication (October 2013). Accessed October 2013. http://www.apa.org/pubs/journals/releases/psp-a0034434.pdf
47. Rodin, M., and B. Rodin. 1972. "Student Evaluation of Teachers." Science 177 (29): 1164-1166.
48. Sanders, S. B., B. Walia, J. Potter, and K. W. Linna. 2011. "Do More Online Instructional Ratings Lead to Better Prediction of Instructor Quality?" Practical Assessment, Research & Evaluation 16 (2). Accessed March 2013. http://pareonline.net/pdf/v16n2.pdf
49. Shevlin, M., P. Banyard, M. Davies, and M. Griffiths. 2000. "The Validity of Student Evaluation of Teaching in Higher Education: Love Me, Love My Lectures?" Assessment & Evaluation in Higher Education 25 (4): 398-405.
50. Sixbury, G. R., and W. E. Cashin. 1995. IDEA Technical Report No. 9: Descriptions of Database for the IDEA Diagnostic Form. Manhattan, KS: Publication of the Center for Faculty Evaluation & Development, Division of Continuing Education, Kansas State University.
51. Spooren, P., and D. Mortelmans. 2006. "Teacher Professionalism and Student Evaluation of Teaching: Will Better Teachers Receive Higher Ratings and Will Better Students Give Better Ratings?" Educational Studies 32 (2): 201-214.
52. Stumpf, S. A., and R. D. Freedman. 1979. "Expected Grade Covariation with Student Ratings of Instruction: Individual versus Class Effects." Journal of Educational Psychology 71: 293-302.
53. Sullivan, A. M., and G. R. Skanes. 1974. "Validity of Student Evaluations of Teaching and the Characteristics of Successful Instructors." Journal of Educational Psychology 66 (4): 584-590.
54. Tang, T. L., and T. Tang. 1987. "A Correlation Study of students' Evaluations of Faculty Performance and Their Self-ratings in an Instructional Setting." College Student Journal 21 (1): 90-97.
55. Timmeman, T. 2008. "On the Validity of ratemyprofessors.com." Journal of Education for Business 88 (1): 55-61.
56. Wilhelm, W. B. 2004. "The Relative Influence of Published Teaching Evaluations and Other Instructor Attributes on Course Choice." Journal of Marketing Education 26 (1): 17-30.
57. Yunker, P. J., and J. Yunker. 2003. "Are Student Evaluations of Teaching Valid? Evidence from an Analytical Business Core Course." Journal of Education for Business 78 (6): 313-317.