Ratemyprofessors is hogwash (but I care): Effects of Ratemyprofessors and university-administered teaching evaluations on professors

Computers in Human Behavior

Volumn 56, Issue , 2016, Pages 155-162

  Boswell, Stefanie S ^a  

^a UNIVERSITY OF THE INCARNATE WORD   (United States)

Author keywords

Ratemyprofessors.com; Self efficacy; Student evaluations of teaching

Indexed keywords

STUDENTS;

EXPOSED TO; PROFESSOR-STUDENT RELATIONSHIPS; RATEMYPROFESSORS.COM; SELF EFFICACY; STUDENT EVALUATION; STUDENT LEARNING; TEACHING EVALUATION;

EDUCATION;

CONTROLLED STUDY; E-MAIL; EMPLOYMENT; EXPOSURE; HUMAN; HUMAN EXPERIMENT; LEARNING; SELF CONCEPT; TEACHING; UNIVERSITY;

EID: 84950157545     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2015.11.045     Document Type: Article

References (82)

1. M.M. Adams, and P.P. Umbach Nonresponse and online student evaluations of teaching: understanding the influence of salience, fatigue, and academic environments Research in Higher Education 53 5 2012 576 591 10.1007/s11162-011-9240-5
2. A. Bandura Self-efficacy: toward a unifying theory of behavioral change Psychological Review 84 1977 191 215 10.1037/0033-295X.84.2.191
3. A. Bandura Self-efficacy mechanism in human agency American Psychologist 37 1982 122 147 10.1037/0003-066X.37.2.122
4. A. Bandura Human agency in social cognitive theory American Psychologist 44 1989 1175 1184 10.1037/0003-066X.44.9.1175
5. A. Bandura Self-efficacy: The exercise of control 1997 Freeman New York
6. S. Bolkan, and A.K. Goodboy Transformational leadership in the classroom: fostering student learning, student participation, and teacher credibility Journal of Instructional Psychology 36 2009 296 306
7. M.J. Brown, M. Baillie, and S. Fraser Rating Ratemyprofessors.com: a comparison of online and official student evaluations of teaching College Teaching 57 2009 89 92 10.3200/CTCH.57.2.89-92
8. C. Buskist, and J. Hogan She needs a haircut and a new pair of shoes: handling those pesky course evaluations Journal of Effective Teaching 10 2010 51 56 Retrieved from http://uncw.edu/cte/ET/
9. J.T. Cacioppo, W.L. Gardner, and G.G. Berntson The affect system has parallel and integrative processing components: form follows function Journal of Personality and Social Psychology 76 1999 839 855 10.1037/0022-3514.76.5.839
10. S. Calkins, and M. Micari Less-than-perfect judges: evaluating student evaluations Thought & Action 2010 7 22 Retrieved from http://www.nea.org/home/1821.htm
11. D. Carnevale University of Saskatchewan fires tenured professor accused of maligning colleagues on Ratemyprofessors website The Chronicle of Higher Education 52 27 2006 A28
12. C.S. Carver, and M.F. Scheier Origins and functions of positive and negative affect: a control-process view Psychological Review 97 1990 19 35 10.1037/0033-295X.97.1.19
13. D.E. Clayson What does ratemyprofessors.com actually rate? Assessment & Evaluation in Higher Education 39 2014 678 698 10.1080/02602938.2013.861384
14. M.P. Couper, M.W. Traugott, and M.J. Lamias Web survey design and administration Public Opinion Quarterly Journal 65 2001 230 253 10.1086/322199
15. E. Davison, and J. Price How do we rate? an evaluation of online student evaluations Assessment & Evaluation in Higher Education 34 2009 65 doi: 10.108002602930801895695
16. D.A. Dillman, G. Phelps, R. Tortora, K. Swift, J. Kohrell, J. Berck, and et al. Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet Social Science Research 38 2009 1 18 10.1016/j.ssresearch.2008.03.007
17. A. Edwards, and C. Edwards Computer-mediated word-of-mouth communication: the influence of mixed reviews on student perceptions of instructors and courses Communication Education 62 4 2013 412 424 10.1080/03634523.2013.800217
18. C. Edwards, A. Edwards, Q. Qing, and S.T. Wahl The influence of computer-mediated word-of-mouth communication on student perceptions of instructors and attitudes toward learning course content Communication Education 56 3 2007 255 277 10.1080/03634520701236866
19. A. Edwards, C. Edwards, C. Shaver, and M. Oaks Computer-mediated word-of-mouth communication on Ratemyprofessors.com: expectancy effects on student cognitive and behavioral learning Journal of Computer-Mediated Communication 14 2 2009 368 392 10.1111/j.1083-6101.2009.01445.x
20. E. Erdfelder, F. Faul, and A. Buchner GPOWER: a general power analysis program Behavioral Research Methods, Instruments, & Computers 28 1996 1 11 10.3758/BF03203630
21. R. Fagan-Wilen, D.W. Springer, B. Ambrosino, and B.W. White The support of adjunct faculty: an academic imperative Social Work Education 25 2006 39 51 10.1080/02615470500477870
22. F. Faul, E. Erdfelder, A. Lang, and A. Buchner G∗Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences Behavior Research Methods 39 2007 175 191 10.3758/BF03193146
23. J. Felton, P.T. Koper, J. Mitchell, and M. Stinson Attractiveness, easiness and other issues: student evaluations of professors on Ratemyprofessors.com Assessment & Evaluation in Higher Education 33 2008 45 61 doi:10.80/020602930601122803
24. J. Felton, J. Mitchell, and M. Stinson Web-based student evaluations of professors: the relations between perceived quality, easiness and sexiness Assessment & Evaluation in Higher Education 29 2004 91 108 10.1080/0260293032000158180
25. J.R. Field, B.J. Bergiel, and R.C. Viosca An exploratory study of student use and perceived accuracy of faculty evaluations on Ratemyprofessors.com Competition Forum 6 2008 378 383
26. L.A. Goodman Snowball sampling The Annals of Mathematical Statistics 32 1961 148 170 10.1214/aoms/1177705148
27. J. Gotlieb Classroom entertainment, upgrades, and student evaluations of business professors Journal of the Academy of Business Education 13 2011 118 136 Retrieved from http://www.abeweb.org/jbe.html
28. F.J. Gravetter, and L.B. Forzano Research methods for the behavioral sciences 2012 Wadsworth Cengage Belmont, CA
29. R.M. Groves, and E. Peytcheva The impact of nonresponse rates on nonresponse bias: a meta-analysis Public Opinion Quarterly 72 2008 167 189 10.1093/poq/nfn011
30. K.B. Hartman, and J.B. Hunt What Ratemyprofessors.com reveals about how and why students evaluate their professors: a glimpse into the student mind-set Marketing Education Review 23 2013 151 161 10.2753/MER1052-8008230204
31. M.W. Hayes, and J. Prus Student use of quantitative and qualitative information on Ratemyprofessors.com for course selection College Student Journal 48 2014 675 688 Retrieved from http://www.projectinnovation.biz/
32. J.R. Huntsinger, and C.T. Smith First thought, best thought: positive mood maintains and negative mood degrades implicit-explicit attitude correspondence Personality and Social Psychology Bulletin 35 2009 187 197 10.1177/0146167208327000
33. S. Jaschik RateMyProfessors: hidden camera edition Retrieved from https://www.insidehighered.com/news/2006/11/02/rmp 2006, November 2
34. I. Johnson Contingent instructors and student outcomes: an artifact or a fact? Research in Higher Education 52 2011 761 785 10.1007/s11162-011-9219-2
35. R.R. Johnson, and A.D. Crews My professor is hot! Correlates of Ratemyprofessors.com ratings for criminal justice and criminology faculty members American Journal of Criminal Justice 38 4 2013 639 656 10.1007/s12103-012-9186-y
36. S.C. Karpen, L. Jia, and R.J. Rydell Discrepancies between implicit and explicit attitude measures as an indicator of attitude strength European Journal of Social Psychology 42 2012 24 29 10.1002/ejsp.849
37. J. Kindred, and S.N. Mohammed 'He will crush you like an academic ninja!': exploring teacher ratings on Ratemyprofessors.com Journal of Computer-Mediated Communication 10 3 2005 10.1111/j.1083-6101.2005.tb00257.x Art. 9
38. M.H. Knol, R. in't Veld, H.M. Vorst, J.H. van Driel, and G.J. Mellenbergh Experimental effects of student evaluations coupled with collaborative consultation on college professors' instructional skills Research in Higher Education 54 2013 825 850 10.1007/s11162-013-9298-3
39. L.R. Kogan, R. Schoenfeld-Tacher, and P.W. Hellyer Student evaluations of teaching: perceptions of faculty based on gender, position, and rank Teaching in Higher Education 15 2010 623 636 10.1080/13562517.2010.491911
40. M. Komarraju, S. Musulkin, and G. Bhattacharya Role of student-faculty interactions in developing college students' academic self-concept, motivation, and achievement Journal of College Student Development 51 3 2010 332 342 10.1353/csd.0.0137
41. N. Kowai-Bell, R.E. Guadagno, T. Little, and J.L. Ballew Professors are people too: the impact of informal evaluations of professors on students and professors Social Psychology of Education 15 2012 337 351 10.1007/s11218-012-9181-7
42. N. Kowai-Bell, R.E. Guadagno, T. Little, N. Preiss, and R. Hensley Rate my expectations: how online evaluations of professors impact students' perceived control Computers in Human Behavior 27 2011 1862 1867 10.1016/j.chb.2011.04.009
43. N.M. Landry, K.E. Kurkul, and C.R. Poirier Online faculty rating sites: examining hot students perceive and use Ratemyprofessors.com Psi Chi Journal of Undergraduate Research 15 2010 139 142 Retrieved from http://www.psichi.org/?page=journal-main
44. A.M. Legg, and J.H. Wilson RateMyProfessors.com offers bias evaluations Assessment & Evaluation in Higher Education 37 2012 89 97 10.1080/02602938. 2010.507299
45. X. Leung, L. Jiang, and J. Busser Online student evaluations of hospitality professors: a cross-cultural comparison Journal of Hospitality, Leisure, Sport & Tourism Education 12 2013 36 46 10.1016/j.jhlste.2012.10.001
46. G. Lewandowski, E. Higgins, and N.N. Nardon Just a harmless website?: an experimental examination of Ratemyprofessors.com's effect on student evaluations Assessment & Evaluation in Higher Education 37 2012 987 1002 10.1080/026-02938.2011.594497
47. K.G. Lewis Making sense of student written comments New Directions for Teaching and Learning 87 2001 25 32 10.1002/tl.25
48. H.W. Marsh Students' evaluations of university teaching: a multidimensional perspective R.P. Perry, J.C. Smart, The scholarship of teaching and learning in higher education: An evidence-based perspective 2007 Springer New York 319 384
49. H.W. Marsh, and L.A. Roche Making students' evaluations of teaching effectiveness effective American Psychologist 52 1997 1187 1197 Retrieved from http://www.apa.org/pubs/journals/amp/
50. D.S. Massey, and R. Tourangeau Where do we go from here? Nonresponse and social measurement The ANNALS of the American Academy of Political and Social Science 645 2013 222 236 10.1177/0002716212464191
51. A. Mayers Introduction to statistics and SPSS in psychology 2013 Pearson Education Harlow
52. W.J. McKeachie Student ratings of faculty: a reprise Academe 65 1979 384 397 10.2307/40248725
53. M. Micari, and P. Pazos Connecting to the professor: Impact of the student-faculty relationship in a highly challenging course College Teaching 60 2012 41 47 10.1080/87567555.2011.627576
54. N. Mohan On the use of non tenure track faculty and the potential effect on classroom content and student evaluation of teaching Journal of Financial Education 37 1/2 2011 29 42 Retrieved from http://www.jfedweb.org/
55. M.A. Olson, R.H. Fazio, and A.S. Hermann Reporting tendencies underlie discrepancies between implicit and explicit measures of self-esteem Psychological Science 18 2007 287 291 10.1111/j.1467-9280.2007.01890.x
56. J. Otto, D.A. Sanford, and D.N. Ross Does Ratemyprofessor.com really rate my professor? Assessment & Education in Higher Education 33 2008 355 368 10.1080/02602930701293405
57. J. Otto, D. Sanford, and W. Wagner Analysis of online student ratings of university faculty Journal of College Teaching & Learning 2 2005 25 30 Retrieved from http://www.cluteinstitute.com/journals/journal-of-college-teaching-learning-tlc/
58. R.L. Peterson, M.L. Berenson, and R. Aijaz An exploratory study: Is there anything good about Ratemyprofessor? Proceedings of the Northeast decision sciences institute 2011 1178 1201 Retrieved from http://nedsi.org/proc/2011/start.htm
59. A. Peytcheva Consequences of survey nonresponse The ANNALS of the American Academy of Political and Social Science 645 2013 222 236 10.1177/0002716212461748
60. Ratemyprofessors.com About Ratemyprofessors.com Retrieved from http://www.ratemyprofessors.com/About.jsp 2015
61. Ratemyprofessors.com How do you tally your ratings? Retrieved from http://www.ratemyprofessors.com/help.jsp#tally 2015
62. Ratemyprofessors.com Introducing: professor tags Retrieved from http://www.ratemyprofessors.com/blog/buzzpost?posturl=%2Fprofessor-tags%2F 2015
63. C. Rehfield Faculty give rate my professors mixed reviews Retrieved from http://www.bupipedream.com/news/44936/faculty-give-rate-my-professors-mixed-reviews/ 2014, November 30
64. L.D. Reid The role of perceived race and gender in the evaluation of college teaching on RateMyProfessors.com Journal of Diversity in Higher Education 3 3 2010 137 152 10.1037/a0019865
65. L.A. Roche, and H.W. Marsh Multiple dimensions of university teacher self-concept Instructional Science 28 2000 439 468 10.1023/A:1026576404113
66. R.J. Rydell, A.R. McConnell, and D.M. Mackie Consequences of discrepant explicit and implicit attitudes: cognitive dissonance and increased information processing Journal of Experimental Social Psychology 44 2008 1526 1532 10.1016/j.jesp.2008.07.006
67. S.A. Safavi, K.A. Bakar, R.A. Tarmizi, and N.H. Alwi Faculty perception of improvements to instructional practices in response to student ratings Educational Assessment, Evaluation and Accountability 25 2013 143 153 10.1007/s11092-013-9160-3
68. J. Sánchez-Fernández, F. Muñoz-Leiva, and F.J. Montoro-Ríos Improving retention rate and response quality in web-based surveys Computers in Human Behavior 28 2012 507 514 10.1016/j.chb.2011.10.023
69. H. Sauermann, and M. Roach Increasing web survey response rates in innovation research: an experimental study of static and dynamic contact design features Research Policy 42 2013 273 286 10.1016/j.respol.2012.05.003
70. K.M. Silva, F.J. Silva, M.A. Quinn, J.N. Draper, K.R. Cover, and A.A. Munoff Rate my professor: online evaluations of psychology instructors Teaching of Psychology 35 2008 71 80 10.1080/00986280801978434
71. P.M. Simpson, and J.A. Siguaw Student evaluations of teaching: an exploratory study of faculty response Journal of Marketing Education 23 2000 199 213 10.1177/0273475300223004
72. C.T. Smith, and B.A. Nosek Affective focus increases the concordance between implicit and explicit attitudes Social Psychology 42 2011 300 313 10.1027/1864-9335/a000072
73. M.E. Sonntag, J.F. Bassett, and T. Snyder An empirical test of the validity of student evaluations of teaching made on RateMyProfessors.com Assessment & Evaluation in Higher Education 34 2009 499 504 10.1080/02602930802079463
74. P. Spooren, B. Brockx, and D. Mortelmans On the validity of student evaluations of teaching: the state of the art Review of Educational Research 83 2013 598 642 10.3102/0034654313496870
75. J.M. Stuber, A. Watson, A. Carle, and K. Staggs Gender expectations and on-line evaluations of teaching: evidence from RateMyProfessors.com Teaching in Higher Education 14 2009 387 399 10.1080/13562510903050137
76. SurveyMonkey.com How does SurveyMonkey adhere to IRB guidelines? Retrieved from http://help.surveymonkey.com/articles/en-US/kb/How-does-SurveyMonkey-adhere-to-IRB-guidelines 2014
77. J.J. Teven The relationship among teacher characteristics and perceived caring Communication Education 50 2001 159 169 10.1080/03634520109379241
78. The University of Texas U.S. universities, by state Retrieved from http://www.utexas.edu/world/univ/state/ 2014
79. T. Timmerman On the validity of RateMyProfessors.com Journal of Education for Business 84 1 2008 55 61 10.3200/JOEB.84.1.55-61
80. M. Tschannen-Moran, and A. Woolfolk Hoy Teacher efficacy: capturing an elusive construct Teaching and Teacher Education 17 2001 783 805 10.1016/S0742-051X(01)00036-1
81. J.M. van Uden, H. Ritzen, and J.M. Pieters Engaging students: the role of teacher beliefs and interpersonal teacher behavior in fostering student engagement in vocational education Teaching and Teacher Education 37 2014 21 32 10.1016/j.tate.2013.08.005
82. S.L. Wright, and M.A. Jenkins-Guarnieri Student evaluations of teaching: combining the meta-analyses and demonstrating further evidence for effective use Assessment & Evaluation in Higher Education 37 2012 683 699 10.1080/02602938.2011.563279