Assessment of teaching effectiveness in U.S. dental schools and the value of triangulation

Journal of Dental Education

Volumn 72, Issue 6, 2008, Pages 707-718

  Jahangiri, Leila ^a   Mucciolo, Thomas W ^a   Choi, Mijin ^a   Spielman, Andrew I ^a  

^a NEW YORK UNIVERSITY COLLEGE OF DENTISTRY   (United States)

Author keywords

Teacher evaluation; Teaching assessment; Teaching effectiveness; Triangulation

Indexed keywords

ARTICLE; DENTAL EDUCATION; DENTAL STUDENT; EDUCATIONAL MODEL; EVALUATION; HUMAN; PEER REVIEW; PSYCHOLOGICAL ASPECT; QUESTIONNAIRE; SELF EVALUATION; STANDARD; TEACHING; UNITED STATES;

EDUCATION, DENTAL; HUMANS; MODELS, EDUCATIONAL; PEER REVIEW; QUESTIONNAIRES; SCHOOLS, DENTAL; SELF ASSESSMENT (PSYCHOLOGY); STUDENTS, DENTAL; TEACHING; UNITED STATES;

EID: 46349086155     PISSN: 00220337     EISSN: 19307837     Source Type: Journal    
DOI: None     Document Type: Article

References (124)

1. Berk RA. Survey of 12 strategies to measure teaching effectiveness. Int J Teach Learn Higher Educ 2005;17(1):48-62.
2. Knapper C. Broadening our approach to teaching evaluation. New Dir Teach Learn 2001;88(4):3-9.
3. French DP. What currency should we use? J College Sci Teach 2006;35(4):60.
4. Jick TD. Mixing qualitative and quantitative methods: triangulation in action. Administrative Sci Q 1979;24(4):602-11.
5. Goldstein J. Making sense of distributed leadership: the case of peer assistance and review. Educ Eval Policy Analysis 2004;26(2):173-97.
6. Golafshani N. Understanding reliability and validity in qualitative research. Qual Rep 2003;8(4):597-607.
7. Felder R, Brent R. How to evaluate teaching. Chem Eng Educ 2004;38(3):202-4.
8. Jarzabkowski P, Bone Z. A "how-to" guide and checklist for peer appraisal of teaching. Innovat Educ Teach Int 1998;35(2):177-82.
9. Berk RA, Naumann PL, Appling SE. Beyond student ratings: peer observation of classroom and clinical teaching. Int J Nurs Educ Scholarship 2004;1(1):1-26.
10. Belgrave LL, Zablotsky D, Guadagno MA. How do we talk to each other? Writing qualitative research for quantitative readers. Qual Health Res 2002;12(10):1427-39.
11. Drapeau M. Subjectivity in research: why not? But.... Qual Rep 2002;7(3):1-14.
12. Bowen GA. Preparing a qualitative research-based dissertation: lessons learned. Qual Rep 2005;10(2):208-22.
13. Arreola RA. Developing a comprehensive faculty evaluation system: a handbook for college faculty and administrators on designing and operating a comprehensive faculty evaluation system. Bolton, MA: Anker Publishing, 2000.
14. Seldin P. Self-evaluation: what works? what doesn't? In: Seldin PA, ed. Changing practices in evaluating teaching. Bolton, MA: Anker Publishing, 1999:97-113.
15. Marsh HW. Students' evaluations of university teaching: dimensionality, reliability, validity, potential biases, and utility. J Educ Psychol 1984;76(5):707-54.
16. Braskamp LA, Ory JC. Assessing faculty work: enhancing individual and institutional performance. San Francisco: Jossey-Bass Higher and Adult Education Series, 1994.
17. Soderberg LO. A credible model: evaluating classroom teaching in higher education. Instr Evaluation 1986;8:13-27.
18. Romberg E. Description of peer evaluation within a comprehensive evaluation program in a dental school. Instr Evaluation 1985;8(1):10-6.
19. Keig L, Waggoner MD. Collaborative peer review: the role of faculty in improving college teaching. ASHE-ERIC Higher Educ Rep 1994(2):18-22.
20. Centra JA. Reflective faculty evaluation: enhancing teaching and determining faculty effectiveness. San Francisco: Jossey-Bass Publishers, 1993.
21. Chambers D, Geissberger M, Leknius C. Association amongst factors thought to be important by instructors in dental education and perceived effectiveness of these instructors by students. Eur J Dent Educ 2004;8(1):18-23.
22. Henzi D, Davis E, Jasinevicius R, Hendricson W. North American dental students' perspectives about their clinical education. J Dent Educ 2006;70(4):361-77.
23. Henzi D, Davis E, Jasinevicius R, Hendricson W. In the students' own words: what are the strengths and weaknesses of the dental school curriculum? J Dent Educ 2007;71(5):632-45.
24. Abrami PC, D'Apollonia S, Cohen PA. Validity of student ratings of instruction: what we know and what we do not. J Educ Psychol 1990;82(2):219-31.
25. Aleamoni LM. Student rating myths versus research facts from 1924 to 1998. J Personnel Eval Educ 1999;13(2):153-66.
26. Apodaca P, Grad H. The dimensionality of student ratings of teaching: integration of uni- and multidimensional models. Stud Higher Educ 2005;30(6):723-48.
27. d'Apollonia S, Abrami PC. Navigating student ratings of instruction. Am Psychol 1997;52(11):1198-208.
28. Davidovitch N, Soen D. Using students' assessments to improve instructors' quality of teaching. J Further Higher Educ 2006;30(4):351-76.
29. Eiszler CF. College students' evaluations of teaching and grade inflation. Res Higher Educ 2002;43(4):483-501.
30. Greenwald AG. Validity concerns and usefulness of student ratings of instruction. Am Psychol 1997;52(11):1182-6.
31. Harrison PD, Ryan JM, Moore PS. College students' self-insight and common implicit theories in rating of teaching effectiveness. J Educ Psychol 1996;88(4):775-82.
32. Howard GS, Conway CG, Maxwell SE. Construct validity of measures of college teaching effectiveness. J Educ Psychol 1985;77(2):187-96.
33. Marsh HW, Roche LA. Making students' evaluations of teaching effectiveness effective: the critical issues of validity, bias, and utility. Am Psychol 1997;52(11):1187-97.
34. McKeachie WJ. Student ratings: the validity of use. Am Psychol 1997;52(11):1218-25.
35. Theall M, Franklin J. Looking for bias in all the wrong places: a search for truth or a witch hunt in student ratings of instruction? New Dir Institutional Res 2001;27(5):45-56.
36. Millea M, Grimes PW. Grade expectations and student evaluation of teaching. College Student J 2002;36(4):582-90.
37. Onwuegbuzie AJ, Witcher AE, Collins KMT, Filer JD, Weidmaier CD, Moore CW. Students' perceptions of characteristics of effective college teachers: a validity study of a teaching evaluation form using a mixed-methods analysis. Am Educ Res J 1997;44(1):113.
38. Sojka J, Gupta A, Deeter-Schmelz D. Student and faculty perceptions of student evaluations of teaching: a study of similarities and differences. College Teach 2002;50(2):44-9.
39. Sproule R. The underdetermination of instructor performance by data from the student evaluation of teaching. Economics Educ Rev 2002;21(3):287-94.
40. Toland MD, De Ayala R. A multilevel factor analysis of students' evaluations of teaching. Educ Psychol Meas 2005;65(2):272-96.
41. Victoroff KZ, Hogan S. Students' perceptions of effective learning experiences in dental school: a qualitative study using a critical incident technique. J Dent Educ 2006;70(2):124-32.
42. Wachtel HK. Student evaluation of college teaching effectiveness: a brief review. Assess Eval Higher Educ 1998;23(2):191-212.
43. Cohen PA. Student ratings of instruction and student achievement: a meta-analysis of multisection validity studies. Rev Educ Res 1981;51(3):281-309.
44. Aleamoni LM. Student ratings of instruction. In: Millman J, ed. Handbook of teacher evaluation. Beverly Hills, CA: Sage Publications, 1981.
45. Cashin WE. Student ratings of teaching: the research revisited. IDEA Paper No. 32. Manhattan: Kansas State University, Center for Faculty Evaluation and Development, 1995:1-10.
46. Aleamoni LM, Hexner PZ. A review of the research on student evaluation and a report on the effect of different sets of instructions on student course and instructor evaluation. Instr Sci 1980;9(1):67-84.
47. Doyle KO, Crichton LI. Student, peer, and self-evaluations of college instructors. J Educ Psychol 1978;70(5):815-26.
48. Hoyt DP, Pallett WH. Appraising teaching effectiveness: beyond student ratings. Idea Paper No. 36. Manhattan: Kansas State University, Center for Faculty Evaluation and Development, 1999:1-8.
49. Aleamoni LM. The usefulness of student evaluations in improving college teaching. Instr Sci 1978;7(1):95-105.
50. Marsh HW. The validity of students' evaluations: classroom evaluations of instructors independently nominated as best and worst teachers by graduating seniors. Am Educ Res J 1977;14(4):441-7.
51. McKeachie WJ, Lin Y-G, Mendelson CN. A small study assessing teacher effectiveness: does learning last? Contemp Educ Psychol 1978;3(4):352-7.
52. Overall JU, Marsh HW. Midterm feedback from students: its relationship to instructional improvement and students' cognitive and affective outcomes. J Educ Psychol 1979;71(6):856-65.
53. Albanese MA. The validity of lecturer ratings by students and trained observers. Acad Med 1991;66(1):26-8.
54. Hativa N, Raviv A. University instructors' ratings profiles: stability over time and disciplinary differences. Res Higher Educ 1996;37(3):341-65.
55. Palchik NS, Burdi AR, Hess GE, Dielman TE. Student assessment of teaching effectiveness in a multi-instructor course for multidisciplinary health professional students. Eval Health Professions 1988;11(1):55-73.
56. Ross JA, Bruce CD. Teacher self-assessment: a mechanism for facilitating professional growth. Teach Teacher Educ 2007;23(2):146-59.
57. Greenwald AG, Gillmore GM. Grading leniency is a removable contaminant of student ratings. Am Psychol 1997;52(11):1209-17.
58. Ory JC, Ryan K. How do student ratings measure up to a new validity framework? New Dir Institutional Res 2001;27(5):27-44.
59. Shevlin M, Banyard P, Davies M, Griffiths M. The validity of student evaluation of teaching in higher education: love me, love my lectures? Assess Eval High Educ 2000;25(4):397-405.
60. Love KG. Comparison of peer assessment methods: reliability, validity, friendship bias, and user reaction. J Appl Psychol 1981;66(4):451-7.
61. Abrami PC, Dickens WJ, Perry RP, Leventhal L. Do teacher standards for assigning grades affect student evaluations of teaching? J Educ Psychol 1980;72(1):107-18.
62. Abrami PC, Perry RP, Leventhal L. The relationship between student personality characteristics, teacher ratings, and student achievement. J Educ Psychol 1982;74(1):111-25.
63. Centra JA. Use of the teaching portfolio and student evaluations for summative evaluation. Paper presented at Annual Meeting of American Educational Research Association, Atlanta, GA, April 12-16, 1993.
64. Chacko TI. Student ratings of instruction: a function of grading standards. Educ Res Q 1983;8(2):19-25.
65. Koshland DE Jr. Teaching and research. Science 1991;251(4991):249.
66. Nimmer JG, Stone EF. Effects of grading practices and time of rating on student ratings of faculty performance and student learning. Res Higher Educ 1991;32(2):195-215.
67. Powell R. Faculty rating scale validity: the selling of a myth. College Engl 1978;39(5):616-29.
68. Snyder CR, Clair M. Effects of expected and obtained grades on teacher evaluation and attribution of performance. J Educ Psychol 1976;68:75-82.
69. Vasta R, Sarmiento RF. Liberal grading improves evaluations but not performance. J Educ Psychol 1979;71(2):207-11.
70. Marsh HW. Students' evaluations of university teaching: research findings, methodological issues, and directions for future research. Int J Educ Res 1987;11(3):253-388.
71. Theall M, Franklin J. Using student ratings for teaching improvement. New Dir Teach Learn 1991;48(4):83-96.
72. Theall M, Abrami PC, Mets LA. The student ratings debate: are they valid? how can we best use them? San Francisco: Jossey-Bass, 2001.
73. Theall M, Franklin J. Student ratings in the context of complex evaluation systems. New Dir Teach Learn 1990;43(3):17-34.
74. Marsh HW, Cooper TL. Prior subject interest, students' evaluations, and instructional effectiveness. Multivariate Behav Res 1981;16(1):83-104.
75. Ory JC. The influence of students' affective entry on instructor and course evaluations. Rev Higher Educ 1980;4(1):13-24.
76. Amin ME. Gender as a discriminating factor in the evaluation of teaching. Assess Eval High Educ 1994;19(2):135-43.
77. Dukes RL, Victoria G. The effects of gender, status, and effective teaching on the evaluation of college instruction. Teach Sociol 1989;17(4):447-57.
78. Feldman KA. College students' views of male and female college teachers: Part II - evidence from students' evaluations of their classroom teachers. Res Higher Educ 1993;34(2):151-211.
79. Erdle S, Murray HG, Rushton J. Personality, classroom behavior, and student ratings of college teaching effectiveness: a path analysis. J Educ Psychol 1985;77(4):394-407.
80. Feldman KA. The association between student ratings of specific instructional dimensions and student achievement: refining and extending the synthesis of data from multisection validity studies. Res Higher Educ 1989;30(6):583-645.
81. Tang TLP. Teaching evaluation at a public institution of higher education: factors related to the overall teaching effectiveness. Public Personnel Management 1997;26:379-89.
82. Feldman KA. The significance of circumstances for college students' ratings of their teachers and courses. Res Higher Educ 1979;10(2):149-72.
83. Pulich MA. Better use of student evaluations for teaching effectiveness. Improving College University Teach 1984;32:91-4.
84. Svinicki MD. Encouraging your students to give feedback. New Dir Teach Learn 2001;87(3):17-24.
85. Marsh HW. Validity of students' evaluations of college teaching: a multitrait-multimethod analysis. J Educ Psychol 1982;74(2):264-79.
86. Centra JA. Student ratings of instruction and their relationship to student learning. Am Educ Res J 1977;14(1):17-24.
87. McKeachie WJ. Research on college teaching: the historical background. J Educ Psychol 1990;82(2):189-200.
88. Cohen PA. Effectiveness of student-rating feedback for improving college instruction: a meta-analysis of findings. Res Higher Educ 1980;13(4):321-41.
89. Brinko KT. The interactions of teaching improvement. New Dir Teach Learn 1991;48(4):39-49.
90. Marsh HW, Roche L. The use of students' evaluations and an individually structured intervention to enhance university teaching effectiveness. Am Educ Res J 1993;30(1):217-51.
91. Seldin P. The use and abuse of student ratings of professors. Chron Higher Educ 1993;39(3):40.
92. Seldin P. Changing practices in faculty evaluation. San Francisco: Jossey-Bass, 1984.
93. Ramsden P. A performance indicator of teaching quality in higher education: the course experience questionnaire. Stud Higher Educ 1991;16(2):129-50.
94. Marsh HW, Dunkin MJ. Students'evaluations of university teaching: a multidimensional perspective. Higher Educ: Handbook Theory Res 1992;8:143-233.
95. Koon J, Murray HG. Using multiple outcomes to validate student ratings of overall teacher effectiveness. J Higher Educ 1995;66(1):61-81.
96. Centra J. Reflective faculty evaluation. San Francisco: Jossey-Bass, 1993.
97. Irby D. Evaluating instructional scholarship in medicine. J Am Podiatr Med Assoc 1993;83(6):332-7.
98. Cederblom D, Lounsbury JW. An investigation of user acceptance of peer evaluations. Personnel Psychol 1980;33(3):567-79.
99. Aleamoni LM. Components of the instructional setting. Instr Evaluation 1982;7:11-6.
100. Keig LW, Waggoner MD. Peer review of teaching: improving college instruction through formative assessment. J Excellence College Teach 1995;6(3):51-83.
101. Root LS. Faculty evaluation: reliability of peer assessments of research, teaching, and service. Res Higher Educ 1987;26(1):71-84.
102. Braskamp LA, Brandenburg DC, Ory JC. Evaluating teaching effectiveness: a practical guide. Beverly Hills, CA: Sage Publications, 1984.
103. Cosh J. Peer observation in higher education: a reflective approach. Innovat Educ Teach Int 1998;35(2):171-6.
104. Shortland S. Peer observation: a tool for staff development or compliance? J Further Higher Educ 2004;28(2):219-28.
105. Rowland S. The enquiring university teacher. London: Society for Research into Higher Education, Ltd., 2000.
106. Sullivan AM, Skanes GR. Validity of student evaluation of teaching and the characteristics of successful instructors. J Educ Psychol 1974;66(4):584-90.
107. Martin GA, Double JM. Developing higher education teaching skills through peer observation and collaborative reflection. Innovat Educ Teach Int 1998;35(2):161-70.
108. Blackwell R, McLean M. Peer observation of teaching and staff development. Higher Educ Q 1996;50(2):156.
109. Bridges EM. The incompetent teacher: the challenge and the response. Philadelphia: Falmer Press, 1986.
110. Lonsdale AJ. Academic staff appraisals in Australian higher education. Part 1: principles and guidelines. Canberra: Australian Government Pub. Service, 1988.
111. Milman NB. Web-based digital teaching portfolios: fostering reflection and technology competence in preservice teacher education students. J Technology Teacher Educ 2005;13(3):373.
112. Lee GC, Wu CC. Enhancing the teaching experience of pre-service teachers through the use of videos in web-based computer-mediated communication (CMC). Innovat Educ Teach Int 2006;43(4):369-80.
113. Cohen PA, McKeachie WJ. The role of colleagues in the evaluation of college teaching. Improving College University Teach 1980;28(4):147-54.
114. DeZure D. Evaluating teaching through peer classroom observation. In: Seldin PA, ed. Changing practices in evaluating teaching. Bolton, MA: Anker Pub. Co., 1999:70-96.
115. Cameron J, Pierce WD. Reinforcement, reward, and intrinsic motivation: a meta-analysis. Rev Educ Res 1994;64(3):363-423.
116. Beck RJ, Livne NL, Bear SL. Teachers' self-assessment of the effects of formative and summative electronic portfolios on professional development. Eur J Teach Educ 2005;28(3):221-44.
117. Leggett M, Bunker A. Teaching portfolios and university culture. J Further Higher Educ 2006;30(3):269-82.
118. De Rijdt C, Tiquet E, Dochy F, Devolder M. Teaching portfolios in higher education and their effects: an explorative study. Teach Teacher Educ 2006;22(8):1084-93.
119. Seldin P. The teaching portfolio: a practical guide to improved performance and promotion/tenure decisions. 2nd ed. Bolton, MA: Anker Pub. Co., 1997.
120. Centra JA. Self-ratings of college teachers: a comparison with student ratings. J Educ Measurement 1973;10(4):287-95.
121. Tucker PD, Stronge JH, Gareis CR. Handbook on teacher portfolios for evaluation and professional development. Larchmont, NY: Eye on Education, 2002.
122. Kulik JA, Kulik CLC. Student ratings of instruction. Teach Psychol 1974;1(2):51-7.
123. Centra JA. Self-ratings of college teachers: a comparison with student ratings. J Educ Measurement 1973;10(4):287-95.
124. Ross JA. Teacher efficacy and the effects of coaching on student achievement. Can J Higher Educ 1992;17(1):51-65.