Using the 360° multisource feedback model to evaluate teaching and professionalism

Medical Teacher

Volumn 31, Issue 12, 2009, Pages 1073-1080

  Berk, Ronald A ^a  

^a JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADMINISTRATIVE PERSONNEL; ALUMNUS; EMPLOYER; FEEDBACK SYSTEM; HUMAN; MEDICAL SCHOOL; PEER GROUP; PROFESSIONALISM; PSYCHOMETRY; REVIEW; TEACHER; TEACHING; ARTICLE; CONSUMER; MEDICAL EDUCATION; MEDICAL STUDENT; METHODOLOGY; PERSONNEL MANAGEMENT; PROFESSIONAL COMPETENCE; STANDARD; UNITED STATES;

CONSUMER SATISFACTION; EDUCATION, MEDICAL, UNDERGRADUATE; EMPLOYEE PERFORMANCE APPRAISAL; FACULTY, MEDICAL; FEEDBACK; HUMANS; PROFESSIONAL COMPETENCE; PSYCHOMETRICS; SCHOOLS, MEDICAL; STUDENTS, MEDICAL; TEACHING; UNITED STATES;

EID: 72049128322     PISSN: 0142159X     EISSN: 1466187X     Source Type: Journal    
DOI: 10.3109/01421590802572775     Document Type: Review

References (60)

1. Allerup P, Aspegren K, Ejlersen E, Jørgesen G, Malchow-Møller A, Møller MK, Pedersen KK, Rasmussen OB, Rohold A, Sørensen B. 2007. Use of 360-degree assessment of residents in internal medicine in a Danish setting: A feasibility study. Med Teach 29:166-170.
2. Appling SE, Naumann PL, Berk RA. 2001. Using a faculty evaluation triad to achieve evidence-based teaching. Nurs Health Care Perspect 22:247-251.
3. Archer JC, Norcini J, Davies H. 2005. Use of SPRAT for peer review of paediatricians in training. Brit Med J 330:1251-1253.
4. Arreola RA. 2007. Developing a comprehensive faculty evaluation system: A handbook for college faculty and administrators on designing and operating a comprehensive faculty evaluation system. 3rd ed. Bolton, MA: Anker.
5. Berk RA. 2005. Survey of 12 strategies to measure teaching effectiveness. Int J Teach Learn Higher Educ 17(1):4862. (http:/www.isetl.org/ ijtlthe).
6. Berk RA. 2006. Thirteen strategies to measure college teaching: A consumer's guide to rating scale construction, assessment, and decision making for faculty, administrators, and clinicians. Sterling, VA: Stylus.
7. Berk RA. 2009. Derogatory and cynical humor in clinical teaching: A case for professionalism. Med Educ 43:7-9.
8. Berk RA, Naumann PL, Appling SE. 2004. Beyond student ratings: Peer observation of classroom and clinical teaching. Int J Nurs Educ Scholarsh 1(1):1-26.
9. Boyd NM. 2005. 360-Degree performance appraisal systems. In: Rabin J, editor. Encyclopedia of public administration and public policy. Oxford, England: Taylor & Francis.
10. Bracken DW, Timmreck CW, Church AH, editors. 2001. The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes. San Francisco: Jossey-Bass.
11. Braskamp LA, Ory JC. 1994. Assessing faculty work. San Francisco: Jossey- Bass.
12. Brutus S, Fleenor JW, London M. 1998. Does 360-degree feedback work in different industries? A between-industry comparison of the reliability and validity of multi-source performance ratings. J Manage Dev 17(3):177-190.
13. Centra JA. 1993. Reflective faculty evaluation: Enhancing teaching and determining faculty effectiveness. San Francisco: Jossey-Bass.
14. Conway JM, Huffcutt AI. 1997. Psychometric properties of multisource performance ratings: A meta-analysis of subordinate, supervisor, peer, and self-ratings. Hum Perform 10:331-360.
15. Davis J. 2002. Comparison of faculty, peer, self, and nurse assessment of obstetrics and gynecology residents. Obstet Gynecol 99:647-651.
16. Diefendorff JM, Silverman SB, Greguras GJ. 2005. Measurement equivalence and multisource ratings for non-managerial positions: Recommendations for research and practice. J Bus Psychol 19(3):399-425.
17. Edwards MR, Ewen AJ. 1996. 360° Feedback: The powerful new model for employee assessment and performance improvement. New York: American Management Association (AMACOM).
18. Evans R, Elwyn G, Edwards A. 2004. Review of instruments for peer assessment of physicians. Brit Med J 328:1240-1245.
19. Forni PM. 2002. Choosing civility: The 25 rules of considerate conduct. New York: St. Martin's Press.
20. Ghorpade J. 2000. Managing five paradoxes of 360-degree feedback. Acad Manage Exec 14(1):140-150.
21. Gillespie TL. 2005. Internationalizing 360-degree feedback: Are subordinate ratings comparable? J Bus Psychol 19(3):361-382.
22. Gray A, Lewis A, Fletcher C, Burke E, Mackay J, Kubelius E, Lindley P. 2003. 360 degree feedback: Best practices guidelines (http://www. psychtesting.org.uk/).
23. Griffin E, Sanders G, Craven D, King J. 2000. A computerized 360° feedback tool for personal and organizational development in general practice. Health Informatics J 6:71-80.
24. Hall W, Violato C, Lewkonia R, Lockyer JM, Fidler H, Toews J, Jennett P, Donoff M, Moores D. 1999. Assessment of physician performance in Alberta: The physician achievement review. Can Med Assoc J 161:52-57.
25. Johnson D, Cujec B. 1998. Comparison of self, nurse and physician assessment of residents rotating through an intensive care unit. Crit Care Med 26:1811-1816.
26. Jones JE. 1996. 360-Degree feedback: Strategies, tactics, and techniques for developing leaders. Amherst, MA: Human Resource Development Press.
27. Joshi R, Ling FW, Jaeger J. 2004. Assessment of a 360-degree instrument to evaluate residents' competency in interpersonal and communication skills. Acad Med 79:458-463.
28. Knapper C, Cranton P, editors. 2001. Fresh approaches to the evaluation of teaching (New Directions for Teaching and Learning, No. 88). Jossey- Bass: San Francisco.
29. Lepsinger R, Lucia AD. 1997. The art and science of 360 degree feedback. San Francisco: Pfeiffer.
30. Lipner RS, Blank LL, Leas BF, Fortna GS. 2002. The value of patient and peer ratings in recertification. Acad Med 77(10S):64S-66S.
31. Lockyer JM. 2003. Multi source feedback in the assessment of physician competencies. J Cont Educ Health Prof 23(1):4-12.
32. Lockyer JM, Clyman S. 2008. Multi source feedback. In: ES Holmboe, RE Hawkins, editors. Practical guide to the evaluation of clinical competence. Philadelphia: Mosby/Elsevier. pp 75-85.
33. Lockyer JM, Violato C. 2004. An examination of the appropriateness of using a common peer assessment instrument to assess physician skills across specialties. Acad Med 79:5S-8S.
34. Lockyer JM, Violato C. 2006. A multi source feedback program for anesthesiologists. Can J Anesth 53:33-39.
35. Lockyer JM, Violato C, Fidler H. 2006. The assessment of emergency physicians by a regulatory authority. Acad Emerg Med 13:1296-1303. (Pubitemid 44791975)
36. Lockyer JM, Violato C, Fidler H. 2007. What multisource feedback factors influence physician self-assessments? A five-year longitudinal study. Acad Med 82:577-580.
37. McCarthy AM, Garavan TN. 2001. 360 degree feedback processes: Performance improvement and employee career development. J Eur Ind Training 25(1):3-32.
38. Murphy DJ, Bruce DA, Mercer SW, Eva KW. 2008. The reliability of workplace-based assessment in postgraduate medical education and training: A national evaluation in general practice in the United Kingdom. Adv Health Sci Educ 10:1007/s10459-008-9104-9108
39. Norcini J, Birch V. 2007. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach 29:855-871.
40. Ramsey P, Carline JD, Inui TS, Larson EB, LoGerfo JP, Wenrich MD. 1993. Use of peer ratings to evaluate physician performance. J Am Med Assoc 269:1655-1660.
41. Risucci DA, Tortolani AJ, Ward RJ. 1989. Ratings of surgical residents by self, supervisors and peers. Surg Gynecol Obstet 169(5):519-526.
42. Sargeant JM, Mann KV, Ferrier S. 2005. Understanding family physicians' reactions to MSF performance assessment: Perceptions of credibility and usefulness. Med Educ 39:497-504.
43. Sargeant JM, Mann KV, Sinclair D, van der Vleuten C, Metsemakers J. 2006. Understanding the influence of emotions and reflections upon multi-source feedback acceptance and use. Adv Health Sci Educ 10:1007/s10459-006-9039-x.
44. Seifert CF, Yukl G, McDonald RA. 2003. Effects of multisource feedback and a feedback facilitator on the influence behavior of managers toward subordinates. J Appl Psychol 88:561-569.
45. Seldin P. 1999. Current practices - good and bad - nationally. In: Seldin P, editor. Changing practices in evaluating teaching: A practical guide to improved faculty performance and promotion/tenure decisions. Bolton, MA: Anker. pp 1-24.
46. Seldin P, editor. 2006. Evaluating faculty performance: A practical guide to assessing teaching, research, and service. Bolton, MA: Anker.
47. Smith AFR, Fortunato VJ. 2008. Factors influencing employee intentions to provide honest upward feedback ratings. J Bus Psychol 22(3):191-207.
48. Smither JW, London M, Reilly RR. 2005. Does performance improve following multisource feedback? A theoretical model, meta-analysis, and review of empirical findings. Personnel Psychol 58:33-66.
49. Tornow WW, London M. 1998. Maximizing the value of 360-degree feedback: A process for successful individual and organizational development. San Francisco: Jossey-Bass.
50. Twale DJ, DeLuca BM. 2008. Faculty incivility: The rise of the academic bully culture and what to do about it. San Francisco: Jossey-Bass.
51. Tyler KM. 2006. Peer-level multiple source feedback for fitness to practice. Med Educ 40:459-489.
52. US Department of Education 1991. Assessing teaching performance. The Department Chair: A Newsletter for Academic Administrators 2 3 2, winter.
53. van Velsor E, Leslie JB, Fleenor JW. 1997. Choosing 360: A guide to evaluating multi-rater feedback instruments for management development. Greensboro, NC: Center for Creative Leadership.
54. Veloski J, Boex JR, Grasberger MJ, Evans A, Wolfson DB. 2006. Systematic review of the literature on assessment, feedback, and physicians' clinical performance 1: BEME Guide No. 7. Med Teach 28:117-128.
55. Vinson MN. 1996. The pros and cons of 360-degree feedback: Making it work. Train Dev 50(4):11-12.
56. Violato C, Lockyer JM, Fidler H. 2003. Multi source feedback: A method of assessing surgical practice. Brit Med J 326:546-548.
57. Violato C, Marini A, Toews J, Lockyer JM, Fidler H. 1997. Feasibility and psychometric properties of using peers, consulting physicians, co-workers, and patients to assess physicians. Acad Med 72:82S-84S.
58. Waldman D, Atwater LE. 1998. Power of 360 degree feedback: How to leverage performance evaluations for top productivity. Burlington, MA: Gulf Professional Publishing.
59. Wenrich MD, Carline JD, Giles LM, Ramsey PG. 1993. Ratings of the performances of practicing internists by hospital-based registered nurses. Acad Med 68:680-687.
60. Wood J, Collins J, Burnside ES, Albanese MA, Propeck PA, Kelcz F, Spilde JM, Schmaltz LM. 2004. Patient, faculty, and self-assessment of radiology resident performance: A 360-degree method of measuring professionalism and interpersonal/communication skills. Acad Radiol 11:931-939.