A Novel Approach to Assessing Professionalism in Preclinical Medical Students Using Multisource Feedback Through Paired Self- and Peer Evaluations

Teaching and Learning in Medicine

Volumn 29, Issue 4, 2017, Pages 402-410

  Emke, Amanda R ^a   Cheng, Steven ^a   Chen, Ling ^a   Tian, Dajun ^a   Dufault, Carolyn ^a  

^a WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

and preclinical medical students; assessment; multisource feedback; Professionalism; team based learning

Indexed keywords

BEHAVIOR; CLASSIFICATION; CONFIDENCE INTERVAL; CONTROLLED STUDY; DATA ANALYSIS; EXERCISE; HUMAN; HUMAN EXPERIMENT; LEARNING; MEDICAL STUDENT; PRECLINICAL STUDY; PROFESSIONALISM; REGRESSION ANALYSIS; SELF EVALUATION; STATISTICAL MODEL; ADULT; CONSTRUCTIVE FEEDBACK; EDUCATION; FEMALE; INTERDISCIPLINARY COMMUNICATION; MALE; MEDICAL EDUCATION; PEER GROUP; PROCEDURES; QUESTIONNAIRE; STATISTICS AND NUMERICAL DATA; UNITED STATES;

ADULT; EDUCATION, MEDICAL, UNDERGRADUATE; EDUCATIONAL MEASUREMENT; FEMALE; FORMATIVE FEEDBACK; HUMANS; INTERDISCIPLINARY COMMUNICATION; MALE; PEER GROUP; PROFESSIONALISM; SELF-ASSESSMENT; STUDENTS, MEDICAL; SURVEYS AND QUESTIONNAIRES; UNITED STATES;

EID: 85019210060     PISSN: 10401334     EISSN: None     Source Type: Journal    
DOI: 10.1080/10401334.2017.1306446     Document Type: Article

References (49)

1. Swick HM, Szenas P, Danoff D, Whitcomb ME. Teaching professionalism in undergraduate medical education. Journal of the American Medical Association 1999;282:830–2.
2. Epstein RM, Hundert EM. Defining and assessing professional competence. Journal of the American Medical Association 2002;287:226–35.
3. Pulito AR Donnelly MB, Plymale M, Mentzer RM, Jr. What do faculty observe of medical students' clinical performance? Teaching and Learning in Medicine 2006;18:99–104.
4. Barrett A, Galvin R, Steinert Y, Scherpbier A, O'Shaughnessy A, Horgan M, et al. A BEME review of the use of workplace-based assessment in identifying and remediating underperformance among postgraduate medical trainees. Medical Teacher 2016;18:1188–98.
5. Donnon T, Al Ansary A, Al Alawi S, Violato C. The reliability, validity, and feasibility of multisource feedback physician assessment: A systematic review. Academic Medicine 2014;89:511–6.
6. Naidoo S, Lopes S, Patterson F, Mead HM, and MacLeod S. Can colleagues', patients', and supervisors' assessments predict successful completion of postgraduate medical training? Medical Education. Epub 2016 November 23.
7. Warm EJ, Schauer D, Revis B, Boex JR. Multisource feedback in the ambulatory setting. Journal of Graduate Medical Education 2010;2:269–77.
8. Eva KW. Assessing tutorial-based assessment. Advances in Health Sciences Education 2001;6:243–57.
9. Arnold L. Assessing professional behavior: Yesterday, today, and tomorrow. Academic Medicine 2002;77:502–15.
10. Bryan RE, Krych AJ, Carmichael SW, Viggiano TR, Pawlina W. Assessing professionalism in early medical education: Experience with peer evaluation and self-evaluation in the gross anatomy course. Annals, Academy of Medicine, Singapore 2005;34:486–91.
11. Dannefer EF, Henson LC, Bierer SB, Grady–Weliky TA, Meldrum S, Nofziger AC, et al. Peer assessment of professional competence. Medical Education 2005;39:713–22.
12. Cottrell S, Diaz S, Cather A, Shumway J. Assessing medical student professionalism: An analysis of peer assessment. Medical Education Online 2006;11:8.
13. Lurie SJ, Lambert DR, Nofziger AC, Epstein RM, Grady-Weliky TA. Relationship between peer assessment during medical school, dean's letter rankings, and ratings by internship directors. Journal of General Internal Medicine 2007;22:13–16.
14. Papinczak T, Young L, Groves M, Haynes M. An analysis of peer, self, and tutor assessment in problem-based learning tutorials. Medical Teacher 2007;29:e122–32.
15. Kamp RJA, Dolmans DHJM, van Berkel HJM, Schmidt HG. Can students adequately evaluate the activities of their peers in PBL? Medical Teacher 2011;33:145–50.
16. Speyer R, Pilz W, van der Kruis J, Brunngs JW. Reliability and validity of student peer assessment in medical education: A systematic review. Medical Teacher 2011;33:e572–85.
17. Colthart I, Bagnall G, Evans A, Allbutt H, Haig A, Illing J, et al. The effectiveness of self-assessment on the identification of learner needs, learner activity, and impact on clinical practice: BEME Guide No. 10. Medical Teacher 2008;30:124–45.
18. Rose JS, Waibel BH, Schenarts PJ. Disparity between resident and faculty surgeons' perceptions of preoperative preparation, intraoperative teaching, and postoperative feedback. Journal of Surgical Education 2011;68:459–64.
19. Lipsett PA, Harris I, Downing S. Resident self-other assessor agreement. Archives of Surgery 2011;146:901–6.
20. Gow KW. Self-evaluation: How well do surgery residents judge performance on a rotation? The American Journal of Surgery 2013;205:557–62.
21. Kruger J, Dunning D. Unskilled and unware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology 1999;77:1121–34.
22. Morihara SK, Jackson DS, Chun MB. Making the professional curriculum for undergraduate medical education more relevant. Medical Teacher 2013;35:908–14.
23. ten Cate O, Chen HC. The parts, the sum and the whole—Evaluating students in teams. Medical Teacher 2016;38:639–41.
24. Rees CE, Knight LV. The trouble with assessing students' professionalism: Theoretical insights from sociocognitive psychology. Academic Medicine 2007;82:46–50.
25. Parmelee DX, Hudes P. Team-based learning: A relevant strategy in health professionals' education. Medical Teacher 2012;34:411–3.
26. Levine RE. Peer evaluation in team-based learning. In L, Michaelsen, D, Parmelee, KK, McMahon, RE, Levine (Eds.), Team-based learning for health professions education: A guide to using small groups for improved learning. Sterling: Stylus, 2007.
27. Agresti A. Categorical data analysis. New York: Wiley & Sons, 1990.
28. SAS® 9.3. System Options. 2nd Ed. Cary, NC: SAS Institute, 2011.
29. Norcini J, Burch V. Workplace-based assessments as an education tool: AMEE Guide No. 31. Medical Teacher 2007;29:855–71.
30. McSweeney K. Assessment for learning: From theory to practice: Final report. September 2012.
31. Holmoboe ES. Faculty and the observation of trainees' clinical skills: Problems and opportunities. Academic Medicine 2004;79:16–22.
32. Epstein RM. Assessment in medical education. The New England Journal of Medicine 2007;356:387–96.
33. Ferris H, O'Flynn D. Assessment in medical education: What are we trying to achieve? International Journal of Higher Education 2015;4:139–44.
34. Lockyer J. Multisource feedback: Can it meet criteria for good assessment? Journal of Continuing Education in the Health Professions 2013;33:89–98.
35. Epstein RM, Dannefer EF, Nofziger AC, Hansen JT, Schultz SH, Jospe N, et al. Comprehensive assessment of professional competence: The Rochester Experiment. Teaching and Learning in Medicine 2004;16:186–96.
36. Al-Wardy NM. Assessment methods in undergraduate medical education. QU Medical Journal 2010;10:203–9.
37. Hauer KE, Ciccone A, Henzel TR, Katsufrakis P, Miller SH, Norcross WA, et al. Remediation of the deficiencies of physicians across the continuum from medical school to practice: A thematic review of the literature. Academic Medicine 2009;84:1822–32.
38. Ziring D, Danoff D, Grosseman S, Langer D, Esposito A, Jan MK, et al. How do medical schools identify and remediate professionalism lapses in medical students? A study of U.S. and Canadian medical schools. Academic Medicine 2015;90:913–20.
39. Yates J, James D. Predicting the “strugglers”: A case-control study of students at Nottingham University Medical School. British Medical Journal 2006;332:1009–13. doi:10.1136/bmj.38730.678310.63
40. Cleland J, Arnold R, Chesser, Al. Failing finals is often a surprise for the student but not the teacher: Identifying difficulties and supporting students with academic difficulties. Medical Teacher 2005;27:504–8.
41. Cleland J, Leggett H, Sandars J, Costa MJ, Patel R, Moffat M. The remediation challenge: Theoretical and methodological insights from a systematic review. Medical Education 2013;47:242–51.
42. Fargen KM, Drolet BC, Philibert I. Unprofessional behaviors among tomorrow's physicians: Review of the literature with a focus on risk factors, temporal trends, and future directions. Academic Medicine 2016;91:858–64.
43. Papadakis MA, Hodgson CS, Tererani A, Kohatsu ND. Unprofessional behavior in medical school is associated with subsequent disciplinary action by a state medical board. Academic Medicine 2004;79:244–9.
44. Papadakis MA, Teherani A, Branch MA, Knetter TR Rattner SL, Stern DT, et al. Disciplinary action by medical boards and prior behavior in medical school. The New England Journal of Medicine 2005;353:2673–82.
45. Papadakis MA, Loeser H, Heady K. Early detection and evaluation of professionalism deficiencies in medical students: One school's approach. Academic Medicine 2001;76:1100–6.
46. Spandorfer J, Puklus T, Rose V, Vahedi M, Collins L, Giordano C, et al. Peer assessment among first year medical students in anatomy. Anatomical Sciences Education 2014;7:144–52.
47. Antonelli MA. Accuracy of second-year medical students' self-assessment of clinical skills. Academic Medicine 1997;72:563–5.
48. Tousignant M, DesMarchais JE. Accuracy of student self-assessment ability compared to their own performance in a problem-based learning medical program: A correlation study. Advances in Health Sciences Education 2002;7:19–27.
49. Roberts C, Stark P. Readiness for self-directed change in professional behaviors: Factorial validation of the Self-reflection and Insight Scale. Medical Education 2008;42:1054–63.