Assessment of communication skills and self-appraisal in the simulated environment: Feasibility of multirater feedback with gap analysis

Simulation in Healthcare

Volumn 4, Issue 1, 2009, Pages 22-29

  Calhoun, Aaron W ^f   Rider, Elizabeth A ^a,b,c,d,e   Meyer, Elaine C ^a,b,c,d,e   Lamiani, Giulia ^a,b,c,d,e   Truog, Robert D ^a,b,c,d,e  

^a UNIVERSITY OF LOUISVILLE   (United States)

^b BOSTON CHILDREN S HOSPITAL   (United States)

^c HARVARD MEDICAL SCHOOL   (United States)

^d MASSACHUSETTS GENERAL HOSPITAL   (United States)

^e UNIVERSITY OF MILAN   (Italy)

^f University of Milan ^*  (United States)

Author keywords

ACGME competencies; Assessment of communication skills; Evaluation; Gap analysis; Medical education; Multirater feedback; Self appraisal; Self assessment; Simulated parent interactions; Simulation of physician communication

Indexed keywords

ARTICLE; COMMUNICATION SKILL; CONSENSUS; DOCTOR PATIENT RELATION; ENVIRONMENTAL FACTOR; FEASIBILITY STUDY; INTENSIVE CARE UNIT; MEDICAL EDUCATION; NEWBORN INTENSIVE CARE; PRIORITY JOURNAL; RELIABILITY; SELF EVALUATION; SIMULATION; EDUCATION; FAMILY; FEEDBACK SYSTEM; HUMAN; HUMAN RELATION; INTERPERSONAL COMMUNICATION; METHODOLOGY; OBSERVER VARIATION; PATIENT CARE; TEACHING;

COMMUNICATION; EDUCATIONAL MEASUREMENT; FAMILY; FEASIBILITY STUDIES; FEEDBACK; HUMANS; INTENSIVE CARE UNITS, PEDIATRIC; INTERNSHIP AND RESIDENCY; OBSERVER VARIATION; PATIENT CARE TEAM; PATIENT SIMULATION; PROFESSIONAL-FAMILY RELATIONS;

EID: 85047683282     PISSN: 15592332     EISSN: 1559713X     Source Type: Journal    
DOI: 10.1097/SIH.0b013e318184377a     Document Type: Article

References (47)

1. ACGME. ACGME Outcomes Project. 2000 [cited; Available at: http://www.acgme.org/outcome. Accessed March 15, 2007.
2. Rider EA, Keefer CH. Communication skills competencies: definitions and a teaching toolbox. Med Educ 2006; 40:624-629.
3. Pieperl M. Getting 360-degree Feedback Right. Harv Bus Rev 2001; 21:142-147.
4. Lockyer J. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof 2003; 23:4-12.
5. Violato C, Marini A, Toews J, et al. Feasibility and psychometric properties of using peers, consulting physicians, co-workers, and patients to assess physicians. Acad Med 1997; 72(10 SUPPL. 1):S82-S84.
6. Foster C, Law M. How many perspectives provide a compass? differentiating 360-degree and multi-source feedback. Int J Sel Assess 2006; 14:288-291.
7. Violato C, Lockyer J, Fidler H. Multisource feedback: a method of assessing surgical practice. Bmj 2003; 326:546-548.
8. Lockyer J, Violato C, Fidler H. Likelihood of Change: A Study Assessing Surgeon Use of Multisource Feedback Data. Teach Learn Med 2003; 15:168-174.
9. Lockyer JM, Violato C, Fidler H. A multi source feedback program for anesthesiologists. Can J Anaesth 2006; 53:33-39.
10. Xiao Y, MacKenzie C, Orasanu J, et al. Information acquisition from audio-video-data sources: an experimental study on remote diagnosis. The LOTAS Group. Telemed J 1999; 5:139-155.
11. Potter TB, Palmer RG. 360-degree assessment in a multidisciplinary team setting. Rheumatology (Oxford) 2003; 42:1404-1407.
12. Wood J, Collins J, Burnside ES, et al. Patient, faculty, and selfassessment of radiology resident performance: a 360-degree method of measuring professionalism and interpersonal/communication skills. Acad Radiol 2004; 11:931-939.
13. Weigelt JA, Brasel KJ, Bragg D, et al. The 360-degree evaluation: increased work with little return? Curr Surg 2004; 61:616-626; discussion 27-28.
14. Epstein RM. Mindful practice. JAMA 1999; 282:833-839.
15. Westberg J, Jason H. Fostering learners' reflection and self-assessment. Fam Med 1994; 26:278-282.
16. Arnold L, Willoughby TL, Calkins EV. Self-evaluation in undergraduate medical education: a longitudinal perspective. J Med Educ 1985; 60:21-28.
17. Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA 2002; 287:226-235.
18. Davis DA, Mazmanian PE, Fordis M, et al. Accuracy of physician selfassessment compared with observed measures of competence: a systematic review. JAMA 2006; 296:1094-1102.
19. Lockyer JM, Violato C, Fidler HM. What multisource feedback factors influence physician self-assessments? A five-year longitudinal study. Acad Med 2007; 82(SUPPL. 10):S77-S80.
20. Eva KW, Regehr G. Knowing when to look it up: a new conception of self-assessment ability. Acad Med 2007; 82(SUPPL. 10):S81-S84.
21. Eva KW, Regehr G. Self-assessment in the health professions: a reformulation and research agenda. Acad Med 2005; 80(SUPPL. 10): S46-S54.
22. Browning DM, Meyer EC, Truog RD, et al. Difficult conversations in health care: cultivating relational learning to address the hidden curriculum. Acad Med 2007; 82:905-913.
23. Boon H, Stewart M. Patient-physician communication assessment instruments: 1986 to 1996 in review. Patient Educ Couns 1998; 35:161-176.
24. Schirmer JM, Mauksch L, Lang F, et al. Assessing communication competence: a review of current tools. Fam Med 2005; 37:184-192.
25. Lang F, McCord R, Harvill L, et al. Communication assessment using the common ground instrument: psychometric properties. Fam Med 2004;36:189-198.
26. Frankel R, Stein T. Getting the most out of the clinical encounter: the four habits model. J Med Pract Manage 2001; 16:184-191.
27. Rider EA, Nawotniak RH, Smith GD. A Practical Guide to Teaching and Assessing the ACGME Core Competencies. Marblehead, MA: HCPro, Inc; 2007.
28. van Thiel J, Kraan HF, Van Der Vleuten CP. Reliability and feasibility of measuring medical interviewing skills: the revised Maastricht History-Taking and Advice Checklist. Med Educ 1991; 25:224-229.
29. Kalet A, Pugnaire MP, Cole-Kelly K, et al. Teaching communication in clinical clerkships: models from the macy initiative in health communications. Acad Med 2004; 79:511-520.
30. Spruill T. Approaches to Competency Assessment. 23 Annual Forum on Behavioral Sciences in Family Medicine. 2002 Sept 30, Chicago.
31. Makoul G. The SEGUE Framework for teaching and assessing communication skills. Patient Educ Couns 2001; 45:23-34.
32. Novack D, Dube C, Goldstein M. Teaching medical interviewing: a basic course on interviewing and the physician-patient relationship. Arch Intern Med 1992;152:1814-1820.
33. Cohen DS, Colliver JA, Marcy MS, et al. Psychometric properties of a standardized-patient checklist and rating-scale form used to assess interpersonal and communication skills. Acad Med 1996; 71(SUPPL. 1): S87-S89.
34. Epstein RM, Dannefer EF, Nofziger AC, et al. Comprehensive assessment of professional competence: the Rochester experiment. Teach Learn Med 2004; 16:186-196.
35. Lipner RS, Blank LL, Leas BF, et al. The value of patient and peer ratings in recertification. Acad Med 2002; 77(SUPPL. 10):S64-S66.
36. Stewart M. The impact of patient-centered care on outcomes. J Fam Pract 2000; 49:796-804.
37. Participants in the Bayer-Fetzer Conference on Physician-Patient Communication in Medical Education. Essential elements of communication in medical encounters: the Kalamazoo Consensus Statement. Acad Med 2001; 76:390-393.
38. Gillotti C, Thompson T, McNeilis K. Communicative competence in the delivery of bad news. Soc Sci Med 2002; 54:1011-1023.
39. Meyer EC, Ritholz MD, Burns JP, et al. Improving the quality of endof- life care in the pediatric intensive care unit: parents' priorities and recommendations. Pediatrics 2006; 117:649-657.
40. Finlay I, Dallimore D. Your child is dead. BMJ 1991; 302:1524-1525.
41. Simpson M, Buckman R, Stewart M, et al. Doctor-patient communication: the Toronto consensus statement. BMJ 1991; 303: 1385-1387.
42. Surbone A. Truth telling. Ann N Y Acad Sci 2000; 913:52-62.
43. Resnik DB. Ethical dilemmas in communicating medical information to the public. Health Policy (Amsterdam, Netherlands) 2001; 55:129-149.
44. Blackhall LJ, Frank G, Murphy S, et al. Bioethics in a different tongue: the case of truth-telling. J Urban Health 2001; 78:59-71.
45. Full Circle Feedback Pty. Ltd. Full Circle Feedback Learning Guide. [cited; Available at:www.fullcirclefeedback.com/resources/fcf-learning-guide- standard.htm. Accessed March 15, 2007.
46. Joshi R, Ling FW, Jaeger J. Assessment of a 360-degree instrument to evaluate residents' competency in interpersonal and communication skills. Acad Med 2004; 79:458-463.
47. Brett JF, Atwater LE. 360 degree feedback: accuracy, reactions, and perceptions of usefulness. J Appl Psychol 2001; 86:930-942.