Assessment of medical professionalism: Who, what, when, where, how, and ... why

Medical Teacher

Volumn 31, Issue 4, 2009, Pages 348-361

  Hawkins, Richard E ^a   Katsufrakis, Peter J ^b   Holtman, Matthew C ^b   Clauser, Brian E ^b  

^a American Board of Medical Specialties   (United States)

^b National Board of Medical Examiners   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLINICAL PRACTICE; DECISION MAKING; EDUCATION PROGRAM; HEALTH CARE QUALITY; HEALTH PERSONNEL ATTITUDE; HUMAN; LEARNING TEST; MEDICAL EDUCATION; MEDICAL PROFESSION; MEDICAL STUDENT; MONITORING; PATIENT CARE; PHYSICIAN; PHYSICIAN ATTITUDE; PROFESSIONAL COMPETENCE; PROFESSIONAL KNOWLEDGE; PROFESSIONALISM; QUALITY CONTROL; REVIEW; SKILL; STUDENT ATTITUDE; THINKING; VALIDITY; ARTICLE; EVALUATION; STANDARD;

EVALUATION STUDIES AS TOPIC; HUMANS; PHYSICIAN'S ROLE; PROFESSIONAL COMPETENCE;

EID: 67649970600     PISSN: 0142159X     EISSN: 1466187X     Source Type: Journal    
DOI: 10.1080/01421590902887404     Document Type: Review

References (89)

1. AAMC. 1998. Report 1. Learning objectives for medical student education: Guidelines for medical schools. Available online at: http://www.aamc.org/meded/ msop/.
2. ABIM Foundation. 2002. American Board of Internal Medicine, ACP-ASIM Foundation, European Federation of Internal Medicine: Medical professionalism in the new millennium: A physician charter. Ann Intern Med 136:243-246.
3. Albanese M. 1999. Rating educational quality: Factors in the erosion of professional standards. Acad Med 74(6):652-658.
4. Archer JC, Norcini J, Davies HA. 2005. Use of SPRAT for peer review of paediatricians in training. Br Med J 330(7502):1251-1253.
5. Arnold L. 2002. Assessing professional behavior: Yesterday, today and tomorrow. Acad Med 77(6):502-515.
6. Arnold EL, Blank LL, Race KEH, Cipparrone N. 1998. Can professionalism be measured? The development of a scale for use in the medical environment. Acad Med 73(10):1119-1121.
7. Arnold L, Stern DT. 2006. What is Medical Professionalism? In: DT Stern, editor. Measuring medical professionalism. New York, NY: Oxford University Press. pp 15-37.
8. Bonke B. 2006. Unprofessional or problematic behaviour of medical students outside the learning environment. Med Teach 28(5): 440-442.
9. Boon K, Turner J. 2004. Ethical and professional conduct of medical students: A review of current assessment measures and controversies. J Med Ethics 30(2):221-226.
10. Brinkman WB, Geraghty SR, Lanphear BP, Khoury JC, Gonzalez JA, DeWitt TG, Britto MT. 2007. The effect of multisource feedback on resident communication skills and professionalism. Arch Pediatr Adolesc Med 161(1):44-49.
11. Butterfield PS, Mazzaferri EL. 1991. A new rating form for use by nurses in assessingresidents' humanistic behavior. J Gen Intern Med 6(2):155-161.
12. Colliver JA, Willis MS, Robbs RS, Cohen DS, Swartz MH. 1998. Assessment of empathy in a standardized-patient examination. Teach Learn Med 10(1):8-11.
13. Cook DA, Dupras DM, Beckman TJ, Thomas KG, Pankratz VS. 2008. Effect of rater training on reliability and accuracy of mini-CEX scores: A randomized, controlled trial. J Gen Intern Med 24(1):74-79.
14. Coulehan J, Williams PC. 2001. Vanquishing virtue: The impact of medical education. Acad Med 76(6):598-605.
15. Cruess RL, Cruess SR. 2006. Teaching professionalism: General principles. Med Teach 28(3):205-208.
16. Cruess R, McIlroy JH, Cruess S, Ginsburg S, Steinert Y. 2006. The Professionalism Mini-Evaluation Exercise: A preliminary investigation. Acad Med 81(10 Suppl):S74-S78.
17. Dannefer EF, Henson LC, Bierer SB, Grady-Weliky TA, Meldrum S, Nofzigerv AC, Barclay C, Epstein RM. 2005. Peer assessment of professional competence. Med Educ 39(7):713-722.
18. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. 2006. Accuracy of physician self-assessment compared with observed measures of competence: A systematic review. JAMA 296(9): 1094-1102.
19. DeLisa JA, Foye PM, Jain SS, Kirshblum S, Christodoulou C. 2001. Measuringprofessionalism in a physiatry residency training program. Am J Phys Med Rehabil 80(3):225-229.
20. Eva KW, Regehr G. 2005. Self-assessment in the health professions: A reformulation and research agenda. Acad Med 80(suppl 10):S46-S54.
21. Friedman Ben David M, Davis MH, Harden RM, Howie PW, Ker J, Pippard MJ. 2001. AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment. Med Teach 23(6):535-551.
22. Feudtner C, Christakis DA, Christakis NA. 1994. Do clinical clerks suffer ethical erosion? Students' perceptions of their ethical development and personal development. Acad Med 69(8):670-679.
23. Five Ws. 2008 Wikipedia. Available online at: http://en.wikipedia.org/ wiki/.
24. Five WS Gerrity MS, Mahaffy J. 1998. Evaluating change in medical school curricula: How did we know where we were going? Acad Med 73(suppl 9):S55-S59.
25. Ginsburg S, Regehr G, Hatala R, McNaughton N, Frohna A, Hodges B, Lingard L, Stern D. 2000. Context, conflict and resolution: A new conceptual framework for evaluating professionalism. Acad Med 75(Suppl 10):S6-S11.
26. Ginsburg S, Rehehr G, Lingard L. 2004. Basing the evaluation of professionalism on observable behaviors: A cautionary tale. Acad Med 10(suppl):S1-S4.
27. Goldie J. 2008. Integrating professionalism teaching into undergraduate medical education in the UK setting. Med Teach 30(5):513-527.
28. Guide to Good Medical Practice - USA (2008). Version 1.0, September 6, 2008. Available online at:https://gmpusa.org/.
29. Hafferty FW, Franks R. 1994. The hidden curriculum, ethics teaching, and the structure of medical education. Acad Med 69(11):861-871.
30. Haidet P, Kelly A, Chou C, & the Communication, Curriculum and Culture Study Group. 2005. Characterizing the patient-centeredness of hidden curricula in medical schools: Development and validation of a new measure. Acad Med, 80(1), 44-50.
31. Hall W, Violato C, Lewkonia R, Lockyer J, Fidler H, Toews J, Jennett P, Donoff M, Moores D. 1999. Assessment of physician performance in Alberta: The Physician Achievement Review. CMAJ 161(1):52-57
32. Harden RM. 1979. How to assess students: An overview. Med Teach 1(2):65-70.
33. Hauenstein NMA. 1998. Training raters to increase the accuracy of appraisals and the usefulness of feedback. In: Smithers JW, editor. Performance appraisal: State of the art in practice. San Francisco, CA: Jossey-Bass Inc. pp 404-442.
34. Hawkins RE, Holmboe ES. 2008. Constructing an evaluation system for an educational program. In: Holmboe ES, Hawkins RE, editors. A practical guide to the evaluation of clinical competence. Philadelphia, PA: Elsevier. pp 216-237.
35. Hemmer PA, Hawkins R, Jackson JL, Pangaro LN. 2000. Assessing how well three evaluation methods detect deficiencies in medical student's professionalism in two settings of an internal medicine clerkship. Acad Med 75(2):167-173.
36. Herbers JE, Noel GL, Cooper GS, Harvey J, Pangaro LN, Weaver MJ. 1989. How accurate are faculty evaluations of clinical competence? J Gen Intern Med 4(3):202-204.
37. Hewson MG, Little ML. 1998. Giving feedback in medical education: Verification of recommended techniques. J Gen Intern Med 13(2): 111-116.
38. Holmboe ES, Hawkins RE. 2004. Effects of training in direct observation of medical residents' clinical competence; A randomized trial. Ann Intern Med 140(11):874-881.
39. Kalet A, Earp JA, Kowlowitz V. 1992. How well do faculty evaluate the interviewing skills of medical students? J Gen Intern Med 7(5):499-505.
40. Kane MT. 2006. Validation. In: Brennan RL, editor. Educational measurement. Westport, CT: American Council on Education and Praeger Publishers. pp 17-64.
41. Kroboth FJ, Hanusa BH, Parker S, Coulehan JL, Kapoor WN, Brown FH, Karpf M, Levey GS. 1992. The inter-rater reliability and internal consistency of a clinical evaluation exercise. J Gen Intern Med 7(2):174-179.
42. Lievens F, Sanchez JI. 2007. Can training improve the quality of inferences made by raters in competency modeling? A quasi-experiment. J Appl Psychol 92(3):812-819.
43. Lipner RS, Blank LL, Leas BF, Fortna GS. 2002. The value of patient and peer ratings in recertification. Acad Med 77(Suppl 10):S64-S66.
44. Littlefield J, Paukert J, Schoolfield J. 2001. Quality assurance data for residents' global performance ratings. Acad Med 76(suppl 10): S102-S104.
45. Lockyer J. 2003. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof 23(1):4-12.
46. Lockyer JM, Clyman SG. 2008. Multisource Feedback (360-degree Evaluation). In: Holmboe ES, Hawkins RE, editors. A practical guide to the evaluation of clinical competence. Philadelphia, PA: Elsevier. pp 75-85.
47. Lockyer JM, Violato C, Fidler H. 2006. A multi source feedback program for Anesthesiologists. Can J Anesthesiol 53(1):33-39.
48. Lynch DC, Surdyk PM, Eiser AR. 2004. Assessing professionalism: A review of the literature. Med Teach 26(4):366-373.
49. Mazor K, Canavan C, Farrell M, Margolis MJ, Clauser BE. 2008. Collecting validity evidence for an assessment of professionalism: Findings from think-aloud interviews. Acad Med 83(Suppl 10):S9-S12.
50. Mazor K, Clauser B, Field T, Yood R, Gurwitz J. 2002. A demonstration of the impact of response bias on patient satisfaction surveys. Health Serv Res 37(5):1403-1417.
51. Mazor K, Clauser BE, Holtman M, Margolis M. 2007. Evaluation of missing data in an assessment of professional behaviors. Acad Med 82(suppl 10): S44-S47.
52. McIntyre RM, Smith DE, Hasset CE. 1984. Accuracy of performance ratings as affected by rater training and purpose of rating. J Appl Psychol 69(1):147-156.
53. Miller GE. 1990. The assessment of clinical skills/competence/ performance. Acad Med 65(Suppl 9):S63-S67.
54. NBME (2007) Assessment of professional behaviors project: List of behaviors. http://professionalbehaviors.nbme.org/2008ListofBehaviors.pdf
55. Noel GL, Herbers JE, Caplow MP, Cooper GS, Pangaro LN, Harvey J. 1992. How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Intern Med 117(9):757-765
56. Noonan LE, Sulsky LM. 2001. Impact of frame-of-reference and behavioral observation training on alternative training effectiveness criteria in a Canadian military sample. Hum Perform 14(1):3-26.
57. Norcini JJ. 2003. Peer assessment of competence. Med Educ 37(6):539-543.
58. Norcini JJ, Holmboe ES, Hawkins RE. 2008. Evaluation challenges in the era of outcomes-based education. In: Holmboe ES, Hawkins RE, editors. A practical guide to the evaluation of clinical competence. Philadelphia, PA: Elsevier. pp 1-9.
59. Papadakis M, Loeser H. 2006. Using critical incident reports and longitudinal observations to assess professionalism. In: Stern DT, editor. Measuring medical professionalism. New York, NY: Oxford University Press. pp 159-173.
60. Prislin MD, Lie D, Shapiro J, Boker J, Radecki S. 2001. Using standardized patients to assess medical students' professionalism. Acad Med 76(suppl 10):S90-S92.
61. Ramsey PG, Carline JD, Blank LL, Wenrich MD. 1996. Feasibility of hospitalbased use of peer ratings to evaluate the performances of practicing physicians. Acad Med 71(4):364-370.
62. Ramsey PG, Wenrich MD, Carline JD, Inui TS, Larson EB, LoGerfo JP. 1993. Use of peer ratings to evaluate physician performance. JAMA 269(13):1655-1660.
63. Raymond MR. 2001. Job analysis and the specification of content for licensure and certification examinations. Appl Meas Educ 14(4): 369-415.
64. Reddy ST, Farnan JM, Yoon JD, Troy L, Upadhyay GA, Humphrey HJ, Arora VM. 2007. Third-year medical students' participation in and perceptions of unprofessional behaviors. Acad Med 82(Suppl 10):S35-S39.
65. Rees C, Shepherd M. 2005. The acceptability of 360-degree judgements as a method of assessing undergraduate medical students' personal and professional behaviors. Med Educ 39(1):49-57.
66. Robins LS, White CB, Alexander GL, Gruppen LD, Grum CM. 2001. Assessing medical students awareness of and sensitivity to diverse health beliefs using a standardized patient station. Acad Med 76(1):76-80.
67. Roch SG, O'Sullivan BJ. 2003. Frame of reference rater training issues: Recall, time and behavior observation training. Int J Training Dev 7(2):93-107.
68. Sergeant J, Mann K, Sinclair D, van der Vleuten C, Metsemakers J. 2007. Challenges in multisource feedback: Intended and unintended outcomes. Med Educ 41(6):583-591.
69. Scott T, Mannion R, Davies H, Marshall M. 2003. The quantitative measurement of organizational culture in healthcare: A review of the available instruments. Health Serv Res 38(3):923-945.
70. Shumway JM, Harden RM. 2003. AMEE Guide No. 25: The assessment of learning outcomes for the competent and reflective physician. Med Teach 25(6):56-584.
71. Singer PA, Cohen R, Rothman A. 1993. The ethics objective structured clinical examination. J Gen Intern Med 8(1):23-28.
72. Smith DE. 1986. Training programs for performance appraisal: A review. Acad Manage Rev 11(1):22-40.
73. Srinivasan M, Litzelman D, Seshadri R, Lane K, Zhou W, Bogdewic S, Gaffney M, Galvin M, Mitchell G, Treadwell P, et al. 2004. Developing an OSTE to address lapses in learners' professional behavior and an instrument to code educators' responses. Acad Med 79(9):888-896.
74. Steinert Y, Cruess S, Cruess R, Snell L. 2005. Faculty development for teaching and evaluating professionalism: From programme design to curriculum change. Med Educ 39(2):127-136.
75. Stern DT. 2006. A framework for measuring professionalism. In: Stern DT, editor. Measuring medical professionalism. New York, NY: Oxford University Press. pp 3-13.
76. Stern DT, Frohna AZ, Gruppen LD. 2005. The prediction of professional behavior. Med Educ 39(1):75-82.
77. Sulsky LM, Day DV. 1992. Frame-of-reference training and cognitive categorization: An empirical investigation of rater memory issues. J Appl Psychol 77(4):501-510.
78. Ten Cate TJ, De Haes JCJM. 2000. Summative assessment of medical students in the affective domain. Med Teach 22(1):40-43.
79. Van Zanten M, Boulet JR, Norcini JJ, McKinley D. 2005. Using a standardized patient assessment to measure professional attributes. Med Educ 39(1):20-29.
80. Veloski JJ, Fields SK, Boex JR, Blank LL. 2005. Measuring professionalism: A review of studies with instruments reported in the literature between 1982 and 2002. Acad Med 80(4):3-370.
81. Violato C, Lockyer J. 2006. Self and peer assessment of pediatricians, psychiatrists and medicine specialists: Implications for self-directed learning. Adv Health Sci Educ 11(3):235-244.
82. Violato C, Lockyer J, Fidler H. 2003. Multisource feedback: A method of assessing surgical practice. Br Med J 326(7388):546-548
83. Violato C, Lockyer JM, Fidler H. 2006. Assessment of pediatricians by a regulatory authority. Pediatrics 117(3):796-802.
84. Violato C, Marini A, Toews J, Lockyer J, Fidler H. 1997. Feasibility and psychometric properties of using peers, consulting physicians, co-workers, and patients to assess physicians. Acad Med 72(Suppl 10):S82-S84.
85. Wenrich MD, Carline JD, Giles LM, Ramsey PG. 1993. Ratings of the performance of practicing internists by hospital-based registered nurses. Acad Med 68(9):680-687.
86. Williams RG, Klamen DA, McGaghie WC. 2003. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med 15(4):270-292.
87. Woehr DJ, Huffcutt AI. 1994. Rater training for performance appraisal: A quantitative review. J Occup Organ Psychol 67:189-205.
88. Woodward CA. 2002. Program evaluation. In: Norman GR, van der Vleuten CPM, Newble DI, editors. International handbook of research in Medical Education. Dordrecht: Kluwer Academic Publishers. pp 127-155.
89. Woolliscroft JO, Howell JD, Patel BP, Swanson DB. 1994. Resident-patient interactions: The humanistic qualities of internal medicine residents assessed by patients, attending physicians, program supervisors, and nurses. Acad Med 69(3):216-224.