Accuracy of physician self-assessment compared with observed measures of competence: A systematic review

JAMA

Volumn 296, Issue 9, 2006, Pages 1094-1102

  Davis, David A ^a,b,c   Mazmanian, Paul E ^d   Fordis, Michael ^e   Van Harrison, R ^f   Thorpe, Kevin E ^a,b   Perrier, Laure ^b  

^a ST MICHAEL'S HOSPITAL   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

^c UNIVERSITY OF TORONTO   (Canada)

^d VIRGINIA COMMONWEALTH UNIVERSITY SCHOOL OF MEDICINE   (United States)

^e BAYLOR COLLEGE OF MEDICINE   (United States)

^f UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; DATA BASE; HEALTH CARE PERSONNEL; HUMAN; MEASUREMENT; MEDICAL PRACTICE; MEDICAL PROFESSION; OBSERVATION; OUTCOME ASSESSMENT; PHYSICIAN; POPULATION RESEARCH; PRIORITY JOURNAL; PROFESSIONAL COMPETENCE; RESIDENT; REVIEW; SELF EVALUATION; CLINICAL COMPETENCE; EDUCATION; MEDICAL EDUCATION; PSYCHOLOGICAL ASPECT;

CLINICAL COMPETENCE; EDUCATION, MEDICAL, CONTINUING; HUMANS; PHYSICIANS; SELF ASSESSMENT (PSYCHOLOGY); SELF-EVALUATION PROGRAMS;

EID: 33748435343     PISSN: 00987484     EISSN: 15383598     Source Type: Journal    
DOI: 10.1001/jama.296.9.1094     Document Type: Review

References (48)

1. Westberg J, Jason H. Fostering learners' reflection and self-assessment. Fam Med. 1994;26:278-282.
2. Davis NL, Willis CE. A new metric for continuing medical education credit. J Contin Educ Health Prof. 2004;24:139-144.
3. Johnson DA, Austin DL, Thompson JN. Role of state medical boards in continuing medical education. J Contin Educ Health Prof. 2005;25:183-189.
4. American Medical Association. Physician resources for CME. http://www.ama-assn.org/ama/pub/category/2922.html. Accessed March 23, 2006.
5. American Board of Medical Specialties. Approved initiatives for Maintenance of Certification for the ABMS board members. http://www.abms.org/ Downloads/Publications/3-Approved%20Initiatives %20for%20MOC.pdf. Accessed June 9, 2006.
6. Wasserman SI, Kimball HR, Duffy FD; Task Force on Recertification. Recertification in internal medicine: a program of continuous professional development. Ann Intern Med. 2000;133:202-208.
7. Can MEDS 2000: extract from the CanMEDS 2000 Project Societal Needs Working Group Report. Med Teach. 2000;22:549-554.
8. Accreditation Council for Graduate Medical Education. General competencies. http://www.acgme.org/outcome/comp/compFull.asp. Accessed June 9, 2006.
9. Bashook PG, Miller SH, Parboosingh J, Horowitz SD, eds. Credentialing physician specialist: a world perspective proceedings. http://www.abms.org/ Downloads/Conferences/Credentialing%20Physician%20Specialists.pdf. Accessed June 9, 2006.
10. Eva KW, Regehr G. Self-assessment in the health professions: a reformulation and research agenda. Acad Med. 2005;80:S46-S54.
11. Research and Development Resource Base in CME. http://www.cme.utoronto. ca/search. Accessed March 23, 2006.
12. Biernat K, Simpson D, Duthie E Jr, Bragg D, London R. Primary care residents self assessment skills in dementia. Adv Health Sci Educ Theory Pract. 2003;8:105-110.
13. Amery J, Lapwood S. A study into the educational needs of children's hospice doctors: a descriptive quantitative and qualitative survey. Palliat Med. 2004;18:727-733.
14. Barnsley L, Lyon PM, Ralston SJ, et al. Clinical skills in junior medical officers: a comparison of self-reported confidence and observed competence. Med Educ. 2004;38:358-367.
15. Fox RA, Ingham Clark CL, Scotland AD, Dacre JE. A study of pre-registration house officers' clinical skills. Med Educ. 2000;34:1007-1012.
16. Leopold SS, Morgan HD, Kadel NJ, Gardner GC, Schaad DC, Wolf FM. Impact of educational intervention on confidence and competence in the performance of a simple surgical task. J Bone Joint Surg Am. 2005;87:1031-1037.
17. Parker RW, Alford C, Passmore C. Can family medicine residents predict their performance on the in-training examination? Fam Med. 2004;36:705-709.
18. Claridge JA, Calland JF, Chandrasekhara V, Young JS, Sanfey H, Schirmer BD. Comparing resident measurements to attending surgeon self-perceptions of surgical educators. Am J Surg. 2003;185:323-327.
19. Fernandez A, Schillinger D, Grumbach K, et al. Physician language ability and cultural competence: an exploratory study of communication with Spanish-speaking patients. J Gen Intern Med. 2004;19:167-174.
20. Young JM, Glasziou P, Ward JE. General practitioners' self ratings of skills in evidence based medicine: validation study. BMJ. 2002;324:950-951.
21. Hoppe RB, Farquhar LJ, Stoffelmayr HR. Residents' attitudes towards and skills in counseling: using undetected standardized patients. J Gen Intern Med. 1990;5:415-420.
22. Ireton HR, Sherman M. Self-ratings of graduating family practice residents' psychological medicine abilities. Fam Pract Res J. 1988;7:236-244.
23. Johnson D, Cujec B. Comparison of self, nurse, and physician assessment of residents rotating through an intensive care unit. Crit Care Med. 1998;26:1811-1816.
24. Paradise JE, Finkel MA, Beiser AS, et al. Assessments of girls' genital findings and the likelihood of sexual abuse: agreement among physicians self-rated as skilled. Arch Pediatr Adolesc Med. 1997;151:883-891.
25. Robbins JM, Kirmayer LJ, Cathebras P, Yaffe MJ, Dworkind M. Physician characteristics and the recognition of depression and anxiety in primary care. Med Care. 1994;32:795-812.
26. Stern DT, Linzer M, O'Sullivan PS, Weld L. Evaluating medical residents' literature-appraisal skills. Acad Med. 1995;70:152-154.
27. Tracey JM, Arroll B, Richmond DE, Barham PM. The validity of general practitioners' self assessment of knowledge: cross sectional study. BMJ. 1997;315:1426-1428.
28. Woods R, McCarthy T, Barry MA, Mahon B. Diagnosing smallpox: would you know it if you saw it? Biosecur Bioterror. 2004;2:157-163.
29. Sibley JC, Sackett DL, Neufeld V, Gerrard B, Rudnick KV, Fraser W. A randomized trial of continuing medical education. N Engl J Med. 1982;306:511-515.
30. Gordon MJ. A review of the validity and accuracy of self-assessments in health professions training. Acad Med. 1991;66:762-769.
31. Dunning D, Heath C, Suls J. Flawed self-assessment: implications for health, education, and the workplace. Psychol Sci Public Interest. 2004;5:69-106.
32. Falchikov N, Boud D. Student self-assessment in higher education: a meta-analysis. Rev Educ Res. 1989;59:395-430.
33. Eva KW, Cunnington JP, Reiter HI, Keane DR, Norman GR. How can I know what I don't know? poor self assessment in a well-defined domain. Adv Health Sci Educ Theory Pract. 2004;9:211-224.
34. Hodges B, Regehr G, Martin D. Difficulties in recognizing one's own incompetence: novice physicians who are unskilled and unaware of it. Acad Med. 2001;76:S87-S89.
35. Kruger J, Dunning D. Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. J Pers Soc Psychol. 1999;77:1121-1134.
36. Ward M, Gruppen L, Regehr G. Measuring self-assessment: current state of the art. Adv Health Sci Educ Theory Pract. 2002;7:63-80.
37. Colliver JA, Verhulst SJ, Barrows HS. Self-assessment in medical practice: a further concern about the conventional research paradigm. Teach Learn Med. 2005;17:200-201.
38. Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA. 2002;287:226-235.
39. Mamede S, Schmidt HG. The structure of reflective practice in medicine. Med Educ. 2004;38:1302-1308.
40. Hays RB, Jolly BC, Caldon LJ, et al. Is insight important? measuring capacity to change performance. Med Educ. 2002;36:965-971.
41. Bandura A. Social cognitive theory: an agentic perspective. Annu Rev Psychol. 2001;52:1-26.
42. Moret L, Tequi B, Lombrail P. Should self-assessment methods be used to measure compliance with handwashing recommendations? a study carried out in a French university hospital. Am J Infect Control. 2004;32:384-390.
43. Simon FA, Aschenbrener CA. Undergraduate medical education accreditation as a driver of lifelong learning. J Contin Educ Health Prof. 2005;25:157-161.
44. Greiner AC, Knebel E, eds. Health Professions Education: A Bridge to Quality. Washington, DC: National Academy Press; 2003.
45. Sherman CD Jr, Davis DA. CME in oncology - from where we were to where we are going. J Cancer Educ. 1995;10:131-136.
46. Sachdeva AK. The new paradigm of continuing education in surgery. Arch Surg. 2005;140:264-269.
47. Lockyer J. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof. 2003;23:4-12.
48. Conlon M. Appraisal: the catalyst of personal development. BMJ. 2003;327:3890-3891.