The effectiveness of self-assessment on the identification of learner needs, learner activity, and impact on clinical practice: BEME Guide no. 10

Medical Teacher

Volumn 30, Issue 2, 2008, Pages 124-145

  Colthart, Iain ^a   Bagnall, Gellisse ^a   Evans, Alison ^b   Allbutt, Helen ^a   Haig, Alex ^a   Illing, Jan ^c   McKinstry, Brian ^d  

^a NHS EDUCATION FOR SCOTLAND   (United Kingdom)

^b UNIVERSITY OF LEEDS   (United Kingdom)

^c NEWCASTLE UNIVERSITY   (United Kingdom)

^d UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; BEHAVIOR CHANGE; CINAHL; CLINICAL PRACTICE; CONTINUING EDUCATION; EMBASE; EVIDENCE BASED PRACTICE; FEEDBACK SYSTEM; GOLD STANDARD; HEALTH CARE QUALITY; HEALTH PRACTITIONER; HUMAN; INFORMATION PROCESSING; INFORMATION RETRIEVAL; MEDICAL EDUCATION; MEDICAL LITERATURE; MEDICAL RESEARCH; MEDICAL STUDENT; MEDLINE; METHODOLOGY; NEEDS ASSESSMENT; OUTCOME ASSESSMENT; PATIENT CARE; POSTGRADUATE EDUCATION; PROFESSIONAL COMPETENCE; PROFESSIONAL PRACTICE; PSYCINFO; QUALITATIVE RESEARCH; QUALITY CONTROL; QUANTITATIVE STUDY; RELIABILITY; REVIEW; SELF EVALUATION; STUDENT ATTITUDE; VALIDITY; VERBAL BEHAVIOR; VIDEORECORDING; WORKSHOP;

CLINICAL COMPETENCE; HEALTH PERSONNEL; HUMANS; NEEDS ASSESSMENT; PROGRAM EVALUATION; SELF ASSESSMENT (PSYCHOLOGY);

EID: 46749133903     PISSN: 0142159X     EISSN: 1466187X     Source Type: Journal    
DOI: 10.1080/01421590701881699     Document Type: Review

References (100)

1. Antonelli, MA (1997) Accuracy of second-year medical students' self-assessment of clinical skills. Acad Med, 72, p. S63.
2. Bryan, RE, Krych, AJ, Carmichael, SW, Viggiano, TR and Pawlina, W. (2005) Assessing professionalism in early medical education: Experience with peer evaluation and self-evaluation in the gross anatomy course. Ann Acad Med Singapore, 34, pp. 486-491.
3. Edwards, R., Kellner, K., Sistrom, C. and Magyari, E. (2003) Medical student self-assessment of performance on an OG clerkship. Am J Obstet Gynecol, 188, pp. 1078-1082.
4. Ericson, C., Christersson, C., Manogue, M. and Rohlin, M. (1997) Clinical Guidelines and Self Assessment in Dental Education. Eur J Dental Educ, 1, pp. 123-128.
5. Eva, KW, Cunnington, JPW, Reiter, HI, Keane, DR and Norman, GR (2004) How Can I Know What I Don't Know? Poor Self Assessment in a Well-Defined Domain. Adv Health Sci Educ, 9, pp. 211-224.
6. Evans, AW, Leeson, RM, Newton John, TR and Petrie, A. (2005) The influence of self-deception and impression management upon self-assessment in oral surgery. Br Dental J, 198, pp. 765-769.
7. Fitzgerald, J., White, C. and Gruppen, L. (2003) A longitudinal study of self-assessment accuracy. Med Educ, 37, pp. 645-649.
8. Fitzgerald, JT, Gruppen, LD and White, CB (2000) The Influence of Task Formats on the Accuracy of Medical Students' Self-assessments. Acad Med, 75, pp. 737-741.
9. Gruppen, L., White, C., Fitzgerald, T., Grum, C. and Woolliscroft, J. (2000) Medical Students Self-assessments and their Allocations of Learning Time. Acad Med, 75, pp. 374-379.
10. Herbert, WN, Mcgaghie, WC, Droegemeuller, W., Riddle, MH and Maxwell, KL (1990) Student evaluation in obstetrics and gynecology: Self vs departmental assessment. Obstet Gynecol, 76, pp. 458-461.
11. Hodges, B., Regehr, G. and Martin, D. (2001) Knowing what we know-difficulties in recognising ones own incompetence: Novice physicians who are unskilled and unaware of it. Acad Med, 76, p. S87.
12. Johnson, D. and Cujec, B. (1998) Comparison of self, nurse and physician assessment of residents rotating through an ICU. Crit Care Med, 76, pp. 1811-1816.
13. Lane, JL and Gottlieb, RP (2004) Improving the interviewing and self-assessment skills of medical students: Is it time to readopt videotaping as an educational tool?. Ambulatory Paediatrics, 4, pp. 244-248.
14. Leopold, SS, Morgan, HD, Kadel, NJ, Gardner, GC, Schaad, DC and Wolf, FM (2005) Impact of educational intervention on confidence and competence in the performance of a simple surgical task. J Bone Joint Surgery, 87, pp. 1031-1037.
15. Mandel, LS, Goff, BA and Lentz, GM (2005) Self-assessment of resident surgical skills: Is it feasible?. Am J Obstet Gynecol, 193, pp. 1817-1822.
16. Martin, D., Regehr, G., Hodges, B. and Mcnaughton, N. (1998) Using videotaped benchmarks to improve the self-assessment ability of family practice residents. Acad Med, 73, pp. 1201-1206.
17. Millis, SR, Jain, SS, Eyles, M., Tulsky, D., Nadler, SF, Foye, PM, Elovic, E. and Delisa, JA (2002) Assessing Physicians' Interpersonal Skills: Do patients and physicians see eye to eye?. Am J Phys Med Rehab, 81, pp. 946-951.
18. Minter, RM, Gruppen, LD, Napolitano, KS and Gauger, PG (2005) Gender differences in the self-assessment of surgical residents. Am J Surgery, 189, pp. 647-650.
19. Paradise, JE, Finkel, MA, Beiser, AS, Berenson, AB, Greenberg, DB and Winter, MR (1997) Assessments of girls' genital findings and the likellihood of sexual abuse: Agreement among physicians self-rated as skilled. Arch Pediat Adolescent Med, 151, pp. 883-891.
20. Parker, RW, Alford, C. and Passmore, C. (2004) Can Family Medicine Residents Predict Their Performance on the In-Training Examination?. Fam Med, 36, pp. 705-709.
21. Reiter, H., Eva, K., Hatala, R. and Norman, G. (2002) Self and Peer Assessment in Tutorials: Application of a Relative-ranking Model. Acad Med, 77, pp. 1134-1139.
22. Rudy, DW, Fejfar, MC, Griffith, CH and Wilson, JF (2001) Self and peer assessment in a first year communication and interviewing course. Eva Health Professions, 24, pp. 436-445.
23. Sommers, PS, Muller, JH, Ozer, EM and Chu, PW (2001) Perceived self-efficacy for performing key physician faculty functions-a baseline assessment of participants in a one-year faculty development program. Acad Med, 76, p. S71.
24. Sullivan, ME, Hitchcock, MA and Dunnington, GL (1999) Peer and Self Assessment During Problem Based Tutorials. Am J Surg, 177, pp. 266-269.
25. Tracey, J., Arroll, B., Barham, P. and Richmond, D. (1997) The validity of general practitioners self assessment of knowledge: Cross sectional study. Br Med J, 315, pp. 1426-1428.
26. Ward, M., Macrae, H., Schlachta, C., Mamazza, J., Poulin, E., Reznick, R. and Regehr, G. (2003) Resident self-assessment of operative performance. Am J Surg, 185, pp. 521-524.
27. Weiss, PM, Koller, CA, Hess, LW and Wasser, T. (2005) How do medical student self-assessments compare with their final clerkship grades?. Med Teach, 27, pp. 445-449.
28. Wilkerson, L., Lee, M. and Hodgson, CS (2002) Evaluating curricular effects on medical students knowledge and self-perceived skills in cancer prevention. Acad Med, 77, p. S51.
29. Woods, R., Mccarthy, T., Barry, MA and Mahon, B. (2004) Diagnosing Smallpox: Would you know it if you saw it?. Biosecurity and Bioterrorism: Biodefense Strat, Pract Sci, 2, pp. 157-163.
30. Woolliscroft, JO, Tenhaken, J., Smith, J. and Calhoun, JG (1993) Medical students' clinical self-assessments: Comparisons with external measures of performance and the students self-assessments of overall performance and effort. Acad Med, 68, pp. 285-294.
31. Young, JM, Glasziou, P. and Ward, JE (2002) General practitioners' self-ratings of skill in evidence based medicine: Validation study. Br Med J, 324, pp. 950-951.
32. Zonia, SL and Stommel, M. (2000) Interns Self-evaluations Compared with Their Faculty's Evaluations. Acad Med, 75, p. 742.
33. Adriaansen, MJM and Van Achterberg, T. (2004) A test instrument for palliative care. Int J Nurs Studies, 41, pp. 107-117.
34. Alnasir, F. and Grant, N. (1999) Student self-assessment in a community-based clinical clerkship in family medicine: A preliminary report. Educ Health, 12, pp. 161-166.
35. Bakken, LL, Sheridan, J. and Carnes, M. (2003) Gender differences among physician-scientists in self-assessed abilities to perform clinical research. Acad Med, 78, pp. 1281-1286.
36. Barnsley, L., Lyon, PM, Ralston, SJ, Hibbert, EJ, Cunningham, I., Gordon, FC and Field, MJ (2004) Clinical skills in junior medical officers: A comparison of self-reported confidence and observed competence. Med Educ, 38, pp. 358-367.
37. Biernat, K., Simpson, D., Duthie, E., Bragg, D. and London, R. (2003) Primary Care Residents Self-assessment Skills in Dementia. Adv Health Sci Educ, 8, pp. 105-110.
38. Chur-Hansen, A. (2000) Medical students' essay-writing skills: criteria-based self-and tutor-evaluation and the role of language background. Med Educ, 34, pp. 194-198.
39. Claridge, JA, Calland, JF and Chandrasekhara, V. (2003) Comparing resident measurements to attending surgeon self-perceptions. Am J Surg, 185, pp. 323-327.
40. Coutts, L. and Rogers, J. (1999) Student Assessment and Standardized Patients-Will the Questions Never End?. Acad Med, 74, p. S128.
41. Das, M., Mpofu, D., Dunn, E. and Lanphear, JH (1998) Self and tutor evaluations in problem-based learning tutorials: Is there a relationship?. Med Educ, 32, pp. 411-418.
42. Davis, JD (2002) Comparison of faculty, peer, self, and nurse assessment of obstetrics and gynecology residents. Am Coll Obstet Gynecol, 99, pp. 647-651.
43. Elliott, N. and Higgins, A. (2005) Self and peer assessment-does it make a difference to student group work. Nurse Educ Pract, 5, pp. 40-48.
44. Evans, A., Mckenna, C. and Oliver, M. (2001) Towards better understanding of self-assessment in oral and maxillofacial surgery. Med Educ, 35, p. 1077.
45. Farnhill, D., Hays, SC and Todisco, J. (1997) Interviewing skills: self-evaluation by medical students. Med Educ, 31, pp. 122-127.
46. Fincher, R. and Lewis, L. (1994) Learning, experience, and self-assessment of competence of third-year medical students in performing bedside procedures. Acad Med, 69, pp. 291-295.
47. Fincher, RM, Lewis, L. and Kuske, T. (1993) Relationships of Interns Performances to their Self-assessments of their Preparedness for Internship and to their Academic Performances in Medical School. Acad Med, 68, pp. S47-S50.
48. Fox, RA, Ingham Clark, CL, Scotland, AD and Dacre, JE (2000) A study of pre-registration house officers' clinical skills. Med Educ, 34, pp. 1007-1012.
49. Frye, AW, Richards, BF, Bradley, EW and Philp, JR (1991) The consistency of students self-assessments in short essay subject matter examinations. Med Educ, 25, pp. 310-316.
50. Harrington, JP, Murnaghan, J. and Regehr, G. (1997) Applying a relative ranking model to the self -assessment of extended performances. Adv Health Sci Educ, 2, pp. 17-25.
51. Hartman, SL and Nelson, MS (1992) What we say and What we do: Self-reported teaching behavior versus performances in written simulations among medical school faculty. Acad Med, 67, pp. 523-527.
52. Hoppe, RB, Farquhar, LJ, Henry, R. and Stoffelmayr, B. (1990) Residents' Attitudes towards and Skills in Counseling: Using Undetected Standardised Patients. J Gen Intern Med, 5, pp. 415-420.
53. Kaiser, S. and Bauer, J. (1995) Checklist Self-Evaluation in a Standardized Patient Exercise. The Am J Surg, 169, pp. 418-420.
54. Levinson, W., Gordon, G. and Skeff, K. (1990) Retrospective versus actual pre-course self-assessments. Eval Health Prof, 13, pp. 445-452.
55. Lind, DS, Rekkas, S., Bui, V., Lam, T., Beirle, E. and Copeland, E. (2002) Competency-Based Student Self-Assessment on a Surgery Rotation. J Sur Res, 105, pp. 31-34.
56. Lorenz, R., Gregory, RP and Davis, DL (2000) Utility of a brief self-efficacy scale in clinical training program evaluation. Eval Health Prof, 23, pp. 182-193.
57. Macdonald, J., Williams, RG and Rogers, DA (2003) Self-assessment in simulation-based surgical skills training. The Am J Surg, 185, pp. 319-322.
58. Mattheos, N., Nattestad, A., Christersson, C., Jansson, H. and Attstrom, R. (2004) The effects of an interactive software application on the self-assessment ability of dental students. Eur J Dent Educ, 8, pp. 97-104.
59. Miller, PJ (1999) The agreement of peer assessment and self-assessment of learning processes in problem-based learning. J Phys Ther Educ, 13, pp. 26-30.
60. Murdoch-Eaton, D. (2002) Reflective Practice Skills in Undergraduates. Acad Med, 77, p. 734.
61. Murdock, JE and Neafsey, PJ (1995) Self-efficacy measurements: An approach for predicting practice outcomes in continuing education?. J Cont Edu Nurs, 26, pp. 158-165.
62. Pierre, RB, Wierenga, A., Barton, M., Thame, K., Branday, JM and Christie, CD (2005) Student self-assessment in a paediatric objective structured clinical examination. West Indian Med J, 54, pp. 144-148.
63. Rees, C. and Shepherd, M. (2005) Students' and assessors' attitudes towards students' self-assessment of their personal and professional behaviours. Med Educ, 39, pp. 30-39.
64. Sklar, DP and Tandberg, D. (1995) The value of self-estimated scholastic standing in residency selection. J Emerg Med, 13, pp. 683-685.
65. Stewart, J., Ohalloran, C., Barton, JR, Singleton, SJ, Harrigan, P. and Spencer, J. (2000) Clarifying the concepts of confidence and competence to produce appropriate self-evaluation measurement scales. Med Educ, 34, pp. 903-909.
66. Tousignant, M. and Desmarchais, JE (2002) Accuracy of student self-assessment ability compared to their own performance in a problem-based learning medical program: A correlation study. Adv Health Sci Educ, 7, pp. 19-27.
67. Wagner, C. and Abholz, HH (2004) Der Effekt einer palliativmedizinischen Fortbildungsreihe auf den Kenntnisstand von Hausrzten und deren Selbsteinschtzung [Effects of CME in Palliative Medicine on GP's knowledge and self-evaluation]. Zeit Allgemeinmedizin, 80, pp. 150-152.
68. Weerakoon, PK and Fernando, DN (1991) Self-evaluation of skills as a method of assessing learning needs for continuing education. Med Teach, 13, p. 103.
69. Wetherell, J., Mullins, G. and Hirsch, R. (1999) Self-assessment in a problem-based learning curriculum in dentistry. Eur J Dental Educ, 3, pp. 97-105.
70. Windish, DM, Knight, AM and Wright, SM (2004) Clinician Teachers Self-assessment versus learners' perceptions. J Gen Inter Med, 19, pp. 554-557.
71. Zijlstra-Shaw, S., Kropmans, TJ and Tams, J. (2005) Assessment of professional behaviour-a comparison of self-assessment by first year dental students and assessment by staff. Br Dent J, 198, pp. 165-171.
72. American Medical Association (1992) Mirror, mirror: Medicine enters the era of self-assessment. ALP Observer, 12, p. 17.
73. Amery, J. and Lapwood, S. (2004) A study into the educational needs of children's hospice doctors: A descriptive quantitative and qualitative survey. Palliative Med, 18, pp. 727-733.
74. Bandura, A. (1977) Self-efficacy: Toward a unifying theory of behavioural change. Psychol Rev, 84, pp. 191-215.
75. Bandura, A. (1982) Self-efficacy mechanism in human agency. Am Psychol, 37, pp. 122-147.
76. Bandura, A. (1994) Self-efficacy. In Ramachaudran VS. (Ed) Encyclopedia of human behavior, 4, pp. 71-81.
77. Bandura, A. (1986) Social Foundations of Thought and Action: A Social Cognitive Theory, Prentice-Hall, Englewood Cliffs, NJ
78. Boud, D. (1995) Enhancing Learning through Self Assessment, KoganPage, London
79. British Medical Association (2003) Appraisal, A Guide for Medical Practitioners, BMA Publications, London
80. Carline, JD, Weinrich, MD and Ramsey, PG (1989) Characteristics of ratings of physician competence by professional associates. Eval Health Prof, 12, pp. 409-423.
81. Dornan, T., Littlewood, S., Margolis, SA, Scherpbier, A., Spender, J. and Ypinazar, V. (2006) How can experience in clinical and community settings contribute to early medical education? A BEME systematic review. Med Teach, 28, pp. 3-18.
82. French Medicine Association cited in: Bruneau (2002)
83. General Medical Council (2002) Tomorrow's Doctors: Recommendation on Undergraduate Medical Education, GMC, London
84. Gordon, MJ (1991) A Review of the Validity and Accuracy of Self-assessments in Health Professions Training. Acad Med, 66, pp. 762-769.
85. Gordon, MJ (1992) Self-assessment Programs and Their Implications for Health Professions Training. Acad Med, 67, pp. 672-679.
86. Haig, A. and Dozier, M. (2003) BEME Guide No.3: Systematic searching for. evidence in medical education-Part 1: Sources of information. Med Teach, 25, pp. 352-363.
87. Hammick, M., Freeth, D., Koppel, I., Reeves, S. and Barr, H. (2007) A best evidence systematic review of interprofessional education. Med Teach, 29, pp. 735-751.
88. Jamtvedt, G., Young, JM, Kristoffersen, DT, O'brien, MA and Oxman, AD (2006) Audit and feedback: Effects on professional practice and health care outcomes
89. Kirkpatrick, DL (1967) Evaluation of training. Training and Development Handbook, pp. 87-112. McGraw-Hill, New York
90. Paulhus, DL (1998) Paulhus Deception Scales (PDS): The Balanced Inventory of Desirable Responding-7. User's manual, Multi-Health Systems Inc., New York
91. Schwarzer, R. General perceived Self-Efficacy in 14 cultures
92. United Kingdom Central Council For Nursing, Midwifery and Health Visiting (1999) Fitness for Practice: The UKCC Commission Nursing and Midwifery Education, UKCC, London
93. Van Der Vleuten, CPM and Swanson, DB (1990) Assessment of clinical skills with standardized patients: State of the art. Teach Learn Med, 2, pp. 58-76.
94. Williams, RG, Klamen, DA and McGaghie, WC (2003) Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med, 15, pp. 270-292.
95. Colliver, JA, Verhulst, SJ and Barrows, HS (2005) Self-assessment in medical practice: A further concern about the conventional research paradigm. Teach Learn Med, 17, pp. 200-201.
96. Davis, DA, Mazmanian, PE, Fordis, M., Van Harrison, R., Thorpe, KE and Perrier, L. (2006) Accuracy of physician self-assessment compared with observed measure of competence. A systematic review. J Am Med Assoc, 296, pp. 1094-1102.
97. Dunning, D. (2006) Strangers to ourselves?. Psychologist, 19, pp. 600-603.
98. Eva, KW and Regehr, G. (2005) Self-assessment in the health professions: a reformulation and research agenda. Acad Med, 80, p. S46.
99. Kruger, J. and Dunning, D. (1999) Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self assessments. J Per Soc Psychol, 77, pp. 1121-1134.
100. Ward, M., Gruppen, L. and Regehr, G. (2002) Measuring Self-Assessment: current State of the Art. Adv Health Sci Educ, 7, pp. 63-80.