Workplace Assessment

Understanding Medical Education: Evidence, Theory and Practice

Volumn , Issue , 2010, Pages 232-245

  Norcini, John J ^a  

^a FOUNDATION FOR ADVANCEMENT OF INTERNATIONAL MEDICAL EDUCATION AND RESEARCH   (United States)

Author keywords

CbD, stimulating trainees to discuss why they acted as they did; Challenges for workplace based assessment; Faculty development, key to success of workplace assessment based on observations; Four to six mini clinical evaluation exercises (mini CEX), direct observation of procedural skills (DOPS) and case based discussion (CbD) encounters; Framework for assessment based on observation; Mini CEX, analogous to a classroom test for clinical setting; Mini CEX, faculty member trainee interact with patients in clinical settings; Tools, as mini CEX, DOPS, CbD and mini PAT valid assessments; Workplace assessment; Workplace observation powerful tool for assessment and feedback

Indexed keywords

EID: 84948950704     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781444320282.ch16     Document Type: Chapter

References (50)

1. Norman GR (2002) Research in medical education: three decades of progress. British Medical Journal. 324: 1560-2.
2. Norcini JJ (2005) Current perspectives in assessment: the assessment of performance at work. Medical Education. 39: 880-9.
3. Miller GE (1990) The assessment of clinical skills/competence/performance. Academic Medicine. 65 (9): s63-7.
4. Norcini JJ (2003) Peer assessment of competence. Medical Education. 37: 539-43.
5. Norcini JJ (2006) Faculty observations of student professional behaviour. In: Stern D (ed.) Measuring Professionalism, pp. 147-58. Oxford University Press, Oxford.
6. Elstein AS, Shulman LS and Sprafka SA (1978) Medical Problem-solving: an analysis of clinical reasoning. Harvard University Press, Cambridge, MA.
7. Pulito AR, Donnelly MB, Plymale M and Mentzer Jr RM (2006) What do faculty observe of medical students'clinical performance? Teaching and Learning in Medicine. 18 (2): 99-104.
8. Silber CG, Nasca TJ, Paskin DL et al. (2004) Do global rating forms enable program directors to assess the ACGME competencies? Academic Medicine. 79 (6): 549-56.
9. Martin JA, Regehr G, Reznick R et al. (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. British Journal of Surgery. 84 (2): 273-8.
10. Norcini JJ and Boulet JR (2003) Methodological issues in the use of standardized patients for assessment. Teaching and Learning in Medicine. 15 (4): 293-7.
11. Brennan RL (2001) Generalizability Theory. Springer-Verlag, New York.
12. Norcini JJ, Blank LL, Duffy FD and Fortna G (2003) The mini-CEX: a method for assessing clinical skills. Annals of Internal Medicine. 138: 476-81.
13. National Health Service. Modernising Medical Careers: Foundation Programmes (http://www.mmc.nhs.uk/pages/foundation; accessed 28 September 2006).
14. Norcini JJ, Blank LL, Arnold GK and Kimball HR (1995) The mini-CEX (clinical evaluation exercise): a preliminary investigation. Annals of Internal Medicine. 123: 795-9.
15. Day SC, Grosso LG, Norcini JJ et al. (1990) Residents'perceptions of evaluation procedures used by their training program. Journal of General Internal Medicine. 5: 421-6.
16. Kogan JR, Bellini LM and Shea JA (2003) Feasibility, reliability, and validity of the mini-clinical evaluation exercise (mCEX) in a medicine core clerkship. Academic Medicine. 78 (s10): S33-5.
17. Durning SJ, Cation LJ, Markert RJ and Pangaor LN (2002) Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training. Academic Medicine. 77 (9): 900-4.
18. Boulet JR, McKinley DW, Norcini JJ and Whelan GP (2002) Assessing the comparability of standardized patient and physician evaluations of clinical skills. Advances in Health Sciences Education. 7: 85-97.
19. Holmboe ES, Huot S, Chung J et al. Construct validity of the miniClinical Evaluation Exercise (miniCEX). Academic Medicine. 78: 826-30.
20. Cruess R, McIlroy JH, Cruess S et al. (2006) The professionalism mini-evaluation exercise: a preliminary investigation. Academic Medicine. 81 (s10): S74-8.
21. Hatala R, Ainslie M, Kassen BO et al. (2006) Assessing the mini-clinical evaluation exercise in comparison to a national specialty examination. Medical Education. 40 (10): 950-6.
22. Kogan JR and Hauer KE (2006) Brief report: use of the mini-clinical evaluation exercise in internal medicine core clerkships. Journal of General Internal Medicine. 21 (5): 501-2.
23. Wragg A, Wade W, Fuller G et al. (2003) Assessing the performance of specialist registrars. Clinical Medicine. 3 (2): 131-4.
24. Larson JL, Williams RG, Ketchum J et al. (2005) Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residents. Surgery. 138 (4): 640-7.
25. Goff BA, Nielsen PE, Lentz GM et al. (2002) Surgical skills assessment: a blinded examination of obstetrics and gynecology residents. American Journal of Obstetrics and Gynecology. 186 (4): 613-17.
26. Winckel CP, Reznick RK, Cohen R and Taylor B (1994) Reliability and construct validity of a structured technical skills assessment form. American Journal of Surgery. 167 (4): 423-7.
27. Maatsch JL, Huang R, Downing S and Barker B (1983) Predictive validity of medical specialty examinations. Final report for Grant HS 02038-04, National Center of Health Services Research. Office of Medical Education and Research and development, Michigan State University, East Lansing, MI.
28. Norman GR, Davis D, Painvin A et al. (1989) Comprehensive assessment of clinical competence of family/general physicians using multiple measures. In: Proceedings of the Annual Conference on Research in Medical Education, pp. 75-9. Association of American Medical Colleges, Washington, DC.
29. Solomon DJ, Reinhart MA, Bridgham RG et al. (1990) An assessment of an oral examination format for evaluating clinical competence in emergency medicine. Academic Medicine. 65 (s9): S43-4.
30. Norcini JJ (2003) Peer assessment of competence. Medical Education. 37: 539-43.
31. Arnold L, Willoughby L, Calkins V and Eberhart G (1981) Use of peer evaluation in the assessment of medical students. Medical Education. 56: 35-42.
32. Arnold L and Stern D (2006) Content and context of peer assessment. In: Stern D (ed.) Measuring Professionalism, pp. 175-94. Oxford University Press, Oxford.
33. Small PA, Stevens B and Duerson MC (1993) Issues in medical education: basic problems and potential solutions. Academic Medicine. 68: S89-98.
34. Ramsey PG, Carline JD, Inui TS et al. (1989) Predictive validity of certification by the American Board of Internal Medicine. Annals of Internal Medicine. 110 (9): 719-26.
35. Ramsey PG, Wenrich MD, Carline JD et al. (1993) Use of peer ratings to evaluate physician performance. Journal of the American Medical Association. 269: 1655-60.
36. Archer JC, Norcini JJ and Davies HA (2005) Peer review of paediatricians in training using SPRAT. British Medical Journal. 330: 1251-3.
37. Martin JA, Reznick RK, Rothman A et al. (1996) Who should rate candidates in an objective structured clinical examination? Academic Medicine. 71 (2): 170-5.
38. Hodges B, McNaughton N, Regehr G et al. (2002) The challenge of creating new OSCE measures to capture the characteristics of expertise. Medical Education. 36 (8): 742-8.
39. Hodges B, Regehr G, McNaughton N et al. (1999) OSCE checklists do not capture increasing levels of expertise. Academic Medicine. 74 (10): 1129-34.
40. Rothman AI, Blackmore D, Dauphinee WD and Reznick R (1997) The use of global ratings in OSCE station scores. Advances in Health Sciences Education. 1: 215-19.
41. Regehr G, MacRae H, Reznick RK and Szalay D (1998) Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Academic Medicine. 73 (9): 993-7.
42. Regehr G, Freeman R, Robb A et al. (1999) OSCE performance evaluations made by standardized patients: comparing checklist and global rating scores. Academic Medicine. 74 (s10): S135-7.
43. Holmboe ES, Yepes M, Williams F and Huot SJ (2004) Feedback and the mini clinical evaluation exercise. Journal of General Internal Medicine. 19 (5 Pt 2): 558-61.
44. Holmboe ES, Hawkins RE and Huot SJ (2004) Effects of training in direct observation of medical residents' clinical competence: a randomized trial. Annals of Internal Medicine. 140 (11): 874-81.
45. Norcini JJ (2001) The validity of long cases. Medical Education. 35: 735-6.
46. Noel GL, Herbers JE, Caplow MP et al. (1992) How well do internal medicine faculty members evaluate the clinical skills of residents? Annals of Internal Medicine. 117: 757-65.
47. Hay JA (1995) Tutorial reports and ratings. Evaluation Methods: a resource handbook. McMaster University, Hamilton, Ontario.
48. Ramsey PG, Carline JD, Blank LL and Wenrich MD (1996) Feasibility of hospital-based use of peer ratings to evaluate the performance of practicing physicians. Academic Medicine. 71: 364-70.
49. Hall W, Violato C, Lewkonia R et al. (1999) Assessment of physician performance in Alberta: the physician achievement review. Canadian Medical Association Journal. 161: 52-7.
50. Norcini JJ (2005) Standard setting. In: Dent JA and Harden RM (eds) A Practical Guide for Medical Teachers, pp. 293-301. Elsevier Churchill Livingston, Edinburgh.