In-training assessment using direct observation of single-patient encounters: A literature review

Advances in Health Sciences Education

Volumn 16, Issue 1, 2011, Pages 131-142

  Pelgrim, E A M ^a   Kramer, A W M ^a   Mokkink, H G A ^a   van den Elsen, L ^a   Grol, R P T M ^a   van der Vleuten, C P M ^b  

^a RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Educational effects; Feasibility; Mini CEX; Reliability; Validity; Work based assessment instruments

Indexed keywords

CLINICAL EDUCATION; DOCTOR PATIENT RELATION; EDUCATION; EDUCATIONAL STATUS; FEEDBACK SYSTEM; HUMAN; MEDICAL STUDENT; METHODOLOGY; REVIEW; WORKPLACE;

CLINICAL CLERKSHIP; EDUCATIONAL MEASUREMENT; EDUCATIONAL STATUS; FEEDBACK; HUMANS; PHYSICIAN-PATIENT RELATIONS; STUDENTS, MEDICAL; WORKPLACE;

EID: 79954838568     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10459-010-9235-6     Document Type: Review

References (44)

1. Alves de Lima, A., Barrero, C., Baratta, S., Castillo Costa, Y., Bortman, G., Carabajales, J., et al. (2007). Validity, reliability, feasibility and satisfaction of the mini-clinial evaluation exercise (mini-CEX) for cardiology residency training. Medical Teacher, 29, 785-790.
2. Anderson, C. I., Jentz, A. B., Harkema, J. M., Kareti, L. R., Apelgren, K. N., & Slomski, C. A. (2005). Assessing the competencies in general surgery residency training. The Americal Journal of Surgery, 189, 288-292.
3. Burch, V. C., Seggie, J. L., & Gary, N. E. (2006). Formative assessment promotes learning in undergraduate clinical clerkships. South African Medical Journal, 96, 430-433.
4. Cook, D. A., & Beckman, T. J. (2009). Does scale length matter? A comparison of nine-versus five-point rating scales for the mini-CEX. Advances in Health Sciences Education, 14, 655-664.
5. Cook, D. A., Dupras, D. M., Beckman, T. J., Thomas, K. G., & Pankratz, S. (2008). Effect of rater training on reliability and accuracy of mini-CEX scores: A randomized, controlled trial. Journal of General Internal Medicine, 24, 74-79.
6. Cruess, R., McIlroy, J. H., Cruess, S., Ginsburg, S., & Steinert, Y. (2006). The professionalism mini-evaluation exercise: A preliminary investigation. Academic Medicine, 81, S74-S78.
7. Donato, A. A., Pangaro, L., Smith, C., Rencic, J., Diaz, Y., Mensinger, J., et al. (2008). Evaluation of a novel assessment form for observing medical residents: A randomised, controlled trail. Medical Education, 42, 1234-1242.
8. Dowson, C., & Hassell, A. (2006). Competence-based assessment of specialist registrars: Evaluation of a new assessment of out-patient consultations. Rheumatology, 45, 459-464.
9. Durning, S. J., Cation, L. J., Markert, R. J., & Pangaro, L. N. (2002). Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training. Academic Medicine, 77, 900-904.
10. Golnik, K. C., & Goldenhar, L. (2005). The ophthalmic clinical evaluation exercise: Reliability determination. Opthalmology, 112, 1649-1654.
11. Golnik, K. C., Goldenhar, L. M., Gittinger, J. W., & Lustbader, J. M. (2004). The ophthalmic clinical evaluation exercise (OCEX). Ophthalmology, 111, 1271-1274.
12. Han, P. K., Keranen, L. B., Lescisin, D. A., & Arnold, R. M. (2005). The palliative care clinical evaluation exercise (CEX): An experience-based intervention for teaching end-of-life communication skills. Academic Medicine, 80, 669-676.
13. Hatala, R., Ainslie, M., Kassen, B. O., Mackie, I., & Roberts, J. M. (2006). Assessing the mini-clinical evaluation exercise in comparison to a national specialty examination. Medical Education, 40, 950-956.
14. Hatala, R., & Norman, G. R. (1999). In-training evaluation during an internal medicine clerkship. Academic Medicine, 74, S118-S120.
15. Holmboe, E. S., Huot, S., Chung, J., Norcini, J., & Hawkins, R. E. (2003). Construct validity of the mini clinical evaluation exercise (miniCEX). Academic Medicine, 78, 826-830.
16. Kogan, J. R., Bellini, L. M., & Shea, J. A. (2002). Implementation of the mini-CEX to evaluate medical students' clinical skills. Academic Medicine, 77, 1156-1157.
17. Kogan, J. R., Bellini, L. M., & Shea, J. A. (2003). Feasibility, reliability, and validity of the mini-clinical evaluation exercise (mCEX) in a medicine core clerkship. Academic Medicine, 78, S33-S35.
18. Kogan, J. R., & Hauer, K. E. (2006). Brief report: Use of the mini-clinical evaluation exercise in internal medicine core clerkships. Journal of General Internal Medicine, 21, 501-502.
19. Kogan, J. R., Holmboe, E. S., & Hauer, K. E. (2009). Tools for direct observation and assessment of clinical skills of medical trainees: A systematic review. JAMA, 302, 12, 1316-1326.
20. Lane, J. L., & Gottlieb, R. P. (2000). Structured clinical observations: A method to teach clinical skills with limited time and financial resources. Pediatrics, 105, 973-977.
21. Links, P. S., Colton, T., & Norman, G. R. (1984). Evaluating a direct observation exercise in a psychiatric clerkship. Medical Education, 18, 46-51.
22. Malhotra, S., Hatala, R., & Courneya, C. A. (2008). Internal medicine residents' perceptions of the mini-clinical evaluation exercise. Medical Teacher, 30, 414-419.
23. Margolis, M. J., Clauser, B. E., Cuddy, M. M., Ciccone, A., Mee, J., Harik, P., et al. (2006). Use of the mini-clinical evaluation exercise to rate examinee performance on a multiple-station clinical skills examination: A validity study. Academic Medicine, 81, S56-S60.
24. Nair, B. R., Alexander, H. G., McGrath, B. P., Parvathy, M. S., Kilsby, E. C., Wenzel, J., et al. (2008). The mini clinical evaluation exercise (mini-CEX) for assessing clinical performance of international medical graduates. The Medical Journal of Australia, 189, 159-161.
25. Norcini, J. J., Blank, L. L., Arnold, G. K., & Kimball, H. R. (1995). The mini-CEX (clinical evaluation exercise): A preliminary investigation. Annals of Internal Medicine, 123, 795-799.
26. Norcini, J. J., Blank, L. L., Arnold, G. K., & Kimball, H. R. (1997). Examiner differences in the mini-CEX. Advances in Health Sciences Education, 2, 27-33.
27. Norcini, J. J., Blank, L. L., Duffy, F. D., & Fortna, G. S. (2003). The mini-CEX: A method for assessing clinical skills. Annals of Internal Medicine, 138, 476-481.
28. Norcini, J., & Burch, V. (2007). Workplace-based assessment as an educational tool: AMEE Guide No. 31. Medical Teacher, 29, 855-871.
29. Nyman, K. C., & Sheridan, B. (1997). Evaluation of consulting skills of trainee general practitioners. Australian Family Physician, 26, S28-S35.
30. Paukert, J. L., Richards, M. L., & Olney, C. (2002). An encounter card system for increasing feedback to students. The American Journal of Surgery, 183, 300-304.
31. Prescott, L. E., Norcini, J. J., McKinlay, P., & Rennie, J. S. (2002). Facing the challenges of competency-based assessment of postgraduate dental training: Longitudinal evaluation of performance (LEP). Medical Education, 36, 92-97.
32. Prescott-Clements, L., van der Vleuten, C. P. M., Schuwirth, L. W. T., Hurst, Y., & Rennie, J. S. (2008). Evidence for validity within workplace assessment: The longitudinal evaluation of performance (LEP). Medical Education, 42, 488-495.
33. Richards, M. L., Paukert, J. L., Downing, S. M., & Bordage, G. (2007). Reliability and usefulness of clinical encounter cards for a third-year surgical clerkship. Journal of Surgical Research, 140, 139-148.
34. Ringsted, C., Ostergaard, D., Ravn, L., Pedersen, J. A., Berlac, P. A., & van der Vleuten, C. P. M. (2003). A feasibility study comparing checklists and global rating forms to assess resident performance in clinical skills. Medical Teacher, 25, 654-658.
35. Ross, R. (2002). A clinical-performance biopsy instrument. Academic Medicine, 77, 268.
36. Shayne, P., Gallahue, F., Rinnert, S., Anderson, C. L., Hern, G., & Katz, E. (2006). Reliability of a core competency checklist assessment in the emergency department: The standardized direct observation assessment tool. Academic Emergency Medicine, 13, 727-732.
37. Shayne, P., Heilpern, K., Ander, D., & Palmer-Smith, V. (2002). Protected clinical teaching time and a bedside clinical evaluation instrument in an emergency medicine training program. Academic Emergency Medicine, 9, 1342-1349.
38. Torre, D. M., Simpson, D. E., Elnicki, D. M., Sebastian, J. L., & Holmboe, E. S. (2007). Feasibility, reliability and user satisfaction with a PDA-based mini-CEX to evaluate the clinical skills of third-year medical students. Teaching and Learning in Medicine, 19, 271-277.
39. Turnbull, J., MacFadyen, J., van Barneveld, C., & Norman, G. (2000). Clinical work sampling. A new approach to the problem of in-training evaluation. Journal of General Internal Medicine, 15, 556-561.
40. van der Vleuten, C. P. M. (1996). The assessment of professional competence: Developments, research and practical implications. Advances in Health Sciences Education, 1, 41-67.
41. van der Vleuten, C. P. M., & Schuwirth, L. W. T. (2005). Assessing professional competence: From methods to programmes. Medical Education, 39, 309-317.
42. Wass, V., & van der Vleuten, C. (2004). The long case. Medical Education, 38, 1176-1180.
43. Wass, V., van der Vleuten, C., Shatzer, J., & Jones, R. (2001). Assessment of clinical competence. Lancet, 357, 945-949.
44. Wilkinson, J. R., Crossley, J. G. M., Wragg, A., Mills, P., Cowan, G., & Wade, W. (2008). Implementing workplace-based assessment across the medical specialties in the United Kingdom. Medical Education, 42, 364-373.