Assessment of clinical performance: Gathering evidence

Internal Medicine Journal

Volumn 37, Issue 9, 2007, Pages 631-636

  Wilkinson, T J ^a,b  

^a UNIVERSITY OF OTAGO   (New Zealand)

^b PRINCESS MARGARET HOSPITAL   (New Zealand)

Author keywords

Clinical competence; Educational assessment; Professional competence

Indexed keywords

CLINICAL EVALUATION; CLINICAL PRACTICE; DATA ANALYSIS; DECISION MAKING; HEALTH PROGRAM; HUMAN; JOB ANALYSIS; PRACTICE GUIDELINE; PRIORITY JOURNAL; RELIABILITY; REVIEW; VALIDITY;

CLINICAL COMPETENCE; HUMANS; PROGRAM EVALUATION; REPRODUCIBILITY OF RESULTS;

EID: 34547864196     PISSN: 14440903     EISSN: 14455994     Source Type: Journal    
DOI: 10.1111/j.1445-5994.2007.01483.x     Document Type: Review

References (48)

1. Newble D, Dauphinee D, Dawson-Saunders B, Macdonald M, Mullholland H, Page G et al. Guidelines for the development of effective and efficient procedures for the assessment of clinical competence. In : Newble DI, Jolly BC, Wakeford R, eds. The Certification and Recertification of Doctors. Issues in the Assessment of Clinical Competence. Cambridge : Cambridge University Press 1994 69 91.
2. General Medical Council. Principles of Good Medical Education and Training - Draft for Consultation. London : General Medical Council 2004 1 9.
3. van der Vleuten CPM, Schuwirth LWT. Assessing professional competence: from methods to programmes. Med Educ 2005 39 : 309 17.
4. Schuwirth LWT, Vleuten CPM. A plea for new psychometric models in educational assessment. Med Educ 2006 40 : 296 300.
5. Schuwirth LWT, van der Vleuten CPM. Merging views on assessment. Med Educ 2004 38 : 1208 10.
6. Newble DI, Jaeger K. The effect of assessments and examinations on the learning of medical students. Med Educ 1983 17 : 165 71.
7. Handfield-Jones RS, Mann KV, Challis ME, Hobma SO, Klass DJ, McManus IC et al. Linking assessment to learning: a new route to quality assurance in medical practice. Med Educ 2002 36 : 949 58.
8. Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990 65 (9 Suppl S63 S67.
9. Rethans JJ, Sturmans F, Drop R, van der Vleuten CPM, Hobus P. Does competence of general practitioners predict their performance? Comparison between examination setting and actual practice. BMJ 1991 303 : 1377 80.
10. Rethans JJ, Norcini JJ, Baron-Maldonado M, Blackmore D, Jolly BC, La Duca T et al. The relationship between competence and performance: implications for assessing practice performance. Med Educ 2002 36 : 901 9.
11. Tamblyn R, Abrahamowicz M, Dauphinee WD, Hanley JA, Norcini J, Girard N et al. Association between licensure examination scores and practice in primary care. JAMA 2002 288 : 3019 26.
12. Ram P, van der Vleuten C, Rethans JJ, Schouten B, Hobma S, Grol R. Assessment in general practice: the predictive value of written-knowledge tests and a multiple-station examination for actual medical performance in daily practice. Med Educ 1999 33 : 197 203.
13. Wass V, van der Vleuten C, Shatzer J, Jones R. Assessment of clinical competence. Lancet 2001 357 : 945 9.
14. Norcini JJ, Blank LL, Duffy FD, Fortna GS. The mini-CEX: a method for assessing clinical skills. Ann Intern Med 2003 138 : 476 81.
15. Hatala R, Ainslie M, Kassen BO, Mackie I, Roberts JM. Assessing the mini-Clinical Evaluation Exercise in comparison to a national specialty examination. Med Educ 2006 40 : 950 56.
16. Modernising Medical Careers. Assessment 2005 cited 2006 Sep 13 Available from : http://www.mmc.nhs/pages/assement
17. Archer JC, Norcini J, Davies HA. Use of SPRAT for peer review of paediatricians in training. BMJ 2005 330 : 1251 3.
18. Evans R, Elwyn G, Edwards A. Review of instruments for peer assessment of physicians. BMJ 2004 328 : 1240 43.
19. Lockyer J. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof 2003 23 : 4 12.
20. Lockyer J, Blackmore D, Fidler H, Crutcher R, Salte B, Shaw K et al. A study of a multi-source feedback system for international medical graduates holding defined licences. Med Educ 2006 40 : 340 47.
21. Norcini JJ. Peer assessment of competence. Med Educ 2003 37 : 539 43.
22. Paget NS, Newble DI, Saunders NA, Du J. Physician assessment pilot study for the Royal Australasian College of Physicians. J Contin Educ Health Prof 1996 16 : 103 11.
23. Ramsey PG, Wenrich MD, Carline JD, Inui TS, Larson EB, LoGerfo JP. Use of peer ratings to evaluate physician performance. J Am Med Assoc 1993 269 : 1655 60.
24. Baker R. Can poorly performing doctors blame their assessment tools? BMJ 2005 330 : 1254.
25. DiMatteo MR, DiNicola DD. Sources of assessment of physician performance: a study of comparative reliability and patterns of intercorrelation. Med Care 1981 19 : 829 42.
26. Wilkinson TJ, Frampton CM. Comprehensive undergraduate medical assessments improve prediction of clinical performance. Med Educ 2004 38 : 1111 16.
27. Lok C, Morgan C, Ranganathan N. The accuracy and interobserver agreement in detecting the 'gallop sounds' by cardiac auscultation. Chest 1998 114 : 1283 8.
28. Verhoeven BH, Hamers JG, Scherpbier AJ, Hoogenboom RJ, van der Vleuten CP. The effect on reliability of adding a separate written assessment component to an objective structured clinical examination. Med Educ 2000 34 : 525 9.
29. Brennan RL, Johnson EG. Generalizability of performance assessments. Educ Meas: Issues Pract 1995 14 : 9 27.
30. Crossley J, Davies H, Humphris G, Jolly B. Generalisability: a key to unlock professional assessment. Med Educ 2002 36 : 972 8.
31. Schuwirth LWT. Assessing medical competence: finding the right answers. Clin Teach 2004 1 : 14 18.
32. Margolis MJ, Clauser BE, Cuddy MM, Ciccone A, Mee J, Harik P et al. Use of the mini-clinical evaluation exercise to rate examinee performance on a multiple-station clinical skills examination: a validity study. Acad Med 2006 81 Suppl S56 S60.
33. Norman G. The long case versus objective structured clinical examinations. BMJ 2002 324 : 748 9.
34. Wass V, Jones R, van der Vleuten C. Standardized or real patients to test clinical competence? The long case revisited. Med Educ 2001 35 : 321 5.
35. Wass V, van der Vleuten C. The long case. Med Educ 2004 38 : 1176 80.
36. van der Vleuten CPM, Norman GR, De Graaff E. Pitfalls in the pursuit of objectivity: issues of reliability. Med Educ 1991 25 : 110 18.
37. Cohen R, Rothman AI, Poldre P, Ross J. Validity and generalizability of global ratings in an objective structured clinical examination. Acad Med 1991 66 : 545 8.
38. Swartz MH, Colliver JA, Bardes CL, Charon R, Fried ED, Moroff S. Global ratings of videotaped performance versus global ratings of actions recorded on checklists: a criterion for performance assessment with standardized patients. Acad Med 1999 74 : 1028 32.
39. Wilkinson TJ, Fontaine S. Patients' global ratings of student competence. Unreliable contamination or gold standard? Med Educ 2002 36 : 1117 21.
40. Keynan A, Friedman M, Benbassat J. Reliability of global rating scales in the assessment of clinical competence of medical students. Med Educ 1987 21 : 477 81.
41. Wilkinson TJ, Frampton CM, Thompson-Fawcett MW, Egan AG. Objectivity in objective structured clinical examinations: checklists are no substitute for examiner commitment. Acad Med 2003 78 : 219 23.
42. Norman GR, van der Vleuten CPM, De Graaff E. Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability. Med Educ 1991 25 : 119 26.
43. Norcini JJ. Current perspectives in assessment: the assessment of performance at work. Med Educ 2005 39 : 880 89.
44. Daelmans HE, Hoogenboom RJ, Scherpbier AJ, Stehouwer CD, van der Vleuten CP. Effects of an in-training assessment programme on supervision of and feedback on competencies in an undergraduate Internal Medicine clerkship. Med Teach 2005 27 : 158 63.
45. Ben-David MF. AMEE guide No 18: Standard setting in student assessment. Med Teach 2000 22 : 120 30.
46. Wilkinson TJ, Newble DI, Frampton CM. Standard setting in an objective structured clinical examination: use of global ratings of borderline performance to determine the passing score. Med Educ 2001 35 : 1043 9.
47. Norcini JJ, Guille R. Combining tests and setting standards. In : Norman GR, van der Vleuten CPM, Newble DI, eds. International Handbook of Research in Medical Education. Dordrecht : Kluwer Academic Publishers 2002 811 34.
48. Downing SM. Validity: on the meaningful interpretation of assessment data. Med Educ 2003 37 : 830 37.