Making sense of work-based assessment: Ask the right questions, in the right way, about the right things, of the right people

Medical Education

Volumn 46, Issue 1, 2012, Pages 28-37

  Crossley, Jim ^a   Jolly, Brian ^b  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b MONASH UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; EDUCATION; HUMAN; MEDICAL EDUCATION; METHODOLOGY; PSYCHOLOGICAL ASPECT; PSYCHOMETRY; REPRODUCIBILITY; STANDARD; WORKPLACE;

CLINICAL COMPETENCE; EDUCATION, MEDICAL; EDUCATIONAL MEASUREMENT; HUMANS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; WORKPLACE;

EID: 83455206788     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/j.1365-2923.2011.04166.x     Document Type: Article

References (33)

1. Biggs J, Collis K. Evaluating the Quality of Learning: the SOLO Taxonomy. New York, NY: Academic Press 1982.
2. Bloom B, ed. Taxonomy of Educational Objectives. The Classification of Educational Goals. Handbook I: Cognitive Domain. New York, NY: McKay 1956.
3. Crossley J, Humphris G, Jolly B. Assessing health professionals. Med Educ 2002;36 (9):800-4.
4. Norcini JJ, Blank LL, Duffy FD, Fortna GS. The mini-CEX: a method for assessing clinical skills. Ann Intern Med 2003;138:476-81.
5. McClelland D. Testing for competence rather than for intelligence. Am Psychol 1973;28:1-14.
6. Miller G. The assessment of clinical skills/competence/performance. Acad Med 1990;65 (Suppl):63-7.
7. Rethans J, Sturmans F, Drop R, van der Vleuten C, Hobus P. Does competence of general practitioners predict their performance? Comparison between examination setting and actual practice. BMJ 1991;303 (6814):1377-80.
8. Kopelow M, Schnabl G, Hassard T, Klass D, Beazley G, Hechter F, Grott M. Assessing practising physicians in two settings using standardised patients. Acad Med 1992;67 (Suppl10):19-21.
9. Academy of Medical Royal Colleges. Improving Assessment. London: AoMRC Press 2009.
10. Nair BR, Alexander H, McGrath B, Parvathy MS, Kilsby E, Wenzel J, Frank I, Pachev G, Page G. The mini-clinical evaluation exercise (mini-CEX) for assessing clinical performance of international medical graduates. Med J Aust 2008;189 (3):159-61.
11. Weller JM, Jolly B, Misur MP, Merry AF, Jones A, Crossley JG, Pederson K, Smith K. Mini-clinical evaluation exercise in anaesthesia training. Br J Anaesth 2009;102:633-41.
12. Kogan J, Holmboe E, Hauer K. Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review. JAMA 2009;302:1316-26.
13. Davies H, Archer J, Southgate L, Norcini J. Initial evaluation of the first year of the Foundation Assessment Programme. Med Educ 2009;43: 74-81.
14. Pitts D, Rowley D, Sher J. Assessment of performance in orthopaedic training. J Bone Joint Surg 2005;87 (9):1187-91.
15. Beard JB, Marriott J, Purdie H, Crossley J. Assessing the surgical skills of trainees in the operating theatre: a prospective observational study. Health Technology Assessment Programme, National Institute for Health Research. [Accessed 11 January 2011].
16. Crossley J, Johnson G, Booth J, Wade W. Good questions good answers: construct-aligned scales perform much better than other scales for WBA. Med Educ 2011;45:560-9.
17. ten Cate O, Snell L, Carraccio C. Medical competence: the interplay between individual ability and the health care environment. Med Teach 2010;32 (8):669-75.
18. Redfern S, Norman I, Calman L, Watson R, Murrells T. Assessing competence to practise in nursing: a review of the literature. Res Papers Educ 2002;17 (27):51-77.
19. Landy FJ, Farr JL. Performance rating. Psychol Bull 1980;87:72-107.
20. Awan S, Lawson LL. The effect of anchor modality on the reliability of vocal severity ratings. J Voice 2009;23:341-52.
21. Bondy KN. Criterion-referenced definitions for rating scales in clinical evaluation. J Nurs Educ 1983;22:376-82.
22. Bondy KN, Jenkins K, Seymour L, Lancaster R, Ishee J. The development and testing of a competency-focused psychiatric nursing clinical evaluation instrument. Arch Psychiatr Nurs 1997;11:66-73.
23. Bogo M, Regehr C, Power R, Hughes J, Woodford M, Regehr G. Toward new approaches for evaluating student field performance: tapping the implicit criteria used by experienced field instructors. J Soc Work Educ 2004;40 (3):417-26.
24. Bogo M, Regehr C, Hughes J, Power R, Globerman J. Evaluating a measure of student field performance in direct service: testing reliability and validity of explicit criteria. J Soc Work Educ 2002;38 (3):385-401.
25. Crossley J, Howe A, Newble D, Jolly B, Davies H. Sheffield Assessment Instrument for Letters (SAIL): performance assessment using out-patient letters. Med Educ 2001;35:1115-24.
26. Donabedian A. Evaluating the quality of medical care. Milbank Q 1966;44: 166-206.
27. Regehr G, MacRae H, Reznick RK, Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 1998;73 (9):993-7.
28. Johnson GJ, Barrett J, Jones M, Wade W. The acute care assessment tool: a workplace-based assessment of the performance of a physician in training on the acute medical take. Clin Teach 2009;6:105-9.
29. Wilkinson J, Crossley J, Wragg A, Mills P, Cowan G, Wade W. Implementing workplace assessment across the medical specialties in the United Kingdom. Med Educ 2008;42 (4):364-73.
30. Crossley J, McDonnell J, Cooper C, McAvoy P, Archer J. Can a district hospital assess its doctors for re-licensure? Med Educ 2008;42 (4):359-63.
31. Bullock A, Hassell A, Markham W, Wall D, Whitehouse A. How ratings vary by staff group in a multi-source feedback assessment of junior doctors. Med Educ 2009;43:516-20.
32. Mackillop L, Crossley J, Vivekananda-Schmidt P, Wade W, Armitage M. A single generic multi-source feedback tool for revalidation of all UK career-grade doctors: does one size fit all? Med Teach 2011;33:75-83.
33. Crossley J, Wilkinson J, Davies H, Wade W, Archer J, McAvoy P. Putting the 360 degrees into multi-source feedback. Abstract presented at the Association for the Study of Medical Education Conference on Multi-source Feedback, London, 13 December 2006;5.