Specialty-specific multi-source feedback: Assuring validity, informing training

Medical Education

Volumn 42, Issue 10, 2008, Pages 1014-1020

  Davies, Helena ^b   Archer, Julian ^a,c   Bateman, Adrian ^d   Dewar, Sandra ^e   Crossley, Jim ^b   Grant, Janet ^f   Southgate, Lesley ^g  

^a PENINSULA MEDICAL SCHOOL   (United Kingdom)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

^c PLYMOUTH UNIVERSITY PENINSULA SCHOOLS OF MEDICINE AND DENTISTRY   (United Kingdom)

^d SOUTHAMPTON GENERAL HOSPITAL   (United Kingdom)

^e Royal College of Pathologists   (United Kingdom)

^f OPEN UNIVERSITY   (United Kingdom)

^g ST GEORGE'S UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

*education, medical, graduate; Clinical competence *standards; England; Feasibility studies; Feedback; Female; Humans; Male; Pathology *education; Personal satisfaction; Validation studies publication type

Indexed keywords

ARTICLE; CONTENT VALIDITY; CURRICULUM; HISTOPATHOLOGY; HUMAN; MEDICAL ASSESSMENT; MEDICAL EDUCATION; MEDICAL EXAMINATION; RELIABILITY; VALIDITY;

CLINICAL COMPETENCE; EDUCATION, MEDICAL, GRADUATE; EDUCATIONAL MEASUREMENT; FEASIBILITY STUDIES; FEEDBACK; FEMALE; GREAT BRITAIN; HUMANS; MALE; PATHOLOGY; STATISTICS AS TOPIC;

EID: 51649094909     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/j.1365-2923.2008.03162.x     Document Type: Article

References (31)

1. van der Vleuten CP, Schuwirth LW. Assessing professional competence: from methods to programmes. Med Educ 2005 39 (3 309 17.
2. Schuwirth LW, van der Vleuten CP. Changing education, changing assessment, changing research? Med Educ 2004 38 (8 805 12.
3. Miller G. The assessment of clinical skills/competence/performance. Acad Med 1990 65 (Suppl 63 7.
4. Donaldson L. Trust, Assurance and Safety: the Regulation of Health Professionals in the 21st Century. London : Department of Health 2007.
5. Cassel CK, Leatherman S, Black C, Clough C, Gilmore IT, Armitage M. Physicians' assessment and competence: USA and UK. Lancet 2006 368 (9547 1557 9.
6. Lockyer JM, Violato C. An examination of the appropriateness of using a common peer assessment instrument to assess physician skills across specialties. Acad Med 2004 79 (Suppl 10 5 8.
7. Torbeck L, Wrightson AS. A method for defining competency-based promotion criteria for family medicine residents. Acad Med 2005 80 (9 832 9.
8. Violato C, Marini A. Using peers, consulting physicians, patients, co-workers and self to assess physicians. Acad Med 1997 72 : 57 63.
9. Higgins RS, Bridges J, Burke JM, O'Donnell MA, Cohen NM, Wilkes SB. Implementing the ACGME general competencies in a cardiothoracic surgery residency programme using 360-degree feedback. Ann Thorac Surg 2004 77 (1 12 7.
10. Violato C, Lockyer J, Fidler H. Multi-source feedback: a method of assessing surgical practice. BMJ 2003 326 : 546 8.
11. Archer JC, Norcini J, Davies HA. Use of SPRAT for peer review of paediatricians in training. BMJ 2005 330 (7502 1251 3.
12. Lockyer JM, Violato C, Fidler H. A multi-source feedback programme for anaesthesiologists. Can J Anesthesia 2006 53 : 33 9.
13. Sargeant J, Mann K, Ferrier S. Exploring family physicians' reactions to multi-source feedback: perceptions of credibility and usefulness. Med Educ 2005 39 (5 497 504.
14. Modernising Medical Careers. http://www.mmc.nhs.uk/default.aspx?page=315. [Accessed 18 August 2008.]
15. Davies HA, Archer JC. Multi-source feedback using the Sheffield peer review assessment tool (SPRAT) - development and practical aspects. Clin Teach 2005 2 (2 77 81.
16. Good Medical Practice 2001. http://www.gmc-uk.org/guidance/archive/ gmp_2001.pdf
17. Cronbach L. My current thoughts on coefficient alpha and successor procedures. Educ Psychol Meas 2004 64 (3 391 418.
18. Crossley J, Russell J, Jolly B, Ricketts C, Schuwirth LW, Norcini J. 'I'm pickin' up good regressions': the governance of generalisability analyses. Med Educ 2007 41 : 926 34.
19. Cohen J, Cohen P. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, 2nd edn. Hillsdale, NJ : Lawrence Erlbaum Associates 1983.
20. Downing SM. Validity: on meaningful interpretation of assessment data. Med Educ 2003 37 (9 830 7.
21. Archer JC, Norcini J, Southgate L, Heard S, Davies H. Mini-PAT (Peer Assessment Tool): a valid component of a national assessment programme in the UK? Adv Health Sci Educ 2008 13 (2 181 92.
22. Schuwirth LW, van der Vleuten CP. A plea for new psychometric models in educational assessment. Med Educ 2006 40 (4 296 300.
23. Crossley J, Davies H, McDonnell J, Cooper C, Archer JC, McAvoy P. A district hospital assessing its doctors for re-licensure: can it work? Med Educ 2008 42 : 359 63.
24. Lockyer JM. Multi-source feedback in the assessment of physician competencies. J Contin Educ Health Prof 2003 23 (1 4 12.
25. Kruger J, Dunning D. Unskilled and unaware of it: how difficulties in recognising one's own incompetence lead to inflated self-assessments. J Pers Soc Psychol 1999 77 (6 1121 34.
26. Violato C, Lockyer J. Self and peer assessment of paediatricians, psychiatrists and medicine specialists: implications for self-directed learning. Adv Health Sci Educ Theory Pract 2006 11 (3 235 44.
27. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA 2006 296 (9 1094 102.
28. Duffy FD, Holmboe ES. Self-assessment in lifelong learning and improving performance in practice: physician know thyself. JAMA 2006 296 (9 1137 9.
29. Violato C, Lockyer J, Fidler H. Multi-source feedback: a method of assessing surgical practice. BMJ 2003 326 (7388 546 8.
30. Sargeant JM, Mann KV, Ferrier SN, Langille DB, Muirhead PD, Hayes VM, Sinclair DE. Responses of rural family physicians and their colleague and coworker raters to a multi-source feedback process: a pilot study. Acad Med 2003 78 (Suppl 10 42 4.
31. van der Vleuten C. Where are We with Assessment and Where are we Going? Genoa : Association for Medical Education in Europe 2006 100.