Multisource feedback questionnaires in appraisal and for revalidation: A qualitative study in UK general practice

British Journal of General Practice

Volumn 62, Issue 598, 2012, Pages

  Hill, Jacqueline J ^a   Asprey, Anthea ^a   Richards, Suzanne H ^a   Campbell, John L ^a  

^a PLYMOUTH UNIVERSITY PENINSULA SCHOOLS OF MEDICINE AND DENTISTRY   (United Kingdom)

Author keywords

Appraisal; General practice; Multisource feedback; Performance assessment; Qualitative research

Indexed keywords

ACCURACY; ADULT; ARTICLE; FEEDBACK SYSTEM; FEMALE; GENERAL PRACTITIONER; HUMAN; HUMAN EXPERIMENT; MALE; METHODOLOGY; MULTISOURCE FEEDBACK QUESTIONNAIRE; PROFESSIONAL COMPETENCE; PROFESSIONAL DEVELOPMENT; REVALIDATION PROCESS; SCORING SYSTEM; SELF EVALUATION; STRUCTURED QUESTIONNAIRE; VALIDATION PROCESS;

ACCREDITATION; ADULT; AGED; ATTITUDE OF HEALTH PERSONNEL; CLINICAL COMPETENCE; EMPLOYEE PERFORMANCE APPRAISAL; FEEDBACK; FEMALE; GENERAL PRACTICE; GENERAL PRACTITIONERS; GREAT BRITAIN; HUMANS; MALE; MIDDLE AGED; QUESTIONNAIRES;

EID: 84861180844     PISSN: 09601643     EISSN: None     Source Type: Journal    
DOI: 10.3399/bjgp12X641429     Document Type: Article

References (48)

1. General Medical Council. The Good Medical Practice Framework for appraisal and revalidation. London: GMC, 2011.
2. General Medical Council. Supporting information for appraisal and revalidation. London: GMC, 2011.
3. General Medical Council, Health Foundation, Federation of State Medical Boards.Revalidation: the way ahead. Publication proceedings: International Revalidation Symposium: Contributing to the evidence base. London, 2-3 Dec 2010.
4. General Medical Council. Annex 3- GMC principles, criteria and key indicators for colleague and patient questionnaires in revaldiation. London: GMC, 2011.
5. Archer J, Norcini J, Davies H. Use of SPRAT for peer review of paediatricians in training.BMJ 2005; 330(7502): 1251-1253. (Pubitemid 40780478)
6. Lockyer J, Fidler H.Comparison of colleague and patientmultisource feedback instruments designed for GPs in UK. London: Royal College of General Practitioners, 2010.
7. Violato C, Lockyer J. Self and peer assessment of pediatricians, psychiatrists andmedicine specialists: implications for self-directed learning. Adv Health Sci Educ 2006; 11(3): 235-244. (Pubitemid 44036009)
8. Miller A, Archer J. Impact of workplace based assessment on doctors'education and performance: a systematic review.BMJ 2010; 341: c5064.
9. Sargeant J, Mann K, Sinclair D, et al. Challenges inmultisource feedback: intended and unintended outcomes.Med Educ 2007; 41(6): 583-591. (Pubitemid 46789583)
10. Sargeant J, Mann K, Ferrier S. Exploring family physicians' reactions to multisource feedback: perceptions of credibility and usefulness.Med Educ 2005; 39(5): 497-504. (Pubitemid 40592959)
11. Sargeant J, Mann K, Sinclair D, et al. Understanding the influence of emotions and reflection uponmulti-source feedback acceptance and use. Adv Health Sci Educ 2008; 13(3): 275-288.
12. Sargeant J, Mann K, Van der Vleuten C, Metsemakers J. 'Directed' selfassessment: practice and feedback within a social context. J Contin Educ Health Prof 2008; 28(1): 47-54.
13. Sargeant JM, Mann KV, van der Vleuten CP, Metsemakers JF. Reflection: a link between receiving and using assessment feedback. Adv Health Sci Educ 2009; 14(3): 399-410.
14. Toegel G, Conger J. 360-degree assessment: time for reinvention. Academy of Management Learning & Education 2003; 2(3): 297-311.
15. Wood L, Hassell A,Whitehouse A, et al. A literature review ofmulti-source feedback systems within and without health services, leading to 10 tips for their successful design.Med Teach 2006; 28(7): e185-e191. (Pubitemid 46978529)
16. Kline T, Sulsky L. Measurement and assessment issues in performance appraisal.Can Psychology 2009; 50: s161-s171.
17. Erdogan B, Kraimer M, Liden R. Procedural justice as a two-dimensional construct: an examination in the performance appraisal account. J Appl Behav Sci 2001; 37(2): 205-222. (Pubitemid 33278406)
18. Elicker J, Levy P, Hall R. The role of leader-member exchange in the performance appraisal process. J Manage 2006; 32(4): 531-551. (Pubitemid 44070061)
19. Stanton J. Reactions to employee performancemonitoring: framework, review, and research directions.HumPerform 2000; 13(1): 85-113.
20. MacDonald H, Sulsky L. Rating formats and rater training redux: a contextspecific approach for enhancing the effectiveness of performance management.Can J Behav Sci 2009; 41(4): 227-240.
21. General Medical Council. Goodmedical practice. London: GMC, 2006.
22. Campbell J, Richards S, Dickens A, et al. Assessing the professional performance of UK doctors: an evaluation of the utility of the General Medical Council patient and colleague questionnaires.Qual Saf Health Care 2008; 17(3): 187-193.
23. Wright C, Richards SH, Hill JJ, et al. Multisource feedback inmedical regulation: the example of the UK GMC Patient and Colleague Questionnaires. Acad Med 2012; in press.
24. Kitzinger J. Focus groups with users and providers of health care. In: Pope C, Mays N, (eds.).Qualitative research in health care. Malden, MA: Blackwell Publishers-BMJ books; 2006: 20-29.
25. Taylor M. Interviewing. In: Holloway I, (ed.).Qualitative research in health care. Maidenhead: Open University Press, 2011: 29-55.
26. Braun V, Clarke V. Using thematic analysis in psychology.Qual Res Psychol 2006; 3(2): 77-101.
27. Ritchie J, Spencer L. Qualitative data analysis for applied policy research. In: Bryman A, Burgess R, (eds.). Analyzing qualitative data. London: Routledge, 1994: 173-194.
28. Strauss A, Corbin J.Basics of qualitative research. 2nd edn. Newbury Park, CA. US: Sage Publications, 1998.
29. Pope C, Ziebland S, Mays N. Qualitative research in health care. Analysing qualitative data.BMJ 2000; 320(7227): 114-116.
30. Cohen S. Assessing the assessments: UK dermatology trainees' views of the workplace assessment tools.Br J Dermatol 2009; 161(1): 34-39.
31. OvereemK, Lombarts MJMH, Arah OA, et al. Threemethods ofmulti-source feedback compared: A plea for narrative comments and coworkers'perspectives.Med Teach 2010; 32(2): 141-147.
32. Campbell J, Roberts M,Wright C, et al. Factors associated with variability in the assessment of UK doctors' professionalism: analysis of survey results. BMJ 2011; 343: d6212.
33. Mead N, Roland M. Understanding why some ethnicminority patients evaluatemedical caremore negatively than white patients: a cross sectional analysis of a routine patient survey in English general practices.BMJ 2009; 339: b3450.
34. Taira DA, Safran DG, Seto TB, et al. Asian-American patient ratings of physician primary care performance. J Gen Intern Med 1997; 12(4): 237-242. (Pubitemid 27175898)
35. Lipner R, Blank L, Leas B, Fortna G. The value of patient and peer ratings in recertification. Acad Med 2002; 77(10 Suppl): S64-S66. (Pubitemid 35155206)
36. Wenrich MD, Carline JD, Giles LM, Ramsey PG. Ratings of the performances of practicing internists by hospital-based registered nurses. Acad Med 1993; 68(9): 680-687. (Pubitemid 23308149)
37. Sargeant JM, Mann KV, Ferrier SN, et al. Responses of rural family physicians and their colleague and coworker raters to amulti-source feedback process: a pilot study. Acad Med 2003; 78(10 Suppl): S42-S44. (Pubitemid 37238503)
38. Mazor K, Clausen BE, Holman M, Margolis M. Evaluation ofmissing data in assessment of professional behaviours. Acad Med 2007; 82(Suppl 10): S44-S47. (Pubitemid 47482549)
39. Peiperl MA. Getting 360 degrees feedback right.Harv Bus Rev 2001; 79(1): 142-147, 177.
40. Ramsey P,Wenrich M, Carline J, et al. Use of peer ratings to evaluate physician performance. JAMA 1993; 269(13): 1655-1660. (Pubitemid 23093951)
41. Archer J, McGraw M, Davies H. Republished paper: assuring validity of multisource feedback in a national programme. Postgrad Med J 2010; 86(1019): 526-531.
42. Bullock AD, Hassell A, MarkhamWA,et al. How ratings vary by staff group in multi-source feedback assessment of junior doctors.Med Educ 2009; 43(6): 516-520.
43. Hall W, Violato C, Lewkonia R, et al. Assessment of physician performance in Alberta: the physician achievement review.Can Med Assoc J 1999; 161(1): 52-57. (Pubitemid 29363823)
44. Lockyer J, Clyman S. Multi source feedback (360 degree evaluation). In: Holmboe E, Hawkins R, (eds.). Practical guide to the evaluation of clinical competence. 1 edn. Philadelphia, PA: Mosby Elsevier; 2008: 75-85.
45. Mackillop LH, Crossley J, Vivekananda-Schmidt P, et al. A single generic multi-source feedback tool for revalidation of all UK career-grade doctors: does one size fit all?Med Teach 2011; 33(2): e75-e83.
46. Lelliott P,Williams R, Mears A, et al. Questionnaires for 360-degree assessment of consultant psychiatrists: development and psychometric properties.Br J Psychiatry 2008; 193(2): 156-160.
47. Hawkins RE, Katsufrakis PJ, Holtman MC, Clauser BE. Assessment of medical professionalism: who, what, when, where, how, and ... why?Med Teach 2009; 31(4): 348-361.
48. Government of Alberta. Alberta Evidence Act. Revised Statutes of Alberta 2000. Chapter A-18. Edmonton, Alberta: Alberta Queen's Printer, 2010.