Evaluation of physicians' professional performance: An iterative development and validation study of multisource feedback instruments

BMC Health Services Research

Volumn 12, Issue 1, 2012, Pages

  Overeem, Karlijn ^a   Wollersheim, Hub C ^a   Arah, Onyebuchi A ^b,c,d   Cruijsberg, Juliette K ^a   Grol, Richard P T M ^a   Lombarts, Kiki M J M H ^d  

^a RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; DOCTOR PATIENT RELATION; FEEDBACK SYSTEM; FEMALE; HUMAN; INSTRUMENTATION; MALE; METHODOLOGY; NETHERLANDS; PEER REVIEW; PERSONNEL MANAGEMENT; PHYSICIAN; PSYCHOLOGICAL ASPECT; PSYCHOMETRY; PUBLIC RELATIONS; QUESTIONNAIRE; REPRODUCIBILITY; SELF EVALUATION; SOCIOECONOMICS; STANDARD; STATISTICAL MODEL; STATISTICS; TOTAL QUALITY MANAGEMENT; UNIVERSITY HOSPITAL; VALIDATION STUDY;

ACADEMIC MEDICAL CENTERS; CLINICAL COMPETENCE; EMPLOYEE PERFORMANCE APPRAISAL; FEEDBACK; FEMALE; HUMANS; INTERPROFESSIONAL RELATIONS; LINEAR MODELS; MALE; NETHERLANDS; PEER REVIEW, HEALTH CARE; PHYSICIAN-PATIENT RELATIONS; PHYSICIANS; PSYCHOMETRICS; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS; SELF-ASSESSMENT; SOCIOECONOMIC FACTORS; TOTAL QUALITY MANAGEMENT;

EID: 84858719705     PISSN: None     EISSN: 14726963     Source Type: Journal    
DOI: 10.1186/1472-6963-12-80     Document Type: Article

References (28)

1. Accuracy of physician self-assessment compared with observed measures of competence-A systematic review. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L, JAMA 2006 296 1094 1102 10.1001/jama.296.9.1094 16954489 (Pubitemid 44343529)
2. Assessment of physician performance in Alberta: the physician achievement review. Hall W, Violato C, Lewkonia R, Lockyer J, Fidler H, Toews J, Jenett P, Donoff M, Moores D, CMAJ 1999 161 52 57 10420867 (Pubitemid 29363823)
3. Antecedents and consequences of reactions to developmental 360 degrees feedback. Atwater LE, Brett JF, Journal of Vocational Behavior 2005 66 532 548 10.1016/j.jvb.2004.05.003 (Pubitemid 40317476)
4. Assessing the professional performance of UK doctors: an evaluation of the utility of the General Medical Council patient and colleague questionnaires. Campbell JL, Richards SH, Dickens A, Greco M, Narayanan A, Brearley S, Qual Saf Health Care 2008 17 187 193 10.1136/qshc.2007.024679 18519625
5. A multi source feedback program for anesthesiologists. Lockyer JM, Violato C, Fidler H, Can J Anaesth 2006 53 33 39 10.1007/BF03021525 16371607 (Pubitemid 43230990)
6. The assessment of emergency physicians by a regulatory authority. Lockyer JM, Violato C, Fidler H, Acad Emerg Med 2006 13 1296 1303 10.1111/j.1553-2712. 2006.tb00293.x 17099191 (Pubitemid 44791975)
7. Multisource feedback: a method of assessing surgical practice. Violato C, Lockyer J, Fidler H, BMJ 2003 326 546 548 10.1136/bmj.326.7388.546 12623920 (Pubitemid 36313223)
8. Assessment of pediatricians by a regulatory authority. Violato C, Lockyer JM, Fidler H, Pediatrics 2006 117 796 802 10.1542/peds.2005-1403 16510660 (Pubitemid 46063222)
9. Specialty-specific multi-source feedback: assuring validity, informing training. Davies H, Archer J, Bateman A, et al. Med Educ 2008 42 1014 1020 10.1111/j.1365-2923.2008.03162.x 18823521
10. Responses of rural family physicians and their colleague and coworker raters to a multi-source feedback process: a pilot study. Sargeant JM, Mann KV, Ferrier SN, Langille DD, Muirhead PD, Hayes VM, Sinclair DE, Acad Med 2003 78 42 44 10.1097/00001888-200310001-00014
11. Factors associated with variability in the assessment of UK doctors' professionalism: analysis of survey results. Campbell JM, Roberts M, Wright C, Hill J, Greco M, Taylor M, Richards S, BMJ 2011 343 6212 10.1136/bmj.d6212 22034193
12. Implementing workplace-based assessment across the medical specialties in the United Kingdom. Wilkinson JR, Crossley JGM, Wragg A, Mills P, Cowani G, Wade W, Med Educ 2008 42 364 373 10.1111/j.1365-2923.2008.03010.x 18338989 (Pubitemid 351388738)
13. Health measurement scales: a practical guide to their development and use. 4th Edition. Streiner DL, Norman GR, Oxford; Oxford university press 2008 5-36 167-206 247 274
14. Three methods of multi-source feedback compared: a plea for narrative comments and coworkers' perspectives. Overeem K, Lombarts MJ, Arah OA, Klazinga NS, Grol RP, Wollersheim HC, Med Teach 2010 32 141 147 10.3109/01421590903144128 20163230
15. A policy analysis of the introduction and dissemination of external peer review (visitatie) as a means of professional self-regulation amongst medical specialists in The Netherlands in the period 1985-2000. Lombarts MJMH, Klazinga NS, Health Policy 2001 58 191 213 10.1016/S0168-8510(01)00158-0 11640999 (Pubitemid 32970420)
16. Assessment of radiology physicians by a regulatory authority. Lockyer JM, Violato C, Fidler HM, Radiology 2008 247 771 778 10.1148/radiol.2473071431 18375839
17. Psychometric properties of the Dutch version of the Hospital-level Consumer Assessment of Health Plans Survey instrument. Arah OA, ten Asbroek AH, Delnoij DM, de Koning JS, Stam PJ, Poll AH, Vriens B, Schmidt PF, Klazinga NS, Health Serv Res 2006 41 284 30 10.1111/j.1475-6773.2005.00462.x 16430612
18. Coefficient alpha and the internal structure of tests. Cronbach LJ, Psychometrika 1951 16 297 334 10.1007/BF02310555
19. A patient survey system to measure quality improvement: questionnaire reliability and validity. Carey RG, Seibert JH, Med Care 1993 31 834 845 10.1097/00005650-199309000-00008 8366685
20. Ramifications of a population model for k as a coefficient of reliability. Kraemer HC, Psychometrika 1979 44 461 7220 10.1007/BF02296208
21. Development of a system for the evaluation of the teaching qualities of anesthesiology faculty. Lombarts KM, Bucx MJ, Arah OA, Anesthesiology 2009 111 709 716 10.1097/ALN.0b013e3181b76516 19707115
22. Republished paper: Assuring validity of multisource feedback in a national programme. Archer J, McGraw M, Davies H, Postgrad Med J 2010 86 526 531 10.1136/pgmj.2008.146209rep 20841329
23. Use of SPRAT for peer review of paediatricians in training. Archer JC, Norcini J, Davies HA, BMJ 2005 330 1251 1253 10.1136/bmj.38447.610451.8F 15883137 (Pubitemid 40780478)
24. Use of peer ratings to evaluate physician performance. Ramsey PG, Wenrich MD, Carline JD, Inui TS, Larson EB, LoGerfo JP, JAMA 1993 269 1655 1660 10.1001/jama.1993.03500130069034 8240483 (Pubitemid 23093951)
25. Effects of instructions to avoid halo error on reliability and validityof performance evaluation ratings. Borman WC, J Appl Psychol 1975 60 556 560
26. Conditions for the success of peer evaluation. Peiperl MA, Int J Human Resource Manag 1999 10 429 458 10.1080/095851999340413
27. Impact of workplace based assessment on doctors' education and performance: a systematic review. Miller A, Archer J, BMJ 2010 341 5064 10.1136/bmj.c5064 20870696
28. Measuring patient views of physician communication skills: development and testing of the Communication Assessment Tool. Makoul G, Krupat E, Chang CH, Patient Educ Couns 2007 67 333 342 10.1016/j.pec.2007.05.005 17574367 (Pubitemid 46990732)