Reliability of a 360-degree evaluation to assess resident competence

American Journal of Physical Medicine and Rehabilitation

Volumn 86, Issue 10, 2007, Pages 845-852

  Massagli, Teresa L ^a,c   Carline, Jan D ^b  

^a UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

^c NONE   (United States)

Author keywords

360 Degree Evaluation; Graduate Medical Education; Physical Medicine and Rehabilitation; Physician Competence

Indexed keywords

ACCREDITATION; ARTICLE; FACTORIAL ANALYSIS; FEASIBILITY STUDY; FEMALE; HUMAN; MALE; MEDICAL STUDENT; NORMAL HUMAN; NURSE; PHYSICAL MEDICINE; PROFESSIONAL COMPETENCE; PSYCHOMETRY; QUESTIONNAIRE; RATING SCALE; REHABILITATION; RESIDENCY EDUCATION; SKILL; STATISTICAL SIGNIFICANCE;

CLINICAL COMPETENCE; EDUCATIONAL MEASUREMENT; FACTOR ANALYSIS, STATISTICAL; FEASIBILITY STUDIES; FEMALE; HUMANS; INTERNSHIP AND RESIDENCY; MALE; PHYSICAL MEDICINE; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; WASHINGTON;

EID: 34748850067     PISSN: 08949115     EISSN: None     Source Type: Journal    
DOI: 10.1097/PHM.0b013e318151ff5a     Document Type: Article

References (24)

1. Accreditation Council for Graduate Medical Education: Outcome Project. Available at: www.acgme.org/outcome. Accessed July 26, 2007.
2. Accreditation Council for Graduate Medical Education/ American Board of Medical Specialties: Toolbox of Assessment Methods, version 1.1. Available at: www.acgme.org/outcome/assess/toolbox.pdf. Accessed July 26, 2007.
3. Info-line: How to build and use a 360 degree feedback system. Am Soc Train Dev 1998;9508:1-13
4. Brett JF, Atwater LE: 360 degree feedback: accuracy, reactions and perceptions of usefulness. J Appl Psychol 2001;86:930-42
5. Collins ML: The Thin Book of 360 Degree Feedback: A Manager's Guide. Plano, TX, Thin Book Publishing Company, 2000
6. Bracken DW, Dalton MA, Jako RA, McCauley CD, Pollman VA: Should 360 Degree Feedback Be Used Only for Developmental Purposes? Greensboro, NC, Center for Creative Leadership Publications, 1997
7. Ramsey PG, Wenrich MD, Carline JD, et al: Use of peer ratings to evaluate physician performance. JAMA 1993;269:1655-60
8. Wenrich MD, Carline JD, Giles LM, Ramsey PG: Ratings of the performances of practicing internists by hospital-based registered nurses. Acad Med 1993;68:680-7
9. Ramsey PG, Carline JD, Blank LL, Wenrich MD: Feasibility of hospital-based use of peer ratings to evaluate the performance of practicing physicians. Acad Med 1996;71:365-70
10. McLeod PJ, Tamblyn R, Benaroya S, Snell L: Faculty ratings of resident humanism predict patient satisfaction in ambulatory clinics. J Gen Intern Med 1994;9:321-6
11. Kaplan CB, Centor RM: The use of nurses to evaluate house officers' humanistic behavior. J Gen Intern Med 1990;5:410-4
12. Butterfield PS, Mazzaferri EL: A new rating form for use by nurses in assessing residents' humanistic behavior. J Gen Intern Med 1991;6:155-61
13. Wooliscroft JO, Howell JD, Patel BP, Swanson DB: Resident-patient interactions: the humanistic qualities of internal medicine residents assessed by patients, attending physicians, program supervisors, and nurses. Acad Med 1994;69:216-24
14. Nelson EC, Gentry MA, Mook KH, Spritzer KL, Higgins JH, Hays RD: How many patients are needed to provide reliable evaluations of individual clinicians? Med Care 2004;42:259-66
15. Musick DW, McDowell SM, Clark N, Salcido R: Pilot study of a 360-degree assessment instrument for physical medicine and rehabilitation residency programs. Am J Phys Med Rehabil 2003;82:394-402
16. Joshi R, Ling FW, Jaeger J: Assessment of a 360-degree instrument to evaluate residents' competency in interpersonal and communication skills. Acad Med 2004;79:458-63
17. Wood J, Collins J, Burnside ES, et al: Patient, faculty, and self-assessment of radiology resident performance: a 360 degree method of measuring professionalism and interpersonal/ communication skills. Acad Radiol 2004;11:931-9
18. Weigelt JA, Brasel KJ, Bragg D, Simpson D: The 360-degree evaluation: increased work with little return? Curr Surg 2004;61:616-26
19. Swanson DB, Webster GD, Norcini JJ: Precision of patient ratings of residents' humanistic qualities: how many items and patients are enough? in Bender W, Hiemstra R, Scherpbler AJJA, Zwiestra RP (Eds): Teaching and Assessing Clinical Competence. Groningen, the Netherlands, Boek-Werk Publications, 1990
20. Schafer JL: NORM: Multiple Imputations of Incomplete Multivariate Data Under a Normal Model, version 2.03 [software]. Available at: http://www.stat.psu.edu/~jls/misoftwa. html. Accessed July 26, 2007
21. Nunnally JC: Psychometric Theory. New York, NY, McGraw Hill Book Company, 1978
22. Shavelson RJ, Webb NM: Generalizability Theory. Newbury Park, CA, Sage Publications, 1991
23. Silber CG, Nasca TJ, Paskin DL, Eiger G, Robeson M, Veloski JJ: Do global rating forms enable program directors to assess the ACGME competencies? Acad Med 2004;79:549-56
24. Paolo A, Bonaminio G: Measuring outcomes of undergraduate medical education: residency directors' ratings of first year residents. Acad Med 2003;78:90-5