Forecasting residents' performance - Partly cloudy

Academic Medicine

Volumn 80, Issue 5, 2005, Pages 415-422

  Williams, Reed G ^a   Dunnington, Gary L ^a   Klamen, Debra L ^a  

^a SOUTHERN ILLINOIS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ANALYTICAL ERROR; CLINICAL EDUCATION; CLINICAL PRACTICE; DECISION MAKING; EVALUATION; HUMAN; JOB PERFORMANCE; MEASUREMENT; MEMORY; OBSERVATION; PRACTICE GUIDELINE; PRIORITY JOURNAL; RATING SCALE; RESIDENCY EDUCATION; REVIEW; UNIVERSITY;

EID: 17844365861     PISSN: 10402446     EISSN: None     Source Type: Journal    
DOI: 10.1097/00001888-200505000-00002     Document Type: Review

References (41)

1. Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical competence ratings. Teach Learn Med. 2003;15:270-92.
2. Stillman PL, Swanson DB, Smee S, et al. Assessing clinical skills of residents with standardized patients. Ann Intern Med. 1986; 105:762-71.
3. Pulito AR, Donnelly MB, Plymale M, Mentzer RM. What do faculty observe of medical students' clinical performance? Paper presented at Association for Surgical Education Meetings, Vancouver, BC, Canada, 2003.
4. Schwind CJ, Williams RG, Boehler ML, Dunnington GL. Do individual attending post-rotation performance ratings detect resident clinical performance deficiencies? Acad Med. 2004;79:453-7.
5. Williams RG, Verhulst SJ, Colliver JA, Dunnington GL. Assuring the reliability of resident performance appraisals: more items or more observations? Surgery. 2005;137:141-7.
6. Viswesvaran C, Ones DS, Schmidt FL. Comparative analysis of the reliability of job performance ratings. J Appl Psychol. 1996;81: 557-74.
7. Conway JM, Huffcutt AI. Psychometric properties of multisource performance ratings: a meta-analysis of subordinate, supervisor, peer, and self-ratings. Hum Perform. 1997;10:331-60.
8. Carline JD, Wenrich M, Ramsey PG. Characteristics of ratings of physician competence by professional associates. Eval Health Prof. 1989;12:409-23.
9. Elstein AS, Shulman LS, Sprafka SA. Medical problem-solving. J Med Educ. 1981;56:75-6.
10. MacRae H, Regehr G, Leadbetter W, Reznick RK. A comprehensive examination for senior surgical residents. Am J Surg. 2000;179:190-3.
11. nd annual meeting of the Central Surgical Association, Tucson, AZ, March 11, 2005.
12. Issenberg SB, McGaghie WC, Hart IR, et al. Simulation technology for health care professional skills training and assessment. JAMA. 1999;282:861-6.
13. Ramsey PG, Wenrich MD, Carline JD, Inui TS, Larson EB, LoGerfo JP. Use of peer ratings to evaluate physician performance. JAMA. 1993;269:1655-60.
14. Verhulst SJ, Colliver JA, Paiva RE, Williams RG. A factor analysis study of performance of first-year residents. J Med Educ. 1986;61: 132-4.
15. Neher JO, Gordon KC, Meyer B, Stevens N. A five-step " microskills" model of clinical teaching. J Am Board Fam Pract. 1992;5:419-24.
16. Salerno SM, O'Malley PG, Pangaro LN, Wheeler GA, Moores LK, Jackson JL. Faculty development seminars based on the one-minute preceptor improve feedback in the ambulatory setting. J Gen Intern Med. 2002; 17:779-87.
17. Furney SL, Orsini AN, Orsetti KE, Stern DT, Gruppen LD, Irby DM. Teaching the one-minute preceptor. A randomized controlled trial. J Gen Intern Med. 2001;16:620-4.
18. Rhoton MF. A new method to evaluate clinical performance and critical incidents in anaesthesia: quantification of daily comments by teachers. Med Educ. 1990;24: 280-9.
19. Rhoton MF, Furgerson CL, Cascorbi HF. Evaluating clinical competence in anesthesia: using faculty comments to develop criteria. Proc Annu Conf Res Med Educ. 1986;25: 57-62.
20. Brennan BG, Norman GR. Use of encounter cards for evaluation of residents in obstetrics. Acad Med. 1997;72(10 suppl 1):S43-4.
21. Flanagan J, Burns R. The employee performance record: A new appraisal and development tool. Harv Bus Rev. 1955;33:95-102.
22. DeNisi AS, Peters LH. Organization of information in memory and the performance appraisal process: evidence from the field. J Appl Psychol. 1996;81:717-37.
23. Norcini JJ, Blank LL, Duffy FD, Fortna GS. The mini-CEX: a method for assessing clinical skills. Ann Intern Med. 2003;138: 476-81.
24. Mish FC (ed). Merriam-Webster's Collegiate Dictionary, 11th ed. Springfield, MA: Merriam-Webster, Inc., 2003.
25. Williams RG, Dunnington G. The prognostic value of resident clinical performance ratings. J Am Coll Surg. 2004;199:620-7.
26. Van der Vleuten C, Verwijnen GM, Wijnen W. Fifteen years of experience with progress testing in a problem-based curriculum. Med Teach. 1996;18:103-9.
27. Verhoeven BH, Verwijnen GM, Scherpbier AJ, van der Vleuten CP. Growth of medical knowledge. Med Educ. 2002;36:711-7.
28. Papadakis MA, Hodgson CS, Teherani A, Kohatsu ND. Unprofessional behavior in medical school is associated with subsequent disciplinary action by a state medical board. Acad Med. 2004;79:244-9.
29. Thompson WG, Lipkin M Jr, Gilbert DA, Guzzo RA, Roberson L. Evaluating evaluation: assessment of the American Board of Internal Medicine Resident Evaluation Form. J Gen Intern Med. 1990;5: 214-7.
30. Hojat M, Gonnella JS, Veloski JJ, Erdmann JB. Is the glass half full or half empty? A reexamination of the associations between assessment measures during medical school and clinical competence after graduation. Acad Med. 1993;68(2 suppl):S69-76.
31. Tonesk X, Buchanan RG. An AAMC pilot study by 10 medical schools of clinical evaluation of students. J Med Educ. 1987;62: 707-18.
32. Tesser A, Rosen S. The reluctance to transmit bad news. In: Berkowitz L (ed). Advances in Experimental Social Psychology, vol 8. New York: Academic Press, 1975.p. 193-232.
33. Scheuneman AL, Carley JP, Baker WH. Residency evaluations. Are they worth the effort? Arch Surg. 1994;129:1067-73.
34. Harris MM, Smith DE, Champagne D. A field study of performance appraisal purpose: Research- versus administrative-based ratings. Personnel Psychol. 1995;48:151-60.
35. Martin JA, Reznick RK, Rothman A, Tamblyn RM, Regehr G. Who should rate candidates in an objective structured clinical examination? Acad Med. 1996;71:170-5.
36. Williams RG, Schwind CJ, Dunnington GL, Fortune J, Rogers DA, Boehler ML. The effects of group dynamics on resident progress committee deliberations. Teach Learn Med. 2005;17:96-100.
37. Littlefield JH, DaRosa DA, Anderson KD, Bell RM, Nicholas GG, Wolfson PJ. Accuracy of surgery clerkship performance raters. Acad Med. 1991;66(9 suppl):S16-8.
38. Newble DI, Hoare J, Sheldrake PF. The selection and training of examiners for clinical examinations. Med Educ. 1980;14:345-9.
39. Noel GL, Herbers JE Jr, Caplow MP, Cooper GS, Pangaro LN, Harvey J. How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Intern Med. 1992;117:757-65.
40. Woehr DJ, Huffcutt AI. Rater training for performance-appraisal: a quantitative review. J Occup Organ Psychol. 1994;67:189-205.
41. Irby DM, Milam S. The legal context for evaluating and dismissing medical students and residents. Acad Med. 1989;64:639-43.