Narrative descriptions should replace grades and numerical ratings for clinical performance in medical education in the United States

Frontiers in Psychology

Volumn 4, Issue NOV, 2013, Pages

  Hanson, Janice L ^a   Rosenberg, Adam A ^a   Lane, J Lindsey ^a  

^a University of Colorado Denver and Children s Hospital Colorado   (United States)

Author keywords

Assessment; Competence; Evaluation; Medical education; Milestones; Narrative; Observation

Indexed keywords

EID: 84889689236     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00668     Document Type: Article

References (64)

1. ACGME. (2012). Frequently Asked Questions About the Next Accreditation System [Online]. Available online at: http://www.acgme-nas.org/assets/pdf/NASFAQs.pdf (Accessed March 31, 2013).
2. ACGME. (2013). Milestones [Online]. Available online at: http://www.acgme-nas.org/milestones.html (Accessed March 31, 2013).
3. ACGME and ABP. (2012). The Pediatrics Milestone Project. (Chicago, IL: Accreditation Council on Graduate Medical Education and Chapel Hill, NC: American Board of Pediatrics).
4. Albanese, M. A., Mejicano, G., and Gruppen, L. (2008). Competency-based medical education: a defense against the four horsemen of the medical education apocalypse. Acad. Med. 83, 1132-1139. doi: 10.1097/ACM.0b013e31818c6638
5. Ander, D. S., Wallenstein, J., Abramson, J. L., Click, L., and Shayne, P. (2012). Reporter-Interpreter-Manager-Educator (RIME) descriptive ratings as an evaluation tool in an emergency medicine clerkship. J. Emerg. Med. 43, 720-727. doi: 10.1016/j.jemermed.2011.05.069
6. Balmer, D. F., Master, C. L., Richards, B., and Giardino, A. P. (2009). Implicit versus explicit curricula in general pediatrics education: is there a convergence? Pediatrics 124, e347-e354. doi: 10.1542/peds.2009-0170
7. Battistone, M. J., Milne, C., Sande, M. A., Pangaro, L. N., Hemmer, P. A., and Shomaker, T. S. (2002). The feasibility and acceptability of implementing formal evaluation sessions and using descriptive vocabulary to assess student performance on a clinical clerkship. Teach. Learn. Med. 14, 5-10. doi: 10.1207/S15328015TLM1401_3
8. Bloodgood, R. A., Short, J. G., Jackson, J. M., and Martindale, J. R. (2009). A change to pass/fail grading in the first two years at one medical school results in improved psychological well-being. Acad. Med. 84, 655-662. doi: 10.1097/ACM.0b013e31819f6d78
9. Boehler, M. L., Rogers, D. A., Schwind, C. J., Mayforth, R., Quin, J., Williams, R. G., et al. (2006). An investigation of medical student reactions to feedback: a randomised controlled trial. Med. Educ. 40, 746-749. doi: 10.1111/j.1365-2929.2006.02503.x
10. Burris, C. (2013, March 4). Principal: 'I was naive about Common Core'. The Washington Post.
11. Canavan, C., Holtman, M. C., Richmond, M., and Katsufrakis, P. J. (2010). The quality of written comments on professional behaviors in a developmental multisource feedback program. Acad. Med. 85, S106-S109. doi: 10.1097/ACM.0b013e3181ed4cdb
12. Dewitt, D., Carline, J., Paauw, D., and Pangaro, L. (2008). Pilot study of a 'RIME'-based tool for giving feedback in a multi-specialty longitudinal clerkship. Med. Educ. 42, 1205-1209. doi: 10.1111/j.1365-2923.2008.03229.x
13. Driessen, E. W., Van Tartwijk, J., Govaerts, M., Teunissen, P., and Van Der Vleuten, C. P. M. (2012). The use of programmatic assessment in the clinical workplace: a Maastricht case report. Med. Teach. 34, 226-231. doi: 10.3109/0142159X.2012.652242
14. Espey, E., Nuthalapaty, F., Cox, S., Katz, N., Ogburn, T., Peskin, T., et al. (2007). To the point: medical education review of the RIME method for the evaluation of medical student clinical performance. Am. J. Obstet. Gynecol. 197, 123-133. doi: 10.1016/j.ajog.2007.04.006
15. Frank, J. R., Snell, L. S., Cate, O. T., Holmboe, E. S., Carraccio, C., Swing, S. R., et al. (2010). Competency-based medical education: theory to practice. Med. Teach. 32, 638-645. doi: 10.3109/0142159X.2010.501190
16. Gaglione, M. M., Moores, L., Pangaro, L., and Hemmer, P. A. (2005). Does group discussion of student clerkship performance at an education committee affect an individual committee member's decisions? Acad. Med. 80, S55-S58. doi: 10.1097/00001888-200510001-00016
17. Gingerich, A., Regehr, G., and Eva, K. W. (2011). Rater-based assessments as social judgments: rethinking the etiology of rater errors. Acad. Med. 86, S1-S7. doi: 10.1097/ACM.0b013e31822a6cf8
18. Ginsburg, S., McIlroy, J., Oulanova, O., Eva, K., and Regehr, G. (2010). Toward authentic clinical evaluation: pitfalls in the pursuit of competency. Acad. Med. 85, 780-786. doi: 10.1097/ACM.0b013e3181d73fb6
19. Gonnella, J. S., Erdmann, J. B., and Hojat, M. (2004). An empirical study of the predictive validity of number grades in medical school using 3 decades of longitudinal data: implications for a grading system. Med. Educ. 38, 425-434. doi: 10.1111/j.1365-2923.2004.01774.x
20. Govaerts, M. J., Van Der Vleuten, C. P., Schuwirth, L. W., and Muijtjens, A. M. (2007). Broadening perspectives on clinical performance assessment: rethinking the nature of in-training assessment. Adv. Health Sci. Educ. Theory Pract. 12, 239-260. doi: 10.1007/s10459-006-9043-1
21. Govaerts, M. J. B., Van De Wiel, M. W. J., Schuwirth, L. W. T., Van Der Vleuten, C. P. M., and Muijtjens, A. M. M. (2013). Workplace-based assessment: raters' perforamnce theories and constructs. Adv. Health Sci. Educ. Theory Pract. 18, 375-396. doi: 10.1007/s10459-012-9376-x
22. Govaerts, M. J. B., Van Der Vleuten, C. P. M., Schuwirth, L. W. T., and Muijtjens, A. M. M. (2005). The use of observational diaries in in-training evaluation: student perspectives. Adv. Health Sci. Educ. Theory Pract. 10, 171-188. doi: 10.1007/s10459-005-0398-5
23. Guerrasio, J., Cumbler, E., Trosterman, A., Wald, H., Brandenburg, S., and Aagaard, E. (2012). Determining need for remediation through postrotation evaluations. J. Grad. Med. Educ. 4, 47-51. doi: 10.4300/JGME-D-11-00145.1
24. Hamburger, E. K., Cuzzi, S., Coddington, D. A., Allevi, A. M., Lopreiato, J., Moon, R., et al. (2011). Observation of resident clinical skills: outcomes of a program of direct observation in the continuity clinic setting. Acad. Pediatr. 11, 394-402. doi: 10.1016/j.acap.2011.02.008
25. Harris, P., Snell, L., Talbot, M., and Harden, R. M. (2010). Competency-based medical education: implications for undergraduate programs. Med. Teach. 32, 646-650. doi: 10.3109/0142159X.2010.500703
26. Heilig, J. V. (2013). U.S. "Reformers" Arguments are Antithesis of Finland. Available online at: http://cloakinginequity.com/2013/03/27/wtf-us-reformers-arguments-are-antithesis-of-finland/ (Accessed March 30, 2013).
27. Hemmer, P. A., and Pangaro, L. (1997). The effectiveness of formal evaluation sessions during clinical clerkships in better identifying students with marginal funds of knowledge. Acad. Med. 72, 641-643. doi: 10.1097/00001888-199707000-00018
28. Hemmer, P. A., Papp, K. K., Mechaber, A. J., and Durning, S. J. (2008). Evaluation, grading, and use of the RIME vocabulary on internal medicine clerkships: results of a national survey and comparison to other clinical clerkships. Teach. Learn. Med. 20, 118-126. doi: 10.1080/10401330801991287
29. Hicks, P. J., Schumacher, D. J., Benson, B. J., Burke, A. E., Englander, R., Guralnick, S., et al. (2010). The pediatrics milestones: conceptual framework, guiding principles, and approach to development. J. Grad. Med. Educ. 2, 410-418. doi: 10.4300/JGME-D-10-00126.1
30. Hodges, B. (2012). "Learning to love the subjective and collective," in Ottawa Conference. Kuala Lumpur.
31. Hodges, B. D. (2010). A tea-steeping or i-Doc model for medical education? Acad. Med. 85, S34-S44. doi: 10.1097/ACM.0b013e3181f12f32
32. Hoffman, K., Hosokawa, M., and Donaldson, J. (2009). What criteria do faculty use when rating students as potential house officers? Med. Teach. 31, e412-e417. doi: 10.1080/01421590802650100
33. Iobst, W. F., Sherbino, J., Cate, O. T., Richardson, D. L., Dath, D., Swing, S. R., et al. (2010). Competency-based medical education in postgraduate medical education. Med. Teach. 32, 651-656. doi: 10.3109/0142159X.2010.500709
34. Jaschik, S. (2013). What Is Merit? [Online]. Available online at: http://www.insidehighered.com/news/2013/01/18/admissions-leadersandlegal-experts-debate-how-define-merit?goback=%2Egna_105053%Egde_105053_member_206299945 (Accessed March 29, 2013).
35. Jones, M. D. Jr., Rosenberg, A. A., Gilhooly, J. T., and Carraccio, C. L. (2011). Perspective: competencies, outcomes, and controversy-linking professional activities to competencies to improve resident education and practice. Acad. Med. 86, 161-165. doi: 10.1097/ACM.0b013e31820442e9
36. Kennedy, T. J., Regehr, G., Baker, G. R., and Lingard, L. (2008). Point-of-care assessment of medical trainee competence for independent clinical work. Acad. Med. 83, S89-S92. doi: 10.1097/ACM.0b013e318183c8b7
37. Kogan, J. R., Holmboe, E. S., and Hauer, K. E. (2009). Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review. Jama 302, 1316-1326. doi: 10.1001/jama.2009.1365
38. Kuper, A., Reeves, S., Albert, M., and Hodges, B. D. (2007). Assessment: do we need to broaden our methodological horizons? Med. Educ. 41, 1121-1123. doi: 10.1111/j.1365-2923.2007.02945.x
39. Lanphear, J. (1999). In support of grading systems. Educ. Health 12, 79-83.
40. Littlefield, J. H., Darosa, D. A., Paukert, J., Williams, R. G., Klamen, D. L., and Schoolfield, J. D. (2005). Improving resident performance assessment data: numeric precision and narrative specificity. Acad. Med. 80, 489-495. doi: 10.1097/00001888-200505000-00018
41. Lurie, S. J., Mooney, C. J., and Lyness, J. M. (2011). Pitfalls in assessment of competency-based educational objectives. Acad. Med. 86, 412-414. doi: 10.1097/ACM.0b013e31820cdb28
42. Lye, P., Biernat, K., Bragg, D., and Simpson, D. (2001). A pleasure to work with-an analysis of written comments on students evaluation. Ambul. Pediatr. 1, 128-131. doi: 10.1367/1539-4409(2001)001<0128:APTWWA>2.0.CO;2
43. Metheny, W. P., Espey, E. L., Bienstock, J., Cox, S. M., Erickson, S. S., Goepfert, A. R., et al. (2005). To the point: medical education reviews evaluation in context: assessing learners, teachers, and training programs. Am. J. Obstet. Gynecol. 192, 34-37. doi: 10.1016/j.ajog.2004.07.036
44. Mulder, H., Ten Cate, O., Daalder, R., Teacher and Berkvens, J. (2010). Building a competency-based workplace curriculum around entrustable professional activities: the case of physician assistant training. Med. Teach. 32, e453-e459. doi: 10.3109/0142159X.2010.513719
45. Nasca, T. J., Philibert, I., Brigham, T., and Flynn, T. C. (2012). The next GME accreditation system-rationale and benefits. N. Engl. J. Med. 366, 1051-1056. doi: 10.1056/NEJMsr1200117
46. Pangaro, L. (1999). A new vocabulary and other innovations for improving descriptive in-training evaluations. Acad. Med. 74, 1203-1207. doi: 10.1097/00001888-199911000-00012
47. Pangaro, L., and ten Cate, O. (2013). Frameworks for learner assessment in medicine: AMEE guide no. 78. Med. Teach. 35, e1197-e1210. doi: 10.3109/0142159X.2013.788789
48. Pangaro, L. N., McGaghie, W. C., Ainsworth, M., Ablbritton, A., Battistone, M. J., Carnahan, D., et al. (2005). "Evaluation and grading of students," in Guidebook for Clerkship Directors, 3rd Edn., eds R.-M. E. Fincher, S. Cox, D. A. Darosa, D. J. Lynn, K. L. Margo, B. Z. Morgenstern, L. N. Pangaro and F. A. Sierles (Omaha, NE: Alliance for Clinical Education), 133-250.
49. Regehr, G., Ginsburg, S., Herold, J., Hatala, R., Eva, K., and Oulanova, O. (2012). Using "standardized narratives" to explore new ways to represent faculty opinions of resident performance. Acad. Med. 87, 419-427. doi: 10.1097/ACM.0b013e31824858a9
50. Regehr, G., Regehr, C., Bogo, M., and Power, R. (2007). Can we build a better mousetrap? Improving the measures of practice performance in the field practicum. J. Soc. Work Educ. 43, 327-343. doi: 10.5175/JSWE.2007.200600607
51. Reznick, R. K., Colliver, J. A., Williams, R. G., and Folse, J. R. (1989). Reliability of different grading systems used in evaluating surgical students. Am. J. Surg. 157, 346-349. doi: 10.1016/0002-9610(89)90568-0
52. Rohe, D. E., Barrier, P. A., Clark, M. M., Cook, D. A., Vickers, K. S., and Decker, P. A. (2006). The benefits of pass-fail grading on stress, mood, and group cohesion in medical students. Mayo Clin. Proc. 81, 1443-1448. doi: 10.4065/81.11.1443
53. Rosemartin, D. S. (2013). Assessment of learning, assessment for learning, shifting our focus. Kappa Delta Pi Rec. 49, 21-25. doi: 10.1080/00228958.2013.759826
54. Ross, S., Poth, C. N., Donoff, M., Humphries, P., Steiner, I., Schipper, S., et al. (2011). Competency-based achievement system: using formative feedback to teach and assess family medicine residents' skills. Can. Fam. Physician 57, e323-e330.
55. Schmahmann, J. D., Neal, M., and Macmore, J. (2008). Evaluation of the assessment and grading of medical students on a neurology clerkship. Neurology 70, 706-712. doi: 10.1212/01.wnl.0000302179.56679.00
56. Silber, C. G., Nasca, T. J., Paskin, D. L., Eiger, G., Robeson, M., and Veloski, J. J. (2004). Do global rating forms enable program directors to assess the ACGME competencies? Acad. Med. 79, 549-556. doi: 10.1097/00001888-200406000-00010
57. Speer, A. J., Solomon, D. J., and Fincher, R. M. (2000). Grade inflation in internal medicine clerkships: results of a national survey. Teach. Learn. Med. 12, 112-116. doi: 10.1207/S15328015TLM1203_1
58. Squires, B. (1999). Conventional grading and the delusions of academe. Educ. Health 12, 73-77.
59. Swing, S. R. (2007). The ACGME outcome project: retrospective and prospective. Med. Teach. 29, 648-654. doi: 10.1080/01421590701392903
60. Takayama, H., Grinsell, R., Brock, D., Foy, H., Pellegrini, C., and Horvath, K. (2006). Is it appropriate to use core clerkship grades in the selection of residents? Curr. Surg. 63, 391-396. doi: 10.1016/j.cursur.2006.06.012
61. Ten Cate, O., Snell, L., and Carraccio, C. (2010). Medical competence: the interplay between individual ability and the health care environment. Med. Teach. 32, 669-675. doi: 10.3109/0142159X.2010.500897
62. White, C. B., and Fantone, J. C. (2010). Pass-fail grading: laying the foundation for self-regulated learning. Adv. Health Sci. Educ. Theory Pract. 15, 469-477. doi: 10.1007/s10459-009-9211-1
63. Wimmers, P. F., Kanter, S. L., Splinter, T. A., and Schmidt, H. G. (2008). Is clinical competence perceived differently for student daily performance on the wards versus clerkship grading? Adv. Health Sci. Educ. Theory Pract. 13, 693-707. doi: 10.1007/s10459-007-9075-1
64. Zahn, C. M., Nalesnik, S. W., Armstrong, A. Y., Satin, A. J., and Haffner, W. H. (2004). Variation in medical student grading criteria: a survey of clerkships in obstetrics and gynecology. Am. J. Obstet. Gynecol. 190, 1388-1393. doi: 10.1016/j.ajog.2003.12.020