Frameworks for learner assessment in medicine: AMEE Guide No. 78

Medical Teacher

Volumn 35, Issue 6, 2013, Pages

  Pangaro, Louis ^a   Ten Cate, Olle ^b  

^a Uniformed Services University of the Health Sciences and the Walter Reed National Military Medical Center   (United States)

^b UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; EDUCATION; HUMAN; MEDICAL EDUCATION; METHODOLOGY; NETHERLANDS; STANDARD; THEORETICAL MODEL; PROCEDURES; STANDARDS;

CLINICAL COMPETENCE; EDUCATION, MEDICAL, UNDERGRADUATE; EDUCATIONAL MEASUREMENT; HUMANS; MODELS, THEORETICAL; NETHERLANDS;

EID: 84878304216     PISSN: 0142159X     EISSN: 1466187X     Source Type: Journal    
DOI: 10.3109/0142159X.2013.788789     Document Type: Article

References (61)

1. Accreditation Council on Graduate Medical Education (ACGME). 1999. ACGME core competencies. [Accessed 21 July 2012]. Available from http://www.mcw.edu/ MedicalSchool/EducationalServices/GraduateMedicalEducation/ ACGMECoreCompetencies.htm
2. Albanese M. 2000. Challenges in using rater judgements in medical education. J Eval Clin Pract 6(3): 305-319.
3. Albanese M. 1999. Rating educational quality: Factors in the erosion of professional standards. Acad Med 74(6): 652-658. (Pubitemid 29283157)
4. Albanese MA, Mejicano G, Mullan P, Kokotailo P, Gruppen L. 2008. Defining characteristics of educational competencies. Med Educ 42(3): 248-255. (Pubitemid 351230175)
5. Anderson B. 1999. Learning objectives for medical student education - Guidelines for medical schools: Report I of the Medical School Objectives Project. Acad Med 74(1): 13-18.
6. Anon. 1999. Oxford dictionaries. Available at http://oxforddictionaries. com/definition/competence
7. Battistone MJ, Milne C, Sande MA, Pangaro LN, Hemmer PA, Shomaker TS. 2002. The feasibility and acceptability of implementing formal evaluation sessions and using descriptive vocabulary to assess student performance on a clinical clerkship. Teach Learn Med 14(1): 5-10.
8. Bloom BS, Engelhart MD, Furst EJ, Hill WH, Krathwohl DR (Eds.). 1956. Taxonomy of educational objectives: The classification of educational goals; Handbook I: Cognitive Domain. London, WI: Longmans, Green & Co. Ltd.
9. Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. 2002. Shifting paradigms: From Flexner to competencies. Acad Med 77(5): 361-367, Available from http://www.ncbi.nlm.nih.gov/pubmed/12010689 (Pubitemid 34526146)
10. Carraccio CL, Benson BJ, Nixon LJ, Derstine PL. 2008. From the educational bench to the clinical bedside: Translating the Dreyfus clinical skills. Acad Med 83(8): 761-767.
11. de Landesheere V. 1997. Taxonomies of educational objectives. In: Keeves J, editor. Educational research, methodology and measurement - An international handbook. Oxford: Pergamon/Elsevier Science Ltd. pp 803-812.
12. Dreyfus HL, Dreyfus SE. 1986. Mind over machine. New York: Free Press.
13. Dudek NL, Marks MB, Regehr G. 2005. Failure to fail: The perspectives of clinical supervisors. Acad Med 80(10 Suppl):S84-87. (Pubitemid 41383282)
14. Durning S, Pangaro L, Denton GD, Hemmer P, Wimmer A, Grau T, Gaglione MA, Moores L. 2003. Inter-site consistency as a standard of programmatic evaluation in a clerkship with multiple, geographically separated sites. Acad Med 78:S36-S38. (Pubitemid 37238501)
15. Elstein AS, Shulman LS, Sprafka SA. 1978. Medical problem solving. An analysis of clinical reasoning. Cambridge, Massachusetts: Harvard University Press.
16. Epstein RM, Hundert EM. 2002. Defining and assessing professional competence. Med Humanit 287(2): 226-235. (Pubitemid 34251949)
17. Frank Jr. 2005. The CanMEDS 2005 physician competency framework: Better standards, better physicians, better care. Ottawa: Royal College of Physicians and Surgeons in Canada.
18. Frank JR, Mungroo R, Ahmad Y, Wang M, De Rossi S, Horsley T. 2010. Toward a definition of competency-based education in medicine: A systematic review of published definitions. Med Teach 32(8): 631-637.
19. Gans ROB. 2009. Mentoring with a formative portfolio: A case for reflection as a separate competency role. Med Teach 31(10): 883-884.
20. Gingerich A, Regehr G, Eva KW. 2011. Rater-based assessments as social judgments: Rethinking the etiology of rater errors. Acad Med 86(10 Suppl):S1-7.
21. Govaerts MJ, van der Vleuten CP, Schuwirth LW, Muijtjens AM. 2007. Broadening perspectives on clinical performance assessment: Rethinking the nature of in-training assessment. Adv Health Sci Educ Theory Pract 12(2): 239-260.
22. General Medical Council (GME). 2009. Tomorrow's Doctors - The duties of a doctor registered with the General Medical Council. London: General Medical Council. Available at http://www.gmc-uk.org/TomorrowsDoctors-2009.pdf-39260971. pdf
23. Green ML, Aagaard EM, Caverzagie KJ, Chick DA, Holmboe E, Kane G, Smith CD, Iobst W. 2009. Charting the road to competence: Developmental milestones for internal medicine residency training. J Grad Med Educ 1(1): 5-20.
24. Harden RM, Crosby JR, Davis MH, Friedman M. 1999a. AMEE Guide No. 14. Outcome-based education: Part 5 - From competency to metacompetency: A model for the specification of learning outcomes. Med Teach 21(6): 546-552. (Pubitemid 30015813)
25. Harden RM, Crosby JR, Davis MH, Fuller T. 1999b. AMEE Guide No. 14: Outcome-based education: Part 1 - An introduction to outcome-based education. Med Teach 21(1): 7-14. (Pubitemid 29092474)
26. Hemmer PA, Papp KK, Mechaber AJ, Durning SJ. 2008. Evaluation, grading, and use of the RIME vocabulary on internal medicine clerkships: Results of a national survey and comparison to other clinical clerkships. Teach Learn Med 20(2): 118-126.
27. Holmboe ES, Ward DS, Reznick RK, Katsufrakis PJ, Leslie KM, Patel VL, Ray DD, Nelson EA. 2011. Faculty development in assessment: The missing link in competency-based medical education. Acad Med 86(4): 460-467.
28. Jones Jr MD, Rosenberg AA, Gilhooly JT, Carraccio CL. 2011. Perspective: Competencies, outcomes, and controversy - Linking professional activities to competencies to improve resident education and practice. Acad Med 86(2): 161-165.
29. Kennedy TJ, Regehr G, Baker GR, Lingard LA. 2005. Progressive independence in clinical training: A tradition worth defending? Acad Med 80(10 Suppl):S106-111. (Pubitemid 41383287)
30. Kenny A. 2004. Ancient philosophy. New York: Oxford University Press. pp 49-53.
31. Krathwohl DR. 2002. A revision of Bloom's taxonomy: An overview. Theor Pract 41(4): 212-218.
32. Krathwohl DR, Bloom BS, Masia BB. 1973. Taxonomy of educational objectives, the classification of educational goals. Handbook II: Affective domain. New York: David McKay Co, Inc.
33. Lave J, Wenger E. 1991. Situated learning. Legitimate peripheral participation. Edinburgh: Cambridge University Press.
34. Lockyer J. 2003. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof 23(1): 4-12.
35. Lurie SJ, Mooney CJ, Lyness JM. 2011. Commentary: Pitfalls in assessment of competency-based educational objectives. Acad Med 86(4): 412-414.
36. Miller GE. 1990. The assessment of clinical skills/competence/ performance. Acad Med 87(7):S63-S67. (Pubitemid 20333148)
37. Nasca TJ, Philibert I, Brigham T, Flynn TC. 2012. The next GME accreditation system - Rationale and benefits. N Engl J Med 366(11): 1051-1056.
38. Norcini J, Burch V. 2007. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach 29(9): 855-871, Also available from http://www.ncbi.nlm.nih.gov/pubmed/18158655
39. Oxford Dictionaries. [Accessed 10 December 2012]. Available at http://oxforddictionaries.com
40. Pangaro L. 1999. A new vocabulary and other innovations for improving descriptive in-training evaluations. Acad Med 74(11): 1203-1207.
41. Pangaro LN. 2000. Investing in descriptive evaluation: A vision for the future of assessment. Med Teach 22(5): 478-481.
42. Pangaro LN, McGaghie WC. 2012. Evaluation of students. In: Morgenstern BZ, editor. Guidebook for clerkship directors. 4th ed. North Syracuse, New York: Gegensatz Press.
43. Pellegrino ED. 1979. Humanism and the physician. Knoxville: University of Tennessee Press. pp 222-224.
44. Piaget J, Inhelder B. 1969. The psychology of the child. New York: Basic Books.
45. Rodriguez R, Pangaro L, 2012. Mapping the ACGME competencies to the RIME Framework, Acad Med 87(12): 1781.
46. Rey G. 2008. The analytic/synthetic distinction. Stanford encyclopedia of philosophy. Available at: http://plato.stanford.edu/entries/analyticsynthetic/
47. Scottish Deans' Medical Curriculum Group 2009. 2011. The Scottish doctor. 3rd edition. [Accessed 21 July 2012]. Available from http://www.scottishdoctor. org/index.asp
48. Schumacher DJ, Lewis KO, Burke AE, Smith ML, Schumacher JB, Pitman MA, Ludwig S, Hicks PJ, Guralnick S, Englander R, et al. 2013. The pediatrics milestones: Initial evidence for their use as learning road maps for residents. Acad Pediatr 13(1): 40-7.
49. Simpson EJ. 1972. The classification of educational objectives in the psychomotor domain. Washington, DC: Gryphon House.
50. Speer AJ, Solomon DJ, Fincher RME. 2000. Grade inflation in internal medicine clerkships: Results of a national survey grade inflation in internal medicine clerkships: Results of a national survey. Teach Learn Med 12(3): 112-116.
51. Sterkenburg A, Barach P, Kalkman C, Gielen M, ten Cate O. 2010. When do supervising physicians decide to entrust residents with unsupervised tasks? Acad Med 85(9): 1408-1417.
52. Tavares W, Eva KW. 2012. Exploring the impact of mental workload on rater-based assessments. Adv Health Sci Educ Theory Pract, doi: 10.1007/s10459-012-9370-3.
53. ten Cate O. 2005. Entrustability of professional activities and competencybased training. Med Educ 39(12): 1176-1177. (Pubitemid 41752330)
54. ten Cate O, Scheele F. 2007. Competency-based postgraduate training: Can we bridge the gap between theory and clinical practice? Acad Med 82(6): 542-547. (Pubitemid 46828201)
55. ten Cate O, Snell L, Carraccio C. 2010. Medical competence: The interplay between individual ability and the health care environment. Med Teach 32(8): 669-675.
56. Tolsgaard MG, Arendrup H, Lindhardt BO, Hillingsø JG, Stoltenberg M, Ringsted C. 2012. Construct validity of the reporter-interpreter- managereducator structure for assessing students' patient encounter skills. Acad Med 87(6): 799-806.
57. Tyler RW. 1949. Basic principles of curriculum and instruction. Chicago: University of Chicago Press.
58. van Herwaarden CLA, Laan RFJM, Leunissen RRM. 2009. The 2009 framework for undergraduate medical education in the Netherlands, Utrecht. Available from http://www.vsnu.nl/Media-item/Raamplan- Artsopleiding-2009.htm
59. Wijnen-Meijer M, Van der Schaaf M, Nillesen K, Harendza SD, ten Cate O. 2013. Essential facets of competence that enable trust in graduates: A Delphi study among physician educators in the Netherlands. J Graduate Med Edu 5: 46-53.
60. Williams RG, Klamen DA, McGaghie WC. 2003. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med 14(4): 37-41.
61. Zibrowski EM, Singh SI, Goldszmidt MA, Watling CJ, Kenyon CF, Schulz V, Maddocks HL, Lingard L. 2009. The sum of the parts detracts from the intended whole: Competencies and in-training assessments. Med Educ 43(8): 741-748.