Evaluating competence using a portfolio: A literature review and web-based application to the ACGME competencies

Teaching and Learning in Medicine

Volumn 16, Issue 4, 2004, Pages 381-387

  Carraccio, Carol ^a   Englander, Robert ^b  

^a UNIVERSITY OF MARYLAND SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF CONNECTICUT SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPETENCE; DISABILITY; EVALUATION; LEARNING; MEDICAL EDUCATION; MEDICAL PRACTICE; OCCUPATION; PERFORMANCE; RESIDENCY EDUCATION; REVIEW;

EID: 9644294307     PISSN: 10401334     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15328015tlm1604_13     Document Type: Review

References (43)

1. Accreditation Council for Graduate Medical Education. Outcomes Project. Available at: http://www.acgme.org/Outcome. Accessed February 3, 2004.
2. Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. Shifting paradigms: From Flexner to competencies. Academic Medicine 2002;77:361-7.
3. Snadden D, Thomas M. The use of portfolio learning in medical education. Medical Teacher 1998;20:192-200.
4. Turnbull J. What is ... normative versus criterion-referenced assessment. Medical Teacher 1989;1:145-50.
5. Challis M. AMEE medical education guide no. 11 (revised): Portfolio-based learning and assessment in medical education. Medical Teacher 1999;4:437-40.
6. Accreditation Council for Graduate Medical Education. Outcomes Project Assessment. Available at: http://www.acgme. org/assess/assHome.asp. Accessed February 3, 2004.
7. Mathers NJ, Challis MC, Howe AC, Field NJ. Portfolios in continuing medical education - Effective and efficient? Medical Education 1999;33:521-30.
8. Freedman Ben-David M. AMEE guide no. 24: Portfolios as a method of student assessment. Medical Teacher 2001;23:535-51.
9. Schön D. Educating the reflective practitioner. San Francisco: Jossey-Bass, 1987.
10. Parboosingh J. Learning portfolios: Potential to assist health professional with self-directed learning. Journal of Continuing Education in the Health Professions 1996;16:75-81.
11. Pitts J, Coles C, Thomas P. Enhancing the reliability in portfolio assessment: Shaping the portfolio. Medical Teacher 2001;23:351-6.
12. Pitts J, Coles C, Thomas P, Smith F. Enhancing reliability in portfolio assessment: Discussions between assessors. Medical Teacher 2002;24:197-201.
13. Finlay IG, Maughan TS, Webster DJ. A randomized controlled study of portfolio learning in undergraduate cancer education. Medical Education 1998;32:172-6.
14. Lonka K, Slotte V, Halttunen M, et al. Portfolios as a learning tool in obstetrics and gynaecology undergraduate training. Medical Education 2001;35:1125-30.
15. Challis M, Mathers NJ, Howe AC, Field NJ. Portfolio-based learning: Continuing medical education for general practitioners - A mid-point evaluation. Medical Education 1997;31:22-6.
16. Campbell C, Parboosingh JT, Tunde Gondocz S, et al. Study of physician's use of a software program to create a portfolio of their self-directed learning. Academic Medicine 1996;71 (Suppl.):49-51.
17. Pitts J, Coles C, Thomas P. Educational portfolios in the assessment of general practice trainers: Reliability of assessors. Medical Education 1999;33:515-20.
18. Jensen GM, Saylor C. Portfolios and professional development in the health professions. Evaluation & the Health Professions 1994;17:344-57.
19. Fung MFKF, Walker M, Fung KFK, et al. An Internet-based learning portfolio in resident education: The KOALA™ multicentre programme. Medical Education 2000;34:474-9.
20. Rosenberg ME, Watson K, Paul J, Miller W, Harris I, Valdivia TD. Development and implementation of a web-based evaluation system for an internal medicine residency program. Academic Medicine 2001;6:92-5.
21. Dornan T, Lee C, Stopford A. SkillsBase: A web-based electronic learning portfolio for clinical skills. Academic Medicine 2001;76:542-3.
22. Stewart J, O'Halloran CO, Barton JR, Singleton SJ, Harrigan P, Spencer J. Clarifying the concepts of confidence and competence to produce appropriate self-evaluation measurement scales. Medical Education 2000;34:903-9.
23. Ward M, Gruppen L, Regehr G. Measuring self-assessment: Current state of the art. Advances in Health Sciences Education: Theory and Practice 2002;7:63-80.
24. Gordon MJ. A review of the validity and accuracy of self-assessments in health professions training. Academic Medicine 1991;66:762-9.
25. Regehr G, Hodges B, Tiberius R, Lopchy J. Measuring self-assessment skills: An innovative relative ranking model. Academic Medicine 1996;71(Suppl.):52-4.
26. Altmaier EM, McGuinness G, Wood P, Ross RR, Bartley J, Smith W. Defining successful performance among pediatric residents. Pediatrics 1990;85:139-43.
27. Norcini JJ, Blank LL, Arnold GK, Kimball HR. The mini CEX: A preliminary investigation. Annals of Internal Medicine 1998;123:795-9.
28. Holmboe E, Hawkins RE. Methods for evaluating the clinical competence of residents in internal medicine: A review. Annals of Internal Medicine 1998;129:42-8.
29. Kroboth FJ, Hanusa BH, Parker S, et al. The inter-rater reliability and internal consistency of a clinical evaluation exercise. Journal of General Internal Medicine 1992;7:174-9.
30. Smith RM. The triple-jump examination as an assessment tool in the problem-based medical curriculum at the University of Hawaii. Academic Medicine 1993;68:366-72.
31. Butterfield PS, Mazzaferri EL. A new rating form for use by nurses in assessing residents' humanistic behavior. Journal of General Internal Medicine 1991;6:155-61.
32. Butterfield PS, Mazzarferri EL, Sachs LA. Nurses as evaluators of the humanistic behavior of internal medicine residents. Journal of Medical Education 1987;62:842-9.
33. Kaplan CB, Centor RM. The use of nurses to evaluate houseofficers' humanistic behavior. Journal of General Internal Medicine 1990;5:410-4.
34. Linn LS, Oye RK, Cope DW, DiMatteo MR. Use of nonphysician staff to evaluate humanistic behavior of internal medicine residents and faculty members. Journal of Medical Education 1986;61:918-20.
35. Tamblyn R, Gebo KA, Hellman DB. The feasibility and value of using patient satisfaction ratings to evaluate internal medicine residents. Journal of General Internal Medicine 1994; 9:146-52.
36. Matthews DA, Feinstein AR. A new instrument for patients' rating of physician performance in the hospital setting. Journal of General Internal Medicine 1989;4:14-22.
37. Van Rosendaal GMA, Jennett PA. Comparing peer and faculty evaluations in an internal medicine residency. Academic Medicine 1994;69:299-303.
38. Wolliscroft JO, Howell JD, Patel BP, Swanson DB. Resident-patient interactions: The humanistic qualities of internal medicine residents assessed by patients, attending physicians, program supervisors and nurses. Academic Medicine 1994; 69:216-24.
39. Carraccio C, Englander R. The objective structured clinical examination: A step in the direction of competency-based education. Archives of Pediatrics & Adolescent Medicine 2000; 154:736-41.
40. Davis MH, Friedman Ben-David M, Harden RM, et al. Portfolio assessment in medical students' final examinations. Medical Teacher 2001;23:357-66.
41. Snadden D. Portfolios-attempting to measure the unmeasurable. Medical Education 1999;33:478-9.
42. Wilkinson TJ, Challis M, Hobma SO, et al. The use of portfolios for assessment of the competence and performance of doctors in practice. Medical Education 2002;36:918-24.
43. Murray E. Challenges in educational research. Medical Education 2002;36:110-2.