Portfolios in medical education: Why do they meet with mixed success? A systematic review

Medical Education

Volumn 41, Issue 12, 2007, Pages 1224-1233

  Driessen, Erik ^a,d   Van Tartwijk, Jan ^b   Van Der Vleuten, Cees ^a   Wass, Val ^c  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b LEIDEN UNIVERSITY   (Netherlands)

^c UNIVERSITY OF MANCHESTER   (United Kingdom)

^d MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

*learning; Clinical competence *standards; Documentation *methods; Education, medical *methods; Educational measurement *methods; Observer variation; Review publication type ; Teaching *methods

Indexed keywords

CLINICAL COMPETENCE; CURRICULUM; DATA ANALYSIS; DATA BASE; DOCUMENTATION; FEASIBILITY STUDY; INFORMATION PROCESSING; INTERRATER RELIABILITY; LEARNING; MEDICAL EDUCATION; REVIEW; SELF EVALUATION; STATISTICAL ANALYSIS;

CLINICAL COMPETENCE; DOCUMENTATION; EDUCATION, MEDICAL; EDUCATIONAL MEASUREMENT; LEARNING; OBSERVER VARIATION; SELF ASSESSMENT (PSYCHOLOGY); TEACHING;

EID: 36649030414     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/j.1365-2923.2007.02944.x     Document Type: Review

References (65)

1. Rabinowitz HK, Babbott D, Bastacky S et al. Innovative approaches to educating medical students for practice in a changing health care environment: the National UME-21 project. Acad Med 2001 76 : 587 95.
2. National Health Service. Modernising Medical Careers Foundation Programmes. http://www.mmc.nhs.uk/pages/foundation. [Accessed 29 August 2006.]
3. Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA 2002 287 (2 226 35.
4. Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990 65 (9 Suppl 63 7.
5. Epstein RM. Assessment in medical education. N Engl J Med 2007 356 : 387 96.
6. Royal College of General Practitioners. Portfolio-based Learning in General Practice: Report of a Working Group on Higher Professional Education: December 1993. Occasional paper 63.
7. General Medical Council. Tomorrow's Doctors: Recommendations on Undergraduate Medical Education. http://www.gmc-uk.org/education/undergraduate/ tomdoc.pdf. [Accessed 29 August 2006.]
8. Accreditation Council for General Medical Education, American Board of Medical Specialties. Toolbox of Assessment Methods, Version 1.1. http://www.acgme.org/Outcome/assess/Toolbox.pdf. [Accessed 29 August 2006.]
9. Hayden SR, Dufel S, Shih R. Definitions and competencies for practice-based learning and improvement. Acad Emerg Med 2002 9 (11 1242 8.
10. Lynch DC, Swing SR, Horowitz SD, Holt K, Messer JV. Assessing practice-based learning and improvement. Teach Learn Med 2004 16 (1 85 92.
11. Alliance for Academic Internal Medicine. Portfolio for internal medicine residency programmes. http://www.im.org/AAIM/Tools/Docs/Forms/competencies.pdf. [Accessed 29 August 2006.]
12. Bennett NL, Davis DA, Easterling WE Jr. et al. Continuing medical education: a new vision of the professional development of physicians. Acad Med 2000 75 : 1167 72.
13. Lewis M, Elwyn G, Wood F. Appraisal of family doctors: an evaluation study. Br J Gen Pract 2003 53 : 454 60.
14. Zeiger RF. Toward continuous medical education. J Gen Int Med 2005 20 (1 91 4.
15. Korthagen FAJ, Kessels J, Koster B, Lagerwerf B, Wubbels T. Linking Theory and Practice: the Pedagogy of Realistic Teacher Education. Mahwah, NJ : Lawrence Erlbaum Associates 2001.
16. Klenowski V. Developing Portfolios for Learning and Assessment: Processes and Principles. London : Routledge/Falmer 2002.
17. Davis DA, Mazmanian PE, Fordis M, van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA 2006 296 (9 1094 102.
18. Eva KW, Regehr G. Self-assessment in the health professions: a reformulation and research agenda. Acad Med 2005 80 (10 Suppl 46 54.
19. van Tartwijk J, Driessen E, Stokking K, van der Vleuten C. Factors influencing the successful introduction of portfolios. Qual Higher Educ 2007 13 (1 69 79.
20. Dornan T, Carroll C, Parboosingh J. An electronic learning portfolio for reflective continuing professional development. Med Educ 2002 36 (8 767 9.
21. Finlay IG, Maughan TS, Webster DJ. A randomised controlled study of portfolio learning in undergraduate cancer education. Med Educ 1998 32 (2 172 6.
22. Gordon J. Assessing students' personal and professional development using portfolios and interviews. Med Educ 2003 37 (4 335 40.
23. Best Evidence Medical Education Collaboration. Information for prospective topic review groups. http://www.bemecollaboration.org/TRGInfo.htm. [Accessed 19 June 2006.]
24. Reed D, Price EG, Windish DM et al. Challenges in systematic reviews of educational intervention studies. Ann Intern Med 2005 142 : 1080 9.
25. Zeichner K, Wray S. The teaching portfolio in US teacher education programmes: what we know and what we need to know. Teach Teach Educ 2001 17 : 613 21.
26. Curran VR, Fleet LA. A review of evaluation outcomes of web-based continuing medical education. Med Educ 2005 39 : 561 7.
27. Magnusson D. Test Theory. Stockholm : Addison-Wesley 1967.
28. Mathers NJ, Challis MC, Howe AC, Field NJ. Portfolios in continuing medical education - effective and efficient? Med Educ 1999 33 (7 521 30.
29. Vink S, Cools HJM, Elsen GMF, Vermunt JD. Reflectie van eerstejaars studenten geneeskunde: wat willen we zien en wat doen de studenten? Dutch J Med Educ 2005 24 (1 4 13 CM, Parboosingh JT, Gondocz ST et al. Study of physicians' use of a software program to create a portfolio of their self-directed learning. Acad Med 1996 71 (10 Suppl 49 50.
30. Dagley V, Berrington B. Learning from an evaluation of an electronic portfolio to support general practitioners' personal development planning, appraisal and revalidation. Educ Prim Care 2005 16 : 567 74.
31. Driessen EW, van Tartwijk J, Overeem K, Vermunt JD, van der Vleuten CPM. Conditions for successful reflective use of portfolios in undergraduate medical education. Med Educ 2005 39 : 1230 5.
32. Driessen EW, van Tartwijk J, Vermunt JD, van der Vleuten CPM. Use of portfolios in early undergraduate medical training. Med Teach 2003 25 (1 14 9.
33. Maughan TS, Finlay IG, Webster DJ. Portfolio learning with cancer patients: an integrated module in undergraduate medical education. Clin Oncol 2001 13 (1 44 9.
34. Pearson DJ, Heywood P. Portfolio use in general practice vocational training: a survey of GP registrars. Med Educ 2004 38 (1 87 95.
35. Davis MH, Friedman BDM, Harden RM et al. Portfolio assessment in medical students' final examinations. Med Teach 2001 23 (4 357 66.
36. Elango S, Jutti RC, Lee LK. Portfolio as a learning tool: students' perspective. Ann Acad Med Singapore 2005 34 (8 511 4.
37. Kjaer NK, Maagaard R, Wied S. Using an online portfolio in postgraduate training. Med Teach 2006 28 (8 708 12.
38. Ryland I, Brown J, O'Brien N et al. The portfolio: how was it for you? Views of F2 doctors from the Mersey Deanery Foundation Pilot Clin Med 2006 6 (4 378 80.
39. Webb TP, Aprahamian C, Weigelt JA, Brasel KJ. The Surgical Learning and Instructional Portfolio (SLIP) as a self-assessment educational tool demonstrating practice-based learning. Curr Surg 2006 63 (6 444 7.
40. Snadden D. Portfolio-based learning and general practice vocational training. Med Educ 1996 30 : 148 52.
41. Fung MKF, Walker M, Fung KKF et al. An Internet-based learning portfolio in resident education: the KOALA-super(TM) multicentre programme. Med Educ 2000 34 (6 474 9.
42. Snadden D, Thomas ML. Portfolio learning in general practice vocational training - does it work? Med Educ 1998 32 (4 401 6.
43. Duque G, Finkelstein A, Roberts A, Tabatabai D, Gold SL, Winer LR. Learning while evaluating: the use of an electronic evaluation portfolio in a geriatric medicine clerkship. BMC Med Educ 2006 6 : 4.
44. Tate P, Foulkes J, Neighbour R, Campion P, Field S. Assessing physicians' interpersonal skills via videotaped encounters: a new approach for the Royal College of General Practitioners membership examination. J Health Commun 1999 4 (2 143 52.
45. O'Sullivan PS, Reckase MD, McClain T, Savidge MA, Clardy JA. Demonstration of portfolios to assess competency of residents. Adv Health Sci Educ 2004 9 (4 309 23.
46. Burch VC, Seggie J. Portfolio assessment using a structured interview. Med Educ 2005 39 (11 1169.
47. Grant AJ, Vermunt JD, Kinnersley P, Houston H. Exploring students' perceptions on the use of significant event analysis, as part of a portfolio assessment process in general practice, as a tool for learning how to use reflection in learning. BMC Med Educ 2007 7 : 5.
48. Rees CE, Sheard CE. Undergraduate medical students' views about a reflective portfolio assessment of their communication skills learning. Med Educ 2004 38 (2 125 8.
49. Amsellem-Ouazana D, van Pee D, Godin V. Use of portfolios as a learning and assessment tool in a surgical practical session of urology during undergraduate medical training. Med Teach 2006 28 (4 356 9.
50. Overeem K, Driessen EW, Drenthe A, van Tartwijk J, van der Vleuten CPM. Kwaliteitscriteria voor portfoliobeoordeling van geneeskundestudenten. [Summary in English.] Dutch J Med Educ 2005 24 (2 64 71.
51. Melville C, Rees M, Brookfield D, Anderson J. Portfolios for assessment of paediatric specialist registrars. Med Educ 2004 38 : 1117 25.
52. Rees CE, Sheard CE. The reliability of assessment criteria for undergraduate medical students' communication skills portfolios: the Nottingham experience. Med Educ 2004 38 (2 138 44.
53. McCready T. Portfolios and the assessment of competence in nursing. Int J Nurs Stud 2007 44 (1 143 51.
54. Pinsky LE, Fryer-Edwards K. Diving for PERLS - working and performance portfolios for evaluation and reflection on learning. J Gen Int Med 2004 19 : 582 7.
55. Wade RC, Yarbrough DB. Portfolios: a tool for reflective thinking in teacher education. Teach Teach Educ 1996 12 (1 63 79.
56. McMullan M. Students' perceptions on the use of portfolios in pre-registration nursing education: a questionnaire survey. Int J Nurs Stud 2006 43 : 333 43.
57. Snyder J, Lippincott A, Bower D. The inherent tensions in the multiple uses of portfolios in teacher education. Teach Educ Q 1998 25 (1 45 60.
58. Tigelaar DEH, Dolmans DHJM, Wolfhagen HAP, van der Vleuten CPM. Using a conceptual framework and the opinion of portfolio experts to develop a teaching portfolio prototype. Stud Educ Eval 2004 30 (4 305 21.
59. Gallagher P. An evaluation of a standards-based portfolio. Nurse Educ Today 2001 21 : 409 16.
60. Pitts J, Coles C, Thomas P, Smith F. Enhancing reliability in portfolio assessment: discussions between assessors. Med Teach 2002 24 (2 197 201.
61. Pitts J, Coles C, Thomas P. Educational portfolios in the assessment of general practice trainers: reliability of assessors. Med Educ 1999 33 : 515 20.
62. Frohna JG, Kalet A, Kachur E et al. Assessing residents' competency in care management: report of a consensus conference. Teach Learn Med 2004 16 (1 77 84.
63. Lonka K, Slotte V, Halttunen M et al. Portfolios as a learning tool in obstetrics and gynaecology undergraduate training. Med Educ 2001 35 (12 1125 30.
64. Collins A, Joseph D, Bielaszyc K. Design research: theoretical and methodological issues. J Learning Sci 2004 13 (1 15 42.
65. Mucklow JC. Continuing medical education in clinical pharmacology and therapeutics: report of a questionnaire survey. Br J Clin Pharmacol 2001 52 (1 9 16.