The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: A case study

Medical Education

Volumn 39, Issue 2, 2005, Pages 214-220

  Driessen, Erik ^a   Van Der Vleuten, C ^a   Schuwirth, L ^a   Van Tartwijk, J ^b   Vermunt, J ^c  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b LEIDEN UNIVERSITY   (Netherlands)

^c UTRECHT UNIVERSITY   (Netherlands)

Author keywords

Clinical competence *standards; Curriculum standards; Education, medical, undergraduate *methods; Educational measurement *methods; Mentors; Reproducibility of results; Students, medical *psychology

Indexed keywords

ARTICLE; DECISION MAKING; EVALUATION; HEALTH CARE QUALITY; HUMAN; MEDICAL AUDIT; MEDICAL RESEARCH; OBSERVER VARIATION; ORIENTATION; PORTFOLIO ASSESSMENT; QUALITATIVE ANALYSIS; RELIABILITY;

CLINICAL COMPETENCE; EDUCATION, MEDICAL, UNDERGRADUATE; EDUCATIONAL MEASUREMENT; HUMANS; MENTORS; QUALITATIVE RESEARCH; REPRODUCIBILITY OF RESULTS; STUDENTS, MEDICAL;

EID: 14044250116     PISSN: 03080110     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1365-2929.2004.02059.x     Document Type: Article

References (20)

1. Friedman Ben David M, Davis MH, Harden RM, Howie PW, Ker J, Pippard MJ. AMEE Medical Education Guide, 24. Portfolios as a method of student assessment. Med Teacher 2001;23 (6):535-51.
2. Webb C, Gray M, Jasper M, McCullan M, Scholes J. Models of portfolios. Med Educ 2002;36:879-98.
3. McCullan M, Endacott R, Gray MA et al. Portfolios and assessment of competence: a review of the literature. J Adv Nurs 2003;41 (3):283-94.
4. Snadden D. Portfolios - attempting to measure the unmeasurable? Med Educ 1999;33:478-9.
5. Baume D, Yorke M. The reliability of assessment by portfolio on a course to develop and accredit teachers in higher education. Studies Higher Educ 2002;27 (1):7-25.
6. Pitts J, Coles C, Thomas P. Educational portfolios in the assessment of general practice trainers: reliability of assessors. Med Educ 1999;33:515-20.
7. Roberts C, Newble DI, O'Rourke A. Portfolio-based assessments in medical education: are they valid and reliable for summative purposes? Med Educ 2002;36:899-900.
8. Koretz D, Stecher B, Klein S, McCaffrey D. The Vermont Portfolio Assessment Program: findings and implications. Educational Measurement: Issues Pract 1994;13 (3):5-16.
9. van der Vleuten CPM, van Luijk SJ, Ballegooijen AMJ, Swanson DB. Training and experience of medical examiners. Med Educ 1989;22:290-6.
10. Norman GR, van der Vleuten CPM, De Graaff E. Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability. Med Educ 1991;25:119-26.
11. Huot B. Beyond the classroom: using portfolios to assess writing. In: Black L, Daiker DA, Sommers J, Stygall G, eds. New Directions in Portfolio Assessment. Reflection, Practice, Critical Theory and Large-scale Scoring. Portsmouth, New Hampshire: Cook Publishers 1994;325-33.
12. van der Vleuten CPM, Norman GR, De Graaff E. Pitfalls in the pursuit of objectivity: issues of reliability. Med Educ 1991;25:110-8.
13. Lincoln YS, Guba EA, eds. Naturalistic Inquiry. Beverly Hills, California: Sage 1985.
14. Denzin NK, Lincoln YS, eds. Handbook of Qualitative Research. 2nd edn. Thousand Oaks, California: Sage 2000.
15. Webb CER, Gray M, Jasper M, McMullan M, Scholes J. Evaluating portfolio assessment systems: what are the appropriate criteria? Nurse Educ Today 2003;23:600-9.
16. Norcini JJ, Shea JA. The credibility and comparability of standards. Appl Measurement Educ 1997;10 (1):39-59.
17. Driessen EW, van Tartwijk J, Vermunt JD, van der Vleuten CPM. Use of portfolios in early undergraduate medical training. Med Teacher 2003;25 (1):18-23.
18. Driessen EW, van der Vleuten CPM. Matching student assessment to problem-based learning: lessons from experience in a law faculty. Studies Cont Educ 2000;22 (2):235-48.
19. Zeichner K, Wray S. The teaching portfolio in US teacher education programmes: what we know and what we need to know. Teaching Teacher Educ 2001;17 (5):613-21.
20. Strauss AL. Qualitative Analysis for Social Scientists. New York: Cambridge University Press 1987.