Composite reliability of a workplace-based assessment toolbox for postgraduate medical education

Advances in Health Sciences Education

Volumn 18, Issue 5, 2013, Pages 1087-1102

  Moonen van Loon, J M W ^a   Overeem, K ^a   Donkers, H H L M ^a   van der Vleuten, C P M ^a   Driessen, E W ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Composite reliability; Generalisability theory; Graduate medical education; Portfolio; Workplace based assessments

Indexed keywords

ARTICLE; EDUCATION; FEMALE; HUMAN; MALE; MEDICAL EDUCATION; MEDICINE; METHODOLOGY; NETHERLANDS; REPRODUCIBILITY; STANDARD; WORKPLACE;

EDUCATION, MEDICAL, GRADUATE; EDUCATIONAL MEASUREMENT; FEMALE; HUMANS; INTERNSHIP AND RESIDENCY; MALE; MEDICINE; NETHERLANDS; REPRODUCIBILITY OF RESULTS; WORKPLACE;

EID: 84888027455     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10459-013-9450-z     Document Type: Article

References (26)

1. Ahmed, K., Miskovic, D., Darzi, A., Athanasiou, T., & Hanna, G. B. (2011). Observational tools for assessment of procedural skills: a systematic review. American Journal of Surgery, 202, 469-480.
2. Barton, J. R., Corbett, S., & van der Vleuten, C. P. M. (2012). The validity and reliability of a direct observation of procedural skills assessment tool: assessing colonoscopic skills of senior endoscopists. Gastrointestinal Endoscopy, 75, 591-597.
3. Brennan, R. L. (1983). Elements of generalizability theory. Iowa: American College Testing Program.
4. Brennan, R. L. (2001). Generalizability theory. New York: Springer.
5. Crossley, J., Davies, H., Humphris, B., & Jolly, G. (2002). Generalisability: A key to unlock professional assessment. Medical Education, 36, 972-978.
6. Crossley, J., Johnson, G., Booth, J., & Wade, W. (2011). Good questions, good answers: construct alignment improves the performance of workplace-based assessment scales. Medical Education, 45, 560-569.
7. Crossley, J., & Jolly, B. (2012). Making sense of work-based assessment: ask the right questions, in the right way, about the right things, of the right people. Medical Education, 46, 28-37.
8. Dijksterhuis, M. G., Voorhuis, M., Teunissen, P. W., Schuwirth, L. W., ten Cate, O. W., Braat, D. D., et al. (2009). Assessment of competence and progressive independence in postgraduate clinical training. Medical Education, 43, 1156-1165.
9. Donato, A. A., & George, D. L. (2012). A blueprint for implementation of a structured portfolio in an internal medicine residency. Academic Medicine, 87, 185-191.
10. Driessen, E. W., van Tartwijk, J., Teunissen, P. W., Govaerts, M., & van der Vleuten, C. P. M. (2012). The use of programmatic assessment in the clinical workplace: A Maastricht case report. Medical Teacher, 34, 226-231.
11. Hays, R. B., Fabb, W. E., & van der Vleuten, C. P. M. (1995). Reliability of the fellowship examination of the royal Australian college of general practitioners. Teaching and Learning in Medicine, 7, 43-50.
12. Kogan, J. R., Holmboe, E. S., & Hauer, K. S. (2009). Tools for direct observation and assessment of clinical skills of medical trainees: A systematic review. Journal of the American Medical Association, 302, 1316-1326.
13. McGill, D. A., van der Vleuten, C. P. M., & Clarke, M. J. (2011). Supervisor assessment of clinical and professional competence of medical trainees: a reliability study using workplace data and a focused analytical literature review. Advances in health sciences education theory and practice, 16, 405-425.
14. Miller, A., & Archer, J. (2010). Impact of workplace based assessment on doctors' education and performance: A systematic review. British Medical Journal, 341, c5064. doi: 10. 1136/bmj. c5064.
15. Norcini, J. J., Blank, L. L., Duffy, F. D., & Fortna, G. S. (2003). The mini-CEX: A method for assessing clinical skills. Annals of Internal Medicine, 138, 476-481.
16. Norcini, J., & Burch, V. (2007). Workplace-based assessment as an educational tool: AMEE guide no. 31. Medical Teacher, 29, 855-871.
17. Overeem, K., Lombarts, M. J. M. H., Arah, O. A., Klazinga, N. S., Grol, R. P. T. M., & Wollersheim, H. C. (2010). Three methods of multi-source feedback compared: A plea for narrative comments and coworkers' perspectives. Medical Teacher, 32, 141-147.
18. Pelgrim, E. A., Kramer, A. W., Mokkink, H. G., van den Elsen, L., Grol, R. P. T. M., & van der Vleuten, C. P. M. (2011). In-training assessment using direct observation of single-patient encounters: A literature review. Advances in health sciences education theory and practice, 16, 131-142.
19. Scheele, F., Teunissen, P. W., van Luijk, S. J., Heineman, E., Fluit, L., Mulder, H., et al. (2008). Introducing competency-based postgraduate medical education in the Netherlands. Medical Teacher, 30, 248-253.
20. Swanson, D. B. (1987). A measurement framework for performance-based tests. In I. Hart & R. Harden (Eds.), Further developments in assessing clinical competence (pp. 11-45). Montreal: Can-Heal publication.
21. Ten Cate, O., & Scheele, F. (2007). Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Academic Medicine, 82, 542-547.
22. Tochel, C., Beggs, K., Haig, A., Roberts, J., Scott, H., Walker, K., et al. (2011). Use of web based systems to support postgraduate medical education. Postgraduate Medical Journal, 87, 800-806.
23. van der Vleuten, C. P. M., Schuwirth, L. W., Scheele, F., Driessen, E. W., & Hodges, B. (2010). The assessment of professional competence: building blocks for theory development. Best Practice & Research. Clinical Obstetrics & Gynaecology, 24, 703-719.
24. Violato, C., Lockyer, J., & Fidler, H. (2003). Multisource feedback: A method of assessing surgical practice. British Medical Journal, 326, 546-548.
25. Weller, J. M., Jolly, B., Misur, M. P., Merry, A. F., Jones, A., Crossley, J. G., et al. (2009). Mini-clinical evaluation exercise in anaesthesia training. British Journal of Anaesthesia, 102, 633-641.
26. Wilkinson, J. R., Crossley, J. G., Wragg, A., Mills, P., Cowan, G., & Wade, W. (2008). Implementing workplace-based assessment across the medical specialties in the United Kingdom. Medical Education, 42, 364-373.