Estimating and comparing the reliability of a suite of workplace-based assessments: An obstetrics and gynaecology setting

Medical Teacher

Volumn 35, Issue 8, 2013, Pages 684-691

  Homer, Matt ^a   Setna, Zeryab ^b   Jha, Vikram ^c   Higham, Jenny ^d   Roberts, Trudie ^a   Boursicot, Katherine ^e  

^a UNIVERSITY OF LEEDS   (United Kingdom)

^b Lady Dufferin Hospital   (Pakistan)

^c UNIVERSITY OF LIVERPOOL   (United Kingdom)

^d IMPERIAL COLLEGE LONDON   (United Kingdom)

^e ST GEORGE'S UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANAMNESIS; CLINICAL COMPETENCE; DECISION MAKING; EDUCATION; GYNECOLOGY; HUMAN; INTERPERSONAL COMMUNICATION; MEDICAL EDUCATION; OBSTETRICS; PHYSICAL EXAMINATION; PROCEDURES; REPRODUCIBILITY; RETROSPECTIVE STUDY; STANDARDS; WORKPLACE; ARTICLE; METHODOLOGY; STANDARD;

CLINICAL COMPETENCE; COMMUNICATION; DECISION MAKING; EDUCATION, MEDICAL, GRADUATE; EDUCATIONAL MEASUREMENT; GYNECOLOGY; HUMANS; MEDICAL HISTORY TAKING; OBSTETRICS; PHYSICAL EXAMINATION; REPRODUCIBILITY OF RESULTS; RETROSPECTIVE STUDIES; WORKPLACE;

EID: 84881040164     PISSN: 0142159X     EISSN: 1466187X     Source Type: Journal    
DOI: 10.3109/0142159X.2013.801548     Document Type: Article

References (22)

1. Aggarwal R, Grantcharov T, Moorthy K, Milland T, Papasavas P, Dosis A, Bello F, Darzi A. 2007. An Evaluation of the Feasibility, Validity, and Reliability of Laparoscopic Skills Assessment in the Operating Room. Ann Surg 245(6): 992-999.
2. Alves de Lima A, Barrero C, Baratta S, Castillo Costa Y, Bortman G, Carabajales J, Conde D, Galli A, Degrange G, Van der Vleuten Cees. 2007. Validity, reliability, feasibility and satisfaction of the Mini-Clinical Evaluation Exercise (Mini-CEX) for cardiology residency training. Med Teach 29(8): 785-790.
3. Brennan RL. 2001. Generalizability Theory. 1st ed. New York: Springer.
4. Crossley J, Davies H, Humphris G, Jolly B. 2002. Generalisability: A key to unlock professional assessment. Med Educ 36(10): 972-978.
5. Crossley J, Johnson G, Booth J, Wade W. 2011. Good questions, good answers: Construct alignment improves the performance of workplacebased assessment scales. Med Educ 45(6): 560-569.
6. Crossley J, Jolly B. 2012. Making sense of work-based assessment: Ask the right questions, in the right way, about the right things, of the right people. Med Educ 46(1): 28-37.
7. Goldstein H. 1995. Multilevel statistical models. 3rd ed. London: Arnold.
8. Govaerts MJ, Schuwirth LW, Van der Vleuten CP, Muijtjens AM. 2010. Workplace-based assessment: Effects of rater expertise. Adv Health Sci Educ Theory Pract 16(2): 151-165.
9. Govaerts MJ, van der Vleuten CP, Schuwirth LW, Muijtjens AM. 2007. Broadening perspectives on clinical performance assessment: Rethinking the nature of in-training assessment. Adv Health Sci Educ Theory Pract 12(2): 239-260.
10. Hatala R, Ainslie M, Kassen BO, Mackie I, Roberts JM. 2006. Assessing the mini-Clinical Evaluation Exercise in comparison to a national specialty examination. Med Educ 40(10): 950-956.
11. Heijne-penninga M, Kuks J, Schönrock-adema J, Snijders T, Cohenschotanus J. 2008. Open-book Tests to Complement Assessmentprogrammes: Analysis of Open and Closed-book Tests. Adv Health Sci Educ Theory Pract 13(3): 263-273.
12. Hox JJ. 2002. Multilevel analysis: Techniques and applications. Mahwah, NJ: Lawrence Erlbaum Associates.
13. van Lohuizen MT, Kuks JB, van Hell EA, Raat AN, Stewart RE, Cohen- Schotanus J. 2010. The reliability of in-training assessment when performance improvement is taken into account. Adv Health Sci Educ Theory Pract 15(5): 659-669.
14. Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M. 1997. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84(2): 273-278.
15. Norcini J. 2005. The Mini Clinical Evaluation Exercise (mini-CEX). Clin Teach 2(1): 25-30.
16. Norcini J, Blank LL, Duffy FD, Fortna GS. 2003. The Mini-CEX: A Method for Assessing Clinical Skills. Ann Intern Med 138(6): 476-481.
17. Norcini J, Burch V. 2007. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach 29(9): 855-871.
18. Rasbash J, Charlton C, Browne W, Healy M, Cameron B. 2009. MLwiN version 2.1. Centre for Multilevel Modelling, University of Bristol.
19. Setna Z, Jha V, Boursicot KAM, Roberts TE. 2010. Evaluating the utility of workplace-based assessment tools for speciality training. Best Pract Res Clin Obstet Gynaecol 24(6): 767-782.
20. Sultana CJ. 2006. The Objective Structured Assessment of Technical Skills and the ACGME Competencies. Obstet Gynecol Clin North Am 33(2): 259-265.
21. van der Vleuten C. 1996. The assessment of professional competence: Developments, research and practical implications. Adv Health Sci Educ Theory Pract 1(1): 41-67.
22. Wilkinson JR, Crossley JGM, Wragg A, Mills P, Cowan G, Wade W. 2008. Implementing workplace-based assessment across the medical specialties in the United Kingdom. Med Educ 42(4): 364-373.