Assessing the assessment in emergency care training

PLoS ONE

Volumn 9, Issue 12, 2014, Pages

  Dankbaar, Mary E W ^a   Stegers Jager, Karen M ^a   Baarveld, Frank ^b   Van Merrienboer, Jeroen J G ^d   Norman, Geoff R ^c   Rutten, Frans L ^b   Van Saase, Jan L C M ^a   Schuit, Stephanie C E ^a  

^a ERASMUS MEDICAL CENTER   (Netherlands)

^b Training institution for family practice SBOH   (Netherlands)

^c MCMASTER UNIVERSITY   (Canada)

^d MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

CHECKLIST; EMERGENCY CARE; HUMAN; SKILL; EDUCATION; EMERGENCY HEALTH SERVICE; MEDICAL EDUCATION; PROCEDURES; QUESTIONNAIRE; STANDARDS;

EDUCATION, MEDICAL, CONTINUING; EDUCATIONAL MEASUREMENT; EMERGENCY MEDICAL SERVICES; HUMANS; SURVEYS AND QUESTIONNAIRES;

EID: 84937466498     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0114663     Document Type: Article

References (37)

1. Perkins GD, Kimani PK, Bullock I, Clutton-brock T, Davies RP, et al. (2012) Improving the Efficiency of Advanced Life Support Training. Ann Intern Med 157(1).
2. Preston JL, Currey J, Eastwood GM (2009) Assessing advanced life support (ALS) competence: Victorian practices. Aust Crit Care Nov 22(4): 164-71.
3. Ringsted C, Lippert F, Hesselfeldt R, Rasmussen MB, Mogensen SS, et al. (2007) Assessment of Advanced Life Support competence when combining different test methods - Reliability and validity. Resuscitation 75: 153-60.
4. Napier F, Davies RP, Baldock C, Stevens H, Lockey AS, et al. (2009) Validation for a scoring system of the ALS cardiac arrest simulation test (CASTest). Resuscitation 9 Sep;80(9): 1034-8.
5. Perkins GD, Hulme J, Tweed MJ (2001) Variability in the assessment of advanced life support skills. Resuscitation Sep;50(3): 281-6.
6. Flowerdew L, Brown R, Vincent C, Woloshynowych M (2012) Development and validation of a tool to assess emergency physicians' nontechnical skills. Ann Emerg Med. Elsevier Inc. May;59(5): 376-85.e4.
7. Ringsted C, Østergaard D, Ravn L, Pedersen JA, Berlac PA, van der Vleuten CPM (2003) A feasibility study comparing checklists and global rating forms to assess resident performance in clinical skills. Med Teach Nov;25(6): 654-8.
8. Breedveld (2009) Rapportage werkgroep Kwaliteitsindeling SEH Spoedeisende hulp: Vanuit een stevige basis. http://www.veiligezorgiederszorg.nl/scrivo/asset.php?id5496020.
9. Schuwirth LWT, Van der Vleuten CPM (2011) General overview of the theories used in assessment: AMEE Guide No. 57. Med Teach. 33(57): 783-97.
10. Downing SM (2004) Reliability: on the reproducibility of assessment data. Med Educ.38: 1006-12.
11. Streiner David, Norman G (2008) Health measurement scales. Oxford University Press.
12. Cook DA, Zendejas B, Hamstra SJ, Hatala R, Brydges R. (2013) What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment. Adv Health Sci Educ Theory Pract. May 2.
13. McGraw K, Wong S (1996) Forming inferences about some intraclass correlations coefficients. Psychol Methods. 1(4): 390-390.
14. Bloch R, Norman G (2012) Generalizability theory for the perplexed: A practical introduction and guide: AMEE Guide No. 68. Med Teach. Jan;34(11): 960-92.
15. Schuwirth LWT, van der Vleuten CPM (2003) The use of clinical simulations in assessment. Med Educ. Nov;37 Suppl 1: 65-71.
16. Wass V, van der Vleuten CPM, Shatzer J, Jones R (2001) Medical education quartet. Assessment of clinical competence. 357: 945-9.
17. Reznick R, Regehr G, Yee G, Rothmann A, Blackmore D, et al. (1998) Process-rating forms versus task-specific checklists in an OSCE for medical licensure. Acad Med. 73(10): S97-9.
18. Regehr G, MacRae H, Reznick RK SD (1998) Comparing the psychometric properties of checklists and global rating scales for assessing performance of an OSCE-format examination. Acad Med. 73(9): 993- 8.
19. Cohen DS, Colliver JA, Marcy MS, Fried ED, Swartz MH (1996) Standard Setting; Psychometric proporties of a standardized-patient checklist and rating-scale form used to access interpersonal and communication skills. Acad Med. 71(1): S87-9.
20. Cohen DS, Colliver JA, Robbs RS, Swartz MH (1996) A large-scale study of the reliabilities of checklist scores and ratings of interpersonal and communication skills evaluated on a standardized-patient examination. Adv Health Sci Educ Theory Pract. Jan;1(3): 209-13.
21. Govaerts MJB, van der Vleuten CPM, Schuwirth LWT (2002) Optimising the reproducibility of a performance-based assessment test in midwifery education. Adv Health Sci Educ Theory Pract. Jan;7(2): 133-45.
22. Pell G, Fuller R, Homer M, Roberts T (2010) How to measure the quality of the OSCE: A review of metrics - AMEE guide no. 49. Med Teach. Jan;32(10): 802-11.
23. Patrício MF, Julião M, Fareleira F, Carneiro AV (2013) Is the OSCE a feasible tool to assess competencies in undergraduate medical education? Med Teach. 2013 Jun;35(6): 503-14.
24. Swanson DB, van der Vleuten CPM (2013) Assessment of clinical skills with standardized patients: state of the art revisited. Teach Learn Med. Jan;25 Suppl 1(December): S17-S25.
25. Hodges B, Regehr G, McNaughton N, Tiberius R, Hanson M (1999) OSCE checklists do not capture increasing levels of expertise. Acad Med. Oct;74(10): 1129-34.
26. Hodges B, Regehr G, Hanson M, McNaughton N (1998) Validation of an objective structured clinical examination in psychiatry. Acad Med. 73(8): 910-2.
27. House JB, Dooley-Hash S, Kowalenko T, Sikavitsas A, Seeyave DM, et al. (2012) Prospective comparison of live evaluation and video review in the evaluation of operator performance in a pediatric emergency airway simulation. J Grad Med Educ. Sep;4(3): 312-6.
28. Boulet JR, Murray D, Kras J, Woodhouse J, McAllister J, et al. (2003) Reliability and validity of a simulation-based acute care skills assessment for medical students and residents. Anesthesiology. Dec;99(6): 1270-80.
29. Norman G. Research In Medical Education: Three Decades Of Progress (2013) BMJ. 324(7353): 1560-2.
30. Elstein AS, Shulman LS, Sprafka S (1978) Medical Problem Solving: An Analysis of Clinical Reasoning. Cambridge MA: Harvard University Press.
31. Van Dalen J, Kerkhofs E, Verwijnen G, van Knippenberg-van den Berg B, van den Hout H, et al. (2002) Predicting communication skills with a paper-and-pencil test. Med Educ.Feb;36(2): 148-53.
32. Farmer EA, Hinchy J (2005) Assessing general practice clinical decision making skills. Aust Fam physician.034(12): 1059-61.
33. Hatala R, Norman GR (2002) Adapting the Key Features Examination for a clinical clerkship. Med Educ. Feb;36(2): 160-5.
34. Tamblyn R, Abrahamowicz M, Wenghofer E, Blackmore D, Winslade N (2013) CLINICIAN ' S CORNER Physician Scores on a National Clinical Skills Examination as Predictors of Complaints. JAMA. 298(9): 993-1001.
35. Wenghofer E, Klass D, Abrahamowicz M, Dauphinee D, Jacques A, et al. (2009) Doctor scores on national qualifying examinations predict quality of care in future practice. Med Educ. Dec;43(12): 1166- 73.
36. Ram P, van der Vleuten CPM, Rethans JJ, Schouten B, Hobma S, Grol R (1999) Assessment in general practice: the predictive value of written-knowledge tests and a multiple-station examination for actual medical performance in daily practice. Med Educ.1999 Mar;33(3): 197-203.
37. Van Der Vleuten CPM, Van Luyk SJ, Van Ballegooijen AMJ, Swanson D (1989) Training and experience of examiners. Med Educ. 23(3): 290-6.