Queen's simulation assessment tool: Development and validation of an assessment tool for resuscitation objective structured clinical examination stations in emergency medicine

Simulation in Healthcare

Volumn 10, Issue 2, 2015, Pages 98-105

  Hall, Andrew Koch ^a   Dagnone, Jeffrey Damon ^a   Lacroix, Lauren ^c   Pickett, William ^a   Klinger, Don Albert ^b  

^a KINGSTON GENERAL HOSPITAL   (Canada)

^b QUEEN S UNIVERSITY   (Canada)

^c UNIVERSITY OF OTTAWA   (Canada)

Author keywords

Assessment; Emergency medicine; Manikins; Medical education; Resuscitation; Simulation

Indexed keywords

CLINICAL COMPETENCE; EDUCATION; EMERGENCY MEDICINE; HUMAN; MEDICAL EDUCATION; OBSERVER VARIATION; PROCEDURES; REPRODUCIBILITY; RESUSCITATION; SIMULATION TRAINING; STANDARDS;

CLINICAL COMPETENCE; EDUCATION, MEDICAL; EDUCATIONAL MEASUREMENT; EMERGENCY MEDICINE; HUMANS; INTERNSHIP AND RESIDENCY; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS; RESUSCITATION; SIMULATION TRAINING;

EID: 84927937085     PISSN: 15592332     EISSN: 1559713X     Source Type: Journal    
DOI: 10.1097/SIH.0000000000000076     Document Type: Article

References (37)

1. McLaughlin S, Fitch MT, Goyal DG, et al.; SAEM Technology in Medical Education Committee and the Simulation Interest, Group. Simulation in graduate medical education 2008: a review for emergency medicine. Acad Emerg Med 2008;15:1117-1129.
2. Hamstra SJ. Keynote address: the focus on competencies and individual learner assessment as emerging themes in medical education research. Acad Emerg Med 2012;19:1336-1343.
3. Steadman RH, Huang YM. Simulation for quality assurance in training, credentialing and maintenance of certification. Best Pract Res Clin Anaesthesiol 2012;26:3-15.
4. The Association of Faculties of Medicine of Canada. The Future of Medical Education in Canada: A Collective Vision for Postgraduate Medical Education. 2012. http://www.afmc.ca/future-of-medicaleducation-in-canada/postgraduate-project/pdf/FMEC-PG-Final-Report-EN.pdf. Accessed on May 14, 2014.
5. Amin Z, Boulet JR, Cook DA, et al. Technology-enabled assessment of health professions education: consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach 2011;33:364-369.
6. Boursicot K, Etheridge L, Setna Z, et al. Performance in assessment: consensus statement and recommendations from the Ottawa conference. Med Teach 2011;33:370-383.
7. Spillane L, Hayden E, Fernandez R, et al. The assessment of individual cognitive expertise and clinical competency: a research agenda. Acad Emerg Med 2008;15:1071-1078.
8. Sherbino J, Bandiera G, Frank J. Assessing competence in emergency medicine trainees; an overview of effective methodologies. Can J Emerg Med 2008;10:365.
9. McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med 2011;86:706-711.
10. Berkenstadt H, Ziv A, Gafni N, Sidi A. Incorporating simulation-based objective structured clinical examination into the Israeli National Board Examination in Anesthesiology. Anesth Analg 2006;102:853-858.
11. Epstein RM. Assessment in medical education. N Engl J Med 2007;356:387-396.
12. McGaghieWC, Issenberg SB, Petrusa ER, Scalese RJ. A critical review of simulation-based medical education research: 2003-2009. Med Educ 2010;44:50-63.
13. Boulet JR, Murray DJ. Simulation-based assessment in anesthesiology: requirements for practical implementation. Anesthesiology 2010;112:1041-1052.
14. Cook DA, Brydges R, Zendejas B, Hamstra SJ, Hatala R. Technology-enhanced simulation to assess health professionals: a systematic review of validity evidence, research methods, and reporting quality. Acad Med 2013;88:872-883.
15. Hall AK, Pickett W, Dagnone JD. Development and evaluation of a simulation-based resuscitation scenario assessment tool for emergency medicine residents. CJEM 2012;14:139-146.
16. Regehr G, MacRae H, Reznick RK, Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 1998;73:993-997.
17. Messick S. In: Linn RL, ed. Validity, Educational Measurement. 3rd ed. New York: Macmillan; 1989:13-103.
18. Downing SM. Validity: on meaningful interpretation of assessment data. Med Educ 2003;37:830-837.
19. Fanning RM, Gaba DM. The role of debriefing in simulation-based learning. Simul Healthc 2007;2:115-125.
20. Andreatta PB, Gruppen LD. Conceptualising and classifying validity evidence for simulation. Med Educ 2009;43:1028-1035.
21. Crossley J, Davies H, Humphris G, Jolly B. Generalisability: a key to unlock professional assessment. Med Educ 2002;36:972-978.
22. Boursicot K, Roberts T, Burdick W. Structured assessments of clinical competence. In: Swanwick T. Understanding Medical Education. Evidence, Theory and Practice. Oxford: Wiley-Blackwell; 2010:246-258.
23. Adler MD, Trainor JL, Siddall VJ, McGaghie WC. Development and evaluation of high-fidelity simulation case scenarios for pediatric resident education. Ambul Pediatr 2007;7:182-186.
24. Brett-Fleegler MB, Vinci RJ, Weiner DL, Harris SK, Shih MC, Kleinman ME. A simulator-based tool that assesses pediatric resident resuscitation competency. Pediatrics 2008;121:e597Ye603.
25. Morgan PJ, Cleave-Hogg DM, Guest CB, Herold J. Validity and reliability of undergraduate performance assessments in an anesthesia simulator. Can J Anaesth 2001;48:225-233.
26. Murray DJ, Boulet JR, Avidan M, et al. Performance of residents and anesthesiologists in a simulation-based skill assessment. Anesthesiology 2007;107:705-713.
27. Weller JM, Bloch M, Young S, et al. Evaluation of high fidelity patient simulator in assessment of performance of anaesthetists. Br J Anaesth 2003;90:43-47.
28. Adler MD, Vozenilek JA, Trainor JL, et al. Comparison of checklist and anchored global rating instruments for performance rating of simulated pediatric emergencies. Simul Healthc 2011;6:18-24.
29. McKay A, Walker ST, Brett SJ, Vincent C, Sevdalis N. Team performance in resuscitation teams: comparison and critique of two recently developed scoring tools. Resuscitation 2012;83:1478-1483.
30. Walker S, Brett S, McKay A, Lambden S, Vincent C, Sevdalis N. Observational Skill-based Clinical Assessment tool for Resuscitation (OSCAR): development and validation. Resuscitation 2011;82:835-844.
31. Andersen PO, Jensen MK, Lippert A, Ostergaard D, Klausen TW. Development of a formative assessment tool for measurement of performance in multi-professional resuscitation teams. Resuscitation 2010;81:703-711.
32. Neira VM, Bould MD, Nakajima A, et al. "GIOSAT": a tool to assess CanMEDS competencies during simulated crises. Can J Anaesth 2013;60:280-289.
33. McEvoy MD, Smalley JC, Nietert PJ, et al. Validation of a detailed scoring checklist for use during advanced cardiac life support certification. Simul Healthc 2012;7:222-235.
34. Napier F, Davies RP, Baldock C, et al. Validation for a scoring system of the ALS cardiac arrest simulation test (CASTest). Resuscitation 2009;80:1034-1038.
35. Donoghue A, Nishisaki A, Sutton R, Hales R, Boulet J. Reliability and validity of a scoring instrument for clinical performance during Pediatric Advanced Life Support simulation scenarios. Resuscitation 2010;81:331-336.
36. Rovamo L, Mattila MM, Andersson S, Rosenberg P. Assessment of newborn resuscitation skills of physicians with a simulator manikin. Arch Dis Child Fetal Neonatal Ed 2011;96:F383YF389.
37. Rosen MA, Salas E, Silvestri S, Wu TS, Lazzara EH. A measurement tool for simulation-based training in emergency medicine: the simulation module for assessment of resident targeted event responses (SMARTER) approach. Simul Healthc 2008;3:170-179.