A new way to look at simulation-based assessment: The relationship between gaze-tracking and exam performance

Canadian Journal of Emergency Medicine

Volumn 21, Issue 1, 2019, Pages 129-137

  Szulewski, Adam ^a   Egan, Rylan ^a   Gegenfurtner, Andreas ^b   Howes, Daniel ^a   Dashi, Gerhard ^a   McGraw, Nick C J ^c   Hall, Andrew K ^a   Dagnone, Damon ^a   Van Merrienboer, Jeroen J G ^d  

^a QUEEN S UNIVERSITY   (Canada)

^b DEGGENDORF INSTITUTE OF TECHNOLOGY   (Germany)

^c UNIVERSITY OF TORONTO   (Canada)

^d MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Assessment; Emergency medicine; Gaze tracking; Medical education; Simulation

Indexed keywords

ABDOMINAL AORTIC ANEURYSM; ADULT; ARTICLE; BRADYCARDIA; CLINICAL ASSESSMENT TOOL; CORRELATION COEFFICIENT; DIABETIC KETOACIDOSIS; EMERGENCY MEDICINE; FEMALE; GAZE TRACKING DATA; HUMAN; HUMAN EXPERIMENT; INTERRATER RELIABILITY; MALE; MENTAL PERFORMANCE; METABOLIC ACIDOSIS; NORMAL HUMAN; REGISTERED NURSE; RESPIRATORY THERAPIST; VIDEORECORDING; VISUAL DISCRIMINATION; CANADA; CLINICAL COMPETENCE; EDUCATION; EMERGENCY; MEDICAL EDUCATION; PROCEDURES; SIMULATION TRAINING;

ADULT; CANADA; CLINICAL COMPETENCE; EDUCATIONAL MEASUREMENT; EMERGENCIES; EMERGENCY MEDICINE; FEMALE; HUMANS; INTERNSHIP AND RESIDENCY; MALE; SIMULATION TRAINING;

EID: 85060658709     PISSN: 14818035     EISSN: 14818043     Source Type: Journal    
DOI: 10.1017/cem.2018.391     Document Type: Article

References (22)

1. Kim J, Neilipovitz D, Cardinal P, Chiu M, Clinch J. A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Crit Care Med 2006;34(8):2167-74.
2. Watkins SC, Roberts DA, Boulet JR, McEvoy MD, Weinger MB. Evaluation of a Simpler Tool to Assess Nontechnical Skills During Simulated Critical Events. Simul Healthc 2017;12(2):69-75.
3. Szulewski A, Howes D. Combining first-person video and gaze-tracking in medical simulation: a technical feasibility study. The Scientific World Journal. 2014;2014.
4. Ericsson KA, Krampe RT, Tesch-Römer C. The role of deliberate practice in the acquisition of expert performance. Psychol Rev 1993;100(3):363.
5. Kaufman DR, Arocha JF, Patel VL. Expertise and tacit knowledge in medicine. In: Tacit knowledge in professional practice (ed. Sternberg RJ,Horvath JA). Psychology Press; 1999: 89-114.
6. Szulewski A, Brindley P, Van Merrienboer JJ. Decisionmaking during medical crises. In: Brindley P, Cardinal P editors Crisis Resource Management in Acute Care Medicine, 1st ed. Ottawa: Royal College of Physicians and Surgeons Canada; 2017: 36-43.
7. Gaba DM, Howard SK, Fish KJ, Smith BE, Sowb YA. Simulation-based training in anesthesia crisis resource management (ACRM): a decade of experience. Simul Gaming 2001;32(2):175-93.
8. Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach 2005;27(1):10-28.
9. Helle L, Nivala M, Kronqvist P, et al. Traditional microscopy instruction versus process-oriented virtual microscopy instruction: a naturalistic experiment with control group. Diagn Pathol 2011;6(1 Suppl 1):S8.
10. Seppänen M, Gegenfurtner A. Seeing through a teacher's eyes improves students' imaging interpretation. Med Educ 2012;46(11):1113-4.
11. Gegenfurtner A, Quesada-Pallarès C, Knogler M. Digital simulation-based training: A meta-analysis. Br J Educ Technol 2014;45(6):1097-114.
12. Hall AK, Dagnone JD, Lacroix L, Pickett W, Klinger DA. Queen's simulation assessment tool: development and validation of an assessment tool for resuscitation objective structured clinical examination stations in emergency medicine. Simul Healthc 2015;10(2):98-105.
13. Cook DA, Brydges R, Zendejas B, Hamstra SJ, Hatala R. Technology-enhanced simulation to assess health professionals: a systematic review of validity evidence, research methods, and reporting quality. Acad Med 2013; 88(6):872-83.
14. Bick JS, Demaria S Jr, Kennedy JD, et al. Comparison of expert and novice performance of a simulated transesophageal echocardiography examination. Simul Healthc 2013;8(5):329-34.
15. Henneman EA, Marquard JL, Fisher DL, Gawlinski A. Eye tracking: a novel approach for evaluating and improving the safety of healthcare processes in the simulated setting. Simu Healthc 2017;12(1):51-6.
16. Szulewski A, Roth N, Howes D. The use of task-evoked pupillary response as an objective measure of cognitive load in novices and trained physicians: a new tool for the assessment of expertise. Acad Med 2015;90(7):981-7.
17. Gegenfurtner A, Lehtinen E, Säljö R. Expertise differences in the comprehension of visualizations: A meta-analysis of eye-tracking research in professional domains. Educ Psychol Rev 2011;23(4):523-52.
18. Szulewski A, Gegenfurtner A, Howes DW, Sivilotti ML, van Merriënboer JJ. Measuring physician cognitive load: validity evidence for a physiologic and a psychometric tool. Adv Health Sci Educ Theory Pract 2017;22(4):951-68.
19. Gegenfurtner A, Kok E, van Geel K, et al. The challenges of studying visual expertise in medical image diagnosis. Med Educ 2017 Jan51(1):97-104.
20. Haider H, Frensch PA. Eye movement during skill acquisition: more evidence for the information-reduction hypothesis. J Exp Psychol Learn Mem Cogn 1999;25(1):172.
21. Kok EM, de Bruin AB, Robben SG, van Merriënboer JJ. Looking in the same manner but seeing it differently: bottom-up and expertise effects in radiology. Appl Cogn Psychol 2012;26(6):854-62.
22. Haider H, Frensch PA. The role of information reduction in skill acquisition. Cogn Psychol 1996;30(3):304-37.