Performance of a cognitive load inventory during simulated handoffs: Evidence for validity

SAGE Open Medicine

Volumn 4, Issue , 2016, Pages

  Young, John Q ^a   Boscardin, Christy K ^b   Van Dijk, Savannah M ^c   Abdullah, Ruqayyah ^a   Irby, David M ^b   Sewell, Justin L ^b   Ten Cate, Olle ^c   O’Sullivan, Patricia S ^b  

^a ZUCKER HILLSIDE HOSPITAL   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c Utrecht Stroke Center   (Netherlands)

Author keywords

Cognitive load; Handoffs; Measurement; Validity

Indexed keywords

ARTICLE; CLINICAL HANDOVER; COGNITION; CONFIRMATORY FACTOR ANALYSIS; EXERCISE; EXTRANEOUS LOAD; FEMALE; GERMANE LOAD; HUMAN; INTRINSIC LOAD; MAJOR CLINICAL STUDY; MALE; MEDICAL SCHOOL; PAAS COGNITIVE LOAD SCALE; PRIORITY JOURNAL; PSYCHOMETRY; SELF REPORT; SIMULATION; THEORETICAL MODEL; VALIDITY;

EID: 85147473567     PISSN: None     EISSN: 20503121     Source Type: Journal    
DOI: 10.1177/2050312116682254     Document Type: Article

References (39)

1. Horwitz LI, Moin T, Krumholz HM, et al. Consequences of inadequate sign-out for patient care. Arch Intern Med 2008; 168(16): 1755-1760.
2. Riesenberg LA, Leitzsch J, Massucci JL, et al. Residents’ and attending physicians’ handoffs: a systematic review of the literature. Acad Med 2009; 84(12): 1775-1787.
3. Starmer AJ, O’Toole JK, Rosenbluth G, et al. Development, implementation, and dissemination of the I-PASS handoff curriculum: a multisite educational intervention to improve patient handoffs. Acad Med 2014; 89(6): 876-884.
4. Patterson ES, Roth EM, Woods DD, et al. Handoff strategies in settings with high consequences for failure: lessons for health care operations. Int J Qual Health Care 2004; 16(2): 125-132.
5. Wohlauer MV, Arora VM, Horwitz LI, et al. The patient handoff: a comprehensive curricular blueprint for resident education to improve continuity of care. Acad Med 2012; 87(4): 411-418.
6. Starmer AJ, Spector ND, Srivastava R, et al. Changes in medical errors after implementation of a handoff program. N Engl J Med 2014; 371(19): 1803-1812.
7. Young JQ, Ten Cate O, O’Sullivan PS, et al. Unpacking the complexity of patient handoffs through the lens of cognitive load theory. Teach Learn Med 2016; 28(1): 88-96.
8. Sweller J. Cognitive load during problem solving: effects on learning. Cognitive Sci 1988; 12(2): 257-285.
9. Sweller J and van Merrienboer JJG. Cognitive load theory and instructional design for medical e. In: Walsh K (ed.) The Oxford textbook of medical education. Oxford: Oxford University Press, 2013, pp. 74-85.
10. Baddeley A. Working memory: theories, models, and controversies. Annu Rev Psychol 2012; 63: 1-29.
11. Cowan N. The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav Brain Sci 2001; 24(1): 87-114; discussion 114-185.
12. Young JQ, Van Merrienboer J, Durning S, et al. Cognitive Load Theory: implications for medical education: AMEE Guide No. 86. Med Teach 2014; 36(5): 371-384.
13. Sweller J, van Merrienboer JJG and Paas FGWC. Cognitive architecture and instructional design. Educ Psychol Rev 1998; 10(3): 251-296.
14. Leppink J, Paas F, van Gog T, et al. Effects of pairs of problems and examples on task performance and different types of cognitive load. Learn Instr 2014; 30: 32-42.
15. Sweller J, Ayres PL and Kalyuga S. Cognitive load theory. New York: Springer, 2011, p. xvi, p. 274.
16. Van Merriënboer JJG and Sweller J. Cognitive load theory and complex learning: recent developments and future directions. Educ Psychol Rev 2005; 17(2): 147-177.
17. De Leeuw KE and Mayer RE. A comparison of three measures of cognitive load: evidence for separable measures of intrinsic, extraneous, and germane load. J Educ Psychol 2008; 100(1): 223-234.
18. Paas FG. Training strategies for attaining transfer of problemsolving skill in statistics: a cognitive-load approach. J Educ Psychol 1992; 84(4): 429-434.
19. Cierniak G, Scheiter K and Gerjets P. Explaining the splitattention effect: is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? Comput Hum Behav 2009; 25(2): 315-324.
20. Haji FA, Rojas D, Childs R, et al. Measuring cognitive load: performance, mental effort and simulation task complexity. Med Educ 2015; 49(8): 815-827.
21. Naismith LM and Cavalcanti RB. Validity of cognitive load measures in simulation-based training: a systematic review. Acad Med 2015; 90(11 Suppl.): S24-S35.
22. Galy E, Cariou M and Mélan C. What is the relationship between mental workload factors and cognitive load types? Int J Psychophysiol 2012; 83(3): 269-275.
23. Paas F, Tuovinen JE, Tabbers H, et al. Cognitive load measurement as a means to advance cognitive load theory. Educ Psychol 2003; 38(1): 63-71.
24. Van Gog T and Paas F. Instructional efficiency: revisiting the original construct in educational research. Educ Psychol 2008; 43(1): 16-26.
25. Naismith LM, Cheung JJH, Ringsted C, et al. Limitations of subjective cognitive load measures in simulation-based procedural training. Med Educ 2015; 49(8): 805-814.
26. Hart SG and Staveland LE. Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock PA and Meshtaki N (eds) Human mental workload. Amsterdam: North-Holland, 1988, pp. 139-183.
27. Hart SG and Staveland LE. Development of NASA-TLX (Task Load Index): results of empirical and theoretical research: Ames Research Center, 1988, https://archive.org/details/nasa_ techdoc_20000004342
28. Leppink J, Paas F, Van der Vleuten CP, et al. Development of an instrument for measuring different types of cognitive load. Behav Res Methods 2013; 45(4): 1058-1072.
29. Sewell JL, Boscardin CK, Young JQ, et al. Measuring cognitive load during procedural skills training with colonoscopy as an exemplar. Med Educ 2016; 50(6): 682-692.
30. Young JQ, Irby DM, Barilla-LaBarca ML, et al. Measuring cognitive load: mixed results from a handover simulation for medical students. Perspect Med Educ 2016; 5: 24-32.
31. Kane MT. Current concerns in validity theory. J Educ Meas 2001; 38(4): 319-342.
32. Downing SM. Validity: on meaningful interpretation of assessment data. Med Educ 2003; 37(9): 830-837.
33. Choi H-H, Van Merriënboer JJG and Paas F. Effects of the physical environment on cognitive load and learning: towards a new model of cognitive load. Educ Psychol Rev 2014; 26(2): 225-244.
34. Young JQ, van Dijk SM, O’Sullivan PS, et al. Influence of learner knowledge and case complexity on handover accuracy and cognitive load: results from a simulation study. Med Educ 2016; 50(9): 969-978.
35. Muthen LK and Muthen BO. Mplus user’s guide. 7th ed. Los Angeles, CA: Muthen & Muthen, 2012
36. Hu L and Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling 1999; 6(1): 1-55.
37. Kalyuga S. Cognitive load theory: how many types of load does it really need? Educ Psychol Rev 2011; 23(1): 1-19.
38. Sweller J and Chandler P. Why some material is difficult to learn. Cognition Instruct 1994; 12(3): 185-233.
39. Young JQ, Wachter RM, Ten Cate O, et al. Advancing the next generation of handover research and practice with cognitive load theory. BMJ Qual Saf 2016; 25(2): 66-70.