Measuring cognitive load: mixed results from a handover simulation for medical students

Perspectives on Medical Education

Volumn 5, Issue 1, 2016, Pages 24-32

  Young, John Q ^a   Irby, David M ^b   Barilla LaBarca, Maria Louise ^c   ten Cate, Olle ^d   O’Sullivan, Patricia S ^b  

^a ZUCKER HILLSIDE HOSPITAL   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c DONALD AND BARBARA ZUCKER SCHOOL OF MEDICINE AT HOFSTRA NORTHWELL   (United States)

^d UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

Author keywords

Cognitive Load; Cognitive Load Theory; Handover; Measurement; Validity

Indexed keywords

EID: 85026827147     PISSN: 22122761     EISSN: 2212277X     Source Type: Journal    
DOI: 10.1007/s40037-015-0240-6     Document Type: Article

References (45)

1. Horwitz LI, Moin T, Krumholz HM, Wang L, Bradley EH. Consequences of inadequate sign-out for patient care. Arch Intern Med. 2008;168:1755–60.
2. Starmer AJ, O’Toole JK, Rosenbluth G, et al. Development, implementation, and dissemination of the I-PASS handoff curriculum: a multisite educational intervention to improve patient handoffs. Acad Med. 2014;89:876–84.
3. Patterson ES, Roth EM, Woods DD, Chow R, Gomes JO. Handoff strategies in settings with high consequences for failure: lessons for health care operations. Int J Qual Health Care. 2004;16:125–32.
4. Wohlauer MV, Arora VM, Horwitz LI, et al. The patient handoff: a comprehensive curricular blueprint for resident education to improve continuity of care. Acad Med. 2012;87:411–8.
5. Starmer AJ, Spector ND, Srivastava R, et al. Changes in medical errors after implementation of a handoff program. N Engl J Med. 2014;371:1803–12.
6. Atkinson RC, Shiffrin RM. Human memory: a proposed system and its control processes. In: Kenneth WS, Janet Taylor S, editors. Psychology of learning and motivation. 2. New York: Academic Press; 1968. pp. 89–195.
7. Mayer RE. Applying the science of learning to medical education. Med Educ. 2010;44:543–9.
8. Baddeley A. Working memory: theories, models, and controversies. Annu Rev Psychol. 2012;63:1–29.
9. Sweller J. Cognitive load during problem solving: effects on learning. Cogn Sci. 1988;12:257–85.
10. Sweller J, Merrienboer JJG van. Cognitive Load Theory and Instructional Design for Medical Education. In: Walsh K, editor. The Oxford textbook of medical education. Oxford: Oxford University Press; 2013. pp. 74–85.
11. Cowan N. The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav Brain Sci. 2001;24:87–114. (discussion –85).
12. Sweller J, Merrienboer JJG van, Paas FGWC. Cognitive architecture and instructional design. Educ Psychol Rev. 1998;10:251–96.
13. Leppink J, Paas F, Gog T van, Vleuten CPM van der, Merrienboer JJG van. Effects of pairs of problems and examples on task performance and different types of cognitive load. Learn Instr. 2014;30:32–42.
14. Sweller J, Ayres PL, Kalyuga S. Cognitive load theory. New York: Springer; 2011. pp. xvi, 274.
15. Merriënboer JJG van, Sweller J. Cognitive load theory and complex learning: recent developments and future directions. Educ Psychol Rev. 2005;17:147–77.
16. DeLeeuw KE, Mayer RE. A comparison of three measures of cognitive load: evidence for separable measures of intrinsic, extraneous, and germane load. J Educ Psychol. 2008;100:223–34.
17. Ayres P. Using subjective measures to detect variations of intrinsic cognitive load within problems. Learn Instr. 2006;16:389–400.
18. Cierniak G, Scheiter K, Gerjets P. Explaining the split-attention effect: is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? Comput Human Behav. 2009;25:315–24.
19. Eysink TS, Jong T de, Berthold K, Kolloffel B, Opfermann M, Wouters P. Learner performance in multimedia learning arrangements: an analysis across instructional approaches. Am Educ Res J. 2009;46:1107–49.
20. Galy E, Cariou M, Mélan C. What is the relationship between mental workload factors and cognitive load types? Int J Psychophysiol. 2012;83:269–75.
21. Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock PA, Meshtaki N, editors. Human mental workload. Amsterdam: North-Holland; 1988. pp. 139–83.
22. Paas FG, Van Merrienboer JJ, Adam JJ. Measurement of cognitive load in instructional research. Percept Mot Skills. 1994;79(1 Pt 2):419–30.
23. Kluge A, Grauel B, Burkolter D. Combining principles of Cognitive Load Theory and diagnostic error analysis for designing job aids: effects on motivation and diagnostic performance in a process control task. Appl Ergon. 2013;44:285–96.
24. Debue N, Leemput C van de. What does germane load mean? An empirical contribution to the cognitive load theory. Front Psychol. 2014;5:1099.
25. Paas F, Tuovinen JE, Tabbers H, Van Gerven PWM. Cognitive load measurement as a means to advance cognitive load theory. Educ Psychol. 2003;38:63–71.
26. Haji FA, Rojas D, Childs R, Ribaupierre S de, Dubrowski A. Measuring cognitive load: performance, mental effort and simulation task complexity. Med Educ. 2015;49:815–27.
27. Naismith LM, Cheung JJH, Ringsted C, Cavalcanti RB. Limitations of subjective cognitive load measures in simulation-based procedural training. Med Educ. 2015;49:805–14.
28. Leppink J, Paas F, Van der Vleuten CP, Van Gog T, Van Merrienboer JJ. Development of an instrument for measuring different types of cognitive load. Behav Res Methods. 2013;45:1058–72.
29. Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): results of Empirical and Theoretical Research: Ames Research Center; 1988 [cited 2015 February 14]. https://archive.org/details/nasa_techdoc_20000004342.
30. Ginns P. Integrating information: a meta-analysis of the spatial contiguity and temporal contiguity effects. Learn Instr. 2006;16:511–25.
31. Kalyuga S, Chandler P, Sweller J. Levels of expertise and instructional design. Hum Factors. 1998;40:1–17.
32. Kester L, Kirschner PA, Van Merriënboer JJG. The management of cognitive load during complex cognitive skill acquisition by means of computer-simulated problem solving. Br J Educ Psychol. 2005;75:71–85.
33. Lafleur A, Côté L, Leppink J. Influences of OSCE design on students’ diagnostic reasoning. Med Educ. 2015;49:203–14.
34. Bergman E, Bruin A de, Vorstenbosch M, et al. Effects of learning content in context on knowledge acquisition and recall: a pretest-posttest control group design. BMC Med Educ. 2015;15:133.
35. Downing SM. Validity: on meaningful interpretation of assessment data. Med Educ. 2003;37:830–7.
36. Young JQ, Ten Cate O, O’Sullivan PS, Irby DM. Unpacking the complexity of patient handoffs through the lens of cognitive load theory. Teach Learn Med. (In Press).
37. Salomon G. Television is “easy” and print is “tough”: the differential investment of mental effort in learning as a function of perceptions and attributions. J Educ Psychol. 1984;76:647–58.
38. Artino AR Jr, La Rochelle JS, Dezee KJ, Gehlbach H. Developing questionnaires for educational research: AMEE Guide No. 87. Med Teach. 2014;36:463–74.
39. Paas FG. Training strategies for attaining transfer of problem-solving skill in statistics: a cognitive-load approach. J Educ Psychol. 1992;84:429–34.
40. Chu ES, Reid M, Schulz T, Burden M, et al. A structured handoff program for interns. Acad Med. 2009;84:347–52.
41. Tabachnick BG, Fidell LS. Using multivariate statistics. Boston: Pearson Education; 2013.
42. Schumacher DJ, Englander R, Carraccio C. Developing the master learner: applying learning theory to the learner, the teacher, and the learning environment. Acad Med. 2013;88:1635–45.
43. Arora VM, Berhie S, Horwitz LI, Saathoff M, Staisiunas P, Farnan JM. Using standardized videos to validate a measure of handoff quality: the handoff mini-clinical examination exercise. J Hosp Med. 2014;9:441–6.
44. Schnotz W, Kurschner C. A reconsideration of cognitive load theory. Educ Psychol Rev. 2007;19:469–508.
45. Kalyuga S. Cognitive load theory: how many types of load does it really need? Educ Psychol Rev. 2011;23:1–19.