Measuring cognitive load: Performance, mental effort and simulation task complexity

Medical Education

Volumn 49, Issue 8, 2015, Pages 815-827

  Haji, Faizal A ^a,b,c   Rojas, David ^a,b   Childs, Ruth ^d   de Ribaupierre, Sandrine ^c   Dubrowski, Adam ^e  

^a UNIVERSITY OF TORONTO   (Canada)

^b HOSPITAL FOR SICK CHILDREN   (Canada)

^c UNIVERSITY OF WESTERN ONTARIO   (Canada)

^d UNIVERSITY OF TORONTO   (Canada)

^e MEMORIAL UNIVERSITY OF NEWFOUNDLAND   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; CANADA; COGNITION; CONTROLLED STUDY; EDUCATION; FEMALE; GENERAL SURGERY; HUMAN; MALE; MEDICAL STUDENT; PROCEDURES; PROSPECTIVE STUDY; PSYCHOLOGICAL THEORY; RANDOMIZED CONTROLLED TRIAL; SIMULATION TRAINING; TASK PERFORMANCE; TEACHING;

ADULT; COGNITION; COMPUTER-ASSISTED INSTRUCTION; FEMALE; GENERAL SURGERY; HUMANS; MALE; ONTARIO; PROSPECTIVE STUDIES; PSYCHOLOGICAL THEORY; SIMULATION TRAINING; STUDENTS, MEDICAL; TASK PERFORMANCE AND ANALYSIS;

EID: 84935434784     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/medu.12773     Document Type: Article

References (63)

1. Haji FA, Hoppe DJ, Morin M-P, Giannoulakis K, Koh J, Rojas D, Cheung JJ. What we call what we do affects how we do it: a new nomenclature for simulation research in medical education. Adv Health Sci Educ Theory Pract 2014;19 (2):273-80.
2. Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, Erwin PJ, Hamstra SJ. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA 2011;306 (9):978-88.
3. McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? a meta-analytic comparative review of the evidence. Acad Med 2011;86 (6):706-11.
4. Nestel DD, Groom JJ, Eikeland-Husebø SS, O'Donnell JMJ. Simulation for learning and teaching procedural skills: the state of the science. Simul Healthc 2011;6 (7 Suppl):10-3.
5. Stefanidis D, Scerbo MW, Korndorffer JR Jr, Scott DJ. Redefining simulator proficiency using automaticity theory. Am J Surg 2007;193 (4):502-6.
6. Stefanidis D, Korndorffer JR, Markley S, Sierra R, Heniford BT, Scott DJ. Closing the gap in operative performance between novices and experts: does harder mean better for laparoscopic simulator training? J Am Coll Surg 2007;205 (2):307-13.
7. Gurusamy K, Aggarwal R, Palanivelu L, Davidson BR. Systematic review of randomised controlled trials on the effectiveness of virtual reality training for laparoscopic surgery. Br J Surg 2008;95:1088-97.
8. Teteris E, Fraser K, Wright B, McLaughlin K. Does training learners on simulators benefit real patients? Adv Health Sci Educ Theory Pract 2012;17 (1):137-44.
9. Cook DA, Bordage G, Schmidt HG. Description, justification and clarification: a framework for classifying the purposes of research in medical education. Med Educ 2008;42:128-33.
10. Cook DA, Hamstra SJ, Brydges R, Zendejas B, Szostek JH, Wang AT, Erwin PJ, Hatala R. Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med Teach 2013;35 (1):e844-75.
11. Issenberg SB, Ringsted C, Østergaard D, Dieckmann P. Setting a research agenda for simulation-based healthcare education. Simul Healthc 2011;6 (3):155-67.
12. Dieckmann PP, Phero JCJ, Issenberg SBS, Kardong-Edgren SS, Østergaard DD, Ringsted CC. The first Research Consensus Summit of the Society for Simulation in Healthcare: conduction and a synthesis of the results. Simul Healthc 2011;6 (Suppl):1-9.
13. Haji FA, Da Silva C, Daigle DT, Dubrowski A. From bricks to buildings: adapting the medical research council framework to develop programmes of research in simulation education and training for the health professions. Simul Healthc 2014;9 (4):249-59.
14. Sweller J. Cognitive load during problem solving: effects on learning. Cogn Sci 1988;12 (2):257-85.
15. van Merriënboer JJG, Sweller J. Cognitive load theory in health professional education: design principles and strategies. Med Educ 2010;44:85-93.
16. Miller GA. The magical number seven plus or minus two: some limits on our capacity for processing information. Psychol Rev 1956;63 (2):81-97.
17. Cowan N. Working memory underpins cognitive development, learning, and education. Educ Psychol Rev 2014;26 (2):197-223.
18. Young JQ, van Merriënboer J, Durning S, ten Cate O. Cognitive load theory: implications for medical education: AMEE Guide No. 86. Med Teach 2014;36 (5):371-84.
19. Sweller J, van Merriënboer JJG, Paas FGWC. Cognitive architecture and instructional design. Educ Psychol Rev 1998;10 (3):251-96.
20. Paas F, Tuovinen JE, Tabbers H, van Gerven PWM. Cognitive load measurement as a means to advance cognitive load theory. Educ Psychol 2003;38 (1):63-71.
21. Sweller J. Element interactivity and intrinsic, extraneous, and germane cognitive load. Educ Psychol Rev 2010;22 (2):123-38.
22. Schnotz W, Kürschner C. A reconsideration of cognitive load theory. Educ Psychol Rev 2007;19 (4):469-508.
23. Brunken R, Plass JL, Leutner D. Direct measurement of cognitive load in multimedia learning. Educ Psychol 2003;38 (1):53-61.
24. Paas FG, van Merriënboer JJ, Adam JJ. Measurement of cognitive load in instructional research. Percept Mot Skills 1994;79 (1 Pt 2):419-30.
25. Ayres P. Using subjective measures to detect variations of intrinsic cognitive load within problems. Learn Instr 2006;16 (5):389-400.
26. Naismith LM, Cheung JJH, Ringsted C, Cavalcanti RB. Limitations of subjective cognitive load measures in simulation-based procedural training. Med Educ 2015;49:805-814.
27. Naismith L, Hambaz S, Cavalcanti RB. How should we measure cognitive load in postgraduate simulation-based education? Med Educ 2014;48 (Suppl 1):128.
28. Haji FA, Khan R, Regehr G, Drake J, de Ribaupierre S, Dubrowski A. Measuring cognitive load during simulation-based psychomotor skills training: sensitivity of secondary-task performance and subjective ratings. Adv Health Sci Educ Theory Pract 2015; PMID: 25764154. [Epub ahead of print].
29. Rojas D, Haji F, Shewaga R, Kapralos B, Dubrowski A. The impact of secondary-task type on the sensitivity of reaction-time based measurement of cognitive load for novices learning surgical skills using simulation. Stud Health Technol Inform 2014;196:353-9.
30. Brydges R, Classen R, Larmer J, Xeroulis G, Dubrowski A. Computer-assisted assessment of one-handed knot tying skills performed within various contexts: a construct validity study. Am J Surg 2006;192 (1):109-13.
31. Choi HH, van Merriënboer J, Paas F. Effects of the physical environment on cognitive load and learning: towards a new model of cognitive load. Educ Psychol Rev 2014;26:225-44.
32. Jowett N, Leblanc V, Xeroulis G, MacRae H, Dubrowski A. Surgical skill acquisition with self-directed practice using computer-based video training. Am J Surg 2007;193 (2):237-42.
33. Paas FG. Training strategies for attaining transfer of problem-solving skill in statistics: a cognitive-load approach. J Educ Psychol 1992;84 (4):429.
34. Datta V, Mackay S, Mandalia M, Darzi A. The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. J Am Coll Surg 2001;193 (5):479-85.
35. Datta V, Chang A, Mackay S, Darzi A. The relationship between motion analysis and surgical technical assessments. Am J Surg 2002;184 (1):70-3.
36. Brunken R, Steinbacher S, Plass JL, Leutner D. Assessment of cognitive load in multimedia learning using dual-task methodology. Exp Psychol 2002;49 (2):109-19.
37. Field A. Repeated-measures designs (GLM 4). Discovering Statistics Using spss, 3rd edn. London: Sage Publications 2009; 457-505.
38. Fitts P, Posner MI. Human Performance. Oxford: Brooks/Cole 1967.
39. Schmidt RA, Lee TD. Motor Control and Learning, 4th edn. Champaign, IL: Human Kinetics 2005.
40. Yurko YY, Scerbo MW, Prabhu AS, Acker CE, Stefanidis D. Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simul Healthc 2010;5 (5):267-71.
41. Stefanidis D, Scerbo MW, Sechrist C, Mostafavi A, Heniford BT. Do novices display automaticity during simulator training? Am J Surg 2008;195 (2):210-3.
42. Carswell C, Clarke D, Seales W. Assessing mental workload during laparoscopic surgery. Surg Innov 2005;12 (1):80-90.
43. Downing SM. Validity - on the meaningful interpretation of assessment data. Med Educ 2003;37:830-7.
44. Leppink J, Paas F, van der Vleuten CPM, van Gog T, van Merriënboer JJG. Development of an instrument for measuring different types of cognitive load. Behav Res Methods 2013;45 (4):1058-72.
45. Kulasegaram KM, Grierson LEM, Norman GR. The roles of deliberate practice and innate ability in developing expertise: evidence and implications. Med Educ 2013;47:979-89.
46. Dubrowski A, Park J, Moulton C-A, Larmer J, MacRae H. A comparison of single- and multiple-stage approaches to teaching laparoscopic suturing. Am J Surg 2007;193 (2):269-73.
47. de Jong T. Cognitive load theory, educational research, and instructional design: some food for thought. Instr Sci 2010;38 (2):105-34.
48. Gerjets P, Scheiter K, Cierniak G. The scientific value of cognitive load theory: a research agenda based on the structuralist view of theories. Educ Psychol Rev 2009;21 (1):43-54.
49. Verkoeijen PPJL, Tabbers HK. Good research requires productive theories and guidelines. Med Educ 2013;47:863-5.
50. Cierniak G, Scheiter K, Gerjets P. Explaining the split-attention effect: is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? Comput Human Behav 2009;25 (2):315-24.
51. Leppink J, Paas F, van Gog T, van der Vleuten CPM, van Merriënboer JJG. Effects of pairs of problems and examples on task performance and different types of cognitive load. Learn Instr 2014;30:32-42.
52. Kalyuga S. Cognitive load theory: how many types of load does it really need? Educ Psychol Rev 2011;23 (1):1-19.
53. Dubrowski A, Brydges R, Satterthwaite L, Xeroulis G, Classen R. Do not teach me while I am working!. Am J Surg 2012;203 (2):253-7.
54. Kurahashi AM, Harvey A, MacRae H, Moulton C-A, Dubrowski A. Technical skill training improves the ability to learn. Surgery 2011;149 (1):1-6.
55. Szulewski A, Roth N, Howes D. The use of task-evoked pupillary response as an objective measure of cognitive load in novices and trained physicians. Acad Med 2015; PMID: 25738386. [Epub ahead of print].
56. van Merriënboer JJG, Sweller J. Cognitive load theory and complex learning: recent developments and future directions. Educ Psychol Rev 2005;17 (2):147-77.
57. Fraser K, Ma I, Teteris E, Baxter H, Wright B, McLaughlin K. Emotion, cognitive load and learning outcomes during simulation training. Med Educ 2012;46:1055-62.
58. Tomasko JM, Pauli EM, Kunselman AR, Haluck RS. Sleep deprivation increases cognitive workload during simulated surgical tasks. Am J Surg 2012;203 (1):37-43.
59. Paas F, Sweller J. An evolutionary upgrade of cognitive load theory: using the human motor system and collaboration to support the learning of complex cognitive tasks. Educ Psychol Rev 2011;24 (1):27-45.
60. Maxwell JP, Masters RSW, Eves FF. The role of working memory in motor learning and performance. Conscious Cogn 2003;12 (3):376-402.
61. Bannert M. Managing cognitive load - recent trends in cognitive load theory. Learn Instr 2002;12 (1):139-46.
62. Dubrowski A. Performance vs. learning curves: what is motor learning and how is it measured? Surg Endosc 2005;19 (9):1290.
63. Lee TD, Magill RA. Can forgetting facilitate skill acquisition? In: Goodman D, Wilberg RB, Franks IM, eds. Differing Perspectives in Motor Learning, Memory, and Control. Amsterdam: Elsevier Science 1985;3-22.