Measuring physician cognitive load: validity evidence for a physiologic and a psychometric tool

Advances in Health Sciences Education

Volumn 22, Issue 4, 2017, Pages 951-968

  Szulewski, Adam ^a   Gegenfurtner, Andreas ^b   Howes, Daniel W ^a   Sivilotti, Marco L A ^c   van Merriënboer, Jeroen J G ^d  

^a QUEEN S UNIVERSITY   (Canada)

^b DEGGENDORF INSTITUTE OF TECHNOLOGY   (Germany)

^c KINGSTON GENERAL HOSPITAL   (Canada)

^d MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Cognitive load; Expertise; Eye tracking; Psychometrics; Pupillometry; Resuscitation; Validity

Indexed keywords

ARITHMETIC; CLINICAL ARTICLE; EYE TRACKING; HUMAN; INSTRUMENT VALIDATION; MEDICINE; MULTIPLE CHOICE TEST; PHYSICIAN; PSYCHOMETRY; PUPILLOMETRY; RESUSCITATION; VALIDITY; ADULT; COGNITION; EDUCATION; FEMALE; MALE; OCULOGRAPHY; PSYCHOLOGICAL THEORY; PSYCHOLOGY; REPRODUCIBILITY;

ADULT; COGNITION; EYE MOVEMENT MEASUREMENTS; FEMALE; HUMANS; MALE; PHYSICIANS; PSYCHOLOGICAL THEORY; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; RESUSCITATION;

EID: 84992724559     PISSN: 13824996     EISSN: 15731677     Source Type: Journal    
DOI: 10.1007/s10459-016-9725-2     Document Type: Article

References (37)

1. Ayres, P. (2006). Using subjective measures to detect variations of intrinsic cognitive load within problems. Learning and Instruction, 16(5), 389–400.
2. Beatty, J. (1982). Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin, 91(2), 276–292.
3. Brunken, R., Plass, J. L., & Leutner, D. (2003). Direct measurement of cognitive load in multimedia learning. Educational Psychologist, 38(1), 53–61.
4. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: L: Erlbaum.
5. Cook, D. A. (2015). Much ado about differences: Why expert-novice comparisons add little to the validity argument. Advances in Health Sciences Education, 20(3), 829–834.
6. Cook, D. A., & Beckman, T. J. (2006). Current concepts in validity and reliability for psychometric instruments: Theory and application. The American Journal of Medicine, 119(2), 166.e7–166.e16.
7. De Jong, T. (2010). Cognitive load theory, educational research, and instructional design: Some food for thought. Instructional Science, 38(2), 105–134.
8. Downing, S. M. (2003). Validity: On the meaningful interpretation of assessment data. Medical Education, 37(9), 830–837.
9. Ericsson, K. A., & Kintsch, W. (1995). Long-term working memory. Psychological Review, 102(2), 211.
10. Ericsson, K. A., Prietula, M. J., & Cokely, E. T. (2007). The making of an expert. Harvard Business Review, 85(7/8), 114.
11. Gegenfurtner, A., Kok, E., Van Geel, K., De Bruin, A., Jarodzka, H., Szulewski, A., & Van Merriënboer, J. J. G. (in press). The challenges of studying visual expertise in medical image diagnosis. Medical Education.
12. Gegenfurtner, A., Lehtinen, E., & Säljö, R. (2011). Expertise differences in the comprehension of visualizations: A meta-analysis of eye-tracking research in professional domains. Educational Psychology Review, 23(4), 523–552.
13. Gegenfurtner, A., & Seppänen, M. (2013). Transfer of expertise: An eye tracking and think aloud study using dynamic medical visualizations. Computers and Education, 63, 393–403.
14. Gegenfurtner, A., Siewiorek, A., Lehtinen, E., & Säljö, R. (2013). Assessing the quality of expertise differences in the comprehension of medical visualizations. Vocations and Learning, 6(1), 37–54.
15. Gegenfurtner, A., & Szulewski, A. (2016). Visual expertise and the Quiet Eye in sports – comment on Vickers. Current Issues in Sport Science, 1, 108. doi:10.15203/CISS_2016.108.
16. Hess, E. H. (1965). Attitude and pupil size. Scientific American, 212, 46–54.
17. Hess, E. H., & Polt, J. M. (1964). Pupil size in relation to mental activity during simple problem-solving. Science, 143(3611), 1190–1192.
18. Kahneman, D., & Beatty, J. (1966). Pupil diameter and load on memory. Science, 154(3756), 1583–1585.
19. Klingner, J., Kumar, R., & Hanrahan, P. (2008). Measuring the task-evoked pupillary response with a remote eye tracker. Paper presented at the Proceedings of the 2008 symposium on Eye tracking research and applications.
20. Klingner, J., Tversky, B., & Hanrahan, P. (2011). Effects of visual and verbal presentation on cognitive load in vigilance, memory, and arithmetic tasks. Psychophysiology, 48(3), 323–332.
21. Kok, E. M., Bruin, A. B., Robben, S. G., & Merriënboer, J. J. (2012). Looking in the same manner but seeing it differently: Bottom-up and expertise effects in radiology. Applied Cognitive Psychology, 26(6), 854–862.
22. Laeng, B., Sirois, S., & Gredebäck, G. (2012). Pupillometry a window to the preconscious? Perspectives on Psychological Science, 7(1), 18–27.
23. Laxmisan, A., Hakimzada, F., Sayan, O. R., Green, R. A., Zhang, J., & Patel, V. L. (2007). The multitasking clinician: Decision-making and cognitive demand during and after team handoffs in emergency care. International Journal of Medical Informatics, 76(11), 801–811.
24. Leppink, J., Paas, F., van Gog, T., van der Vleuten, C. P., & van Merriënboer, J. J. (2014). Effects of pairs of problems and examples on task performance and different types of cognitive load. Learning and Instruction, 30, 32–42.
25. Naismith, L. M., & Cavalcanti, R. B. (2015). Validity of cognitive load measures in simulation-based training: A systematic review. Academic Medicine, 90(11), S24–S35.
26. Naismith, L. M., Cheung, J. J., Ringsted, C., & Cavalcanti, R. B. (2015). Limitations of subjective cognitive load measures in simulation-based procedural training. Medical Education, 49(8), 805–814.
27. Norman, G. (2005). Research in clinical reasoning: Past history and current trends. Medical Education, 39(4), 418–427.
28. Paas, F. G. (1992). Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. Journal of Educational Psychology, 84(4), 429.
29. Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63–71.
30. Perry, S. J., Wears, R. L., Croskerry, P., & Shapiro, M. J. (2013). Process Improvement and Patient Safety. In J. Marx, R. Walls & R. Hockberger (Eds.), Rosen's Emergency Medicine - Concepts and Clinical Practice (8 Edn., Vol. 2, pp. 2505–2511). Philadelphia: Elsevier Health Sciences.
31. Schubert, C. C., Denmark, T. K., Crandall, B., Grome, A., & Pappas, J. (2013). Characterizing novice-expert differences in macrocognition: An exploratory study of cognitive work in the emergency department. Annals of Emergency Medicine, 61(1), 96–109.
32. Sweller, J. (2010). Element interactivity and intrinsic, extraneous, and germane cognitive load. Educational Psychology Review, 22(2), 123–138.
33. Sweller, J., Van Merrienboer, J. J. G., & Paas, F. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10(3), 251–296.
34. Szulewski, A., Fernando, S. M., Baylis, J., & Howes, D. (2014). Increasing pupil size is associated with increasing cognitive processing demands: A pilot study using a mobile eye-tracking device. Open Journal of Emergency Medicine, 2(1), 8–11.
35. Szulewski, A., Roth, N., & Howes, D. (2015). The use of task-evoked pupillary response as an objective measure of cognitive load in novices and trained physicians: A new tool for the assessment of expertise. Academic Medicine, 90(7), 981–987.
36. Tuovinen, J., & Paas, F. (2004). Exploring multidimensional approaches to the efficiency of instructional conditions. Instructional Science, 32(1–2), 133–152. doi:10.1023/B:TRUC.0000021813.24669.62.
37. Young, J. Q., Van Merrienboer, J., Durning, S., & Ten Cate, O. (2014). Cognitive load theory: Implications for medical education: AMEE guide no. 86. Medical Teacher, 36(5), 371–384.