Medical students' cognitive load in volumetric image interpretation: Insights from human-computer interaction and eye movements

Computers in Human Behavior

Volumn 62, Issue , 2016, Pages 394-403

  Stuijfzand, Bobby G ^a,d   Van Der Schaaf, Marieke F ^a   Kirschner, Femke C ^a   Ravesloot, Cécile J ^b   Van Der Gijp, Anouk ^b   Vincken, Koen L ^c  

^a UTRECHT UNIVERSITY   (Netherlands)

^b UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^c UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^d UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Cognitive load; Eye tracking; Human computer interaction; Medical education; Volumetric image interpretation

Indexed keywords

CURRICULA; EDUCATION; EDUCATION COMPUTING; EYE MOVEMENTS; IMAGE ANALYSIS; MEDICAL EDUCATION; MEDICAL IMAGING; STUDENTS;

COGNITIVE LOADS; COMPREHENSIVE MEASUREMENT; EDUCATION CURRICULUMS; EYE-TRACKING; IMAGE INTERPRETATION; MULTI-LEVEL ANALYSIS; STRUCTURAL EQUATION MODELLING; VOLUMETRIC IMAGES;

HUMAN COMPUTER INTERACTION;

EID: 84963705524     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2016.04.015     Document Type: Article

References (63)

1. K.P. Andriole, J.M. Wolfe, R. Khorasani, S.T. Treves, D.J. Getty, and F.L. Jacobson S.E. Seltzer Optimizing analysis, visualization, and navigation of large image data sets: one 5000-section CT scan can ruin your whole day Radiology 259 2 2011 346 362 http://doi.org/10.1148/radiol.11091276
2. P.D. Antonenko, and D.S. Niederhauser The influence of leads on cognitive load and learning in a hypertext environment Computers in Human Behavior 26 2 2010 140 150 http://doi.org/10.1016/j.chb.2009.10.014
3. P.D. Antonenko, F. Paas, R. Grabner, and T. van Gog Using electroencephalography to measure cognitive load Educational Psychology Review 22 4 2010 425 438 http://doi.org/10.1007/s10648-010-9130-y
4. B.P. Bailey, and S.T. Iqbal Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management ACM Transactions on Computer-Human Interaction (TOCHI) 14 4 2008 1 28 http://doi.org/10.1145/1314683.1314689
5. R. Brünken, J.L. Plass, and D. Leutner Direct measurement of cognitive load in multimedia learning Educational Psychologist 38 1 2003 53 61 http://doi.org/10.1207/S15326985EP3801-7
6. R. Brünken, S. Steinbacher, W. Schnotz, J.L. Plass, and D. Leutner Assessment of cognitive load in multimedia learning using dual-task methodology Experimental Psychology 49 2 2002 109 119 http://doi.org/10.1027//1618-3169.49.2.109
7. B.M. Byrne Structural equation modeling with MPlus. Basic concepts, applications, and programming 2012 Routledge New York, NY
8. S. Chen, and J. Epps Automatic classification of eye activity for cognitive load measurement with emotion interference Computer Methods and Programs in Biomedicine 110 2 2013 111 124 http://doi.org/10.1016/j.cmpb.2012.10.021
9. M.T.H. Chi, R. Glaser, and E. Rees Expertise in problem solving R. Sternberg, Advances in the psychology of human intelligence 1982 Erlbaum Hillsdale, NJ 7 75
10. T. Clarke, P. Ayres, and J. Sweller The impact of sequencing and prior knowledge on learning mathematics through spreadsheet applications Educational Technology Research and Development 53 3 2005 15 24 http://doi.org/10.1007/BF02504794
11. M. Corbetta, and G.L. Shulman Control of goal-directed and stimulus-driven attention in the brain Nature Reviews Neuroscience 3 3 2002 201 215 http://doi.org/10.1038/nrn755
12. J.W. De Fockert, G. Rees, C.D. Frith, and N. Lavie The role of working memory in visual selective attention Science 291 5509 2001 1803 1806 http://doi.org/10.1126/science.1056496
13. K.E. DeLeeuw, and R.E. Mayer A comparison of three measures of cognitive load: evidence for separable measures of intrinsic, extraneous, and germane load Journal of Educational Psychology 100 1 2008 223 234 http://doi.org/10.1037/0022-0663.100.1.223
14. J.J. Donald, and S.A. Barnard Common patterns in 558 diagnostic radiology errors Journal of Medical Imaging and Radiation Oncology 56 2 2012 173 178 http://doi.org/10.1111/j.1754-9485.2012.02348.x
15. S.M. Ellis, X. Hu, L. Dempere-Marco, G.Z. Yang, A.U. Wells, and D.M. Hansell Thin-section CT of the lungs: eye-tracking analysis of the visual approach to reading tiled and stacked display formats European Journal of Radiology 59 2 2006 257 264 http://doi.org/10.1016/j.ejrad.2006.05.006
16. K.W. Eva, G.R. Norman, A.J. Neville, T.J. Wood, and L.R. Brooks Expert/novice differences in memory: a reformulation Teaching and Learning in Medicine 14 4 2002 257 263 http://doi.org/10.1207/S15328015TLM1404-10
17. A. Evers, W. Lucassen, R. Meijer, and K. Sijtsma COTAN beoordelingssysteem voor de kwaliteit van tests (COTAN ratingsystem for the quality of tests) 2010 Retrieved from http://dare.uva.nl/document/179627
18. X. Fan, B. Thompson, and L. Wang Effects of sample size, estimation methods, and model specification on structural equation modeling fit indexes Structural Equation Modeling: A Multidisciplinary Journal 6 1 1999 56 83 http://doi.org/10.1080/10705519909540119
19. P.W.M. van Gerven, F.G.W.C. Paas, J.J.G. van Merriënboer, and H.G. Schmidt Memory load and the cognitive pupillary response in aging Psychophysiology 41 2 2004 167 174 http://doi.org/10.1111/j.1469-8986.2003.00148.x
20. A. van der Gijp, C.J. Ravesloot, M.F. van der Schaaf, I.C. van der Schaaf, J.C.B.M. Huige, and K.L. Vincken J.P.J. van Schaik Volumetric and two-dimensional image interpretation show different cognitive processes in learners Academic Radiology 22 5 2015 632 639 http://doi.org/10.1016/j.acra.2015.01.001
21. T. van Gog, L. Kester, F. Nievelstein, B. Giesbers, and F. Paas Uncovering cognitive processes: different techniques that can contribute to cognitive load research and instruction Computers in Human Behavior 25 2 2009 325 331 http://doi.org/10.1016/j.chb.2008.12.021
22. T. Grunwald, and C. Corsbie-Massay Guidelines for cognitively efficient multimedia learning tools: educational strategies, cognitive load, and interface design Academic Medicine 81 3 2006 213 223 http://doi.org/10.1097/00001888-200603000-00003
23. M. Hegarty, M. Keehner, C. Cohen, D.R. Montello, and Y. Lippa The role of spatial cognition in medicine: applications for selecting and training professionals G. Allan, Applied spatial cognition 2007 Lawrence Erlbaum Associates Mahwah, NJ
24. N. Hollender, C. Hofmann, M. Deneke, and B. Schmitz Integrating cognitive load theory and concepts of human-computer interaction Computers in Human Behavior 26 6 2010 1278 1288 http://doi.org/10.1016/j.chb.2010.05.031
25. L.T. Hu, and P.M. Bentler Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives Structural Equation Modeling: A Multidisciplinary Journal 6 1 1999 1 55 http://doi.org/10.1080/10705519909540118
26. M.A. Khawaja, F. Chen, and N. Marcus Measuring cognitive load using linguistic features: implications for usability evaluation and adaptive interaction design International Journal of Human-Computer Interaction 30 5 2014 343 368 http://doi.org/10.1080/10447318.2013.860579
27. F. Kirschner, F.G.W.C. Paas, and P.A. Kirschner Individual and group-based learning from complex cognitive tasks: effects on retention and transfer efficiency Computers in Human Behavior 25 2 2009 306 314 http://doi.org/10.1016/j.chb.2008.12.008
28. K.H. Koh, and B.D. Zumbo Multi-group confirmatory factor analysis for testing measurement invariance in mixed item format data Journal of Modern Applied Statistical Methods 7 2 2008 471 477
29. E.M. Kok, H. Jarodzka, A.B.H. de Bruin, H.A.N. BinAmir, S.G.F. Robben, and J.J.G. van Merrienboer Systematic viewing in radiology: seeing more, missing less? Advances in Health Sciences Education 21 1 2015 189 205 http://doi.org/10.1007/s10459-015-9624-y
30. E.A. Krupinski Current perspectives in medical image perception Attention, Perception, and Psychophysics 72 5 2010 1205 1217 http://doi.org/10.3758/APP.72.5.1205
31. E.A. Krupinski The role of perception in imaging: past and future Seminars in Nuclear Medicine 41 6 2011 392 400 http://doi.org/10.1053/j.semnuclmed.2011.05.002
32. E.A. Krupinski, K.S. Berbaum, R.T. Caldwell, K.M. Schartz, M.T. Madsen, and D.J. Kramer Do long radiology workdays affect nodule detection in dynamic CT interpretation? Journal of the American College of Radiology 9 3 2012 191 198 http://doi.org/10.1016/j.jacr.2011.11.013
33. H.L. Kundel, C.F. Nodine, E.F. Conant, and S.P. Weinstein Holistic component of image perception in mammogram interpretation: gaze-tracking study Radiology 242 2 2007 396 402 http://doi.org/10.1148/radiol.2422051997
34. S. van der Land, A.P. Schouten, F. Feldberg, B. van den Hooff, and M. Huysman Lost in space? Cognitive fit and cognitive load in 3D virtual environments Computers in Human Behavior 29 3 2013 1054 1064 http://doi.org/10.1016/j.chb.2012.09.006
35. N. Lavie Distracted and confused?: Selective attention under load Trends in Cognitive Sciences 9 2 2005 75 82 http://doi.org/10.1016/j.tics.2004.12.004
36. A.M. Lesgold, H. Rubinson, P. Feltovich, R. Glaser, D. Klopfer, and Y. Wang Expertise in a complex skill: diagnosing x-ray pictures M.T.H. Chi, R. Glaser, J. Farr, The nature of expertise 1988 Lawrence Erlbaum Associates, Inc Hillsdale, NJ 311 342
37. S. Martin Measuring cognitive load and cognition: metrics for technology-enhanced learning Educational Research and Evaluation 20 7-8 2014 592 621 http://doi.org/10.1080/13803611.2014.997140
38. R.E. Mayer, and R. Moreno Nine ways to reduce cognitive load in multimedia learning Educational Psychologist 38 1 2003 43 52 http://doi.org/10.1207/S15326985EP3801-6
39. J.J.G. van Merriënboer, and J. Sweller Cognitive load theory and complex learning: recent developments and future directions Educational Psychology Review 17 2 2005 147 177 http://doi.org/10.1007/s10648-005-3951-0
40. J.J.G. van Merriënboer, and J. Sweller Cognitive load theory in health professional education: design principles and strategies Medical Education 44 1 2010 85 93 http://doi.org/10.1111/j.1365-2923.2009.03498.x
41. G.R. Norman, C.L. Coblentz, L.R. Brooks, and C.J. Babcook Expertise in visual diagnosis: a review of the literature Academic Medicine 67 10 1992 78 83 http://doi.org/10.1097/00001888-199210000-00045
42. N. Nourbakhsh, Y. Wang, and F. Chen GSR and blink features for cognitive load classification P. Kotzé, G. Marsden, G. Lindgaard, J. Wesson, M. Winckler, Human-computer interaction - INTERACT 2013 2013 Springer Berlin Heidelberg Berlin, Heidelberg, Germany 159 166 http://doi.org/10.1007/978-3-642-40483-2-11
43. F.G.W.C. Paas Training strategies for attaining transfer of problem-solving skill in statistics: a cognitive load approach Journal of Educational Psychology 84 4 1992 429 434 http://doi.org/10.1037//0022-0663.84.4.429
44. F.G.W.C. Paas, J.E. Tuovinen, H. Tabbers, and P.W.M. van Gerven Cognitive load measurement as a means to advance cognitive load theory Educational Psychologist 38 1 2003 63 72 http://doi.org/10.1207/S15326985EP3801-8
45. F.G.W.C. Paas, J.J.G. van Merriënboer, and J.J. Adam Measurement of cognitive load in instructional research Perceptual & Motor Skills 79 1 1994 419 430 http://doi.org/10.2466/pms.1994.79.1.419
46. O. Palinko, A.L. Kun, A. Shyrokov, and P. Heeman Estimating cognitive load using remote eye tracking in a driving simulator Symposium on Eye-Tracking Research & Applications 2010 141 144 10.1145/1743666.1743701
47. A. Pinto, C. Acampora, F. Pinto, E. Kourdioukova, L. Romano, and K. Verstraete Learning from diagnostic errors: a good way to improve education in radiology European Journal of Radiology 78 3 2011 372 376 http://doi.org/10.1016/j.ejrad.2010.12.028
48. C.J. Ravesloot, A. van der Gijp, M.F. van der Schaaf, J.C.B.M. Huige, K.L. Vincken, and C.P. Mol J.P.J. van Schaik Support for external validity of radiological anatomy tests using volumetric images Academic Radiology 22 5 2015 640 645 http://doi.org/10.1016/j.acra.2014.12.013
49. C.J. Ravesloot, M.F. van der Schaaf, J.P.J. van Schaik, O.T.J. ten Cate, A. van der Gijp, C.P. Mol, and et al. Volumetric CT-images improve testing of radiological image interpretation skills European Journal of Radiology 84 5 2015 856 861 10.1016/j.ejrad.2014.12.015
50. B.I. Reiner, M.D. Siegel, and K. Siddiqui Evolution of the digital revolution: a radiologist perspective Journal of Digital Imaging 16 4 2003 324 330 http://doi.org/10.1007/s10278-003-1743-y
51. F. Rengier, M.F. Häfner, R. Unterhinninghofen, R. Nawrotzki, J. Kirsch, H.-U. Kauczor, and et al. Integration of interactive three-dimensional image post-processing software into undergraduate radiology education effectively improves diagnostic skills and visual-spatial ability European Journal of Radiology 82 8 2013 1366 1371 http://doi.org/10.1016/j.ejrad.2013.01.010
52. N. Ruiz, R. Taib, and F. Chen Freeform pen-input As evidence of cognitive load and expertise Proceedings of the 13th International Conference on Multimodal Interfaces 2011 ACM New York, NY 185 188 http://doi.org/10.1145/2070481.2070511
53. N. Ruiz, R. Taib, Y.(D.) Shi, E. Choi, and F. Chen Using pen input features as indices of cognitive load Proceedings of the 9th International Conference on Multimodal Interfaces 2007 ACM New York, NY 315 318 http://doi.org/10.1145/1322192.1322246
54. A. Satorra Scaled and adjusted restricted tests in multi-sample analysis of moment structures R.D.H. Heijmans, D.S.G. Pollock, A. Satorra, Innovations in multivariate statistical analysis. A festschrift for Heinz Neudecke 2000 Kluwer Academic Publishers London, UK 223 247 http://doi.org/10.1007/978-1-4615-4603-0-17
55. C. Schrader, and T.J. Bastiaens The influence of virtual presence: effects on experienced cognitive load and learning outcomes in educational computer games Computers in Human Behavior 28 2 2012 648 658 http://doi.org/10.1016/j.chb.2011.11.011
56. A.T. Stull, M. Hegarty, and R.E. Mayer Getting a handle on learning anatomy with interactive three-dimensional graphics Journal of Educational Psychology 101 4 2009 801 816 http://doi.org/10.1037/a0016849
57. J. Sweller Instructional design consequences of an analogy between evolution by natural selection and human cognitive architecture Instructional Science 32 1-2 2004 9 31 10.1023/B:TRUC.0000021808.72598.4d
58. J. Sweller, P. Ayres, and S. Kalyuga Measuring cognitive load Cognitive load theory: Explorations in the learning sciences, instructional systems and performance technologies 2011 Springer New York, NY 71 85 http://doi.org/10.1007/978-1-4419-8126-4-6
59. J. Sweller, J.J.G. van Merriënboer, and F.G.W.C. Paas Cognitive architecture and instructional design Educational Psychology Review 10 3 1998 251 296 http://doi.org/10.1023/A:1022193728205
60. P.M. Taylor A review of research into the development of radiologic expertise: implications for computer-based training Academic Radiology 14 10 2007 1252 1263 http://doi.org/10.1016/j.acra.2007.06.016
61. Tobii technology A. B. Tobii eye tracking: An introduction to eye tracking and Tobii eye trackers 2010 Retrieved from http://www.tobii.com/Global/Analysis/Training/WhitePapers/Tobii-EyeTracking-Introduction-WhitePaper.pdf?epslanguage=en
62. K.L. Vincken, and C.J. Ravesloot VQuest 2010 ISI UMCU Utrecht, The Netherlands
63. R. Zheng, and A. Cook Solving complex problems: a convergent approach to cognitive load measurement British Journal of Educational Technology 43 2 2012 233 246 http://doi.org/10.1111/j.1467-8535.2010.01169.x