Measuring the impact of subtitles on cognitive load: Eye tracking and dynamic audiovisual texts

ACM International Conference Proceeding Series

Volumn , Issue , 2013, Pages 62-66

  Kruger, Jan Louis ^a   Hefer, Esté ^a   Matthew, Gordon ^a  

^a NORTH WEST UNIVERSITY   (South Africa)

Author keywords

change in pupil diameter; cognitive load; dynamic audiovisual texts; educational design; EEG; eye tracking; subtitles

Indexed keywords

COGNITIVE LOADS; COGNITIVE OVERLOAD; EYE-TRACKING; LONG TERM PERFORMANCE; MEASUREMENT TECHNIQUES; PERFORMANCE MEASURE; PUPIL DIAMETER; SUBTITLES;

ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGY;

EDUCATION;

EID: 84883875044     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2509315.2509331     Document Type: Conference Paper

References (28)

1. Ahern, S. and Beatty, J. 1979. Pupillary responses during information processing vary with Scholastic Aptitude Test scores. Science. 205, 1289-1292. (Pubitemid 10239860)
2. Antonenko, P., Paas, F., Grabner, R. and Van Gog, T. 2010. Using Electroencephalography to Measure Cognitive Load. Educational Psychology Review, 22:425-438.
3. Basar, E. 1999. Brain function and oscillations. Integrative brain functions. Neurophysiology and Cognitive Processes, Vol. 2. Berlin: Springer.
4. Brünken, R., Plass, J.L., and Leutner, D. 2003. Direct Measurement of Cognitive Load in Multimedia Learning. Educational Psychologist, 38 (1), 53-61. (Pubitemid 36400004)
5. Diao, Y., Chandler and P., Sweller, J. 2007. The effect of written text on comprehension of spoken English as a foreign language. The American Journal of Psychology, 120(2), 237-261.
6. Gevins, A., and Smith, M. E. 2003. Neurophysiological measures of cognitive workload during human-computer interactions. Theoretical Issues in Ergonomic Science, 4, 113-131.
7. HPRG (Human Performance Research Group). s.a. Nasa Task Load Index (TLX) v.1.0: paper and pencil package. California: NASA Ames Research Center. URL= http://humansystems.arc.nasa.gov/groups/TLX/downloads/TLXScale.pdf
8. Hyönä, J., Tommola, J., and Alaja, A.M. 1995. Pupil dilation as a measure of processing load in simultaneous interpretation and other language tasks. The Quarterly Journal of Experimental Psychology. 48 (a), 598-612.
9. Janisse, M.P. 1977. Pupillometry: The Psychology of the Pupillary Response. Washington: Hemisphere Publishing Corporation.
10. Kahneman, D., and Beatty, J. 1966. Pupil diameter and load on memory. Science. 154, 1583-1585.
11. Kalyuga, S. 2011. Cognitive load theory: Implications for affective computing. In McCarthy, P. M., & Murray, R. C. (Eds.). Proceedings of the 24th International Florida Artificial Intelligence Research Society Conference. Menlo Park, CA: Association for the Advancement of Artificial Intelligence (AAAI), 105-110.
12. Kalyuga, S. 2012. Instructional benefits of spoken words: A review of cognitive load factors. Educational Research Review, 7, 2 (June 2012), 145-159.
13. Klimesch, W. 1999. EEG alpha and theta oscillations reflect cognitive and memory performance: A review and analysis. Brain Research Reviews, 29, 169-195. (Pubitemid 29191338)
14. Klimesch, W., Schack, B., and Sauseng, P. 2005. The functional significance of theta and upper alpha oscillations for working memory: A review. Experimental Psychology, 52, 99-108.
15. Klingner, J., Kumar, R., and Hanrahan, P. 2008. Measuring the task-evoked pupillary response with a remote eye tracker. Proceedings from ETRA 2008, 69-72.
16. Mampusti, E.T., Ng, J.S., Quinto, J.J.I., Teng, G.L., Suarez, M.T.C. and Trogo, R.S. 2011. Measuring academic affective states of students via brainwave signals. in Third International Conference on Knowledge and Systems Engineering (KSE), 226-231.
17. Mayer, R. E. 2002. Cognitive Theory and the design of multimedia instruction: an example of the two-way street between cognition and instruction. New Directions for Teaching and Learning, 89, 55-71.
18. Mayer, R.E., Heiser, J., and Lohn, S. 2001. Cognitive constraints on multimedia learning: When presenting more material results in less understanding. Journal of Educational Psychology, 93 (1), 187-198.
19. Nesbit, J.C. and Hadwin, A.F. Methodological issues in educational psychology. In Alexander, P.A., and Winne, P.H. eds. Handbook of Educational Psychology (2nd Ed), Earlbaum, Mahwah NJ, 2006, 825-848.
20. O'Brien, S. 2006. Eye tracking and translation memory matches. Perspectives - Studies in Translatology. 14 (3), 185-205.
21. O'Brien, S. 2008. Processing fuzzy matches in translation memory tools: an eye-tracking analysis. IN: Göpferich, S., Jakobsen, A.L. and Mees, I.M. (eds.) Looking at Eyes. Eye-Tracking Studies of Reading and Translation Processing. Copenhagen Studies in Language, 79-102.
22. Paas, F.G.W.C. 1992. Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. Journal of Educational Psychology, 84 (4), 429-434.
23. Paas, F., Renkl, A. and Sweller, J. 2004. Cognitive Load Theory: Instructional implications of the interaction between information structures and cognitive architecture. Instructional Science, 32, 1-8. (Pubitemid 39045927)
24. Paas, F., Tuovinen, J., Tabbers, H., and Van Gerven, P.W.M. 2003. Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38 (1), 63-71. (Pubitemid 36400005)
25. Paas, F.G.W.C. and Van Merriënboer, J.G. 1993. The efficiency of instructional conditions: An approach to combine mental effort and performance measures. Human Factors, 35, 4 (December 1993), 737-741.
26. Paas, F.G.W.C., Van Merriënboer, J.G. and Adam, J.J. 1994. Measurement of cognitive load in instructional research. Perceptual and Motor Skills, 79, 1 (August 1994), 419-430.
27. Schultheis, H. and Jameson, A. 2004. Assessing cognitive load in adaptive hypermedia systems: Physiological and behavioural methods. IN: Neijdl, W., and de Bra, P. (eds.) Adaptive Hypermedia and Adaptive Web-based Systems. Eindhoven: Springer Verlag, 18-24.
28. Steinhauer, S.R. 2002. Pupillary Responses, Cognitive Psychophysiology and Psychopathology [Online]. Pittsburgh: University of Pittsburgh School of Medicine. URL= http://www.wpic.pitt.edu/research/biometrics/Publications/ PupilWeb.htm