Modality effects on cognitive load and performance in high-load information presentation

International Conference on Intelligent User Interfaces, Proceedings IUI

Volumn , Issue , 2009, Pages 335-344

  Cao, Yujia ^a   Theune, Mariët ^a   Nijholt, Anton ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Cognitive load; Heart rate variability; High load information presentation; Modality effect; Performance

Indexed keywords

COGNITIVE LOAD; HEART RATE VARIABILITY; HIGH-LOAD INFORMATION PRESENTATION; MODALITY EFFECT; PERFORMANCE;

COGNITIVE SYSTEMS; HEART VALVE PROSTHESES; HUMAN COMPUTER INTERACTION; KNOWLEDGE MANAGEMENT;

USER INTERFACES;

EID: 77953873724     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1502650.1502697     Document Type: Conference Paper

References (25)

1. Andre, E. The Generation of Multimedia Presentations. Handbook of Natural Language Processing, 305-327, 2000.
2. Arens, Y., Hovy, E. and van Mulken, S. Structure and Rules in Automated Multimedia Presentation Planning. In Proc. IJCAI, '93, 1253-1259, 1993.
3. Bachvarova, Y., van Dijk, B. and Nijholt, A. Towards a Unified Knowledge-Based Approach to Modality Choice. In Proc. Workshop on Multimodal Output Generation (MOG) '07, 5-15, 2007.
4. Baddeley, A.D. and Hitch, G.J. Working Memory. The Psychology of Learning and Motivation: Advances in Research and Theory, 8, 47-89, 1974.
5. Baddeley, A.D. Essentials of Human Memory. Psychology Press, 1999.
6. Bernsen, N.O. Foundations of Multimodal Representations: a Taxonomy of Representational Modalities. Interacting with Computers, 6(4), 347-371, 1994.
7. Bernsen, N.O. Multimodality in Language and Speech Systems - From Theory to Design Support Tool. Multimodality in Language and Speech Systems, Kluwer Academic Publishers (2002), 93-148, 2002.
8. Brunken, R., Plass, J.L. and Leutner, D. Direct Measurement of Cognitive Load in Multimedia Learning. Educational Psychologist, 38(1), 53-61, 2003.
9. Buxton, W. Speech, Language and Audition. Readings in Human Computer Interaction: Toward the Year 2000, Morgan Kaufmann Publishers (1995), 525-570, 1995.
10. Chandler, P. and Sweller, J. Cognitive Load Theory and the Format of Instruction. Cognition and Instruction, 8(4), 293-332, 1991.
11. Clark, J.M. and Paivio, A. Dual Coding Theory and Education. Educational Psychology Review, 3(3), 149-210, 1991.
12. Elouazizi, N. and Bachvarova, Y. On Cognitive Relevance in Automatic Multimodal Systems. In Proc. IEEE International Symposium on Multimedia Software Engineering '04, 418-426, 2004.
13. Feiner, S.K. and McKeown, K.R. Automating the Generation of Coordinated Multimedia Explanations. IEEE Computer, 24, 33-41, 1991.
14. Hart, S.G. and Staveland, L.E. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Human Mental Workload, 1, 139-183, 1988.
15. Kramer, A.F. Physiological Metrics of Mental Workload: a Review of Recent Progress. In Damos, D.L. ed. Multiple-task performance, 279-328, CRC Press, 1991.
16. Mayer, R.E. and Moreno, R. A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory. Journal of Educational Psychology, 90(2), 312-320, 1998.
17. Mayer, R.E. and Moreno, R. Nine Ways to Reduce Cognitive Load in Multimedia Learning. Educational Psychologist, 38(1), 45-52, 2003.
18. Paivio, A. Mental Representations: A Dual Coding Approach. Oxford University Press, 1986.
19. Scerbo, M.W., Freeman, F.G., Mikulka, P.J., Parasuraman, R. and Di Nocero, F. The Efficacy of Psychophysiological Measures for Implementing Adaptive Technology. NASA Langley Research Center TP-2001-211018 NASA, Hampton, 2001.
20. Sharma, R., Yeasin, M., Krahnstoever, N., Rauschert, I., Cai, G., Brewer, I., MacEachren, A.M. and Sengupta, K. Speech-gesture Driven Multimodal Interfaces for Crisis Management. In Proc. of the IEEE, 91(9), 1327-1354, 2003.
21. Turoff, M., Chumer, M., Van de Walle, B. and Yao, X. The Design of a Dynamic Emergency Response Management Information System (DERMIS). Journal of Information Technology Theory and Application, 5(4), 1-35, 2004.
22. Wahlster, W. SmartKom: Symmetric Multimodality in an Adaptive and Reusable Dialogue Shell. In Proc. Human Computer Interaction Status Conference, 3, 47-62, 2003.
23. Wahlster, W., Andre, E., Bandyopadhyay, S., Graf, W. and Rist, T. WIP: The Coordinated Generation of Multimodal Presentations from a Common Representation. Communication from an Artificial Intelligence Perspective: Theoretical and Applied Issues, 121-144, 1992.
24. Wickens, C.D. Engineering Psychology and Human Performance (3rd edition). Prentice Hall, 1999.
25. Wilson, G.F. and Eggemeier, F.T. Psychophysiological Assessment of Workload in Multi-task Environments. In Damos, D.L. ed. Multiple-task performance, 329-360, CRC Press, 1991.