Blending speech output and visual text in the multimodal interface

Human Factors

Volumn 50, Issue 5, 2008, Pages 782-788

  Dowell, John ^a   Shmueli, Yael ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BLENDING;

AUDITORY INTERFACES; COMPLEX INFORMATIONS; COMPLEX SENTENCES; MULTIMEDIA PRESENTATIONS; MULTIMODAL DISPLAYS; MULTIMODAL INTERFACES; POTENTIAL APPLICATIONS; REPEATED MEASURES; SMALL SCREENS; SPEECH OUTPUTS; VERBAL WORKING MEMORIES; VISUAL DISPLAYS; VISUAL INTERFACES;

INTERACTIVE COMPUTER SYSTEMS;

ARTICLE; COMPREHENSION; COMPUTER INTERFACE; CONTROLLED STUDY; E-MAIL; HUMAN; HUMAN COMPUTER INTERACTION; HUMAN EXPERIMENT; MACHINE LEARNING; MENTAL PERFORMANCE; PRODUCT DEVELOPMENT; VERBAL COMMUNICATION; VISUAL DISPLAY UNIT; WORKING MEMORY;

COMPREHENSION; ELECTRONIC MAIL; HUMANS; MEMORY; MULTIMEDIA; SPEECH PERCEPTION; USER-COMPUTER INTERFACE; VISUAL PERCEPTION;

EID: 57749177053     PISSN: 00187208     EISSN: None     Source Type: Journal    
DOI: 10.1518/001872008X354165     Document Type: Article

References (16)

1. Banbury, S. P., Macken, W. J., Tremblay, S., & Jones, D. M. (2001). Auditory distraction and short-term memory: Phenomena and practical implications. Human Factors, 43, 12-29.
2. Cacciabue, P. C., & Martinetto, M. (2006). A user centred approach for designing driving support systems: The case of collision avoidance. Cognition, Technology and Work, 8, 201-214.
3. Daneman, M,, & Carpenter, P. A. (1980). Individual differences in working memory and reading. Journal of Verbal Learning and Verbal Behaviour, 19, 450-466.
4. Ericsson, K. A., & Kintsch, W. (1995). Long-term working memory. Psychological Review, 102, 211-245.
5. Faraday, P., & Sutcliffe, A. G. (1997). Evaluating multimedia presentations. New Review of Hypermedia and Multimedia, 3, 7-37.
6. Just, M. A., & Carpenter, P. A. (1992). A capacity theory of comprehension: Individual differences in working memory. Psychological Review, 99, 122-149.
7. Kalyuga, S., Chandler, P., & Sweller, J. (1999). Managing split attention and redundancy in multimedia instruction. Applied Cognitive Psychology, 13, 351-371.
8. Martin, R. C., Wogalter, M. S., & Forlano, J. C. (1988). Reading comprehension in the presence of unattended speech and music. Journal of Memory and Language, 27, 382-398.
9. May, J., & Barnard, P. J. (1997). Modelling multimodal interaction: A theory-based technique for design analysis and support. In S. Howard, J. Hammond, & G. Lindegaard (Eds.), Human-computer interaction INTERACT '97 (pp. 667-668). London: Chapman & Hall.
10. Moreno, R., & Mayer, R. E. (2002a). Learning science in virtual reality multimedia environments: Role of methods and media. Journal of Educational Psychology, 94, 598-610.
11. Moreno, R., & Mayer, R. E. (2002b). Verbal redundancy in multimedia learning: When reading helps listening. Journal of Educational Psychology, 94, 156-163.
12. Seagull, F. J., Wickens, C. D., & Loeb, R. G. (2001). When is less more? Attention and workload in auditory, visual, and redundant patient-monitoring conditions. In Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting (pp. 1395-1399). Santa Monica, CA: Human Factors and Ergonomics Society.
13. Smith, S. L., & Mosier, J. N. (1986). Guidelines for designing user interface software (Report ESD-TR-86-278). Bedford, MA: MITRE.
14. Wickens, C. D., Goh, J., Helleberg, J., Horrey, W., & Talleur, D. A. (2003). Attentional models of multitask pilot performance using advanced display technology. Human Factors, 45, 360-379.
15. Wickens, C. D., & Gosney, J. L. (2003, November). Redundancy, modality, priority and instructions in dual task interference between simulated vehicle control and in-vehicle technology (Tech. Rep. AHFD-03-18/GM-03-3). Savoy, IL: University of Illinois at Urbana-Champaign, Aviation Human Factors Division. Retrieved August 27, 2008, from http://www.humanfactors.illinois.edu/Reports&PapersPDFs/ TechReport/03-18.pdf
16. Wickens, C. D., & Hollands, J. G. (2000). Engineering psychology and human performance (3rd ed.). Upper Saddle River, NJ: Prentice Hall.