Multimodal interfaces: A framework based on modality appropriateness

Proceedings of the Human Factors and Ergonomics Society

Volumn , Issue , 2006, Pages 1542-1546

  Van Erp, Jan B F ^a   Kooi, Frank L ^a   Bronkhorst, Adelbert W ^a   Van Leeuwen, David L ^a   Van Esch, Myra P ^a   Van Wijngaarden, Sander J ^a  

^a TNO   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN COMPUTER INTERACTION; INFORMATION ANALYSIS; OBJECT RECOGNITION; RISK ANALYSIS;

MULTIMODAL INTERFACES; SENSORY MODALITIES; TACTILE SENSORY SYSTEMS;

INTERFACES (COMPUTER);

EID: 44349119357     PISSN: 10711813     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Akamatsu, M. & Sato, S. (1992a). The multimodal integrative Mouse - a mouse with tactile display. Proceedings of ACM CHI '92 Conference on human factors in computing systems.
2. Brewster, S. A., Wright, P. C., and Edwards, A. D. N. (1994). The Design and Evaluation of an Auditory-Enhanced ScrollBar, Proceedings of ACM CHI'94 Conference on Human Factors in Computing Systems (Vol. 1, pp. 173-179).
3. Conolly, K. & Jones, B. (1970). A developmental study of afferent-reafferent integration. British Journal of Psychology, 61, 259 - 266.
4. Cook, M.J., Angus, C., Campbell, C. & Cranner, C., (1999). Speech interfaces in real-time control systems. People in control. London: Institution of electrical engineeers. pp. 428-433.
5. Cook, M.J., Cranner, C., Finan, R., Sapeluk, A. &Milton, C.A. (1997). Memory load and task interference: hidden usability issues in speech interfaces. In: D. Harris (ed.) Engineering psychology and cognitive ergonomics, part 1. Aldershot, UK: Ashgate publishing, pp. 141-150.
6. Davidson, R. & Mather, J.H. (1966). Cross-modal judgments of length. American Journal of Psychology, 79, 409-418.
7. Driver, J., Spence, C., 1998. Cross-modal links in spatial attention. Philos. Trans. Biol. Sci. 353 (1373), 1319-1331.
8. Fishbein, H.D., Decker, J., Wilcox, P. (1977). Cross-modality transfer of spatial information. Br. J Psychol. 68 (4), 503-508.
9. Forren, M.G. & Mitchell, C.M. (1986). Multimodal interfaces in supervisory control. Proceedings of the human factors society 30th annual meeting. pp 317-321.
10. Ho, C. & Spence, C. (2005). Olfactory facilitation of dual-task performance. Neuroscience Letters, 389 (1), 35-40.
11. Lechelt, E.C. & Verenka, A. (1980). Spatial anisotropy in intramodal and cross-modal judgments of stimulus orientation: the stability of the oblique effect. Perception 9 (5), 581-589.
12. Lloyd, D.M., Bolanowski, S.J., Howard, L., McGlone, F. (1999). Mechanisms of attention in touch. Somatosens. Motor Res. 16 (1), 3-10.
13. Millar, S. (1972). The development of visual and kinesthetic judgments of distance. British Journal of Psychology, 63, 271 - 282.
14. Selcon, S.J., Taylor, R.M. & Shadrake, R.A. (1992). Multimodal cockpit warnings: pictures, words, or both? Proceedings of the human factors society 36th annual meeting, pp 57-61
15. Shams, L.., Ma, W.J. & Beierholmc, U. (2005). Sound-induced £ash illusion as an optimal percept. NeuroReport, 16(17), 1923-1927.
16. Spence, C. & Driver, J. (1997). Cross-Modal Links in Attention Between Audition, Vision, and Touch: Implications for interface Design. International Journal of Cognitive Ergonomics, 1 (4), 351-373.
17. Spence, C., Nicholls, M.E., Gillespie, N., Driver, J. (1998). Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision. Percept. Psychophys. 60 (4), 544-557.
18. Van Erp, J.B.F. & Van Veen, H.A.H.C. (2004). Vibrotactile in-vehicle navigation system. Transportation Research part F: Human Factors, 7, 247-256.
19. Van Erp, J.B.F. & Verschoor, M.H. (2004). Cross-Modal Visual and Vibro-Tactile Tracking. Applied Ergonomics, 35, 105-112.
20. Van Erp, J.B.F. & Werkhoven, P.J. (2004). Vibrotactile and visual asynchronies: Sensitivity and consistency. Perception, 33, 103-111.
21. Wickens, C.D. & Liu, Y. (1988). Codes and modalities in multiple resources: A success and a qualification. Human Factors, 30 (5), 599-616.
22. Wogalter, M.S., Rashid, R., Clarke, M.J. & Kalsher, M. (1991). Evaluating the behavioral effectiveness of a multimodal voice warning sign in a visually cluttered environment. Proceedings of the human factors society 35th annual meeting, pp 718-722.