A simple index for multimodal flexibility

Conference on Human Factors in Computing Systems - Proceedings

Volumn 3, Issue , 2010, Pages 1475-1484

  Oulasvirta, Antti ^a   Bergstrom Lehtovirta, Joanna ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

attention; mobile human computer interaction; modality allocation; multimodal interaction; multitasking

Indexed keywords

FLEXIBILITY INDEX; MOBILE HUMAN-COMPUTER INTERACTION; MOBILE TEXT ENTRY; MULTI-MODAL; MULTI-MODAL INTERACTIONS; MULTI-MODALITY; REAL WORLD SITUATIONS; SENSORY MODALITY; UNIMODAL;

HUMAN ENGINEERING; INTERACTIVE COMPUTER SYSTEMS; KNOWLEDGE MANAGEMENT; MULTITASKING;

HUMAN COMPUTER INTERACTION;

EID: 77954015930     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1753326.1753547     Document Type: Conference Paper

References (36)

1. Baber, C., and Mellor, B. Using critical path analysis to model multimodal human-computer interaction. International Journal of Human - Computer Studies 54, 4 (2001), 613-636.
2. Bertelson, P., and de Gelder, B. The psychology of multimodal perception. In: Crossmodal Space and Crossmodal Attention (2004), 141-177.
3. Brewster, S., Lumsden, J., Bell, M., Hall, M., and Tasker, S. Multimodal "eyes-free" interaction techniques for wearable devices. Proc. CHI2003, ACM Press (2003), New York, pp. 473-480.
4. Briem, V., and Hedman, L. Behavioural effects of mobile telephone use during simulated driving. Ergonomics 38, 12 (1995), 2536-2562. (Pubitemid 26006635)
5. Brumby, D., Howes, A., and Salvucci, D. A cognitive constraint model of dual-task trade-offs in a highly dynamic driving task. Proc. CHI2007, ACM Press (2007), New York, pp. 233-242.
6. Burke, J., Prewett, M., Gray, A., Yang, L., Stilson, F., Coovert, M., Elliot, L., and Redden, E. Comparing the effects of visual-auditory and visual-tactile feedback on user performance: A meta-analysis. Proc. ICMI2006, ACM Press (2006), New York, pp. 108-117.
7. Cashdan, S. and Zung, B. J. Effect of sensory modality and delay on form recognition. Journal of Experimental Psychology 86, 3 (1970), 458.
8. Cohen, M. R., and Nagel, E. Logic and Scientific Method. Harcourt Brace Jovanovich (1934), New York.
9. Colquhoun, W. Evaluation of auditory, visual, and dual-mode displays for prolonged sonar monitoring in repeated sessions. Human Factors 17, 5 (1975), 425.
10. Driver, J., and Spence, C. Cross-modal links in spatial attention. Philosophical Transactions: Biological Sciences 353, 1373 (1998), 1319-1331.
11. Gray, W., and Boehm-Davis, D. Milliseconds matter: An introduction to microstrategies and to their use in describing and predicting interactive behavior. Journal of Experimental Psychology Applied 6, 4 (2000), 322-335.
12. Hoggan, E., Brewster, S., and Johnston, J. Investigating the effectiveness of tactile feedback for mobile touchscreens. Proc. CHI2008, ACM Press (2008), New York, pp. 1573-1582
13. Hoggan, E., Raisamo, R., and Brewster, S. Mapping information to audio and tactile icons. Proc. ICMI2009, ACM Press (2009), New York.
14. Isokoski, P., and Linden, T. Effect of foreign language on text transcription performance: Finns writing English. Proc. NordiCHI2004, ACM Press (2004), New York, pp. 109-112.
15. Jacko, J., Barnard, L., Kongnakorn, T., Moloney, K., Edwards, P., Emery, V., and Sainfort, F. Isolating the effects of visual impairment: Exploring the effect of AMD on the utility of multimodal feedback. Proc. CHI2004, ACM Press (2004), New York, pp. 311-318.
16. Jaimes, A., and Sebe, N. Multimodal human-computer interaction: A survey. Computer Vision and Image Understanding 108, 1-2 (2007), 116-134.
17. Kane, S., Wobbrock, J., and Smith, I. Getting off the treadmill: Evaluating walking user interfaces for mobile devices in public spaces. Proc. MobileHCI, ACM Press (2008), New York, pp. 109-118.
18. Kieras, D., and Meyer, D. An overview of the EPIC architecture for cognition and performance with application to human-computer interaction. Human-Computer Interaction 12, 4 (1997), 391-438. (Pubitemid 127715457)
19. Lee, J., and Spence, C. Assessing the benefits of multimodal feedback on dual-task performance under demanding conditions. Proc. BritishHCI2008, British Computer Society (2008), Swindon, UK, 185-192.
20. Levenshtein, V. Binary codes capable of correcting deletions, insertions and reversals. Soviet Physics Doklady 10, 8 (1966), 707-710.
21. Liu, Y. Comparative study of the effects of auditory, visual and multimodality displays on drivers' performance in advanced traveller information systems. Ergonomics 44, 4 (2001), 425-442. (Pubitemid 32243499)
22. Lyons, K., Starner, T., Plaisted, D., Fusia, J., Lyons, A., Drew, A., and Looney, E. Twiddler typing: One-handed chording text entry for mobile phones. Proc. CHI2004, ACM Press (2004), New York, pp. 671-678.
23. MacKenzie, I. Motor behaviour models for human- computer interaction. In J. Carroll (ed.), HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science. Morgan Kaufmann (2003), San Francisco, 27-54.
24. MacKenzie, I., and Soukoreff, R. Phrase sets for evaluating text entry techniques. Proc. CHI2003, ACM Press (2003), New York, pp. 754-755.
25. Mizobuchi, S., Chignell, M., and Newton, D. Mobile text entry: Relationship between walking speed and text input task difficulty. Proc. MobileHCI2005, ACM Press (2005), New York, pp. 122-128.
26. Nigay, L., and Coutaz, J. A design space for multimodal systems: Concurrent processing and data fusion. Proc. CHI1993, ACM Press (1993), New York, 172-178.
27. Oulasvirta, A., Tamminen, S., Roto, V., and Kuorelahti, J. Interaction in 4-second bursts: The fragmented nature of attentional resources in mobile HCI. Proc. CHI2005, ACM Press (2005), New York, pp. 919-928.
28. Oviatt, S. Multimodal interfaces: The human-computer interaction. In A. Sears, J. Jacko (eds.), Human-Computer Interaction Handbook, Lawrence Erlbaum (2003), New York, 286-304.
29. Pashler, H. The Psychology of Attention. MIT Press (1999), Boston.
30. Perakakis, M., and Potamianos, A. Multimodal system evaluation using modality efficiency and synergy metrics. Proc. ICMI2008, ACM Press (2008), New York, pp. 9-16.
31. Posner, M. Chronometric Explorations of Mind. Erlbaum (1978), Hillsdale, NJ.
32. Rockwell, T. Skills, judgment and information acquisition in driving. Human Factors in Highway Traffic Safety Research, Wiley (1972), New York, 133-164.
33. Salvucci, D. A multitasking general executive for compound continuous tasks. Cognitive Science 29, 3 (2005), 457-492. (Pubitemid 40899973)
34. Senders, J. W., Kristofferson, A. B., Levison, W. H., Dietrich, C. W., and Ward, J. L. The attentional demand of automobile driving. Highway Research Record #195. National Academy of Sciences, Transportation Research Board (1967), Washington, DC, 15-33.
35. Sivak, M. The information that drivers use: Is it indeed 90% visual? Perception, 25, 9 (1996), 1081-1090.
36. Wickens, C. Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science 3, 2 (2002), 159-177.