Temporal binding of multimodal controls for dynamic map displays: A systems approach

ICMI'11 - Proceedings of the 2011 ACM International Conference on Multimodal Interaction

Volumn , Issue , 2011, Pages 409-415

  Haas, Ellen C ^a   Pillalamarri, Krishna S ^a   Stachowiak, Chris C ^a   McCullough, Gardner ^b  

^a U S ARMY RESEARCH LABORATORY   (United States)

^b UNIVERSITY OF MARYLAND BALTIMORE COUNTY   (United States)

Author keywords

multimodal controls; speech; touch

Indexed keywords

DYNAMIC MAPS; LABORATORY STUDIES; MEAN AGES; MULTI-MODAL; REAL TIME; ROBOTIC SWARMS; SPATIAL POSITIONS; SPEECH COMMANDS; SUPERVISORY CONTROL; SYSTEMS APPROACH; TOUCH; U.S. ARMY; USER COMMANDS; USER PERFORMANCE; VISUAL INTERFACE; VOICE COMMAND;

AUTOMOBILE EXHIBITIONS; INTERACTIVE COMPUTER SYSTEMS; RESEARCH LABORATORIES; ROBOTICS; SPEECH;

REAL TIME SYSTEMS;

EID: 83455208389     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2070481.2070558     Document Type: Conference Paper

References (20)

1. Oviatt, S.L. 1996. Multimodal interfaces for dynamic interactive maps. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Common Ground (Vancouver, British Columbia, Canada) 13-18.
2. Naumann, A.B., Wechsung, I., Hurtienne, J. 2010. Multimodal Interaction: A suitable strategy for including older users? Interacting with Computers. 465-474.
3. Haas, E. C., Fields, M., Stachowiak, C., Hill, S., and Pillalamarri, K. 2010. Extreme Scalability: Designing Interfaces and Algorithms for Soldier Robotic Swarm Interaction, Year 2. Technical Report 5222. U. S. Army Research Laboratory, Aberdeen Proving Ground, Maryland.
4. Raisamo, R. 1999. Multimodal Human-Computer Interaction: A Constructive and Empirical Study. Doctoral Dissertation. Report A-1999-13, Department of Computer Science, University of Tampere.
5. th ACM Symposium on User Interface Software Technology (UIST), ACM Press, New York, NY, 21-30.
6. Oviatt. S. L., Coulston, R., and Lunsford, R. 2004. When do we interact multimodally? Cognitive load and multimodal communications patterns. In Proceedings of the Sixth International Conference on Multimodal Interfaces (ICMI'04), 129-136.
7. Oviatt., S. L., Coulston., R., Tomko, S., Xiao, B., Lunsford, R., Wesson, M., and Carmichael, L. 2003. Toward a theory of organized multimodal integration patterns during human-computer interaction, In Proceedings of the 5th IEEE International Conference on Multimodal Interfaces (ICMI'03), 44-47.
8. Microsoft Touch Design Guidelines, http://msdn.microsoft.com/en-us/ library/cc872774.aspx, accessed on December 12, 2009.
9. Oviatt, S. L., Lunsford, R., and Coulston, R. 2005 . Individual differences in multimodal integration patterns: what are they and why do they exist. In Proceedings of Computer-Human Interaction Papers, Eye Gaze and Multimodal Integration Patterns, 241-249. (Pubitemid 41809061)
10. st Nordic Symposium on Multimodal Interfaces, Copenhagen, September.
11. Reeves, A., Fuller, H., and Fine, E. 2005. The role of attention in binding shape to color. Vision Research, 45, 3343-3355. (Pubitemid 41573580)
12. Gawron, V.J. 2000. Human Performance Measures Handbook, Lawrence Erlbaum Associates, London, 54-55.
13. U.S. Department of the Army, 1990. Use of Volunteers as Subjects of Research, Technical Report AR 70-25. Government Printing Office, Washington, DC. DOI =, http://www.army.mil/usapa/epubs/pdf/r70-25.pdf
14. U.S. Department of Defense, Office of the Secretary of Defense. 1999. Code of Federal Regulations, Protection of Human Subjects. Government Report 32 CFR 219, Government Printing Office, Washington, D.C. DOI = http://www.dtic.mil/ biosys/downloads/32cfr219.pdf
15. SynWin (Version 1.2.28) [Computer Software.] Chula Vista, California: Activity Research Services.
16. Cleveland, W. S. 1984. Graphical methods for data presentation: Full scale breaks, dot charts, and multibased logging. The American Statistician, 38(4), 270-280.
17. Arning, K., and Ziefle, M. 2007. Understanding age differences in PDA and acceptance Performance. Computers in Human Behavior, 2904-2927. (Pubitemid 46880146)
18. Nigay, L., and Coutaz, J. 1997. Multifeature systems: The CARE properties and their impact on software design. Intelligence and Multimodality in Multimedia Interfaces, AAAI Press.
19. Jokinen, K., and Hurtig, T. 2006. User expectations and real experience on a multimodal interactive system. Proceedings of Interspeech 2006.
20. Oviatt, S.L. 2006. Human-centered design meets cognitive load theory: designing interfaces that help people think.