Designing and evaluating multimodal interaction for mobile contexts

ICMI'08: Proceedings of the 10th International Conference on Multimodal Interfaces

Volumn , Issue , 2008, Pages 265-272

  Lemmelä, Saija ^a   Vetek, Akos ^a   Mäkelä, Kaj ^a   Trendafilov, Dari ^a  

^a NOKIA RESEARCH CENTER   (United States)

Author keywords

Design; Experimentation; Human factors; Theory

Indexed keywords

APPLICATIONS; CONCURRENT ENGINEERING; HUMAN ENGINEERING; INTERACTIVE COMPUTER SYSTEMS; JOB ANALYSIS; RAPID PROTOTYPING;

CONTEXT ANALYSIS; DESIGN AND EVALUATION METHODS; EXPERIMENTATION; HUMAN FACTORS; INTERACTION DESIGNS; INTERACTION STRATEGIES; ITERATIVE DESIGNS; ITERATIVE PROCESS; LESSONS LEARNED; MOBILE CONTEXTS; MULTI-MODAL INTERACTIONS; MULTI-MODAL USER INTERFACES; MULTIMODAL APPLICATIONS; SPEECH INTERACTIONS; THEORY; UI DESIGNS;

USER INTERFACES;

EID: 63449121544     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1452392.1452447     Document Type: Conference Paper

References (30)

1. Bachvarova, Y., van Dijk, B. and Nijholt, A. 2007. Towards a Unified Knowledge-Based Approach to Modality Choice. In Proceedings Workshop on Multimodal Output Generation (Aberdeen, Scotland, January 25-26, 2007). MOG 2007. CTIT Workshop Proceedings Series WP07-01, 5-15.
2. th international conference on Multimodal interfaces (Trento, Italy, October 4-6, 2005). ICMI'05. ACM Press, New York, NY, USA, 100-107. DOI=http://doi.acm.org/10.1145/1088463. 1088482
3. Bernsen, N.O. 1993. Modality Theory: Supporting Multimodal Interface Design. In Proceedings of ERCIM Workshop on Multimodal Human-Computer Interaction. 13-23.
4. Bernsen, N.O. and Dybkjær, L. 2001. Exploring Natural Interaction in the Car. In Proceedings of the International Workshop on Information Presentation and Natural Multimodal Dialogue (Verona, Italy, December 75-79, 2001). 75-79.
5. Brewster, S. 2002. Overcoming the Lack of Screen Space on Mobile Computers. Personal and Ubiquitous Computing. 6, 3 (May 2002), 188-205.
6. Costanza, E., Inverso, S.A., and Allen, R. 2005. Toward subtle intimate interfaces for mobile devices using an EMG controller. In Proceedings of the Conference on Human Factors in Computing Systems (Portland, USA, April 2-7, 2005) CHI 2005, 481-489.
7. Frohlich, D. M. 1992. The design space of interfaces. In L Kjelldahl (Ed.) Multimedia - Principles, systems and applications. Springer-Verlag, Berlin, Germany, 53-69.
8. Jameson, A. and Klöckner, K. 2005. User Multitasking with Mobile Multimodal Systems. Spoken Multimodal Human- Computer Dialogue in Mobile Environments, Springer, Netherlands, 349-377.
9. Klemmer, S.R., Sinha, A.K., Chen, J., Landay, J.A., Aboobaker, N., and Wang, A. 2000. SUEDE: A Wizard of Oz Prototyping Tool for Speech User Interfaces. In Proceedings of the 13th annual ACM symposium on User interface software and technology (San Diego, USA, November 5-8, 2000, 2000). UIST 2000, ACM Press, New York. NY, USA, 1-10. DOI=http://doi.acm.org/10.1145/354401.354406
10. Lemmelä, S. 2008. Selecting optimal modalities for multimodal interaction in mobile and pervasive environments. In Pervasive 2008 Workshop Proceedings (Sydney, Australia, May 18, 2008). IMUx 2008, 208-217.
11. Nesbitt, K.V. 2004. MS-Taxonomy: a conceptual framework for designing multi-sensory displays. In Proceedings of Eighth International Conference on Information Visualisation (London, UK, July 14-16, 2004). IV 2004, IEEE Computer Society, New York, NY, USA, 665-670.DOI=http://doi.ieeecomputersociety.org/10. 1109/IV.2004.1320213
12. Nielsen, J., and Landauer, T. K. 1993. A mathematical model of the finding of usability problems, In Proceedings of ACM INTERCHI'93 Conference (Amsterdam, Netherlands, April 24-29, 1993). INTERCHI'93, ACM Press, New York. NY, USA, 206-213. DOI=http://doi.acm.org/10.1145/169059.169166
13. Obrenovic, Z., Abascal, J. and Starcevic, D. 2007. Universal accessibility as a multimodal design issue. Communications of the ACM, 50, 5 (May 2007), 83-88. DOI=http://doi.acm.org/10.1145/1230819.1241668
14. Oviatt, S., Coulston, R., and Lunsford, R. 2004. When do we interact multimodally?: cognitive load and multimodal communication patterns. In Proceedings of the 6th international conference on Multimodal interfaces (State College, PA, USA, October 13-15, 2004). ICMI 2004, ACM Press, New York. NY, 129-136. DOI=http://doi.acm.org/10.1145/1027933.1027957
15. Pascoe, J., Ryan, N. and Morse, D. 2000. Using while moving: HCI issues in fieldwork environments. ACM Transactions on Computer-Human Interaction (TOCHI), 7, 3 (September 2000), 417-437. DOI= http://doi.acm.org/10.1145/355324. 355329
16. Pirhonen, A., Brewster, S. and Holguin, C. 2002. Gestural and audio metaphors as a means of control for mobile devices. In Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves (Minneapolis, MN, USA, April 20-25, 2002). CHI 2002, ACM Press, New York, NY, USA, 291-298. DOI= http://doi.acm.org/10.1145/503376.503428
17. Reeves, L.M., Lai, J., Larson, J.A., Oviatt, S. et al. 2004. Guidelines for multimodal user interface design. Communications of the ACM, 47, 1 (January 2004), 57-59. DOI= http://doi.acm.org/10.1145/962081.962106
18. Schmidt, A., Aidoo, K.A., Takaluoma, A., Tuomela, U., Van Laerhoven, K., Van de Velde, W. Advanced Interaction in Context. In Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing, Karlsruhe, Germany, 1999, 89-101.
19. Shneiderman, B. 1997. Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley, Longman Publishing Co. Inc.
20. Siewiorek, D., Smailagic, A., Furukawa, J., Krause, A., Moraveji, N., Reiger, K., Shaffer, J., Fei Lung Wong. SenSay: a context-aware mobile phone. In Proceedings of Seventh IEEE International Symposium on Wearable Computers, 2003, 248- 249.
21. Sinha, A.K. and Landay, J.A. 2001. Visually Prototyping Perceptual User Interfaces through Multimodal Storyboarding. In Proceedings of the 2001 workshop on Perceptive user interfaces (Orlando, USA, November 15-16, 2001) PUI 2001, ACM Press, New York. NY, USA, 1-4. DOI= http://doi.acm.org/10.1145/971478.971501
22. Sutcliffe, A.G., Kurniawan, S. and Shin, J.E. 2006. A method and advisor tool for multimedia user interface design. International Journal of Human-Computer Studies 64, 4 (April 2006), 375-392.
23. Sutton, S., Cole, R., Villiers, J., Schalkwyk, J., Vermeulen, P., Macon, M., Yan, Y., Kaiser, E., Rundle, B., Shobaki, K., Hosom, P., Kain, A., Wouters, J., Massaro, D., Cohen, M. 1998. Universal Speech Tools: The CSLU Toolkit. In Proceedings of 5th International Conference on Spoken Language Processing (Sydney, Australia, November 30-December 4, 1998). ICSLP'98, 3221-3224.
24. Tamminen, S., Oulasvirta, A., Toiskallio, K., and Kankainen, A. 2004. Understanding mobile contexts. Personal and Ubiquitous Computing, 8, 2, (May 2004), 135-143.
25. Tollmar, K., Junestrand, S. and Torgny, O. 2000. Virtually living together. In Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques (New York, USA. August 17-19, 2000). DIS'00, ACM Press, New York. NY, USA, 83-91. DOI=http://doi.acm.org/10. 1145/347642.347670
26. Wang, K. 2002. SALT: a spoken language interface for webbased multimodal dialog systems. In Proceedings of International Conference on Spoken Language Processing. ICSLP 2002, 2241-2244.
27. Wensveen, S.A.G., Djajadiningrat, J.P. and Overbeeke, C.J. 2004. Interaction frogger: a design framework to couple action and function through feedback and feedforward. Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques (Cambridge, MA, USA, August 1-4, 2004). DIS'04, ACM Press, New York. NY, USA, 177-184. DOI= http://doi.acm.org/10.1145/1013115.1013140
28. Verkasalo, H. 2007. A Cross-Country Comparison of Mobile Service and Handset Usage. Licentiate's thesis, Helsinki University of Technology, Networking Laboratory, Finland.
29. Wobbrock, J.O. 2006. The Future of Mobile Device Research in HCI. In Proceedings of the workshop on 'What is the Next Generation of Human-Computer Interaction?' at CHI 2006 (Montreal, Canada, April 23, 2006). 118-121.
30. Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R., Baudisch, P. 2007. Earpod: eyes-free menu selection using touch input and reactive audio feedback. In Proceedings of the SIGCHI conference on Human factors in computing systems (San Jose, CA, USA, April 28 - May 3, 2007). CHI 2007, ACM Press, New York. NY, USA, 1395-1404. DOI=http://doi.acm.org/10.1145/1240624.1240836