Explorative studies on multimodal interaction in a PDAand desktop-based scenario

ICMI'08: Proceedings of the 10th International Conference on Multimodal Interfaces

Volumn , Issue , 2008, Pages 121-128

  Ratzka, Andreas ^a  

^a UNIVERSITY OF REGENSBURG   (Germany)

Author keywords

Mobile computing; Multimodality; User interface patterns

Indexed keywords

DECISION SUPPORT SYSTEMS; INTERACTIVE COMPUTER SYSTEMS; MOBILE COMPUTING; SPEECH RECOGNITION; USABILITY ENGINEERING; USER INTERFACES;

DECISION SUPPORTS; DESIGN RECOMMENDATIONS; EMPIRICAL CASE STUDIES; INTERACTION STYLES; INTERACTION TECHNIQUES; MULTI-MODAL INTERACTIONS; MULTIMODALITY; SPEECH RECOGNITION ENGINES; STAND -ALONE; USABILITY ENGINEERING LIFE CYCLES; USER INTERFACE PATTERNS; WIZARD-OF-OZ;

PHASE INTERFACES;

EID: 63449103416     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1452392.1452416     Document Type: Conference Paper

References (38)

1. Mayhew, D.J.: The Usability Engineering Lifecycle. Morgan Kaufmann, San Francisco (1999)
2. Ratzka, A., Wolff, C.: A pattern-based methodology for multimiodal interaction design. In Sojka, P., Kopeček, I., Pala, K., eds.: Proc. of Text, Speech, and Dialogue, TSD'06. LNAI 4188, Berlin, Heidelberg, Springer (2006) 677-686
3. Ratzka, A.: Design patterns in the context of multi-modal interaction. In: To appear in: Proceedings of the 6th Nordic Conference on Pattern Languages of Programs 2007 VikingPLoP 2007. (2008)
4. Tidwell, J.: Common ground: A pattern language for human-computer interface design. (1999)
5. Tidwell, J.: Designing Interfaces: Patterns for Effective Interaction Design. O'Reilly (2005)
6. van Welie, M., Trætteberg, H.: Interaction patterns in user interfaces. In: Proceedings of the Seventh Pattern Languages of Programs Conference. (2000)
7. Ratzka, A.: A wizard-of-oz setting for multimodal interaction. an approach to user-based elicitation of design patterns. In Osswald, A., Stempfhuber, M., Wolff, C., eds.: Open Innovation. Proc. 10th International Symposium for Information Science, Konstanz, Universitätsverlag Konstanz (2007) 159-170
8. Niedermaier, F.B.: Entwicklung und Bewertung eines Rapid-Prototyping Ansatzes zur multimodalen Mensch-Maschine-Interaktion im Kraftfahrzeug. PhD thesis, Fakultät für Elektrotechnik und Informationstechnik der Technischen Universität München (2003)
9. Dragičević, P.: Un modèle d'interaction en entrée pour des systèmes interactifs multi-dispositifs hautement configurables. PhD thesis, Université de Nantes, école doctorale sciences et technologies de l'information et des matérieaux (Mars 2004)
10. Bernsen, N.O.: A toolbox of output modalities: Representing output information in multimodal interfaces. (1997)
11. Bernsen, N.O.: Multimodality in language and speech systems - from theory to design support tool. I Granström, B., ed.: Multimodality in Language and Speech Systems, Dordrecht, Kluwer (2001)
12. Seifert, K.: Evaluation multimodaler Computer-Systeme in frühen Entwicklungsphasen. PhD thesis, Fakultät V - Verkehrs- und Maschinensysteme, Technische Universität Berlin (2002)
13. Alexander, C.: The Timeless Way of Building. Oxford University Press (1979)
14. Gabriel, D.: A pattern definition. http://hillside.net/patterns/ definition.html (checked on 2007-05-09)
15. Alexander, C., Ishikawa, S., Silverstein, M., Jacobson, M., Fiksdahl-King, I., Angel, S.: A Pattern Language. Oxford University Press (1977)
16. Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley (1995)
17. Buschmann, F., Meunier, R., Rohnert, H., Sommerlad, P., Stal, M.: Pattern-orientierte Softwarearchitektur. Addison-Wesley, Bonn (1998)
18. Borchers, J.O.: A pattern approach to interaction design. AI & Society Journal of Human-Centered Systems and Machine Intelligence 15(4) (2001) 359-376
19. Duyne, D.K.V., Landay, J., Hong, J.I.: The Design of Sites: Patterns, Principles, and Processes for Crafting a Customer-Centered Web Experience. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA (2002)
20. van Welie, M.: Gui design patterns. In: www.welie.com - ...patterns in Interaction Design. (2003)
21. Hauptmann, A.G.: Speech and gestures for graphic image manipulation. In: CHI '89: Proceedings of the SIGCHI conference on Human factors in computing systems, New York, NY, USA, ACM (1989) 241-245
22. Oviatt, S., Olsen, E.: Integration themes in multimodal human-computer interaction. In Shirai, K., Furui, S., Kakehi, K., eds.: Proceedings of the International Conference on Spoken Language Processing. Volume 2., Yokohama, Japan, Acoustical Society of Japan (1994)
23. Oviatt, S., Cohen, P.R., Wang, M.Q.: Toward interface design for human language technology: modality and structure as determinants of linguistic complexity. Speech Commun. 15(3-4) (1994) 283-300
24. Angeli, A.D., Gerbino, W., Cassano, G., Petrelli, D.: Visual display, pointing, and natural language: the power of multimodal interaction. In: AVI '98: Proceedings of the working conference on Advanced visual interfaces, New York, NY, USA, ACM Press (1998) 164-173
25. Oviatt, S.: Multimodal interfaces for dynamic interactive maps. In: CHI '96: Proceedings of the SIGCHI conference on Human factors in computing systems, New York, NY, USA, ACM (1996) 95-102
26. Cohen, P., Johnston, M., McGee, D., Oviatt, S.L., Clow, J., Smith, I.: The efficiency of multimodal interaction: A case study. In: ICSLP'98. (1998)
27. Cohen, P., McGee, D., Clow, J.: The efficiency of multimodal interaction for a map-based task. In: Proceedings of the sixth conference on Applied natural language processing, San Francisco, CA, USA, Morgan Kaufmann Publishers Inc. (2000) 331-338
28. Oviatt, S., Kuhn, K.: Referential features and linguistic indirection in multimodal language. In: Proceedings of the International Conference on Spoken Language Processing. Volume 6., ASSTA (1998) 2339-2342
29. Oviatt, S.: Ten myths of multimodal interaction. Commun. ACM 42(11) (1999) 74-81
30. Oviatt, S.: Mutual disambiguation of recognition errors in a multimodal architecture. In: CHI '99: Proceedings of the SIGCHI conference on Human factors in computing systems, New York, NY, USA, ACM (1999) 576-583
31. Oviatt, S.: Multimodal system processing in mobile environments. In: UIST '00: Proceedings of the 13th annual ACM symposium on User interface software and technology, New York, NY, USA, ACM Press (2000) 21-30
32. Oviatt, S.L.: Multimodal signal processing in naturalistic noisy environments. In Yuan, B., Huang, T., Tang, X., eds.: Proceedings of the 6th International Conference on SPoken Language Processing (ICSLP). Volume 2., Peking, Chinese Friendship Publishers (2000) 696-699
33. Oviatt, S.: Taming recognition errors with a multimodal interface. Commun. ACM 43(9) (2000) 45-51
34. Kumar, S., Cohen, P.R., Coulston, R.: Multimodal interaction under exerted conditions in a natural field setting. In: ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces, New York, NY, USA, ACM Press (2004) 227-234
35. Nishimoto, T., Shida, N., Kobayashi, T., Shirai, K.: Improving human interface in drawing tool using speech. In: Proceedings of 4th IEEE International Workshop on Robot and Human Communication, ROMAN'95. (1995) 107-112
36. Huang, X., Acero, A., Chelba, C., Deng, L., Duchene, D., Goodman, J., Hon, H., Jacoby, D., Jiang, L., Loynd, R., Mahajan, M., Mau, P., Meredith, S., Mughal, S., Neto, S., Plumpe, M., Wang, K., Wang, Y.: Mipad: A next generation pda prototype. In: ICSLP, Peking (2000)
37. Lai, J.: Facilitating mobile communication with multimodal access to email messages on a cell phone. In: CHI '04: CHI '04 extended abstracts on Human factors in computing systems, New York, NY, USA, ACM Press (2004) 1259-1262
38. Jöst, M., Hü ß ler, J., Merdes, M., Malaka, R.: Multimodal interaction for pedestrians: an evaluation study. In: IUI '05: Proceedings of the 10th international conference on Intelligent user interfaces, New York, NY, USA, ACM Press (2005) 59-66