Towards a multimodal interaction space: Categorisation and applications

Personal and Ubiquitous Computing

Volumn 11, Issue 8, 2007, Pages 609-619

  Bongers, Bert ^a,b   van der Veer, Gerrit C ^c  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

^b MAAS Interaction Lab   (Netherlands)

^c OPEN UNIVERSITY OF THE NETHERLANDS   (Netherlands)

Author keywords

Framework; Interactive architecture; Multimodal interaction

Indexed keywords

COMPUTER ARCHITECTURE; INTERACTIVE COMPUTER SYSTEMS; INTERACTIVE DEVICES; USER INTERFACES;

INTERACTIVE ARCHITECTURE; MULTIMODAL INTERACTION;

HUMAN COMPUTER INTERACTION;

EID: 35448960894     PISSN: 16174909     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00779-006-0138-8     Document Type: Conference Paper

References (44)

1. Bongers AJ (2004) Interaction with our electronic environment; an e -cological approach to physical interface design. Cahier Book series, Hogeschool van Utrecht
2. Bongers AJ (2000) Physical interaction in the electronic arts, interaction theory and interfacing techniques for real-time performance. In: Wanderley MM, Battier M (eds) Trends in gestural control of music. IRCAM, pp. 41-70
3. Paradiso J (1997) New ways to play: Electronic music interfaces. IEEE Spectr 34/12:18-30
4. Bongers AJ (2002) Interactivated spaces. In: Proceedings of the symposium on systems research in the arts, Baden-Baden, Germany, August 2002
5. Bongers AJ, Harris YC (2002) A structured instrument design approach: the video-organ. In: Proceedings of the conference on new instruments for musical expression, Dublin, May 2002
6. Sluis R, van de Eggen JH, Jansen J, Kohar H (2001) User interface for an in-home environment. In: Proceedings of the interact conference, Tokyo 2001
7. Bowman DA, Kruijff E, LaViola JJ, Poupyrev I (2004) 3D User interfaces, theory and practice. Addison Wesley, Reading
8. Nigay L, Coutaz J (1993) A design space for multimodal systems: concurrent processing and data fusion. In: Proceedings of the InterCHI, 1993
9. Dragicevic P, Navarre D, Palanque P, Schyn A, Bastide R (2004) Very-high-fidelity prototyping for both presentation and dialogue parts of multimodal interactive systems. EHCI-DSVIS In: Preproceedings 61-88, Hamburg, 2004
10. Schaefer R, Bleul S and Müller, W (2004) A novel dialog model for the design of multimodal user interfaces. EHCI-DSVIS In: Preproceedings, Hamburg, 2004, pp. 390-391
11. Bongers AJ, Eggen JH, Keyson DV, Pauws SC (1998) Multimodal interaction styles. HCI Letters J 1/1:3-5
12. Camurri A, Mazzarino B, Riccchetti M, Timmers R, Volpe G (2003) Multimodal analysis of expressive gesture in music and dance performance. In: Camurri A, Volpe G (eds) Gesture based communication in human-computer interaction, LNAI2915. Springer, Berlin Heidelberg New York, pp 20-39
13. Schomaker L, Münch S, Hartung K, (eds) 1995, A taxonomy of multimodal interaction in the human information processing system. Report of the ESPRIT project 8579: MIAMI
14. Kress G, Leeuwen T van (2001) Multimodal discourse, the modes and media of contemporary communication. Oxford University Press, Oxford
15. Larson JA, Raman TV, Raggett D (eds) (2003) Multimodal interaction framework. W3C Note, on line at http://www.w3.org/TR/mmi-framework
16. Harris YC and Bongers AJ (2002) Approaches to creating interactivated spaces, from intimate to inhabited interfaces. J Organised Sound, Cambridge University Press, Special issue on Interactivity 7/3
17. Dix A, Finlay J, Abowd G, Beale R (1993) Human-computer interaction. Prentice Hall, Englewoods Cliffs
18. Nielsen J (1986) A virtual protocol model for computer-human interaction. Int J Man Mach Stud 24:301-312
19. Nielsen J (1992) A layered interaction analysis of direct manipulation. http://www.useit.com/papers
20. Norman DA (1986) Cognitive engineering. In: Norman DA, Draper SW (eds) User centered system design, chpt. 3. Lawrence Erlbaum Ass., Hillsdale
21. Taylor MM (1988) Layered protocol for computer-human dialogue. I: Principles. Int J Man Mach Stud 28:175-218
22. Eggen JH, Haakma. R, Westerink JHDM (1996) Layered protocols: Hands-on experience. Int J Man Mach Stud 44:45-72
23. Engel. FL, Goossens P, Haakma R (1994) Improved efficiency through I- and E-feedback: A trackball with contextual force feedback. Int J Man Mach Stud 41:949-974
24. Taylor MM and Waugh DA (1991) Multiplexing, diviplexing, and the control of Multimodal Dialogue. In: Taylor MM, Néel F, Bouwhuis DG (eds) The structure of multimodal dialogue II. Acquafredda di Maratea, Italy
25. Garrett JJ (2003) The elements of user experience. New Riders Publishing, Indianapolis
26. Loomis JM, Leederman SJ (1986) Tactual perception. In: Handbook of perception and human performance, Chp. 31
27. Gibson JJ (1979) The ecological approach to visual perception. Houghton Mifflin, Boston
28. Gibson JJ (1966) The senses considered as perceptual systems. Houghton Miffling, Boston
29. Bernsen NO (1993) Modality theory: Supporting multimodal interface design. In: Proceedings from the ERCIM workshop on multimodal human-computer interaction, Nancy, pp. 13-23, November
30. Oosterhuis K (2002) Architecture goes wild. 010 Publishers, Rotterdam
31. Rosenbloom A (2004) Interactive immersion in 3D computer graphics. In: Communications of the ACM 47/8:28-31
32. Zellner P (1999) Hybrid space-new forms in digital architecture, Thames & Hudson, London
33. Jormakka K (2002) Flying dutchmen, motion in architecture. Birkhäuser
34. Buxton WAS (2002) Less is More (More or Less): Uncommon sense and the design of computers. In: Denning PJ (ed) The invisible future, McGraw-Hill, pp 145-179
35. Hubers JC (2005) Parametric design in protospace 1.1. In: Martens B, Brown A (eds) Learning from the pasta foundation for the future. Osterreichischer Kunst- und Kulturverlag, Vienna
36. Hubers JC (2005) Design environment protospace 1.1. In. Sariyildiz S, Tunçer B (eds) Innovation in architecture, engineering and construction. Delft university of technology chair technical design & informatics, The Netherlands
37. Rodet X, Lambert JP, Cahen R, Gaudy T, Gosselin F, Mobuchon P (2005) Study of haptic and visual interaction for sound and music control in the phase project. In: Proceedings of the international conference on new interfaces for musical expression (NIME) Vancouver, May 2005
38. Puckette MS, Apel T, Zicarelli DD (1998) Real-time audio analysis tools for Pd and MSP. In: Proceedings of the international computer music conference (ICMC)
39. Culler D, Estrin D, Srivastava M (2004) Overview of sensor networks. Guest editors introduction. IEEE Comput Spec Issue Sensor Netw 37/8:41-49
40. Olsen Jr, DR and Nielsen T (2001) Laser pointer interaction, In: ACM CHI Conference proceedings: Human factors in computing systems. Seattle, pp. 17-22
41. Myers BA, Bhatnagar R, Nichols J, Peck CH, Kong D, Miller R, Long AC (2002) Interacting at a distance: Measuring the performance of laser pointers and other devices. In: Proceedings of the CHI conference, April 2002
42. Yuan D and Manduchi R (2004) A tool for range sensing and environment discovery for the blind. In: Proceedings of the IEEE workshop on real-time 3-D sensors and their use
43. Bongers AJ and Veer GC van der (2006) Tactual articulatory feedback and gestural input. J Hum Comput Stud (submitted)
44. Bongers AJ (2002) Palpable pixels, a method for the development of virtual textures. In: Ballesteros S, Heller M (eds) Touch, blindness and neuroscience. UNED Ediciones, Madrid