An open source workbench for prototyping multimodal interactions based on off-the-shelf heterogeneous components

EICS'09 - Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems

Volumn , Issue , 2009, Pages 245-254

  Lawson, Jean Yves Lionel ^a   Al Akkad, Ahmad Amr ^b   Vanderdonckt, Jean ^a   Macq, Benoit ^a  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^b FRAUNHOFER INSTITUTE FOR APPLIED INFORMATION TECHNOLOGY FIT   (Germany)

Author keywords

Component based architecture; Multimodal interfaces; Multimodal software architecture; Prototyping; Reusable software component

Indexed keywords

COMPONENT-BASED ARCHITECTURE; MULTI-MODAL; MULTI-MODAL INTERFACES; MULTIMODAL SOFTWARE ARCHITECTURE; PROTOTYPING; REUSABLE SOFTWARES;

ARCHITECTURE; BRIDGES; COMPUTER SOFTWARE REUSABILITY; DESIGN; INTEGRATED OPTICS; INTERACTIVE COMPUTER SYSTEMS; SOFTWARE ARCHITECTURE;

SOFTWARE PROTOTYPING;

EID: 77949381075     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1570433.1570480     Document Type: Conference Paper

References (27)

1. Benoit, A., Bonnaud, L., Caplier, A., Damousis, I., Tzovaras, D., Jourde, E., Nigay, L., Serrano M. and Lawson, J-Y. 2006. Multimodal Signal Processing and Interaction for a Driving Simulation: Component-based Architecture. Journal on Multimodal User Interfaces,1, 1,49-58.
2. Bouchet, J., Nigay, L. (2004). ICARE: A Component-Based Approach for the Design and Development of Multimodal Interfaces, Extended Abstracts CHI'04, ACM, pp. 1325-1328.
3. Camurri, A., Ricchetti, M., and Trocca, R. 1999. EyesWeb - toward gesture and affect recognition in dance/music interactive systems, Proc. IEEE Multimedia Systems '99, Firenze, Italy, June 1999.
4. Cohen, P. R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., and Clow, J. 1997. QuickSet: multimodal interaction for distributed applications, Proc. of MULTIMEDIA '97. ACM Press, pp. 31-40.
5. Coutaz, J. Nigay, L. Salber, D. Blandford, A. May, J. and Young, R. (1995), Four Easy Pieces for Assessing the Usability of Multimodal in Interaction the CARE Properties, Proc.of Interact' 95, pp. 115-120.
6. Dragicevic P. and Fekete J-D. Input Device Selection and Interaction Configuration with ICON: Joint proc. of IHM'01-HCI'01. Springer Verlag, pp 543-558.
7. eNTERFACE Workshops, http://www.enterface.net/
8. Gray, P., Ramsay, A., Serrano, M. A demonstration of the OpenInterface Interaction Development Environment. UIST'07 Adj. Proc.
9. H. Sakoe, S. Chiba, Dynamic programming algorithm optimization for spoken word recognition. In IEEE Transactions on Acoustics, Speech, and Signal Processing 26 (1) (1978) 43-49.
10. Hartmann, B., Abdulla, L., Mittal, M., and Klemmer, S. R. 2007. Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition. Proc. of CHI '07. ACM Press, 145-154.
11. Hartmann, B., Klemmer, S. R., Bernstein, M., Abdulla, L., Burr, B., Robinson-Mosher, A., and Gee, J. 2006. Reflective physical prototyping through integrated design, test, and analysis. Proc. of UIST '06.
12. Kato, H., Billinghurst, M. (1999) Marker Tracking and HMD Calibration for a video-based Augmented Reality Conferencing System. Proc. of IWAR'99.
13. Lawson, J.-Y., Vanderdonckt, J., Macq, B. Rapid Prototyping of Multimodal Interactive Applications Based on Off-The-Shelf Heterogeneous Components. UIST'08 Adjunct. Proc.
14. Lawson, J-Y., 2006. OpenInterface Description Languages Specification. Technical report, 2006: http://www.openinterface.org/platform/documentation
15. Li, Y. and Landay, J. A. 2005. Informal prototyping of continuous graphical interactions by demonstration, Proc. of UIST '05. ACM Press, pp. 221-230.
16. Martin, J. C., TYCOON: Theoretical Framework and Software Tools for Multimodal Interfaces, Intelligence and Multimodality in Multimedia Interfaces, AAAI Press, 1997.
17. Max/MSP, http://www.cycling74.com
18. Maynes-Aminzade, D., Winograd, T., and Igarashi, T. (2007). Eyepatch: prototyping camera-based interaction through Examples, Proc. of UIST'07, ACM Press, pp. 33-42.
19. Mehta, N. R., Medvidovic, N., and Phadke, S. 2000. Towards a taxonomy of software connectors. Proc. of ICSE '00. ACM Press, pp. 178-187.
20. Merrill, D. and Paradiso, J. A Personalization, Expressivity, and Learnability of an Implicit Mapping Strategy for Physical Interfaces, Proc. of CHI'05 ACM Press, pp. 2152-2161.
21. Puckette, M., 1996. "Pure Data: another integrated computer music environment.", Proc. of the Second Intercollege Computer Music Concerts, Tachikawa, pp. 37-41
22. Schedlbauer, M. J. An extensible platform for the interactive exploration of Fitts' Law and related movement time models. In CHI '07 Extended Abstracts on Human Factors in Computing Systems. ACM Press, pp. 2633-2638.
23. Shaw, M. and Garlan, D. Software Architecture: Perspectives on an Emerging Discipline. Prentice-Hall, 1996.
24. Sinha, A. K. and Landay, J. A. 2003. Capturing user tests in a multimodal, multidevice informal prototyping tool. Proc. of ICMI '03, ACM Press, pp. 117-124.
25. Trevisan, Daniela G.; Nicolas, Vincent; Macq, Benoit; NEDEL, Luciana P. MedicalStudio: a medical component-based framework, Proc of.WIM '07.
26. Vybornova, O., Mendonça, H., Lawson, J.Y., Macq, B. High Level Data Fusion on a Multimodal Interactive Applications Platform. Proc of ISM'08.
27. Web Services Description Language (WSDL), http://www.w3.org/TR/wsdl.