A framework for the intelligent multimodal presentation of information

Signal Processing

Volumn 86, Issue 12, 2006, Pages 3696-3713

  Rousseau, Cyril ^a   Bellik, Yacine ^a   Vernier, Frédéric ^a   Bazalgette, Didier ^b  

^a CNRS   (France)

^b DGA/DSP/STTC/DT/SH   (France)

Author keywords

Human computer interaction; Interaction context; Multimodal presentation; Output multimodality; Outputs simulation; Outputs specification

Indexed keywords

INTERACTION CONTEXT; MULTIMODAL PRESENTATIONS; OUTPUT MULTIMODALITY; OUTPUTS SIMULATION; OUTPUTS SPECIFICATION;

COMPUTER SIMULATION; COMPUTER SOFTWARE; HUMAN COMPUTER INTERACTION; MATHEMATICAL MODELS; MODAL ANALYSIS; PROBLEM SOLVING;

INFORMATION THEORY;

EID: 33749435753     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2006.02.041     Document Type: Article

References (42)

1. Stephanidis C., and Savidis A. Universal access in the information society: methods, tools, and interaction technologies. Universal Access Inform Soc 1 1 (2001) 40-55
2. Coutaz J. Multimedia and multimodal user interfaces: a software engineering perspective, Proceedings of Workshop on Human Computer Interaction (1992), St Petersburg, Russia
3. L. Bass, R. Faneuf, R. Little, N. Mayer, B. Pellegrino, S. Reed, R. Seacord, S. Sheppard, M.R. Szczur (Eds.), A metamodel for the runtime architecture of an interactive system, SIGCHI Bulletin, Vol. 24, The UIMS Tool Developers Workshop, January 1992, pp. 32-37.
4. N.O. Bernsen, A reference model for output information in intelligent multimedia presentation systems, in: G.P. Faconti, T. Rist (Eds.), Proceedings of ECAI '96 Workshop on Towards a standard Reference Model for Intelligent Multimedia Presentation Systems, Budapest, August 1996.
5. Bordegoni M., Faconti G., Maybury M.T., Rist T., Ruggieri S., Trahanias P., and Wilson M. A standard reference model for intelligent multimedia presentation systems. Comput. Stand. Inter. 18 6-7 (1997) 477-496
6. L. Nigay, J. Coutaz, A generic platform for addressing the multimodal challenge, Proceedings of CHI'95, Denver, Colorado, USA, 7-11 May 1995, pp. 98-105.
7. Y. Bellik, Interfaces multimodales: concepts, modèles et architectures, Ph.D. Thesis, University of Paris XI, Orsay, France, 1995.
8. A. K. Dey, D. Salber, G.D. Abowd, A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications, in: T.P. Moran, P. Dourish (Eds.), Hum-Comput. Interact. 16 (2-4) (2001) 97-166.
9. Arens Y., and Hovy E.H. The design of a model-based multimedia interaction manager. Artifi. Intell. Rev. 9 3 (1995) 167-188
10. J. Coutaz, L. Nigay, D. Salber, A. Blandford, J. May, R.M. Young, Four easy pieces for assessing the usability of multimodal interaction: the CARE properties, Proceedings of INTERACT'95, Lillehammer, Norway, 1995.
11. C. Stephanidis, C. Karagiannidis, A. Koumpis, Decision making in intelligent user interfaces, Proceedings of Intelligent User Interfaces 97, 6-9 January 1997, pp. 195-202.
12. Johnston M., and Bangalore S. Finite-state multimodal integration and understanding. Nat. Lang. Eng. 11 2 (2005) 159-187
13. R. Bastide, P. Palanque, H. Le Duc, J. Munoz, Integrating rendering specifications into a formalism for the design of interactive systems, Proceedings of the 5th Eurographics Workshop on Design: Specification and Verification of Interactive systems (DSV-IS'98), Abington, UK, June 1998.
14. Calvary G., Coutaz J., Thevenin D., Limbourg Q., Bouillon L., and Vanderdonckt J. A unifying reference framework for multi-target user interfaces. Interact. Comput. 15 3 (2003) 289-308
15. Karagiannidis C., Koumpis A., and Stephanidis C. Adaptation in intelligent multimedia presentation systems as a decision making process. Comput. Stand. Inter. 18 2-3 (1997)
16. F. Vernier, L. Nigay, A framework for the combination and characterization of output modalities, Proceedings of the 7th International Workshop on Design, Specification and Verification of Interactive Systems (DSV-IS), Limerick, Ireland, 5-6 June 2000, pp. 35-50.
17. André E. The generation of multimedia presentations. In: Dale R., Moisl H., and Somers H. (Eds). Handbook of Natural Language Processing: Techniques and Applications for the Processing of Language as Text (2000), Marcel Dekker, New York 305-327
18. T. Lemlouma, N. Layaida, Context-aware adaptation for mobile devices, Proceedings of Mobile Data Management 2004, Berkeley, CA, USA, 19-22 January 2004, pp. 106-111.
19. Rist T., and Brandmeier P. Customizing graphics for tiny displays of mobile devices. Pers. Ubiquitous Comput. 6 4 (2002) 260-268
20. M. Dalal, S. Feiner, K. McKeown, S. Pan, M. Zhou, T. Höllerer, J. Shaw, Y. Feng, J. Fromer, Negotiation for automated generation of temporal multimedia presentations, Proceedings of ACM Multimedia 96, Boston, USA, 18-22 November 1996, pp. 55-64.
21. W. H. Graf, The constraint-based layout framework LayLab and its applications, Proceedings of the Workshop on Effective Abstractions in Multimedia Layout, Presentations, and Interaction in conjunction with ACM Multimedia'95, San Francisco, USA, 4 November 1995.
22. André E. Natural Language in Multimedia/Multimodal Systems. In: Mitkov R. (Ed). Handbook of Handbook of Computational Linguistics (2003), Oxford University Press, Oxford 650-669
23. A. Braffort, A. Choisier, C. Collet, P. Dalle, F. Gianni, B. Lenseigne, J. Segouat, Toward an annotation software for video of sign language, including image processing tools and signing space modelling, Proceedings of 4th Conference on Language Resources and Evaluation (LREC'O4), Lisbonne, Portugal, 2004.
24. A. Schmidt, K. Aidoo, A. Takaluoma, U. Tuomela, K. van Laerhoven, W. van de Velde, Advanced interaction in context, Proceedings of 1st International Symposium on Handheld and Ubiquitous Computing (HUC '99), Karlsruhe, Germany, 1999.
25. J. Vanderdonckt, D. Grolaux, P. Van Roy, Q. Limbourg, B. Macq, B. Michel, A design space for context sensitive user interfaces, Proceedings of 14th International Conference on Intelligent and Adaptive Systems and Software Engineering IASSEi'05, Toronto, Canada, 20-22 July 2005.
26. C. Rousseau, Y. Bellik, F. Vernier, D. Bazalgette, Architecture framework for output multimodal systems design, Proceedings of OZCHI'04, Wollongong, Australia, 22-24 November 2004.
27. C. Karagiannidis, A. Koumpis, C. Stephanidis, Deciding 'What', 'When', 'Why', and 'How' to adapt in intelligent multimedia presentation systems, Proceedings ECAI Workshop on Towards a standard reference model for intelligent multimedia presentation systems, Budapest, Hungary, August 1996.
28. L. Balme, A. Demeure, N. Barralon, J. Coutaz, G. Calvary, in: P. Markopoulos et al. (Eds.), CAMELEON-RT: a Software Architecture Reference Model for Distributed, Migratable, and Plastic User Interfaces, Lecture Notes in Computer Science, volume 3295/2004, Ambient Intelligence: Second European Symposium, EUSAI 2004, 8-11 November 2004, pp. 291-302.
29. D. Thevenin, J. Coutaz, Plasticity of user interfaces: framework and research agenda, Proceedings of INTERACT'99, Edinburgh, UK, August 1999, pp. 110-117.
30. M. Crease, P. Gray, S. Brewster, A toolkit of mechanism and context independent widgets, Proceedings of the 7th Workshop DSV-IS, Limerick, Ireland, 5-6 June 2000, pp. 121-133.
31. S. Abrilian, J.-C. Martin, S. Buisine, Algorithms for controlling cooperation between output modalities in 2D embodied conversational agents, Proceedings of ICMI'03, Vancouver, Canada, 5-7 November 2003, pp. 293-296.
32. C. Rousseau, Y. Bellik, F. Vernier, Multimodal output specification/simulation platform, Proceedings of ICMI'05, Trento, Italy, 04-06 October 2005.
33. M. Antona, A. Savidis, C. Stephanidis, MENTOR: an interactive design environment for automatic user interface adaptation, Technical Report 341, ICS-FORTH, Heraklion, Crete, Greece, August 2004.
34. W. Chou, D. A. Dahl, M. Johnston, R. Pieraccini, D. Raggett, W3C: EMMA: Extensible MultiModal Annotation markup language, Retrieved 14-12-2004 from http://www.w3.org/TR/emma/
35. K. Katsurada, Y. Nakamura, H. Yamada, T. Nitta, XISL: a language for describing multimodal interaction scenarios, Proceedings of ICMI'03, 5-7 November 2003, pp. 281-284.
36. S. Bleul, R. Schaefer, W. Mueller, Multimodal dialog description for mobile devices, Proceedings Workshop on XML-based User Interface Description Languages at AVI'04, Gallipoli, Italy, 25 May 2004.
37. Q. Limbourg, J. Vanderdonckt, UsiXML: a user interface description language supporting multiple levels of independence, in: M. Matera, S. Comai (Eds.), Engineering Advanced Web Applications, Rinton Press, 2004.
38. R. Bastide, D. Bazalgette, Y. Bellik, L. Nigay, C. Nouvel, The INTUITION design process: structuring military multimodal interactive cockpits design according to the MVC design pattern. Proceedings of HCI International 2005, Las Vegas, Nevada, USA, July 2005.
39. J. Bouchet, L. Nigay, ICARE: A Component Based Approach for the Design and Development of Multimodal Interfaces, Extended Abstracts of CHI'04, 2004.
40. J. Bouchet, L. Nigay, T. Ganille, The ICARE component-based approach for multimodal interaction: application to military plane multimodal cockpit, Proceedings of HCI International 2005, Las Vegas, Nevada, USA, July 2005.
41. R. Bastide, E. Barboni, D. Bazalgette, X. Lacaze, D. Navarre, P. Palanque, A. Schyn supporting intuition through formal specification of the user interface for military aircraft cockpit. Proceedings of HCI International 2005, Las Vegas, Nevada, USA, July 2005.
42. C. Rousseau, Y. Bellik, F. Vernier, D. Bazalgette, Multimodal output simulation platform for real-time military systems, Proceedings of HCI International 2005, Las Vegas, Nevada, USA, 22-27 July 2005.