A framework to manage multimodal fusion of events for advanced interactions within Virtual Environments

Proceedings of the 8th Eurographics Workshop on Virtual Environments, EGVE 2002

Volumn , Issue , 2002, Pages 159-168

  Touraine, Damien ^a   Bourdot, Patrick ^a   Bellik, Yacine ^a   Bolot, Laurence ^a  

^a CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH RECOGNITION;

DATA GLOVE; DATAFLOW; DISTRIBUTED ARCHITECTURE; FUSION PROCESS; GESTURE RECOGNITION SYSTEM; HAPTIC DEVICES; MULTI-MODAL FUSION; SPEECH RECOGNITION SYSTEMS; SYNCHRONIZATION SYSTEMS; TIME SYNCHRONIZATION;

VIRTUAL REALITY;

EID: 85121793785     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. P. Bourdot, M. Krus, and R. Gherbi. Cooperation between reactive 3D objects and a multimodal X window kernel for CAD. In Lecture Notes in Artificial Intelligence (1374) on Multimodal Human-Computer Communication : Systems, Techniques and Experiments, pages pp. 188-212. Springer, January 1998.
2. P. Bourdot and D. Touraine. A hierarchical server to manage multimodal and collaborative interactions within Virtual Environments. In Proc. of the 19th IASTED International Conference on Applied Informatics, Innsbruck (Austria), February 2001.
3. P. Bourdot and D. Touraine. Polyvalent display framework to control virtual navigations by 6dof tracking. In Proc. of IEEE International Virtual Reality Conference 2002, Mars 2002.
4. C. Carlsson and O. Hagsand. DIVE - a platform for multi-user virtual environments. Computer & graphics, 17(6):663 - 669, 1993.
5. P. R. Cohen, D. McGee, S. Oviatt, L. Wu, J. Clow, R. King, S. Julier, and L. Rosenblum. Multimodal interaction for 2d and 3d environments. In IEEE Computer Graphics and Applications, volume 19(4), pages 10-13. IEEE Press, 1999.
6. P. R. Cohen and S. L. Oviatt. The role of voice input for human-machine communicatio. In Proceedings of the National Academy of Sciences, volume 92(22), pages 9921-9927. Washington, D. C. National Academy of Sciences Press, 1995.
7. Y. Gong. Speech recognition in noisy environments: A survey. In Speech Communication, volume 6, pages 261-291, 1995.
8. A. Gregory, M. Lin, S. Gottschalk, and R. Taylor. Hcollide: A framework for fast and accurate collision detection for haptic interaction. In IEEE Virtual Reality, 1999.
9. R. Taylor II, T. Hudson, A. Seeger, H.Weber, J. Juliano, and A. Helser. Vrpn: A device-independent, networktransparent vr peripheral system. In Proc. of Virtual Reality Software & Technology 2001 (VRST'01), Banff, Alberta (Canada), November 2001.
10. C. Just, C. Cruz-Neira, and A. Baker. Performance measurement capabilities of vr juggler : Real-time monitoring of immersive applications. In The 4th international immersive projection technology workshop, 2000.
11. J. Kelso, L. Arsenault, C. Logie, F. das Neves, and R. Kriz. Diverse graphics interface for performer programmer's guide. Technical report, University Visualization and Animation Group of the Advanced Communication and Information Technology Center, Virginia Tech, July 2000. http://www.diverse.vt.edu/dtk/.
12. J. A. Larson, S. L. Oviatt, and D. Ferro. Designing the user interface for pen and speech applications. In Conference on Human Factors in Computing Systems (CHI'99), 1999.
13. D. R. McGee, P. R. Cohen, and L. Wu. Something from nothing: Augmenting a paper-based work practice with multimodal interaction. In Proceedings of the Designing Augmented Reality Environments Conference, pages 71-80. ACM Press, 2000.
14. D.L Mills. Network time protocol (version 3): Specification, implementation and analysis. University of Delaware, March 1992. Request For Comment (RFC) : 1305.
15. L. Nigay and J. Coutaz. A design space for multimodal systems : Concurent processing and data fusion. In Proc. of INTERCHI'93, pages 172-178. ACM Press, april 1993.
16. US Depatement of defense. High Level Architecture (HLA) interface specification. submission to the IEEE committy, April 1998.
17. S. Oviatt, P. Cohen, LZ. Wu, J. Vergo, L. Duncan, B. Suhm, J. Bers, Holzman, T. Winograd, J. Landay, J. Larson, and D. Ferro. Designing the user interface for multimodal speech and pen-based gesture applications: State-of-the-art systems and future research directions. In Human-computer interaction, volume 15 (4), pages 263-322, 2000.
18. S. L. Oviatt, A. DeAngeli, and K. Kuhn. Integration and synchronization of input modes during multimodal human-computer interaction. In Proceedings of Conference on Human Factors in Computing Systems (CHI'97), pages 415-422. New York: ACM Press, 1997.
19. C. Pinon-Bouwens and LB. Mc Donald. Distributed interactive simulation: Interoperability of dissimilar training devices for team training. In Twenty-Third Annual Summer Computer Simulation Conference, editor, the 1991 Summer Computer Simulation Conference, volume xxiii+1194, pages 934 - 939, CSC, San Diego, CA, USA, 1991.
20. G. Reitmayr and D. Schmalstieg. An open software architecture for virtual reality interaction. In Proc. of Virtual Reality Software & Technology 2001 (VRST'01), Banff, Alberta (Canada), November 2001.
21. D. Rubine. The automatic recognition of gestures. PhD thesis, Carnegie Mellon University, 1991.
22. A. Shaikh, S. Juth, A. Medl, I. Marsic, C. Kulikowski, and J. Flanagan. An architecture for multimodal information fusion. In Proceedings of the Workshop on Perceptual User Interfaces (PUI'97), pages 91-93, 1997.
23. S. Singhal and M. Zyda. Networked Virtual Environments. ACM Press, July 1999. ISBN=0-201-32557-8.
24. D. N. Snowdon and A. J. West. The AVIARY VRsystem. a prototype implementation. June 1994.
25. D. Touraine and P. Bourdot. VEserver : A manager for input and haptic multi-sensorial devices. In Proc. of 10th IEEE international workshop on Robot and Human Communication, pages 2-7, september 2001.
26. M. J. Zyda, D. R. Pratt, W. D. Osborne, and J. G. Monahan. NPSNET: Real-time collision detection and response. The Journal of Visualization and Computer Animation, 4(1):13-24, January-March 1993.