Quickset: Multimodal interaction for distributed applications

Proceedings of the 5th ACM International Conference on Multimedia, MULTIMEDIA 1997

Volumn , Issue , 1997, Pages 31-40

  Cohen, Philip R ^a   Johnston, Michael ^a   Mcgee, David ^a   Oviatt, Sharon ^a   Pittman, Jay ^a   Smith, Ira ^a   Chen, Liang ^a   Glow, Josh ^a  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

Author keywords

Agent architecture; Distributed interactive simulation; Gesture recognition; Multimodal interfaces; Natural language processing; Speech recognition

Indexed keywords

ARCHITECTURE; COMPUTER SIMULATION LANGUAGES; GESTURE RECOGNITION; INTERACTIVE COMPUTER SYSTEMS; MARINE COMMUNICATION; NATURAL LANGUAGE PROCESSING SYSTEMS; SPEECH RECOGNITION;

AGENT ARCHITECTURES; DISTRIBUTED APPLICATIONS; DISTRIBUTED INTERACTIVE SIMULATION; EMERGING APPLICATIONS; MULTI-MODAL INTERACTIONS; MULTI-MODAL INTERFACES; MULTI-MODAL SIMULATION; MULTIMODAL INTEGRATION;

COMPUTER ARCHITECTURE;

EID: 84885236196     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/266180.266328     Document Type: Conference Paper

References (32)

1. Bolt, R. A. 1980. Put-That-There:Voice and gesture at the graphics interface. Computer Graphics. 14.3, pp. 262-270.
2. Baker, M. P., and Wickens, C. D. Human factors in virtual environments for the visual analysis of scientific data. Unpublished ms., University of Illinois.
3. Brooks, Frederic. 3-D user interfaces: When results matter, Invited presentation (unpublished), UIST'96, Seattle, 1996.
4. Brison, E. and Vigouroux, N. (unpublished ms.). Multimodal references: A generic fusion process. URTT-URA CNRS. University Paul Sabatier, Toulouse, France.
5. Calder, J. 1987. Typed unification for natural language processing. In E. Klein and J. van Benthem (Eds.), Categories, Polymorphisms, and Unification. Centre for Cognitive Science, University of Edinburgh, Edinburgh, pp. 65-72.
6. Cheyer, A., and Julia, L. 1995. Multimodal maps: An agent- based approach. International Conference on Cooperative Multimodal Communication (CMC/95), May 1995. Eindhoven, The Netherlands, pp. 24-26.
7. Carpenter, R. 1990. Typed feature structures: Inheritance, (In)equality, and Extensionality. In W. Daelemans and G. Gazdar (Eds.), Proceedings of the UK Workshop: Inheritance in Natural Language Processing, Tilburg University, pp. 9-18.
8. Carpenter, R. 1992. The logic of typed feature structures. Cambridge University Press, Cambridge.
9. Christensen, J., Marks, J.., and Shieber, S. Placing text labels on maps and diagrams, Graphics Gems IV, Heckbert, P. (ed.), Academic Press, Cambridge, Mass., 1994, 497-504.
10. Clarkson, J. D., and Yi, J. LeatherNet: A synthetic forces tactical training system for the USMC commander. Proceedings of the Sixth Conference on Computer Generated Forces and Behavioral Representation. Orlando, Florida, 1996 275-281.
11. Cohen, P. R. The Role of Natural Language in a Multimodal Interface. Proceedings of UIST'92, ACM Press, NY, 1992, 143149.
12. Cohen, P. R., Dalrymple, M., Moran, D. B., Pereira, F. C. N., Sullivan, J. W., Gargan, R. A., Schlossberg, J. L., Tyler, S. W., Synergistics use of direct manipulation and natural language, Proceedings of Human Factors in Computing Systems (CHI'89), ACM Press, New York, 1989, 227-234.
13. Cohen, P. R., Cheyer, A., Wang, M., and Baeg, S.C. An Open Agent Architecture. Proceedings of the AAAI Spring Symposium Series on Software Agents (March 21-22, Stanford), Stanford Univ., CA, 1994, 1-8.
14. Courtemanche, AJ. and Ceranowicz, A. Mod SAF Development Status. Proceedings of the Fifth Conference on Computer Generated Forces and Behavioral Representation, Univ. Central Florida, Orlando, 1995, 3-13.
15. Cruz-Neira, C. D. J., Sandin, T. A., DeFanti, "Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE, " Computer Graphics, ACM SIGGRAPH, August 1993, pp. 135-142.
16. Johnston, M., Cohen, P. R., McGee, D., Pittman, J., Oviatt, S. L., and Smith, I. Unification-based multimodal integration, Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL-97/EACL-97) Conference, Madrid, Spain, July, 1997.
17. Koons, D.B., C J. Sparrell and K. R. Thorisson. 1993. Integrating simultaneous input from speech, gaze, and hand gestures. In Mark T. Maybury (ed.) Intelligent Multimedia Interfaces. AAAI Press/MIT Press, Cambridge, MA, pp. 257-276.
18. Manke, S., Finke, M., and Waibel, A., The use of dynamic writing information in a connectionist on-line cursive handwriting recognition system, Advances in Neural Information processing Systems 7 (NIPS), 1994.
19. Moore, R. C., Dowding, J, Bratt, H., Gawron, M., and Cheyer, A. CommandTalk: A spoken-language interface for battlefield simulations, Proc. of the 3rd Applied Natural Language Conference, Wash. DC, 1997.
20. Neal, J.G. and Shapiro, S.C. Intelligent multi-media interface technology. In J.W. Sullivan and S.W. Tyler, editors, Intelligent User Interfaces, chapter 3, pages 45-68. ACM Press Frontier Series, Addison Wesley Publishing Co., New York, New York, 1991.
21. Oviatt, S. L. Pen/Voice: Complementary multimodal communication, Proceedings of SpeechTech'92, New York, February, 1992, 238-241.
22. Oviatt, S.L. Multimodal interfaces for dynamic interactive maps. Proceedings of CHI'96 Human Factors in Computing Systems ACM Press, NY, 1996, 95-102.
23. Oviatt, S.L. Multimodal interactive maps: Designing for human performance, Human Computer Interaction, in press.
24. Oviatt, S. L, A. DeAngeli, and K. Kuhn. Integration and synchronization of input modes during multimodal human- computer interaction. Proceedings of the Conference on Human Factors in Computing Systems (CHI '97), ACM Press, NY, 1997, 415-422.
25. Oviatt, S. L., and Olsen, E., Integration themes in multimodal human-computer interaction, Proceedings of the International Conference on Spoken Language Processing, Acoustical Society of Japan, Yokohama, Japan, 1994, 551-554.
26. Pittman, J. A. Recognizing handwritten text Human Factors in Computing Systems (CHI'91), 1991, 271-275.
27. Stoakley, R., Conway, M., and Pausch, R. Virtual reality on a WIM: Interactive worlds in miniature, Proceedings, of Human Factors in Computing Systems (CHI'95), ACM Press, New York, 1995, 265-272.
28. Thorpe, J. A. The new technology of large scale simulator networking: Implications for mastering the art of warfighting. 9th Interservice Training Systems Conference, 1987, 492-501.
29. Vo, M. T. and Wood, C. Building an application framework for speech and pen input integration in multimodal learning interfaces. International Conference on Acoustics, Speech, and Signal Processing, Atlanta, GA. 1996.
30. Waibel, A., Vo, M. T., Duchnowski, P., and Manke, S. Multimodal interfaces, Artificial Intelligence Review, 1995.
31. Wauchope, K. 1994. Eucalyptus: Integrating natural language input with a graphical user interface. Naval Research Laboratory, Report NRL/FR/5510-94-9711.
32. Zyda, M. J., Pratt, D. R., Monahan, J. G., and Wilson, K. P., NPSNET: Constructing a 3-D virtual world, Proceedings of the 1992 Symposium on Interactive 3-D Graphics, March, 1992.