Confirmation in multimodal systems

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn 2, Issue , 1998, Pages 823-829

  McGee, David R ^a   Cohen, Philip R ^a   Oviatt, Sharon ^a  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

Author keywords

Confirmation; Disambiguation; Multimodal; Uncertainty

Indexed keywords

CONFIRMATION; CONTROLLED EXPERIMENT; DISAMBIGUATION; ERROR RATE; EXECUTABLES; MULTI-MODAL; MULTIMODAL SYSTEM; PRIMARY MODALITY; UNCERTAINTY; USER EXPECTATIONS;

EID: 85149118801     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. D. Pedis and K. Purang, "Conversational adequacy: Mistakes are the essence," in Proceedings of Workshop on Detecting, Repairing, and Preventing Human-Machine Miscommunication, AAAI96,1996.
2. R. Bolt, "Put-That-There: Voice and gesture at the graphics interface," Computer Graphics, vol. 14, pp. 262-270, 1980.
3. M. T. Vo and C. Wood, "Building an Application Framework for Speech and Pen Input Integration in Multimodal Learning Interfaces," in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP96, Atlanta, GA, 1996.
4. P. R. Cohen, M. Johnston, D. McGee, I. Smith, J. Pittman, L. Chen, and J. Clow, "Multimodal interaction for distributed interactive simulation," in Proceedings of Innovative Applications of Artificial Intelligence Conference, IAAI97, Menlo Park, CA, 1997.
5. M. Johnston, P. R. Cohen, D. McGee, S. L. Oviatt, J. A. Pittman, and I. Smith, "Unification-based multimodal integration," in Proceedings of 35th Annual Meeting of the Association for Computational Linguistics, ACL97, Madrid, Spain, 1997.
6. J. R. Rhyne and C. G Wolf, "Chapter 7: Recognition-based user interfaces," in Advances in Human-Computer Interaction, vol. 4, H. R. Hanson and D. Hix, Eds., pp. 191-250,1992.
7. S. Oviatt, A. DeAngeli, and K. Kuhn, "Integration and synchronization of input modes during multimodal human-computer interaction," in Proceedings of Conference on Human Factors in Computing Systems, CHI"97, pp. 415-422, Atlanta, GA, 1997.
8. P. Lefebvre, G Duncan, and F. Poirier, "Speaking with computers: A multimodal approach," in Proceedings of EUROSPEECH93 Conference, pp. 1665-1668, Berlin, Germany, 1993.
9. P. Morin and J. Junqua, "Habitable interaction in goal-oriented multimodal dialogue systems," in Proceedings of EUROSPEECH93 Conference, pp. 1669-1672, Berlin, Germany, 1993.
10. L. Hirschman and C. Pao, "The cost of errors in a spoken language system," in Proceedings of EUROSPEECH93 Conference, pp. 1419-1422, Berlin, Germany, 1993.
11. H. Clark and D. Wilkes-Gibbs, "Referring as a collaborative process," Cognition, vol. 13, pp. 259-294,1986.
12. P. R. Cohen and H. J. Levesque, "Confirmations and joint action," in Proceedings of International Joint Conference on Artificial Intelligence, pp. 951-957,1991.
13. D. G Novick and S. Sutton, "An empirical model of acknowledgment for spoken-language systems," in Proceedings of 32nd Annual Meeting of the Association for Computational Linguistics, ACL94, pp. 96-101, Las Cruces, New Mexico, 1994.
14. D. Traum, "A Computational Theory of Grounding in Natural Language Conversation," Computer Science Department, University of Rochester, Rochester, NY, Ph.D. 1994.
15. H. H. Clark and E. F. Schaefer, 'Contributing to discourse," Cognitive Science, vol. 13, pp. 259-294,1989.
16. S. L. Oviatt, P. R. Cohen, and A. M. Podlozny, "Spoken language and performance during interpretation," in Proceedings of International Conference on Spoken Language Processing, ICSLP90, pp. 1305-1308, Kobe, Japan, 1990.
17. S. L. Oviatt and P. R. Cohen, "Spoken language in interpreted telephone dialogues," Computer Speech and Language, vol. 6, pp. 277-302,1992.
18. G Ferguson, J. Allen, and B. Miller, 'The design and implementation of the TRAJNS-96 system: A prototype mixed-initiative planning assistant," University of Rochester, Rochester, NY, TRAINS Technical Note 96-5, October 1996 1996.
19. G Ferguson, J. Allen, and B. Miller, 'TRAINS-95: Towards a mixed-initiative planning assistant," in Proceedings of Third Conference on Artificial Intelligence Planning Systems, AIPS96, pp. 70-77,1996.
20. D. Goddeau, E. Brill, J. Glass, C. Pao, M. Phillips, J. Polifroni, S. Seneff, and V. Zue, "GALAXY: A Human-Language Interface to On-line Travel Information," in Proceedings of International Conference on Spoken Language Processing, ICSLP 94, pp. 707-710, Yokohama, Japan, 1994.
21. R. Lau, G Flammia, C. Pao, and V. Zue, "WebGALAXY: Spoken language access to information space from your favorite browser," Massachusetts Institute of Technology, Cambridge, MA, URL http^/www.sls.lcs.mitedu/SLSPublications.html. December 1997 1997.
22. V. Zue, "Navigating the information superhighway using spoken language interfaces," IEEE Expert, pp. 39-43,1995.
23. P. R. Cohen, A. Cheyer, M. Wang, and S. C. Baeg, "An open agent architecture," in Proceedings ofAAAI 1994 Spring Symposium on Software Agents, pp. 1-8,1994.
24. X. Huang, A. Acero, F. Alleva, M.-Y Hwang, L. Jiang, and M. Mahajan, "Microsoft Windows Highly Intelligent Speech Recognizer Whisper," in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP95,1995.
25. P. Heisterkamp, "Ambiguity and uncertainty in spoken dialogue," in Proceedings of EUROSPEECH93 Conference, pp. 1657-1660, Berlin, Germany, 1993.
26. Y. Takebayashi, "Chapter 14: Integration of understanding and synthesis functions for multimedia interfaces," in Multimedia interface design, M. M. Blattner and R. B. Dannenberg, Eds. New York, NY: ACM Press, pp. 233-256, 1992.
27. A. L Rudnicky and A. G Hauptmann, "Chapter 10: Multimodal interaction in speech systems," in Multimedia Interface Design, M. M. Blattner and R. B. Dannenberg, Eds. New York, NY: ACM Press, pp. 147-171,1992.
28. A. Lavie, L. Levin, Y. Qu, A. Waibel, and D. Gates, "Dialogue processing in a conversational speech translation system," in Proceedings of International Conference on Spoken Language Processing, ICSLP96, pp. 554-557,1996.
29. R. W. Smith, "An evaluation of strategies for selective utterance verification for spoken natural language dialog," in Proceedings of Fifth Conference on Applied Natural Language Processing, ANLP96, pp. 4148,1996.
30. Y. Niimi and Y Kobayashi, "A dialog control strategy based on the reliability of speech recognition," in Proceedings of International Conference on Spoken Language Processing, ICSLP96, pp. 534-537,1996.