Implementation testing of a hybrid symbolic/statistical multimodal architecture

7th International Conference on Spoken Language Processing, ICSLP 2002

Volumn , Issue , 2002, Pages 173-176

  Kaiser, Edward C ^a   Cohen, Philip R ^a  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DESIGN AND IMPLEMENTATIONS; IMPLEMENTATION TESTING; MULTIMODAL ARCHITECTURES; MULTIMODAL ERRORS; MULTIMODAL RECOGNITION; MULTIMODAL SYSTEM; NOCV1; POSTERIOR PROBABILITY; TRAINING FEATURES;

EID: 85009247655     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Oviatt, S. L. "Taming recognition errors with a multimodal architecture". Communications of the ACM (special issue on conversational interfaces), ACM Press, New York. 2000, 43(9), 45-51.
2. Oviatt, S. L. "Breaking the Robustness Barrier: Recent Progress on the Design of Robust Multimodal Systems". To appear in Advances in Computers (ed. By M. Zelkowitz), Academic Press, vol. 56, 2002.
3. Oviatt, S. L. "Mutual disambiguation of recognition errors in a multimodal architecture". Proceedings of the Conference on Human Factors in Computing Systems (CHI'99), ACM Press, New York, 1999; pp 576-583.
4. Bangalore, S.; Johnston, M. "Integrating multimodal language processing with speech recognition". Proceedings of the International Conference on Spoken Language Processing (ICSLP'2000) (eds. B. Yuan, T. Huang & X. Tang), Chinese Friendship Publishers, Beijing. 2000, 2, 126-129.
5. th Annual Meeting of the Association for Computational Linguistics. (COLING-ACL 98), p 624-630
6. Wu, L.; Oviatt, S.; Cohen, P. "Multimodal integration: A statistical view". IEEE Transactions on Multimedia. 1999, 1(4), 334-342.
7. Wu, L., Oviatt, S. L., & Cohen, P. R. "From members to teams to committee: A robust approach to gestural and multimodal recognition", IEEE Transactions on Neural Networks, to appear in 2002 (special Issue on "Intelligent Multimedia").
8. Oviatt, S. L., DeAngeli, A. & Kuhn, K. "Integration and synchronization of input modes during multimodal humancomputer interaction", in Proceedings of Conference on Human Factors in Computing Systems: CHI'97, New York, ACM Press, 415-422
9. Cohen, P. R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., and Clow, J. (1997). "QuickSet: Multimodal interaction for distributed applications", Proceedings of the Fifth International Multimedia Conference (Multimedia'97), ACM Press, pp 31-40.
10. Johnston, M., Cohen, P. R., McGee, D., Oviatt, S. L., Pittman, J. A., Smith, I. 1997. "Unification-based Multimodal Integration", Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics. Madrid, Spain
11. Kumar, S.; Cohen, P. R.; Levesque, H. J. "The Adaptive Agent Architecture: Achieving Fault-Tolerance Using Persistent Broker Teams." In Proceedings of the Fourth International Conference on Multi-Agent Systems (ICMAS 2000), Boston, MA, USA, July 7-12, 2000, pages 159-166.
12. Cohen, P. R., Cheyer, A., Wang, M., and Baeg, S. C. "An open agent architecture", in AAAI Spring Symposium, pp. 1-8, Mar. 1994.
13. Reprinted in Readings in Agents, Huhns, M. and Singh, M. (eds), Morgan Kaufmann Publishers, San Francisco, 1998
14. Vo, M. T., & Wood, C. (1996). "Building an application framework for speech and pen input integration in multimodal learning interfaces", in Proceedings of the International Conference on Acoustics Speech and Signal Processing (IEEE-ICAASP), Vol. 6, 3545-3548, IEEE Press.
15. S. Issar and W. Ward. 1993. "CMU's Robust Spoken Language Understanding System. In Eurospeech'93, pages 2147-2150.
16. E. Kaiser, M. Johnston, and P. Heeman. 1999. "Profer: Predictive, Robust Finite-State Parsing for Spoken Language." In Proceedings of ICASSP'99.
17. Johnston, M. 2000. "Deixis and conjunction in multimodal systems." Proceedings of COLING-2000, Saarbruecken, Germany.
18. Fernando C. N Pereira and Michael Riley. "Speech Recognition by Composition of Weighted Finite Automata", In E. Roche and Y. Schabes, editors, Finite-State Language Processing. MIT Press, Cambridge, Massachusetts. 1997.
19. Chelba, Ciprian, "Exploiting Syntactic Structure for Natural Language Modeling", PhD. Thesis, John Hopkins University, 2000.
20. Roark, Brian, "Robust Probabilistic Predictive Syntactic Processing: Motivation, Models, and Applications", Ph. D. Thesis, Brown University, May, 2001.
21. John E. Hopcroft and Jeffrey D. Ullman, "Introduction to Automata Theory, Languages and Computation", Addison-Wesley, 1979.
22. http://www.research.att.com/sw/tools/description.html