Integrating multimodal language processing with speech recognition

6th International Conference on Spoken Language Processing, ICSLP 2000

Volumn , Issue , 2000, Pages

  Bangalore, Srinivas ^a   Johnston, Michael ^a  

^a AT AND T LABS RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN COMPUTER INTERACTION; SPEECH; SYNTACTICS;

AMBIGUITY RESOLUTION; CRITICAL CHALLENGES; FINITE-STATE MODELS; HUMAN COMPUTER INTERFACES; LANGUAGE PROCESSING; LANGUAGE PROCESSING TECHNIQUES; PROBABILISTIC FRAMEWORK; SPEECH RECOGNITION PERFORMANCE;

SPEECH RECOGNITION;

EID: 85009133573     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Abney, S. 1991. Parsing by chunks. In R. Berwick, S. Abney, and C. Tenny (eds.), Principle-based parsing. Kluwer Academic Publishers, Dordrecht.
2. Bangalore, S. and G. Riccardi. 2000. Stochastic finite-state models for spoken language machine translation. NAACL Workshop on Embedded Machine Translation Systems.
3. Bolt, R. A. 1980. "Put-That-There": Voice and gesture at the graphics interface. Computer Graphics, 14. 3, p. 262-270.
4. Buntschuh, B., Kamm, C, DiFabbrizio, G., Abella, A., Mohri, M., Narayanan, S., Zeljkovic, I., Sharp, R. D., Wright, J., Marcus, S., Shaffer, J., Duncan, R. and J. G. Wilpon, 1998. VPQ: A spoken language interface to large scale directory information. ICSLP'98, Sydney, Australia.
5. Cohen, P. R., Johnston, M., McGee, D., Oviatt, S. L., Pittman, J., Smith, I., Chen, L., & Clow, J. 1998. Multimodal interaction for distributed interactive simulation. In M. Maybury and W. Wahlster (eds.), Readings in Intelligent Interfaces, Morgan Kaufmann Publishers. p. 562-569.
6. Johnston, M. and S. Bangalore. 2000. Finite-state multimodal parsing and understanding. Proceedings of COLING-2000.
7. Johnston, M. 1998. Unification-based multimodal parsing. In Proceedings of COLING-ACL 98, p 624-630.
8. Johnston, M., Cohen, P. R., McGee, D., Oviatt, S. L., Pittman, J. A., Smith, I. 1997. Unification-based multimodal integration. In Proceedings of the 35th ACL. Madrid, Spain. p. 281-288.
9. Kaplan, R. M. and M. Kay, M. 1994. Regular models of phonological rule systems. Computational Linguistics, 20:3.
10. Koskenniemi, K. K. 1984. Two-level morphology: a general computation model for word-form recognition and production. PhD thesis, University of Helsinki.
11. Mohri, M., Pereira, F. C. N. and M. D. Riley. 2000. The design principles of a weighted finite-state transducer library. Theoretical Computer Science, 231:17-32.
12. Neal, J. G., and S. C. Shapiro. 1991. Intelligent multi-media interface technology. In J. W. Sullivan and S. W. Tyler (eds.), Intelligent User Interfaces, ACM Press, NewYork. p. 45-68.
13. Nederhof, M-J. 1997. Regular approximations of CFLs: A Grammatical View. Proceedings of the International Workshop on Parsing Technology, Boston, 1997.
14. Oviatt, S. L. 1999. Mutual disambiguation of recognition errors in a multimodal architecture. CHI'99, ACM Press, New York.
15. Pereira, F. C. N. and M. D. Riley. 1994. Speech recognition by composition of weighted finite automata. In Proceedings of the ARPA Workshop on Human Language Technology.
16. Pereira, F. C. N. and R. Wright. 1997. Finite-state approximation of phrase structure grammars. In E. Roche and Y. Schabes (eds.), Finite-state Language Processing, MIT Press, MA.
17. Petajan, E. D., Bischoff, B., and D. Bodoffi. 1988. An improved automatic lipreading system to enhance speech recognition. ACM SIGCHI-88, p. 19-25.
18. Roche, E. 1999. Finite state transducers: parsing free and frozen sentences. In A. Kornai (ed.), Extended Finite State Models of Language, Cambridge University Press, Cambridge, England.
19. Rosenberg, A. L. 1964. On n-tape finite state acceptors. FOCS 5.
20. Srinivas, B. 1997. Complexity of lexical descriptions and its relevance to partial parsing. PhD Thesis, UPenn.
21. Wahlster, W. 1991. User and discourse models for multimodal communication. In J. Sullivan and S. Tyler (eds.), Intelligent User Interfaces, ACM Press. p. 45-67.
22. Wu, L., Oviatt, S. L. and P. R. Cohen. 1999. Multimodal integration - a statistical view. IEEE Transactions on Multimedia, 1(4):334-341.