A visual context-aware multimodal system for spoken language processing

EUROSPEECH 2003 - 8th European Conference on Speech Communication and Technology

Volumn , Issue , 2003, Pages 2273-2276

  Mukherjee, Niloy ^a   Roy, Deb ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; SPEECH; SPEECH COMMUNICATION; SPEECH PROCESSING; SPEECH RECOGNITION;

CONTEXTUAL INFORMATION; MULTIMODAL SYSTEM; OBJECT DESCRIPTION; ON-LINE SPEECH PROCESSING; SPOKEN LANGUAGE PROCESSING; SPOKEN LANGUAGES; VISUAL ATTENTION; VISUALLY-GROUNDED LANGUAGE;

VISUAL LANGUAGES;

EID: 85009172899     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., Sedivy, J. E., "Integration of visual and linguistic information in spoken language comprehension", Science, 268, 1632-1634, 1995
2. Spivey, M.J., Tyler, M. J., Eberhard, K. M., Tanenhaus, M. K., "Linguistically mediated visual search", Psychological Science, 12 (4), 282-286, 2000
3. Tanenhaus, M. K., Magnuson, J. S., Dahan, D., Chambers, C., "Eyemovements and lexical access in spoken-language comprehension: Evaluating a linking hypothesis between fixations and linguistic processing", Journal of Psycholinguistic Research, 29, 557-580, 2000
4. Brown, P., F., Della Pietra, V., J., deSouza, P., V., Lai, J., C., Mercer, R., L., "Class-based n-gram models of natural language", Computational Linguistics, 18 (4), 467479, December, 1992.
5. Rosenfeld, R., "Two decades of statistical language modeling: Where do we go from here?", Proc. of the IEEE, 88, 1270-1278, August, 2000.
6. Roy, D., "Learning visually-grounded words and syntax for a scene description task", Computer Speech and Language, 16 (3), 2002.
7. Roy, D., Gorniak, P. J., Mukherjee, N., Juster, J., "A trainable spoken language understanding system for visual object selection", Proc. of the International Conference on Spoken Language Processing, 2002.
8. Regier, T., Carlson, L., "Grounding spatial language in perception: An empirical and computational investigation", Journal of Experimental Psychology: General, 130 (2), 273-298, 2001.
9. Kneser, R., Ney, H., "Improved clustering techniques for class-based statistical language modeling", Proc. of the European Conference on Speech Communication and Technology, 1993.
10. Benjamin Yoder, "Spontaneous speech recognition using hidden markov models", M.S. thesis, Massachusetts Institute of Technology, Cambridge, MA, 2001