INTEGRATION OF EYE FIXATION INFORMATION WITH SPEECH RECOGNITION SYSTEMS

5th European Conference on Speech Communication and Technology, EUROSPEECH 1997

Volumn , Issue , 1997, Pages 1639-1643

  Sarukkai, Ramesh R ^a,b   Hunter, Craig ^a  

^a University of Rochester   (United States)

^b Kurzweil AI

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN COMPUTER INTERACTION; SPEECH COMMUNICATION;

AUDITORY MODALITY; EYE FIXATIONS; HUMAN EYE; INTERACTIVE PLANNING; SEARCH PROCESS; SPEECH RECOGNITION SYSTEMS; SPEECH RECOGNIZER; SYMBOLIC OBJECTS; TIGHT COUPLING; VISUAL MODALITIES;

SPEECH RECOGNITION;

EID: 57049088228     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Ramesh R. Sarukkai, and Dana H. Ballard, "Word Set Probability Boosting for Improved Spontaneous Dialogue Recognition", to appear in IEEE Trans, on Speech and Audio Proc.
2. C. Bregler, H. Hild, S. Mahnke, and A. Waibel " Bimodal Sensor Integration on the Example of 'Speechreading'", Proc. of IEEE Int. Conf on Neural Networks, San Francisco, 1993
3. Cooper, Roger M. "The Control of Eye Fixation by the Meaning of Spoken Language", Cognitive Psychology, 1974, pp. 84-107.
4. K. Eberhard, M. Spivey-Knowlton, J. Sedivey, and M. Tanenhaus. "Eye Movements as a Window into RealTime Spoken Language", Journal of Psycholinguistic Research(in press), 1995.
5. Jacob, R.J.K. "The Use of Eye Movements in Human-Computer Interaction Techniques", ACM Transactions on Information Systems, 1991, 9(3) pp. 152-169.
6. Locke, John L. "A Child's Path to Spoken Language", Cambridge, Mass.: Harvard University Press, 1993.
7. A. Kobsa, J. Allgayer, C. Reddig, N. Reithinger, D.Schmauks, K. Harbusch, and W. Wahlster "Combining Deictic Gestures and Natural Language for Referent Identification", Proceedings of the 11th Conference on Computational Linguistics, Bonn, Germany, 1986,pp. 356-361.
8. P. Olivieri, J. Gips, J. McHugh, "EagleEyes: eye controlled multimedia", in Proc. of ACM MultiMedia'95, San Francisco, pp:537-538 (Video summary)
9. E. Stoehr, and H. Lieberman, "Hearing Aid: Adding verbal hints to a learning interface", Proc. of ACM Multimedia'95, San Francisco, pp:223-230
10. I. Starker and R. A. Bolt, "A Gaze-Responsive Self-Disclosing Display", Proc. ACM CHI'90 Human Factors in Computing Systems Conference, pp 3-9, Addison-Wesley/ACM Press(1990).
11. Thorisson, K. R. "Face-to-Face Communication with Computer Agents", Working Notes, AAAI Spring Symposium on Believable Agents, Stanford University, California, Aug. 13-16, 1994, pp 86-90
12. James F. Allen, George Ferguson, Brad Miller, and Eric Ringger, "Spoken Dialogue and Interactive Planning", in Proc. of ARPA Spoken Language Technology Workshop, Austin, TX, 1995.
13. Ronald Rosenfeld, "Adaptive Statistical Language Modeling: A Maximum Entropy Approach", CMU-CS-94-138.
14. Koons, D. B., Sparrel, C. J. and Thorisson, K. R. "Integrating Simultaneous Input from Speech, Gaze and Hand Gestures", In M. T. Maybury(Ed-), Intelligent Multi-Media Interfaces. AAAI/MIT Press.