Perceptual interfaces for information interaction: Joint processing of audio and visual information for human-computer interaction

6th International Conference on Spoken Language Processing, ICSLP 2000

Volumn , Issue , 2000, Pages

  Neti, C ^a   Iyengar, G ^a   Potamianos, G ^a   Senior, A ^a   Maison, B ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO ACOUSTICS; SPEECH RECOGNITION;

AUDIO AND VISUAL INFORMATION; HUMAN ACTIVITIES; HUMAN IDENTITY; INFORMATION INTERACTION; JOINT PROCESSING; PERCEPTUAL INTERFACES; SENSORY INTEGRATION; SPEAKER RECOGNITION;

HUMAN COMPUTER INTERACTION;

EID: 85009060634     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. H. McGurk and J. MacDonald, "Hearing lips and seeing voices", Nature, vol. 264, pp. 746-748, 1976.
2. D. W. Massaro and D. G. Stork, "Speech recognition and sensory integration", American Scientist, vol. 86, pp. 236-244, 1998.
3. S. Basu, C. Neti, N. Rajput, A. Senior, L. Subramaniam, A. Verma, Audio-visual large vocabulary continuous speech recognition in the broadcast domain. IEEE MMSP Workshop, 1999.
4. A. Verma, T. Faruquie, A. Senior, C. Neti and S. Basu, Late-integration in audio-visual continuous speech recognition. Automatic Speech Reco. & Understanding Workshop, 1999.
5. B. Maison, C. Neti and A. Senior, Audio-visual speaker recognition for video broadcast news: some fusion techniques. IEEE MMSP Workshop, 1999.
6. G. Iyengar and C. Neti, Speaker Change detection using joint audio-visual statistics. RIAO 2000, Paris, France, April 2000.
7. P. Decuetos, C. Neti and A. Senior, Audio-visual Intent-tospeak detection for Human Computer Interaction. IEEE Int. Conf. on Acoustics Speech and Signal Processing., 2000.
8. G. Potamianos and H. P. Graff, Discriminative training of HMM stream exponents for audio-visual speech recognition. Proc. ICASSP, pp. 3733-3736, 1998.
9. G. Potamianos, A. Verma, C. Neti, G. Iyengar, and S. Basu, "A cascade image transform for speaker independent automatic speechreading", to appear: Proc. Int. Conf. Multimedia Expo., New York, 2000.
10. G. Potamianos and C. Neti, Stream Confidence estimation for audio-visual speech recognition. Proc. ICSLP, Beijing, 2000. To appear.
11. Senior, A. W., Recognizing faces in broadcast video. IEEE International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, 105-110, 1999.